[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:21:59.652884  9799 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.145.254:39847
I20260709 12:21:59.654461  9799 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:21:59.655501  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:59.672832  9808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:59.671947  9806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:59.673476  9799 server_base.cc:1061] running on GCE node
W20260709 12:21:59.671983  9805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:00.790935  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:00.791208  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:00.791431  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783599720791405 us; error 0 us; skew 500 ppm
I20260709 12:22:00.792261  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:00.798650  9799 webserver.cc:533] Webserver started at http://127.9.145.254:36521/ using document root <none> and password file <none>
I20260709 12:22:00.799579  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:00.799830  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:00.800312  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:00.806327  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599719482688-9799-0/minicluster-data/master-0-root/instance:
uuid: "9847245531cf40159a35ba279d6c45ab"
format_stamp: "Formatted at 2026-07-09 12:22:00 on dist-test-slave-1sdq"
I20260709 12:22:00.814790  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:22:00.820387  9814 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:00.821758  9799 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:22:00.822253  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599719482688-9799-0/minicluster-data/master-0-root
uuid: "9847245531cf40159a35ba279d6c45ab"
format_stamp: "Formatted at 2026-07-09 12:22:00 on dist-test-slave-1sdq"
I20260709 12:22:00.822616  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599719482688-9799-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599719482688-9799-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599719482688-9799-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:00.884662  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:00.886338  9799 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:22:00.886840  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:00.961318  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.254:39847
I20260709 12:22:00.961429  9866 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.254:39847 every 8 connection(s)
I20260709 12:22:00.969519  9867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:00.991662  9867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9847245531cf40159a35ba279d6c45ab: Bootstrap starting.
I20260709 12:22:00.997646  9867 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9847245531cf40159a35ba279d6c45ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:00.999564  9867 log.cc:826] T 00000000000000000000000000000000 P 9847245531cf40159a35ba279d6c45ab: Log is configured to *not* fsync() on all Append() calls
I20260709 12:22:01.004360  9867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9847245531cf40159a35ba279d6c45ab: No bootstrap required, opened a new log
I20260709 12:22:01.025323  9867 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9847245531cf40159a35ba279d6c45ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9847245531cf40159a35ba279d6c45ab" member_type: VOTER }
I20260709 12:22:01.025902  9867 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9847245531cf40159a35ba279d6c45ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:01.026139  9867 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9847245531cf40159a35ba279d6c45ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9847245531cf40159a35ba279d6c45ab, State: Initialized, Role: FOLLOWER
I20260709 12:22:01.027117  9867 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9847245531cf40159a35ba279d6c45ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9847245531cf40159a35ba279d6c45ab" member_type: VOTER }
I20260709 12:22:01.027611  9867 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9847245531cf40159a35ba279d6c45ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:22:01.027856  9867 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9847245531cf40159a35ba279d6c45ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:22:01.028158  9867 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9847245531cf40159a35ba279d6c45ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:01.033018  9867 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9847245531cf40159a35ba279d6c45ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9847245531cf40159a35ba279d6c45ab" member_type: VOTER }
I20260709 12:22:01.033917  9867 leader_election.cc:304] T 00000000000000000000000000000000 P 9847245531cf40159a35ba279d6c45ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9847245531cf40159a35ba279d6c45ab; no voters: 
I20260709 12:22:01.035724  9867 leader_election.cc:290] T 00000000000000000000000000000000 P 9847245531cf40159a35ba279d6c45ab [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:22:01.036055  9870 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9847245531cf40159a35ba279d6c45ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:01.038278  9870 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9847245531cf40159a35ba279d6c45ab [term 1 LEADER]: Becoming Leader. State: Replica: 9847245531cf40159a35ba279d6c45ab, State: Running, Role: LEADER
I20260709 12:22:01.039260  9870 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9847245531cf40159a35ba279d6c45ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9847245531cf40159a35ba279d6c45ab" member_type: VOTER }
I20260709 12:22:01.040323  9867 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9847245531cf40159a35ba279d6c45ab [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:22:01.049692  9871 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9847245531cf40159a35ba279d6c45ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9847245531cf40159a35ba279d6c45ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9847245531cf40159a35ba279d6c45ab" member_type: VOTER } }
I20260709 12:22:01.051014  9872 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9847245531cf40159a35ba279d6c45ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9847245531cf40159a35ba279d6c45ab. Latest consensus state: current_term: 1 leader_uuid: "9847245531cf40159a35ba279d6c45ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9847245531cf40159a35ba279d6c45ab" member_type: VOTER } }
I20260709 12:22:01.051739  9871 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9847245531cf40159a35ba279d6c45ab [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:01.053678  9872 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9847245531cf40159a35ba279d6c45ab [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:01.060648  9880 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:22:01.070465  9880 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:22:01.072836  9799 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:22:01.089195  9880 catalog_manager.cc:1383] Generated new cluster ID: 88c493472b5449f4a58d75d53116fe7e
I20260709 12:22:01.089628  9880 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:22:01.107877  9880 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:22:01.109472  9880 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:22:01.123504  9880 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9847245531cf40159a35ba279d6c45ab: Generated new TSK 0
I20260709 12:22:01.124501  9880 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:22:01.140262  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:01.149893  9889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:01.151188  9890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:01.154886  9892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:01.155416  9799 server_base.cc:1061] running on GCE node
I20260709 12:22:01.156301  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:01.156522  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:01.156685  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783599721156666 us; error 0 us; skew 500 ppm
I20260709 12:22:01.157302  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:01.161473  9799 webserver.cc:533] Webserver started at http://127.9.145.193:35975/ using document root <none> and password file <none>
I20260709 12:22:01.162088  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:01.162336  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:01.162644  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:01.163826  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599719482688-9799-0/minicluster-data/ts-0-root/instance:
uuid: "82a49120848b44bda3940155093e8f86"
format_stamp: "Formatted at 2026-07-09 12:22:01 on dist-test-slave-1sdq"
I20260709 12:22:01.169831  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 12:22:01.174360  9897 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:01.175194  9799 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 12:22:01.175493  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599719482688-9799-0/minicluster-data/ts-0-root
uuid: "82a49120848b44bda3940155093e8f86"
format_stamp: "Formatted at 2026-07-09 12:22:01 on dist-test-slave-1sdq"
I20260709 12:22:01.175804  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599719482688-9799-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599719482688-9799-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599719482688-9799-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:01.201984  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:01.203450  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:01.206174  9799 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:01.210492  9799 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:01.210765  9799 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:01.211045  9799 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:01.211205  9799 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:01.319828  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.193:35957
I20260709 12:22:01.319877  9959 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.193:35957 every 8 connection(s)
I20260709 12:22:01.327080  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:01.338954  9964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:01.340677  9965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:01.351451  9967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:01.353500  9799 server_base.cc:1061] running on GCE node
I20260709 12:22:01.354599  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:01.354831  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:01.355039  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783599721355018 us; error 0 us; skew 500 ppm
I20260709 12:22:01.355661  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:01.362563  9960 heartbeater.cc:344] Connected to a master server at 127.9.145.254:39847
I20260709 12:22:01.362746  9799 webserver.cc:533] Webserver started at http://127.9.145.194:44639/ using document root <none> and password file <none>
I20260709 12:22:01.363157  9960 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:01.363354  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:01.363622  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:01.363911  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:01.364481  9960 heartbeater.cc:507] Master 127.9.145.254:39847 requested a full tablet report, sending...
I20260709 12:22:01.365100  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599719482688-9799-0/minicluster-data/ts-1-root/instance:
uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
format_stamp: "Formatted at 2026-07-09 12:22:01 on dist-test-slave-1sdq"
I20260709 12:22:01.368589  9831 ts_manager.cc:194] Registered new tserver with Master: 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957)
I20260709 12:22:01.371783  9831 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58312
I20260709 12:22:01.372090  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.000s	sys 0.008s
I20260709 12:22:01.377633  9972 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:01.378604  9799 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:22:01.378908  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599719482688-9799-0/minicluster-data/ts-1-root
uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
format_stamp: "Formatted at 2026-07-09 12:22:01 on dist-test-slave-1sdq"
I20260709 12:22:01.379191  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599719482688-9799-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599719482688-9799-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599719482688-9799-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:01.408411  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:01.409737  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:01.412261  9799 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:01.415436  9799 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:01.415647  9799 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:01.415899  9799 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:01.416054  9799 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:01.513991  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.194:44897
I20260709 12:22:01.514144 10035 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.194:44897 every 8 connection(s)
I20260709 12:22:01.521256  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:01.529277 10039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:01.534524 10040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:01.536940 10036 heartbeater.cc:344] Connected to a master server at 127.9.145.254:39847
I20260709 12:22:01.537452 10036 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:01.538713 10036 heartbeater.cc:507] Master 127.9.145.254:39847 requested a full tablet report, sending...
I20260709 12:22:01.542008  9831 ts_manager.cc:194] Registered new tserver with Master: fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897)
I20260709 12:22:01.544116  9831 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58326
W20260709 12:22:01.550700 10042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:01.551406  9799 server_base.cc:1061] running on GCE node
I20260709 12:22:01.552255  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:01.552474  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:01.552646  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783599721552628 us; error 0 us; skew 500 ppm
I20260709 12:22:01.553174  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:01.556066  9799 webserver.cc:533] Webserver started at http://127.9.145.195:41665/ using document root <none> and password file <none>
I20260709 12:22:01.556541  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:01.556722  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:01.557070  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:01.558246  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599719482688-9799-0/minicluster-data/ts-2-root/instance:
uuid: "8d19ed551837428eac56733d1ca5ce23"
format_stamp: "Formatted at 2026-07-09 12:22:01 on dist-test-slave-1sdq"
I20260709 12:22:01.563122  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:22:01.566696 10047 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:01.567565  9799 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:22:01.567850  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599719482688-9799-0/minicluster-data/ts-2-root
uuid: "8d19ed551837428eac56733d1ca5ce23"
format_stamp: "Formatted at 2026-07-09 12:22:01 on dist-test-slave-1sdq"
I20260709 12:22:01.568156  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599719482688-9799-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599719482688-9799-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599719482688-9799-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:01.579730  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:01.581003  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:01.582576  9799 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:01.585588  9799 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:01.585816  9799 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:01.586050  9799 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:01.586259  9799 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:22:01.680456  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.195:34059
I20260709 12:22:01.680567 10109 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.195:34059 every 8 connection(s)
I20260709 12:22:01.696888 10110 heartbeater.cc:344] Connected to a master server at 127.9.145.254:39847
I20260709 12:22:01.697305 10110 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:01.698132 10110 heartbeater.cc:507] Master 127.9.145.254:39847 requested a full tablet report, sending...
I20260709 12:22:01.700220  9831 ts_manager.cc:194] Registered new tserver with Master: 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059)
I20260709 12:22:01.700654  9799 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014936857s
I20260709 12:22:01.701995  9831 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58336
I20260709 12:22:01.763617  9831 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58350:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:01.768867  9831 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:01.875260 10001 tablet_service.cc:1511] Processing CreateTablet for tablet 6aa0aa5fbe02488b8a62e6a40038d912 (DEFAULT_TABLE table=test-workload [id=c9bdbdb015fc404984ef59c406c983e2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:01.875825 10000 tablet_service.cc:1511] Processing CreateTablet for tablet 8d4d6d86011e48c6ad195acd1ba7ce87 (DEFAULT_TABLE table=test-workload [id=c9bdbdb015fc404984ef59c406c983e2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:01.879169  9999 tablet_service.cc:1511] Processing CreateTablet for tablet 9c1463f2c68c44829df48142a9dc4e23 (DEFAULT_TABLE table=test-workload [id=c9bdbdb015fc404984ef59c406c983e2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:01.879851  9998 tablet_service.cc:1511] Processing CreateTablet for tablet 4f4115ad9f0b4f9ca0eb5b0ae157e4ca (DEFAULT_TABLE table=test-workload [id=c9bdbdb015fc404984ef59c406c983e2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:01.880967  9995 tablet_service.cc:1511] Processing CreateTablet for tablet 3684752ed7ac4ca8a2c549f530aaa3cc (DEFAULT_TABLE table=test-workload [id=c9bdbdb015fc404984ef59c406c983e2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:01.882333  9997 tablet_service.cc:1511] Processing CreateTablet for tablet 8be8e2238b7c4097a4c787eb91279601 (DEFAULT_TABLE table=test-workload [id=c9bdbdb015fc404984ef59c406c983e2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:01.883929  9994 tablet_service.cc:1511] Processing CreateTablet for tablet 85cb505e935e4789a576c1004547f6c2 (DEFAULT_TABLE table=test-workload [id=c9bdbdb015fc404984ef59c406c983e2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:01.884891  9993 tablet_service.cc:1511] Processing CreateTablet for tablet 82ecf8b74e41485a977d82e0801b276d (DEFAULT_TABLE table=test-workload [id=c9bdbdb015fc404984ef59c406c983e2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:01.877099 10001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aa0aa5fbe02488b8a62e6a40038d912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:01.886912  9999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c1463f2c68c44829df48142a9dc4e23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:01.890568  9993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ecf8b74e41485a977d82e0801b276d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:01.894680  9997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8be8e2238b7c4097a4c787eb91279601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:01.895821  9998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f4115ad9f0b4f9ca0eb5b0ae157e4ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:01.902581 10000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d4d6d86011e48c6ad195acd1ba7ce87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:01.906664  9994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85cb505e935e4789a576c1004547f6c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:01.910595  9995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3684752ed7ac4ca8a2c549f530aaa3cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:01.917522 10128 tablet_bootstrap.cc:492] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e: Bootstrap starting.
I20260709 12:22:01.925061 10128 tablet_bootstrap.cc:654] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:01.925107  9999 tablet_service.cc:1511] Processing CreateTablet for tablet 25e260872eeb455d95f2b95dd0b933e3 (DEFAULT_TABLE table=test-workload [id=c9bdbdb015fc404984ef59c406c983e2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:01.926569  9999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e260872eeb455d95f2b95dd0b933e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:01.939112 10128 tablet_bootstrap.cc:492] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e: No bootstrap required, opened a new log
I20260709 12:22:01.939776 10128 ts_tablet_manager.cc:1403] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e: Time spent bootstrapping tablet: real 0.023s	user 0.005s	sys 0.015s
I20260709 12:22:01.943059 10128 raft_consensus.cc:359] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:01.946290 10128 raft_consensus.cc:385] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:01.947091 10128 raft_consensus.cc:740] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbaeeb68dadd4c69a96dbc88b2b1507e, State: Initialized, Role: FOLLOWER
I20260709 12:22:01.948705 10128 consensus_queue.cc:260] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:01.966264 10036 heartbeater.cc:499] Master 127.9.145.254:39847 was elected leader, sending a full tablet report...
I20260709 12:22:01.964416  9924 tablet_service.cc:1511] Processing CreateTablet for tablet 8d4d6d86011e48c6ad195acd1ba7ce87 (DEFAULT_TABLE table=test-workload [id=c9bdbdb015fc404984ef59c406c983e2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:01.970824  9923 tablet_service.cc:1511] Processing CreateTablet for tablet 9c1463f2c68c44829df48142a9dc4e23 (DEFAULT_TABLE table=test-workload [id=c9bdbdb015fc404984ef59c406c983e2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:01.971575  9922 tablet_service.cc:1511] Processing CreateTablet for tablet 4f4115ad9f0b4f9ca0eb5b0ae157e4ca (DEFAULT_TABLE table=test-workload [id=c9bdbdb015fc404984ef59c406c983e2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:01.981451  9924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d4d6d86011e48c6ad195acd1ba7ce87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:01.977844  9920 tablet_service.cc:1511] Processing CreateTablet for tablet 3684752ed7ac4ca8a2c549f530aaa3cc (DEFAULT_TABLE table=test-workload [id=c9bdbdb015fc404984ef59c406c983e2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:01.982280 10128 ts_tablet_manager.cc:1434] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e: Time spent starting tablet: real 0.042s	user 0.014s	sys 0.002s
I20260709 12:22:01.970813  9921 tablet_service.cc:1511] Processing CreateTablet for tablet 8be8e2238b7c4097a4c787eb91279601 (DEFAULT_TABLE table=test-workload [id=c9bdbdb015fc404984ef59c406c983e2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:01.974663  9925 tablet_service.cc:1511] Processing CreateTablet for tablet 6aa0aa5fbe02488b8a62e6a40038d912 (DEFAULT_TABLE table=test-workload [id=c9bdbdb015fc404984ef59c406c983e2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:01.986368  9919 tablet_service.cc:1511] Processing CreateTablet for tablet 85cb505e935e4789a576c1004547f6c2 (DEFAULT_TABLE table=test-workload [id=c9bdbdb015fc404984ef59c406c983e2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:01.987183  9918 tablet_service.cc:1511] Processing CreateTablet for tablet 82ecf8b74e41485a977d82e0801b276d (DEFAULT_TABLE table=test-workload [id=c9bdbdb015fc404984ef59c406c983e2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:01.993305  9923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c1463f2c68c44829df48142a9dc4e23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:01.995127  9917 tablet_service.cc:1511] Processing CreateTablet for tablet 25e260872eeb455d95f2b95dd0b933e3 (DEFAULT_TABLE table=test-workload [id=c9bdbdb015fc404984ef59c406c983e2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:01.995806 10128 tablet_bootstrap.cc:492] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e: Bootstrap starting.
I20260709 12:22:02.000720  9919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85cb505e935e4789a576c1004547f6c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.005812  9920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3684752ed7ac4ca8a2c549f530aaa3cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.007710  9917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e260872eeb455d95f2b95dd0b933e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.009933  9918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ecf8b74e41485a977d82e0801b276d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.014612  9925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aa0aa5fbe02488b8a62e6a40038d912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.016417  9922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f4115ad9f0b4f9ca0eb5b0ae157e4ca. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:22:02.020660 10037 tablet.cc:2406] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:22:02.025204  9921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8be8e2238b7c4097a4c787eb91279601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.047104 10128 tablet_bootstrap.cc:654] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:02.069757 10069 tablet_service.cc:1511] Processing CreateTablet for tablet 85cb505e935e4789a576c1004547f6c2 (DEFAULT_TABLE table=test-workload [id=c9bdbdb015fc404984ef59c406c983e2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:02.072518 10073 tablet_service.cc:1511] Processing CreateTablet for tablet 9c1463f2c68c44829df48142a9dc4e23 (DEFAULT_TABLE table=test-workload [id=c9bdbdb015fc404984ef59c406c983e2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:02.069667 10074 tablet_service.cc:1511] Processing CreateTablet for tablet 8d4d6d86011e48c6ad195acd1ba7ce87 (DEFAULT_TABLE table=test-workload [id=c9bdbdb015fc404984ef59c406c983e2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
W20260709 12:22:02.078938  9879 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:02.080451 10075 tablet_service.cc:1511] Processing CreateTablet for tablet 6aa0aa5fbe02488b8a62e6a40038d912 (DEFAULT_TABLE table=test-workload [id=c9bdbdb015fc404984ef59c406c983e2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:02.083807 10071 tablet_service.cc:1511] Processing CreateTablet for tablet 8be8e2238b7c4097a4c787eb91279601 (DEFAULT_TABLE table=test-workload [id=c9bdbdb015fc404984ef59c406c983e2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:02.091990 10069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85cb505e935e4789a576c1004547f6c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.093031 10072 tablet_service.cc:1511] Processing CreateTablet for tablet 4f4115ad9f0b4f9ca0eb5b0ae157e4ca (DEFAULT_TABLE table=test-workload [id=c9bdbdb015fc404984ef59c406c983e2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:02.079502 10070 tablet_service.cc:1511] Processing CreateTablet for tablet 3684752ed7ac4ca8a2c549f530aaa3cc (DEFAULT_TABLE table=test-workload [id=c9bdbdb015fc404984ef59c406c983e2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:02.095175 10067 tablet_service.cc:1511] Processing CreateTablet for tablet 25e260872eeb455d95f2b95dd0b933e3 (DEFAULT_TABLE table=test-workload [id=c9bdbdb015fc404984ef59c406c983e2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:02.098126 10068 tablet_service.cc:1511] Processing CreateTablet for tablet 82ecf8b74e41485a977d82e0801b276d (DEFAULT_TABLE table=test-workload [id=c9bdbdb015fc404984ef59c406c983e2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:02.100180 10074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d4d6d86011e48c6ad195acd1ba7ce87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.103439 10128 tablet_bootstrap.cc:492] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e: No bootstrap required, opened a new log
I20260709 12:22:02.103942 10128 ts_tablet_manager.cc:1403] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e: Time spent bootstrapping tablet: real 0.110s	user 0.007s	sys 0.016s
I20260709 12:22:02.108855 10070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3684752ed7ac4ca8a2c549f530aaa3cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.117022 10073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c1463f2c68c44829df48142a9dc4e23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.118945 10072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f4115ad9f0b4f9ca0eb5b0ae157e4ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.120759 10068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ecf8b74e41485a977d82e0801b276d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.123582 10071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8be8e2238b7c4097a4c787eb91279601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.125144 10128 raft_consensus.cc:359] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.130280 10067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e260872eeb455d95f2b95dd0b933e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.129767 10128 raft_consensus.cc:385] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:02.132153 10128 raft_consensus.cc:740] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbaeeb68dadd4c69a96dbc88b2b1507e, State: Initialized, Role: FOLLOWER
I20260709 12:22:02.140519 10075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aa0aa5fbe02488b8a62e6a40038d912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.132922 10128 consensus_queue.cc:260] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.149681 10128 ts_tablet_manager.cc:1434] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e: Time spent starting tablet: real 0.045s	user 0.009s	sys 0.001s
I20260709 12:22:02.150799 10128 tablet_bootstrap.cc:492] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e: Bootstrap starting.
I20260709 12:22:02.195902 10128 tablet_bootstrap.cc:654] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:02.205116 10132 tablet_bootstrap.cc:492] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86: Bootstrap starting.
W20260709 12:22:02.265825 10117 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.IsCreateTableDone -> {remote=127.9.145.254:39847, user_credentials={real_user=slave}} blocked reactor thread for 50080.4us
I20260709 12:22:02.268123 10128 tablet_bootstrap.cc:492] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e: No bootstrap required, opened a new log
I20260709 12:22:02.268620 10128 ts_tablet_manager.cc:1403] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e: Time spent bootstrapping tablet: real 0.118s	user 0.011s	sys 0.017s
I20260709 12:22:02.271054 10133 tablet_bootstrap.cc:492] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23: Bootstrap starting.
I20260709 12:22:02.271514 10128 raft_consensus.cc:359] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } }
I20260709 12:22:02.272277 10128 raft_consensus.cc:385] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:02.272578 10128 raft_consensus.cc:740] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbaeeb68dadd4c69a96dbc88b2b1507e, State: Initialized, Role: FOLLOWER
I20260709 12:22:02.273343 10128 consensus_queue.cc:260] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } }
I20260709 12:22:02.275552 10128 ts_tablet_manager.cc:1434] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:22:02.279289 10132 tablet_bootstrap.cc:654] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:02.293135 10133 tablet_bootstrap.cc:654] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:02.289903 10128 tablet_bootstrap.cc:492] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P fbaeeb68dadd4c69a96dbc88b2b1507e: Bootstrap starting.
I20260709 12:22:02.296943 10132 tablet_bootstrap.cc:492] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86: No bootstrap required, opened a new log
I20260709 12:22:02.297515 10132 ts_tablet_manager.cc:1403] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86: Time spent bootstrapping tablet: real 0.110s	user 0.015s	sys 0.008s
I20260709 12:22:02.301365 10128 tablet_bootstrap.cc:654] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P fbaeeb68dadd4c69a96dbc88b2b1507e: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:02.300938 10132 raft_consensus.cc:359] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.301961 10132 raft_consensus.cc:385] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:02.302369 10132 raft_consensus.cc:740] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82a49120848b44bda3940155093e8f86, State: Initialized, Role: FOLLOWER
I20260709 12:22:02.303727 10132 consensus_queue.cc:260] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.305167 10133 tablet_bootstrap.cc:492] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23: No bootstrap required, opened a new log
I20260709 12:22:02.305630 10133 ts_tablet_manager.cc:1403] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.007s
I20260709 12:22:02.309022 10133 raft_consensus.cc:359] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.309909 10133 raft_consensus.cc:385] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:02.310446 10133 raft_consensus.cc:740] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d19ed551837428eac56733d1ca5ce23, State: Initialized, Role: FOLLOWER
I20260709 12:22:02.311335 10133 consensus_queue.cc:260] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.315673 10130 raft_consensus.cc:493] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.316224 10130 raft_consensus.cc:515] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.316946 10138 raft_consensus.cc:493] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.317016  9960 heartbeater.cc:499] Master 127.9.145.254:39847 was elected leader, sending a full tablet report...
I20260709 12:22:02.319375 10133 ts_tablet_manager.cc:1434] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:22:02.320710 10110 heartbeater.cc:499] Master 127.9.145.254:39847 was elected leader, sending a full tablet report...
I20260709 12:22:02.323330 10130 leader_election.cc:290] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059)
I20260709 12:22:02.324733 10133 tablet_bootstrap.cc:492] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23: Bootstrap starting.
I20260709 12:22:02.330550 10132 ts_tablet_manager.cc:1434] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.012s
I20260709 12:22:02.333235 10128 tablet_bootstrap.cc:492] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P fbaeeb68dadd4c69a96dbc88b2b1507e: No bootstrap required, opened a new log
I20260709 12:22:02.333909 10128 ts_tablet_manager.cc:1403] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P fbaeeb68dadd4c69a96dbc88b2b1507e: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.003s
I20260709 12:22:02.333360 10132 tablet_bootstrap.cc:492] T 8be8e2238b7c4097a4c787eb91279601 P 82a49120848b44bda3940155093e8f86: Bootstrap starting.
I20260709 12:22:02.337177 10128 raft_consensus.cc:359] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.338037 10128 raft_consensus.cc:385] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:02.338433 10128 raft_consensus.cc:740] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbaeeb68dadd4c69a96dbc88b2b1507e, State: Initialized, Role: FOLLOWER
I20260709 12:22:02.317447 10138 raft_consensus.cc:515] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.341796 10138 leader_election.cc:290] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897), 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059)
I20260709 12:22:02.344648 10133 tablet_bootstrap.cc:654] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:02.348609 10128 consensus_queue.cc:260] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P fbaeeb68dadd4c69a96dbc88b2b1507e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.351156 10128 ts_tablet_manager.cc:1434] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P fbaeeb68dadd4c69a96dbc88b2b1507e: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:22:02.352200 10128 tablet_bootstrap.cc:492] T 8be8e2238b7c4097a4c787eb91279601 P fbaeeb68dadd4c69a96dbc88b2b1507e: Bootstrap starting.
I20260709 12:22:02.362205 10128 tablet_bootstrap.cc:654] T 8be8e2238b7c4097a4c787eb91279601 P fbaeeb68dadd4c69a96dbc88b2b1507e: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:02.363873 10130 raft_consensus.cc:493] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.364485 10130 raft_consensus.cc:515] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.366900 10130 leader_election.cc:290] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059)
I20260709 12:22:02.370002  9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85cb505e935e4789a576c1004547f6c2" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a49120848b44bda3940155093e8f86" is_pre_election: true
I20260709 12:22:02.372208  9934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1463f2c68c44829df48142a9dc4e23" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a49120848b44bda3940155093e8f86" is_pre_election: true
I20260709 12:22:02.385686 10132 tablet_bootstrap.cc:654] T 8be8e2238b7c4097a4c787eb91279601 P 82a49120848b44bda3940155093e8f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:02.389281 10133 tablet_bootstrap.cc:492] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23: No bootstrap required, opened a new log
I20260709 12:22:02.389833 10133 ts_tablet_manager.cc:1403] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23: Time spent bootstrapping tablet: real 0.065s	user 0.017s	sys 0.011s
I20260709 12:22:02.397778 10133 raft_consensus.cc:359] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.398582 10133 raft_consensus.cc:385] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:02.399137 10133 raft_consensus.cc:740] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d19ed551837428eac56733d1ca5ce23, State: Initialized, Role: FOLLOWER
I20260709 12:22:02.402679 10128 tablet_bootstrap.cc:492] T 8be8e2238b7c4097a4c787eb91279601 P fbaeeb68dadd4c69a96dbc88b2b1507e: No bootstrap required, opened a new log
I20260709 12:22:02.403311 10128 ts_tablet_manager.cc:1403] T 8be8e2238b7c4097a4c787eb91279601 P fbaeeb68dadd4c69a96dbc88b2b1507e: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.008s
W20260709 12:22:02.404645  9976 leader_election.cc:343] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:02.407279  9976 leader_election.cc:343] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:02.400705 10133 consensus_queue.cc:260] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.413360 10085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f4115ad9f0b4f9ca0eb5b0ae157e4ca" candidate_uuid: "82a49120848b44bda3940155093e8f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d19ed551837428eac56733d1ca5ce23" is_pre_election: true
I20260709 12:22:02.415217 10128 raft_consensus.cc:359] T 8be8e2238b7c4097a4c787eb91279601 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
W20260709 12:22:02.416617  9901 leader_election.cc:343] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:02.416095 10128 raft_consensus.cc:385] T 8be8e2238b7c4097a4c787eb91279601 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:02.417943 10128 raft_consensus.cc:740] T 8be8e2238b7c4097a4c787eb91279601 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbaeeb68dadd4c69a96dbc88b2b1507e, State: Initialized, Role: FOLLOWER
I20260709 12:22:02.418951 10128 consensus_queue.cc:260] T 8be8e2238b7c4097a4c787eb91279601 P fbaeeb68dadd4c69a96dbc88b2b1507e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.421972 10133 ts_tablet_manager.cc:1434] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:22:02.422695 10128 ts_tablet_manager.cc:1434] T 8be8e2238b7c4097a4c787eb91279601 P fbaeeb68dadd4c69a96dbc88b2b1507e: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.001s
I20260709 12:22:02.423801 10132 tablet_bootstrap.cc:492] T 8be8e2238b7c4097a4c787eb91279601 P 82a49120848b44bda3940155093e8f86: No bootstrap required, opened a new log
I20260709 12:22:02.426394 10128 tablet_bootstrap.cc:492] T 25e260872eeb455d95f2b95dd0b933e3 P fbaeeb68dadd4c69a96dbc88b2b1507e: Bootstrap starting.
I20260709 12:22:02.426916 10132 ts_tablet_manager.cc:1403] T 8be8e2238b7c4097a4c787eb91279601 P 82a49120848b44bda3940155093e8f86: Time spent bootstrapping tablet: real 0.094s	user 0.025s	sys 0.004s
I20260709 12:22:02.429862 10132 raft_consensus.cc:359] T 8be8e2238b7c4097a4c787eb91279601 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.430706 10132 raft_consensus.cc:385] T 8be8e2238b7c4097a4c787eb91279601 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:02.431043 10132 raft_consensus.cc:740] T 8be8e2238b7c4097a4c787eb91279601 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82a49120848b44bda3940155093e8f86, State: Initialized, Role: FOLLOWER
I20260709 12:22:02.431819 10132 consensus_queue.cc:260] T 8be8e2238b7c4097a4c787eb91279601 P 82a49120848b44bda3940155093e8f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.434008 10128 tablet_bootstrap.cc:654] T 25e260872eeb455d95f2b95dd0b933e3 P fbaeeb68dadd4c69a96dbc88b2b1507e: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:02.439973 10132 ts_tablet_manager.cc:1434] T 8be8e2238b7c4097a4c787eb91279601 P 82a49120848b44bda3940155093e8f86: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.005s
I20260709 12:22:02.441128 10132 tablet_bootstrap.cc:492] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86: Bootstrap starting.
I20260709 12:22:02.449898 10132 tablet_bootstrap.cc:654] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:02.451175 10128 tablet_bootstrap.cc:492] T 25e260872eeb455d95f2b95dd0b933e3 P fbaeeb68dadd4c69a96dbc88b2b1507e: No bootstrap required, opened a new log
I20260709 12:22:02.451710 10128 ts_tablet_manager.cc:1403] T 25e260872eeb455d95f2b95dd0b933e3 P fbaeeb68dadd4c69a96dbc88b2b1507e: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.004s
I20260709 12:22:02.452899 10085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85cb505e935e4789a576c1004547f6c2" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d19ed551837428eac56733d1ca5ce23" is_pre_election: true
I20260709 12:22:02.453235 10011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f4115ad9f0b4f9ca0eb5b0ae157e4ca" candidate_uuid: "82a49120848b44bda3940155093e8f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" is_pre_election: true
I20260709 12:22:02.453646 10084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1463f2c68c44829df48142a9dc4e23" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d19ed551837428eac56733d1ca5ce23" is_pre_election: true
I20260709 12:22:02.454246 10011 raft_consensus.cc:2468] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82a49120848b44bda3940155093e8f86 in term 0.
I20260709 12:22:02.456528  9898 leader_election.cc:304] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82a49120848b44bda3940155093e8f86, fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 8d19ed551837428eac56733d1ca5ce23
I20260709 12:22:02.457470 10138 raft_consensus.cc:2804] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:02.457873 10138 raft_consensus.cc:493] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.457598 10128 raft_consensus.cc:359] T 25e260872eeb455d95f2b95dd0b933e3 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.458257 10138 raft_consensus.cc:3060] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:02.458393 10128 raft_consensus.cc:385] T 25e260872eeb455d95f2b95dd0b933e3 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:02.458726 10128 raft_consensus.cc:740] T 25e260872eeb455d95f2b95dd0b933e3 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbaeeb68dadd4c69a96dbc88b2b1507e, State: Initialized, Role: FOLLOWER
W20260709 12:22:02.458851  9976 leader_election.cc:343] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:02.459503 10128 consensus_queue.cc:260] T 25e260872eeb455d95f2b95dd0b933e3 P fbaeeb68dadd4c69a96dbc88b2b1507e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.460016  9976 leader_election.cc:304] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 82a49120848b44bda3940155093e8f86, 8d19ed551837428eac56733d1ca5ce23
I20260709 12:22:02.459479 10133 tablet_bootstrap.cc:492] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23: Bootstrap starting.
I20260709 12:22:02.464075 10128 ts_tablet_manager.cc:1434] T 25e260872eeb455d95f2b95dd0b933e3 P fbaeeb68dadd4c69a96dbc88b2b1507e: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:22:02.465126 10128 tablet_bootstrap.cc:492] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e: Bootstrap starting.
I20260709 12:22:02.468408 10133 tablet_bootstrap.cc:654] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:02.471762 10128 tablet_bootstrap.cc:654] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:02.472649 10138 raft_consensus.cc:515] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.474327 10130 raft_consensus.cc:2749] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:02.475344 10138 leader_election.cc:290] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 1 election: Requested vote from peers fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897), 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059)
W20260709 12:22:02.475548  9976 leader_election.cc:343] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:02.475991  9976 leader_election.cc:304] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 82a49120848b44bda3940155093e8f86, 8d19ed551837428eac56733d1ca5ce23
I20260709 12:22:02.476490 10085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f4115ad9f0b4f9ca0eb5b0ae157e4ca" candidate_uuid: "82a49120848b44bda3940155093e8f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d19ed551837428eac56733d1ca5ce23"
I20260709 12:22:02.476821 10130 raft_consensus.cc:2749] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:22:02.478260  9901 leader_election.cc:343] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:02.479674 10011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f4115ad9f0b4f9ca0eb5b0ae157e4ca" candidate_uuid: "82a49120848b44bda3940155093e8f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
I20260709 12:22:02.480305 10011 raft_consensus.cc:3060] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:02.486492 10130 raft_consensus.cc:493] T 8be8e2238b7c4097a4c787eb91279601 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.487190 10133 tablet_bootstrap.cc:492] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23: No bootstrap required, opened a new log
I20260709 12:22:02.487039 10130 raft_consensus.cc:515] T 8be8e2238b7c4097a4c787eb91279601 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.487735 10133 ts_tablet_manager.cc:1403] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.013s
I20260709 12:22:02.489432 10130 leader_election.cc:290] T 8be8e2238b7c4097a4c787eb91279601 P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059)
I20260709 12:22:02.489995 10132 tablet_bootstrap.cc:492] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86: No bootstrap required, opened a new log
I20260709 12:22:02.490512 10132 ts_tablet_manager.cc:1403] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86: Time spent bootstrapping tablet: real 0.050s	user 0.022s	sys 0.000s
I20260709 12:22:02.490935 10133 raft_consensus.cc:359] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.491618 10133 raft_consensus.cc:385] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:02.491899 10133 raft_consensus.cc:740] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d19ed551837428eac56733d1ca5ce23, State: Initialized, Role: FOLLOWER
I20260709 12:22:02.492806 10133 consensus_queue.cc:260] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.494777  9934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8be8e2238b7c4097a4c787eb91279601" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a49120848b44bda3940155093e8f86" is_pre_election: true
I20260709 12:22:02.495429 10133 ts_tablet_manager.cc:1434] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:02.495535  9934 raft_consensus.cc:2468] T 8be8e2238b7c4097a4c787eb91279601 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbaeeb68dadd4c69a96dbc88b2b1507e in term 0.
I20260709 12:22:02.493551 10132 raft_consensus.cc:359] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.496542 10133 tablet_bootstrap.cc:492] T 8be8e2238b7c4097a4c787eb91279601 P 8d19ed551837428eac56733d1ca5ce23: Bootstrap starting.
I20260709 12:22:02.496671 10132 raft_consensus.cc:385] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:02.498458 10132 raft_consensus.cc:740] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82a49120848b44bda3940155093e8f86, State: Initialized, Role: FOLLOWER
I20260709 12:22:02.499292 10132 consensus_queue.cc:260] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.500592 10085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8be8e2238b7c4097a4c787eb91279601" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d19ed551837428eac56733d1ca5ce23" is_pre_election: true
I20260709 12:22:02.502175 10132 ts_tablet_manager.cc:1434] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 12:22:02.503198 10132 tablet_bootstrap.cc:492] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86: Bootstrap starting.
W20260709 12:22:02.503638  9976 leader_election.cc:343] T 8be8e2238b7c4097a4c787eb91279601 P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:02.504370  9976 leader_election.cc:304] T 8be8e2238b7c4097a4c787eb91279601 P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82a49120848b44bda3940155093e8f86, fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 8d19ed551837428eac56733d1ca5ce23
I20260709 12:22:02.507941 10130 raft_consensus.cc:2804] T 8be8e2238b7c4097a4c787eb91279601 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:02.508649 10130 raft_consensus.cc:493] T 8be8e2238b7c4097a4c787eb91279601 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.509209 10130 raft_consensus.cc:3060] T 8be8e2238b7c4097a4c787eb91279601 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:02.520331 10011 raft_consensus.cc:2468] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a49120848b44bda3940155093e8f86 in term 1.
I20260709 12:22:02.524991  9898 leader_election.cc:304] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82a49120848b44bda3940155093e8f86, fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 8d19ed551837428eac56733d1ca5ce23
I20260709 12:22:02.525748 10138 raft_consensus.cc:2804] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:02.526274 10138 raft_consensus.cc:697] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 [term 1 LEADER]: Becoming Leader. State: Replica: 82a49120848b44bda3940155093e8f86, State: Running, Role: LEADER
I20260709 12:22:02.527215 10138 consensus_queue.cc:237] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.529857 10128 tablet_bootstrap.cc:492] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e: No bootstrap required, opened a new log
I20260709 12:22:02.530542 10128 ts_tablet_manager.cc:1403] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e: Time spent bootstrapping tablet: real 0.066s	user 0.023s	sys 0.005s
I20260709 12:22:02.530555 10130 raft_consensus.cc:515] T 8be8e2238b7c4097a4c787eb91279601 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.533119 10132 tablet_bootstrap.cc:654] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:02.534288  9934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8be8e2238b7c4097a4c787eb91279601" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a49120848b44bda3940155093e8f86"
I20260709 12:22:02.534464 10130 leader_election.cc:290] T 8be8e2238b7c4097a4c787eb91279601 P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 1 election: Requested vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059)
I20260709 12:22:02.534890  9934 raft_consensus.cc:3060] T 8be8e2238b7c4097a4c787eb91279601 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:02.535030 10128 raft_consensus.cc:359] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.535787 10133 tablet_bootstrap.cc:654] T 8be8e2238b7c4097a4c787eb91279601 P 8d19ed551837428eac56733d1ca5ce23: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:02.539719 10085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8be8e2238b7c4097a4c787eb91279601" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d19ed551837428eac56733d1ca5ce23"
W20260709 12:22:02.541306  9976 leader_election.cc:343] T 8be8e2238b7c4097a4c787eb91279601 P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:02.543721  9831 catalog_manager.cc:5697] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 reported cstate change: term changed from 0 to 1, leader changed from <none> to 82a49120848b44bda3940155093e8f86 (127.9.145.193). New cstate: current_term: 1 leader_uuid: "82a49120848b44bda3940155093e8f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:02.545789  9934 raft_consensus.cc:2468] T 8be8e2238b7c4097a4c787eb91279601 P 82a49120848b44bda3940155093e8f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbaeeb68dadd4c69a96dbc88b2b1507e in term 1.
I20260709 12:22:02.547189  9976 leader_election.cc:304] T 8be8e2238b7c4097a4c787eb91279601 P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82a49120848b44bda3940155093e8f86, fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 8d19ed551837428eac56733d1ca5ce23
I20260709 12:22:02.548484 10130 raft_consensus.cc:2804] T 8be8e2238b7c4097a4c787eb91279601 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:02.535759 10128 raft_consensus.cc:385] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:02.555660 10128 raft_consensus.cc:740] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbaeeb68dadd4c69a96dbc88b2b1507e, State: Initialized, Role: FOLLOWER
I20260709 12:22:02.557641 10128 consensus_queue.cc:260] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.561983 10130 raft_consensus.cc:697] T 8be8e2238b7c4097a4c787eb91279601 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 LEADER]: Becoming Leader. State: Replica: fbaeeb68dadd4c69a96dbc88b2b1507e, State: Running, Role: LEADER
I20260709 12:22:02.564069 10128 ts_tablet_manager.cc:1434] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.004s
I20260709 12:22:02.563819 10130 consensus_queue.cc:237] T 8be8e2238b7c4097a4c787eb91279601 P fbaeeb68dadd4c69a96dbc88b2b1507e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.571499 10128 tablet_bootstrap.cc:492] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e: Bootstrap starting.
I20260709 12:22:02.585924 10132 tablet_bootstrap.cc:492] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86: No bootstrap required, opened a new log
I20260709 12:22:02.587195 10132 ts_tablet_manager.cc:1403] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86: Time spent bootstrapping tablet: real 0.084s	user 0.007s	sys 0.010s
I20260709 12:22:02.594805 10133 tablet_bootstrap.cc:492] T 8be8e2238b7c4097a4c787eb91279601 P 8d19ed551837428eac56733d1ca5ce23: No bootstrap required, opened a new log
I20260709 12:22:02.595417 10132 raft_consensus.cc:359] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } }
I20260709 12:22:02.595417 10133 ts_tablet_manager.cc:1403] T 8be8e2238b7c4097a4c787eb91279601 P 8d19ed551837428eac56733d1ca5ce23: Time spent bootstrapping tablet: real 0.099s	user 0.026s	sys 0.030s
I20260709 12:22:02.596532 10132 raft_consensus.cc:385] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:02.600131 10132 raft_consensus.cc:740] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82a49120848b44bda3940155093e8f86, State: Initialized, Role: FOLLOWER
I20260709 12:22:02.600744 10128 tablet_bootstrap.cc:654] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:02.601058 10132 consensus_queue.cc:260] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } }
I20260709 12:22:02.596868  9829 catalog_manager.cc:5697] T 8be8e2238b7c4097a4c787eb91279601 P fbaeeb68dadd4c69a96dbc88b2b1507e reported cstate change: term changed from 0 to 1, leader changed from <none> to fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194). New cstate: current_term: 1 leader_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:02.607309 10132 ts_tablet_manager.cc:1434] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 12:22:02.608438 10132 tablet_bootstrap.cc:492] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86: Bootstrap starting.
I20260709 12:22:02.609547 10128 tablet_bootstrap.cc:492] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e: No bootstrap required, opened a new log
I20260709 12:22:02.609922 10128 ts_tablet_manager.cc:1403] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.010s
I20260709 12:22:02.612211 10133 raft_consensus.cc:359] T 8be8e2238b7c4097a4c787eb91279601 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.614496 10133 raft_consensus.cc:385] T 8be8e2238b7c4097a4c787eb91279601 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:02.615082 10140 raft_consensus.cc:493] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.615834 10140 raft_consensus.cc:515] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.620229 10140 leader_election.cc:290] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897)
I20260709 12:22:02.615089 10133 raft_consensus.cc:740] T 8be8e2238b7c4097a4c787eb91279601 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d19ed551837428eac56733d1ca5ce23, State: Initialized, Role: FOLLOWER
I20260709 12:22:02.630988 10133 consensus_queue.cc:260] T 8be8e2238b7c4097a4c787eb91279601 P 8d19ed551837428eac56733d1ca5ce23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.640462 10128 raft_consensus.cc:359] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.641330 10128 raft_consensus.cc:385] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:02.644024 10128 raft_consensus.cc:740] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbaeeb68dadd4c69a96dbc88b2b1507e, State: Initialized, Role: FOLLOWER
I20260709 12:22:02.644784 10128 consensus_queue.cc:260] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.643435 10132 tablet_bootstrap.cc:654] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:02.647063 10128 ts_tablet_manager.cc:1434] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.001s
I20260709 12:22:02.648164 10128 tablet_bootstrap.cc:492] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e: Bootstrap starting.
I20260709 12:22:02.652282 10138 raft_consensus.cc:493] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.653165 10138 raft_consensus.cc:515] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } }
I20260709 12:22:02.659889 10138 leader_election.cc:290] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059), fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897)
I20260709 12:22:02.664548 10139 raft_consensus.cc:493] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.665993 10133 ts_tablet_manager.cc:1434] T 8be8e2238b7c4097a4c787eb91279601 P 8d19ed551837428eac56733d1ca5ce23: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.002s
I20260709 12:22:02.668615 10011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa0aa5fbe02488b8a62e6a40038d912" candidate_uuid: "82a49120848b44bda3940155093e8f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" is_pre_election: true
I20260709 12:22:02.665869 10139 raft_consensus.cc:515] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.672209 10011 raft_consensus.cc:2468] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82a49120848b44bda3940155093e8f86 in term 0.
I20260709 12:22:02.673806  9898 leader_election.cc:304] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82a49120848b44bda3940155093e8f86, fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 
I20260709 12:22:02.676119 10139 leader_election.cc:290] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897), 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059)
I20260709 12:22:02.676787 10139 raft_consensus.cc:2804] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:02.679632 10010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e260872eeb455d95f2b95dd0b933e3" candidate_uuid: "82a49120848b44bda3940155093e8f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" is_pre_election: true
I20260709 12:22:02.680315 10085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa0aa5fbe02488b8a62e6a40038d912" candidate_uuid: "82a49120848b44bda3940155093e8f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d19ed551837428eac56733d1ca5ce23" is_pre_election: true
I20260709 12:22:02.680893 10084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e260872eeb455d95f2b95dd0b933e3" candidate_uuid: "82a49120848b44bda3940155093e8f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d19ed551837428eac56733d1ca5ce23" is_pre_election: true
I20260709 12:22:02.685223 10133 tablet_bootstrap.cc:492] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23: Bootstrap starting.
I20260709 12:22:02.685426 10139 raft_consensus.cc:493] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.688019 10139 raft_consensus.cc:3060] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:02.688896 10128 tablet_bootstrap.cc:654] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:02.696660  9901 leader_election.cc:343] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:02.699611  9901 leader_election.cc:343] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:02.691612 10010 raft_consensus.cc:2468] T 25e260872eeb455d95f2b95dd0b933e3 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82a49120848b44bda3940155093e8f86 in term 0.
I20260709 12:22:02.701480  9898 leader_election.cc:304] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82a49120848b44bda3940155093e8f86, fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 8d19ed551837428eac56733d1ca5ce23
I20260709 12:22:02.702495 10138 raft_consensus.cc:2804] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:02.702975 10138 raft_consensus.cc:493] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.703583 10138 raft_consensus.cc:3060] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:02.709776 10139 raft_consensus.cc:515] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } }
I20260709 12:22:02.710235 10138 raft_consensus.cc:515] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.716068 10085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa0aa5fbe02488b8a62e6a40038d912" candidate_uuid: "82a49120848b44bda3940155093e8f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d19ed551837428eac56733d1ca5ce23"
I20260709 12:22:02.717280 10140 raft_consensus.cc:493] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.714138 10133 tablet_bootstrap.cc:654] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:02.717789 10140 raft_consensus.cc:515] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.718878 10132 tablet_bootstrap.cc:492] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86: No bootstrap required, opened a new log
I20260709 12:22:02.719969 10138 leader_election.cc:290] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 1 election: Requested vote from peers fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897), 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059)
W20260709 12:22:02.719923  9901 leader_election.cc:343] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:02.721184 10140 leader_election.cc:290] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897)
I20260709 12:22:02.721966 10085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e260872eeb455d95f2b95dd0b933e3" candidate_uuid: "82a49120848b44bda3940155093e8f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d19ed551837428eac56733d1ca5ce23"
I20260709 12:22:02.722011 10010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e260872eeb455d95f2b95dd0b933e3" candidate_uuid: "82a49120848b44bda3940155093e8f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
I20260709 12:22:02.722819 10010 raft_consensus.cc:3060] T 25e260872eeb455d95f2b95dd0b933e3 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:02.722826 10011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa0aa5fbe02488b8a62e6a40038d912" candidate_uuid: "82a49120848b44bda3940155093e8f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
I20260709 12:22:02.723825 10011 raft_consensus.cc:3060] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:02.724341 10132 ts_tablet_manager.cc:1403] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86: Time spent bootstrapping tablet: real 0.116s	user 0.030s	sys 0.008s
I20260709 12:22:02.724249 10139 leader_election.cc:290] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 1 election: Requested vote from peers 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059), fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897)
W20260709 12:22:02.725821  9901 leader_election.cc:343] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:02.728814 10140 raft_consensus.cc:493] T 8be8e2238b7c4097a4c787eb91279601 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.729405 10140 raft_consensus.cc:515] T 8be8e2238b7c4097a4c787eb91279601 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.733752  9934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ecf8b74e41485a977d82e0801b276d" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a49120848b44bda3940155093e8f86" is_pre_election: true
I20260709 12:22:02.741742 10011 raft_consensus.cc:2468] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a49120848b44bda3940155093e8f86 in term 1.
I20260709 12:22:02.734424 10010 raft_consensus.cc:2468] T 25e260872eeb455d95f2b95dd0b933e3 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a49120848b44bda3940155093e8f86 in term 1.
I20260709 12:22:02.746146  9898 leader_election.cc:304] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82a49120848b44bda3940155093e8f86, fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 8d19ed551837428eac56733d1ca5ce23
I20260709 12:22:02.746233 10140 leader_election.cc:290] T 8be8e2238b7c4097a4c787eb91279601 P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897)
I20260709 12:22:02.746582  9933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8be8e2238b7c4097a4c787eb91279601" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a49120848b44bda3940155093e8f86" is_pre_election: true
I20260709 12:22:02.747565 10139 raft_consensus.cc:2804] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:02.740680  9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3684752ed7ac4ca8a2c549f530aaa3cc" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a49120848b44bda3940155093e8f86" is_pre_election: true
I20260709 12:22:02.749109  9933 raft_consensus.cc:2393] T 8be8e2238b7c4097a4c787eb91279601 P 82a49120848b44bda3940155093e8f86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d19ed551837428eac56733d1ca5ce23 in current term 1: Already voted for candidate fbaeeb68dadd4c69a96dbc88b2b1507e in this term.
I20260709 12:22:02.742671 10132 raft_consensus.cc:359] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.750715 10130 raft_consensus.cc:493] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.751025 10132 raft_consensus.cc:385] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:02.748579 10139 raft_consensus.cc:697] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [term 1 LEADER]: Becoming Leader. State: Replica: 82a49120848b44bda3940155093e8f86, State: Running, Role: LEADER
I20260709 12:22:02.751400 10132 raft_consensus.cc:740] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82a49120848b44bda3940155093e8f86, State: Initialized, Role: FOLLOWER
I20260709 12:22:02.751220 10130 raft_consensus.cc:515] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.752087 10139 consensus_queue.cc:237] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } }
I20260709 12:22:02.752311 10132 consensus_queue.cc:260] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.753415 10130 leader_election.cc:290] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059)
I20260709 12:22:02.750044  9898 leader_election.cc:304] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82a49120848b44bda3940155093e8f86, fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 8d19ed551837428eac56733d1ca5ce23
I20260709 12:22:02.755165 10132 ts_tablet_manager.cc:1434] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.008s
I20260709 12:22:02.756083 10085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3684752ed7ac4ca8a2c549f530aaa3cc" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d19ed551837428eac56733d1ca5ce23" is_pre_election: true
I20260709 12:22:02.756726 10132 tablet_bootstrap.cc:492] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86: Bootstrap starting.
I20260709 12:22:02.756731 10085 raft_consensus.cc:2468] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbaeeb68dadd4c69a96dbc88b2b1507e in term 0.
I20260709 12:22:02.758033 10138 raft_consensus.cc:2804] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:22:02.762408 10051 leader_election.cc:343] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:02.755390  9934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3684752ed7ac4ca8a2c549f530aaa3cc" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a49120848b44bda3940155093e8f86" is_pre_election: true
I20260709 12:22:02.763322 10010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3684752ed7ac4ca8a2c549f530aaa3cc" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" is_pre_election: true
I20260709 12:22:02.764045 10011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ecf8b74e41485a977d82e0801b276d" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" is_pre_election: true
I20260709 12:22:02.764583 10009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8be8e2238b7c4097a4c787eb91279601" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" is_pre_election: true
I20260709 12:22:02.764735 10010 raft_consensus.cc:2468] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d19ed551837428eac56733d1ca5ce23 in term 0.
I20260709 12:22:02.761880  9976 leader_election.cc:304] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d19ed551837428eac56733d1ca5ce23, fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 
I20260709 12:22:02.765951 10130 raft_consensus.cc:2804] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:22:02.766072 10051 leader_election.cc:343] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:02.766671 10048 leader_election.cc:343] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:02.767467 10048 leader_election.cc:304] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d19ed551837428eac56733d1ca5ce23; no voters: 82a49120848b44bda3940155093e8f86, fbaeeb68dadd4c69a96dbc88b2b1507e
I20260709 12:22:02.768738 10048 leader_election.cc:304] T 8be8e2238b7c4097a4c787eb91279601 P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d19ed551837428eac56733d1ca5ce23; no voters: 82a49120848b44bda3940155093e8f86, fbaeeb68dadd4c69a96dbc88b2b1507e
I20260709 12:22:02.766373 10130 raft_consensus.cc:493] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.769999 10140 raft_consensus.cc:2749] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:22:02.771384  9976 leader_election.cc:343] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:02.771448 10140 raft_consensus.cc:3060] T 8be8e2238b7c4097a4c787eb91279601 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:02.773540 10130 raft_consensus.cc:3060] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:02.774469 10138 raft_consensus.cc:697] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [term 1 LEADER]: Becoming Leader. State: Replica: 82a49120848b44bda3940155093e8f86, State: Running, Role: LEADER
I20260709 12:22:02.782115 10138 consensus_queue.cc:237] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.792446 10048 leader_election.cc:304] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d19ed551837428eac56733d1ca5ce23, fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 82a49120848b44bda3940155093e8f86
I20260709 12:22:02.802628 10170 raft_consensus.cc:2804] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:02.803438 10170 raft_consensus.cc:493] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.804570 10170 raft_consensus.cc:3060] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:02.805610 10128 tablet_bootstrap.cc:492] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e: No bootstrap required, opened a new log
I20260709 12:22:02.806181 10128 ts_tablet_manager.cc:1403] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e: Time spent bootstrapping tablet: real 0.158s	user 0.022s	sys 0.007s
I20260709 12:22:02.808674  9830 catalog_manager.cc:5697] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 reported cstate change: term changed from 0 to 1, leader changed from <none> to 82a49120848b44bda3940155093e8f86 (127.9.145.193). New cstate: current_term: 1 leader_uuid: "82a49120848b44bda3940155093e8f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:02.814416 10140 raft_consensus.cc:2749] T 8be8e2238b7c4097a4c787eb91279601 P 8d19ed551837428eac56733d1ca5ce23 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:02.814183 10128 raft_consensus.cc:359] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.814867 10133 tablet_bootstrap.cc:492] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23: No bootstrap required, opened a new log
I20260709 12:22:02.814917 10128 raft_consensus.cc:385] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:02.815300 10128 raft_consensus.cc:740] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbaeeb68dadd4c69a96dbc88b2b1507e, State: Initialized, Role: FOLLOWER
I20260709 12:22:02.815439 10133 ts_tablet_manager.cc:1403] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23: Time spent bootstrapping tablet: real 0.144s	user 0.032s	sys 0.020s
I20260709 12:22:02.816030 10128 consensus_queue.cc:260] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.819656 10128 ts_tablet_manager.cc:1434] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:22:02.821305 10130 raft_consensus.cc:515] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.823413 10133 raft_consensus.cc:359] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } }
I20260709 12:22:02.824369 10133 raft_consensus.cc:385] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:02.826647 10133 raft_consensus.cc:740] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d19ed551837428eac56733d1ca5ce23, State: Initialized, Role: FOLLOWER
I20260709 12:22:02.828878 10133 consensus_queue.cc:260] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } }
I20260709 12:22:02.831265  9934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3684752ed7ac4ca8a2c549f530aaa3cc" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a49120848b44bda3940155093e8f86"
W20260709 12:22:02.832803  9976 leader_election.cc:343] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:02.834949 10132 tablet_bootstrap.cc:654] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:02.837301  9829 catalog_manager.cc:5697] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 reported cstate change: term changed from 0 to 1, leader changed from <none> to 82a49120848b44bda3940155093e8f86 (127.9.145.193). New cstate: current_term: 1 leader_uuid: "82a49120848b44bda3940155093e8f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:02.838364 10085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3684752ed7ac4ca8a2c549f530aaa3cc" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d19ed551837428eac56733d1ca5ce23"
I20260709 12:22:02.839190 10130 leader_election.cc:290] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 1 election: Requested vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059)
I20260709 12:22:02.842578 10133 ts_tablet_manager.cc:1434] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 12:22:02.845016 10133 tablet_bootstrap.cc:492] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23: Bootstrap starting.
I20260709 12:22:02.851935 10130 raft_consensus.cc:493] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.852406 10133 tablet_bootstrap.cc:654] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:02.852499 10130 raft_consensus.cc:515] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.855463 10170 raft_consensus.cc:515] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.857085 10085 raft_consensus.cc:2393] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fbaeeb68dadd4c69a96dbc88b2b1507e in current term 1: Already voted for candidate 8d19ed551837428eac56733d1ca5ce23 in this term.
I20260709 12:22:02.857702 10132 tablet_bootstrap.cc:492] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86: No bootstrap required, opened a new log
I20260709 12:22:02.858141 10132 ts_tablet_manager.cc:1403] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86: Time spent bootstrapping tablet: real 0.102s	user 0.007s	sys 0.019s
I20260709 12:22:02.860956  9976 leader_election.cc:304] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 82a49120848b44bda3940155093e8f86, 8d19ed551837428eac56733d1ca5ce23
I20260709 12:22:02.860746 10132 raft_consensus.cc:359] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.861672 10132 raft_consensus.cc:385] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:02.861977 10132 raft_consensus.cc:740] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82a49120848b44bda3940155093e8f86, State: Initialized, Role: FOLLOWER
I20260709 12:22:02.862329 10158 raft_consensus.cc:2749] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:02.862044 10140 raft_consensus.cc:493] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.863451 10132 consensus_queue.cc:260] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.863523 10140 raft_consensus.cc:515] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.863915  9934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4d6d86011e48c6ad195acd1ba7ce87" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a49120848b44bda3940155093e8f86" is_pre_election: true
I20260709 12:22:02.865715 10140 leader_election.cc:290] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897)
I20260709 12:22:02.867128 10010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4d6d86011e48c6ad195acd1ba7ce87" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" is_pre_election: true
I20260709 12:22:02.867327  9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3684752ed7ac4ca8a2c549f530aaa3cc" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a49120848b44bda3940155093e8f86"
I20260709 12:22:02.867830 10010 raft_consensus.cc:2468] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d19ed551837428eac56733d1ca5ce23 in term 0.
I20260709 12:22:02.868162 10132 ts_tablet_manager.cc:1434] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:22:02.869212 10132 tablet_bootstrap.cc:492] T 82ecf8b74e41485a977d82e0801b276d P 82a49120848b44bda3940155093e8f86: Bootstrap starting.
I20260709 12:22:02.869413 10048 leader_election.cc:304] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d19ed551837428eac56733d1ca5ce23, fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 
I20260709 12:22:02.870232 10140 raft_consensus.cc:2804] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:02.870406  9934 raft_consensus.cc:2468] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbaeeb68dadd4c69a96dbc88b2b1507e in term 0.
I20260709 12:22:02.870652 10140 raft_consensus.cc:493] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.871037 10140 raft_consensus.cc:3060] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:02.870885  9933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4d6d86011e48c6ad195acd1ba7ce87" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a49120848b44bda3940155093e8f86" is_pre_election: true
I20260709 12:22:02.873525  9976 leader_election.cc:304] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82a49120848b44bda3940155093e8f86, fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 
I20260709 12:22:02.874825 10085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4d6d86011e48c6ad195acd1ba7ce87" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d19ed551837428eac56733d1ca5ce23" is_pre_election: true
I20260709 12:22:02.875653 10130 leader_election.cc:290] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059)
I20260709 12:22:02.876304 10130 raft_consensus.cc:2804] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:02.876724 10130 raft_consensus.cc:493] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.877467 10130 raft_consensus.cc:3060] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:02.878175 10140 raft_consensus.cc:515] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.879390 10085 raft_consensus.cc:2393] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbaeeb68dadd4c69a96dbc88b2b1507e in current term 1: Already voted for candidate 8d19ed551837428eac56733d1ca5ce23 in this term.
W20260709 12:22:02.880146 10051 leader_election.cc:343] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:02.884161 10010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4d6d86011e48c6ad195acd1ba7ce87" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
I20260709 12:22:02.884245 10140 leader_election.cc:290] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 1 election: Requested vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897)
I20260709 12:22:02.885293  9934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4d6d86011e48c6ad195acd1ba7ce87" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a49120848b44bda3940155093e8f86"
I20260709 12:22:02.886029  9934 raft_consensus.cc:3060] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:02.888250 10132 tablet_bootstrap.cc:654] T 82ecf8b74e41485a977d82e0801b276d P 82a49120848b44bda3940155093e8f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:02.894721  9934 raft_consensus.cc:2468] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d19ed551837428eac56733d1ca5ce23 in term 1.
I20260709 12:22:02.899318 10051 leader_election.cc:304] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82a49120848b44bda3940155093e8f86, 8d19ed551837428eac56733d1ca5ce23; no voters: 
I20260709 12:22:02.900436 10140 raft_consensus.cc:2804] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:02.902840 10170 leader_election.cc:290] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 1 election: Requested vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897)
I20260709 12:22:02.903103 10009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3684752ed7ac4ca8a2c549f530aaa3cc" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
I20260709 12:22:02.903970 10009 raft_consensus.cc:2393] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d19ed551837428eac56733d1ca5ce23 in current term 1: Already voted for candidate fbaeeb68dadd4c69a96dbc88b2b1507e in this term.
I20260709 12:22:02.905344 10048 leader_election.cc:304] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d19ed551837428eac56733d1ca5ce23; no voters: 82a49120848b44bda3940155093e8f86, fbaeeb68dadd4c69a96dbc88b2b1507e
I20260709 12:22:02.904505 10130 raft_consensus.cc:515] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.906544 10170 raft_consensus.cc:2749] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:02.907181 10010 raft_consensus.cc:2393] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d19ed551837428eac56733d1ca5ce23 in current term 1: Already voted for candidate fbaeeb68dadd4c69a96dbc88b2b1507e in this term.
I20260709 12:22:02.911218  9934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4d6d86011e48c6ad195acd1ba7ce87" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a49120848b44bda3940155093e8f86"
I20260709 12:22:02.911882 10133 tablet_bootstrap.cc:492] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23: No bootstrap required, opened a new log
I20260709 12:22:02.912104  9934 raft_consensus.cc:2393] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fbaeeb68dadd4c69a96dbc88b2b1507e in current term 1: Already voted for candidate 8d19ed551837428eac56733d1ca5ce23 in this term.
I20260709 12:22:02.912968 10133 ts_tablet_manager.cc:1403] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23: Time spent bootstrapping tablet: real 0.068s	user 0.026s	sys 0.027s
I20260709 12:22:02.916204 10085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4d6d86011e48c6ad195acd1ba7ce87" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d19ed551837428eac56733d1ca5ce23"
I20260709 12:22:02.916224 10133 raft_consensus.cc:359] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.917192 10130 leader_election.cc:290] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 1 election: Requested vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059)
I20260709 12:22:02.917419 10133 raft_consensus.cc:385] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:02.917909 10133 raft_consensus.cc:740] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d19ed551837428eac56733d1ca5ce23, State: Initialized, Role: FOLLOWER
I20260709 12:22:02.918982 10133 consensus_queue.cc:260] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.920271 10132 tablet_bootstrap.cc:492] T 82ecf8b74e41485a977d82e0801b276d P 82a49120848b44bda3940155093e8f86: No bootstrap required, opened a new log
I20260709 12:22:02.920713 10132 ts_tablet_manager.cc:1403] T 82ecf8b74e41485a977d82e0801b276d P 82a49120848b44bda3940155093e8f86: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.012s
I20260709 12:22:02.921990 10133 ts_tablet_manager.cc:1434] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:22:02.923159 10133 tablet_bootstrap.cc:492] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 8d19ed551837428eac56733d1ca5ce23: Bootstrap starting.
I20260709 12:22:02.923556 10132 raft_consensus.cc:359] T 82ecf8b74e41485a977d82e0801b276d P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.924342 10132 raft_consensus.cc:385] T 82ecf8b74e41485a977d82e0801b276d P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:02.924552 10140 raft_consensus.cc:697] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [term 1 LEADER]: Becoming Leader. State: Replica: 8d19ed551837428eac56733d1ca5ce23, State: Running, Role: LEADER
I20260709 12:22:02.924690 10132 raft_consensus.cc:740] T 82ecf8b74e41485a977d82e0801b276d P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82a49120848b44bda3940155093e8f86, State: Initialized, Role: FOLLOWER
I20260709 12:22:02.925467 10132 consensus_queue.cc:260] T 82ecf8b74e41485a977d82e0801b276d P 82a49120848b44bda3940155093e8f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.925586 10140 consensus_queue.cc:237] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.928318 10132 ts_tablet_manager.cc:1434] T 82ecf8b74e41485a977d82e0801b276d P 82a49120848b44bda3940155093e8f86: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:02.930451 10132 tablet_bootstrap.cc:492] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86: Bootstrap starting.
I20260709 12:22:02.931061 10133 tablet_bootstrap.cc:654] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 8d19ed551837428eac56733d1ca5ce23: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:02.934748  9901 consensus_peers.cc:597] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 -> Peer 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059): Couldn't send request to peer 8d19ed551837428eac56733d1ca5ce23. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:02.945060 10132 tablet_bootstrap.cc:654] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:02.955101 10133 tablet_bootstrap.cc:492] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 8d19ed551837428eac56733d1ca5ce23: No bootstrap required, opened a new log
I20260709 12:22:02.955770 10133 ts_tablet_manager.cc:1403] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 8d19ed551837428eac56733d1ca5ce23: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.015s
I20260709 12:22:02.955868  9976 leader_election.cc:304] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 82a49120848b44bda3940155093e8f86, 8d19ed551837428eac56733d1ca5ce23
I20260709 12:22:02.957895 10130 raft_consensus.cc:2749] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:02.959965 10133 raft_consensus.cc:359] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.960886 10133 raft_consensus.cc:385] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:02.961270 10133 raft_consensus.cc:740] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d19ed551837428eac56733d1ca5ce23, State: Initialized, Role: FOLLOWER
I20260709 12:22:02.961277  9830 catalog_manager.cc:5697] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195). New cstate: current_term: 1 leader_uuid: "8d19ed551837428eac56733d1ca5ce23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:02.962281 10133 consensus_queue.cc:260] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 8d19ed551837428eac56733d1ca5ce23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.964658 10132 tablet_bootstrap.cc:492] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86: No bootstrap required, opened a new log
I20260709 12:22:02.965143 10132 ts_tablet_manager.cc:1403] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.010s
I20260709 12:22:02.965217 10133 ts_tablet_manager.cc:1434] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 8d19ed551837428eac56733d1ca5ce23: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:22:02.966390 10133 tablet_bootstrap.cc:492] T 85cb505e935e4789a576c1004547f6c2 P 8d19ed551837428eac56733d1ca5ce23: Bootstrap starting.
I20260709 12:22:02.967828 10132 raft_consensus.cc:359] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.968490 10132 raft_consensus.cc:385] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:02.968765 10132 raft_consensus.cc:740] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82a49120848b44bda3940155093e8f86, State: Initialized, Role: FOLLOWER
I20260709 12:22:02.969436 10132 consensus_queue.cc:260] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.974488 10132 ts_tablet_manager.cc:1434] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:22:02.975445 10132 tablet_bootstrap.cc:492] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86: Bootstrap starting.
I20260709 12:22:02.973543 10133 tablet_bootstrap.cc:654] T 85cb505e935e4789a576c1004547f6c2 P 8d19ed551837428eac56733d1ca5ce23: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:02.981283 10132 tablet_bootstrap.cc:654] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:02.988162 10133 tablet_bootstrap.cc:492] T 85cb505e935e4789a576c1004547f6c2 P 8d19ed551837428eac56733d1ca5ce23: No bootstrap required, opened a new log
I20260709 12:22:02.988294 10132 tablet_bootstrap.cc:492] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86: No bootstrap required, opened a new log
I20260709 12:22:02.988651 10133 ts_tablet_manager.cc:1403] T 85cb505e935e4789a576c1004547f6c2 P 8d19ed551837428eac56733d1ca5ce23: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.008s
I20260709 12:22:02.988673 10132 ts_tablet_manager.cc:1403] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86: Time spent bootstrapping tablet: real 0.013s	user 0.001s	sys 0.010s
I20260709 12:22:02.991493 10133 raft_consensus.cc:359] T 85cb505e935e4789a576c1004547f6c2 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.991647 10132 raft_consensus.cc:359] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.992264 10133 raft_consensus.cc:385] T 85cb505e935e4789a576c1004547f6c2 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:02.992298 10132 raft_consensus.cc:385] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:02.992657 10133 raft_consensus.cc:740] T 85cb505e935e4789a576c1004547f6c2 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d19ed551837428eac56733d1ca5ce23, State: Initialized, Role: FOLLOWER
I20260709 12:22:02.992762 10132 raft_consensus.cc:740] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82a49120848b44bda3940155093e8f86, State: Initialized, Role: FOLLOWER
I20260709 12:22:02.993331 10133 consensus_queue.cc:260] T 85cb505e935e4789a576c1004547f6c2 P 8d19ed551837428eac56733d1ca5ce23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.993687 10132 consensus_queue.cc:260] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:02.995204 10133 ts_tablet_manager.cc:1434] T 85cb505e935e4789a576c1004547f6c2 P 8d19ed551837428eac56733d1ca5ce23: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:22:02.995780 10132 ts_tablet_manager.cc:1434] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:22:02.996112 10133 tablet_bootstrap.cc:492] T 25e260872eeb455d95f2b95dd0b933e3 P 8d19ed551837428eac56733d1ca5ce23: Bootstrap starting.
I20260709 12:22:03.002895 10133 tablet_bootstrap.cc:654] T 25e260872eeb455d95f2b95dd0b933e3 P 8d19ed551837428eac56733d1ca5ce23: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.004462 10138 raft_consensus.cc:493] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.005033 10138 raft_consensus.cc:515] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:03.007546 10138 leader_election.cc:290] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897), 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059)
I20260709 12:22:03.008370 10010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3684752ed7ac4ca8a2c549f530aaa3cc" candidate_uuid: "82a49120848b44bda3940155093e8f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" is_pre_election: true
I20260709 12:22:03.009233 10010 raft_consensus.cc:2393] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 82a49120848b44bda3940155093e8f86 in current term 1: Already voted for candidate fbaeeb68dadd4c69a96dbc88b2b1507e in this term.
I20260709 12:22:03.010144 10085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3684752ed7ac4ca8a2c549f530aaa3cc" candidate_uuid: "82a49120848b44bda3940155093e8f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d19ed551837428eac56733d1ca5ce23" is_pre_election: true
I20260709 12:22:03.011333 10085 raft_consensus.cc:2393] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 82a49120848b44bda3940155093e8f86 in current term 1: Already voted for candidate 8d19ed551837428eac56733d1ca5ce23 in this term.
I20260709 12:22:03.012943  9901 leader_election.cc:304] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82a49120848b44bda3940155093e8f86; no voters: 8d19ed551837428eac56733d1ca5ce23, fbaeeb68dadd4c69a96dbc88b2b1507e
I20260709 12:22:03.014340 10138 raft_consensus.cc:3060] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.018878 10133 tablet_bootstrap.cc:492] T 25e260872eeb455d95f2b95dd0b933e3 P 8d19ed551837428eac56733d1ca5ce23: No bootstrap required, opened a new log
I20260709 12:22:03.019407 10133 ts_tablet_manager.cc:1403] T 25e260872eeb455d95f2b95dd0b933e3 P 8d19ed551837428eac56733d1ca5ce23: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.008s
I20260709 12:22:03.021991 10138 raft_consensus.cc:2749] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:03.022209 10133 raft_consensus.cc:359] T 25e260872eeb455d95f2b95dd0b933e3 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:03.022878 10133 raft_consensus.cc:385] T 25e260872eeb455d95f2b95dd0b933e3 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.023101 10133 raft_consensus.cc:740] T 25e260872eeb455d95f2b95dd0b933e3 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d19ed551837428eac56733d1ca5ce23, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.023660 10133 consensus_queue.cc:260] T 25e260872eeb455d95f2b95dd0b933e3 P 8d19ed551837428eac56733d1ca5ce23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:03.025130 10133 ts_tablet_manager.cc:1434] T 25e260872eeb455d95f2b95dd0b933e3 P 8d19ed551837428eac56733d1ca5ce23: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:22:03.029242 10130 consensus_queue.cc:1048] T 8be8e2238b7c4097a4c787eb91279601 P fbaeeb68dadd4c69a96dbc88b2b1507e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:03.031761 10138 raft_consensus.cc:493] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.032416 10138 raft_consensus.cc:515] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:03.034660 10138 leader_election.cc:290] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897), 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059)
I20260709 12:22:03.035386 10010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85cb505e935e4789a576c1004547f6c2" candidate_uuid: "82a49120848b44bda3940155093e8f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" is_pre_election: true
I20260709 12:22:03.036063 10010 raft_consensus.cc:2468] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82a49120848b44bda3940155093e8f86 in term 0.
I20260709 12:22:03.037652  9898 leader_election.cc:304] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82a49120848b44bda3940155093e8f86, fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 
I20260709 12:22:03.038933 10085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85cb505e935e4789a576c1004547f6c2" candidate_uuid: "82a49120848b44bda3940155093e8f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d19ed551837428eac56733d1ca5ce23" is_pre_election: true
I20260709 12:22:03.039608 10085 raft_consensus.cc:2468] T 85cb505e935e4789a576c1004547f6c2 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82a49120848b44bda3940155093e8f86 in term 0.
I20260709 12:22:03.040573 10139 raft_consensus.cc:2804] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:03.040970 10139 raft_consensus.cc:493] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.041311 10139 raft_consensus.cc:3060] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.046273 10140 raft_consensus.cc:493] T 25e260872eeb455d95f2b95dd0b933e3 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.046793 10140 raft_consensus.cc:515] T 25e260872eeb455d95f2b95dd0b933e3 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:03.048767 10140 leader_election.cc:290] T 25e260872eeb455d95f2b95dd0b933e3 P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897)
I20260709 12:22:03.049631  9933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e260872eeb455d95f2b95dd0b933e3" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a49120848b44bda3940155093e8f86" is_pre_election: true
I20260709 12:22:03.051046 10010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e260872eeb455d95f2b95dd0b933e3" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" is_pre_election: true
I20260709 12:22:03.050997 10139 raft_consensus.cc:515] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:03.051990 10010 raft_consensus.cc:2393] T 25e260872eeb455d95f2b95dd0b933e3 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d19ed551837428eac56733d1ca5ce23 in current term 1: Already voted for candidate 82a49120848b44bda3940155093e8f86 in this term.
I20260709 12:22:03.052937 10140 raft_consensus.cc:493] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.053437 10140 raft_consensus.cc:515] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:03.054392 10051 leader_election.cc:304] T 25e260872eeb455d95f2b95dd0b933e3 P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d19ed551837428eac56733d1ca5ce23; no voters: 82a49120848b44bda3940155093e8f86, fbaeeb68dadd4c69a96dbc88b2b1507e
I20260709 12:22:03.055501 10176 raft_consensus.cc:3060] T 25e260872eeb455d95f2b95dd0b933e3 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.056232 10010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85cb505e935e4789a576c1004547f6c2" candidate_uuid: "82a49120848b44bda3940155093e8f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
I20260709 12:22:03.056545 10085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85cb505e935e4789a576c1004547f6c2" candidate_uuid: "82a49120848b44bda3940155093e8f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d19ed551837428eac56733d1ca5ce23"
I20260709 12:22:03.056803 10010 raft_consensus.cc:3060] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.057209 10085 raft_consensus.cc:3060] T 85cb505e935e4789a576c1004547f6c2 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.061365  9933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1463f2c68c44829df48142a9dc4e23" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a49120848b44bda3940155093e8f86" is_pre_election: true
I20260709 12:22:03.061793 10009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1463f2c68c44829df48142a9dc4e23" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" is_pre_election: true
I20260709 12:22:03.062352  9933 raft_consensus.cc:2468] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d19ed551837428eac56733d1ca5ce23 in term 0.
I20260709 12:22:03.062520 10009 raft_consensus.cc:2468] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d19ed551837428eac56733d1ca5ce23 in term 0.
I20260709 12:22:03.063855 10176 raft_consensus.cc:2749] T 25e260872eeb455d95f2b95dd0b933e3 P 8d19ed551837428eac56733d1ca5ce23 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:03.055693 10130 consensus_queue.cc:1048] T 8be8e2238b7c4097a4c787eb91279601 P fbaeeb68dadd4c69a96dbc88b2b1507e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:22:03.063791 10051 leader_election.cc:304] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82a49120848b44bda3940155093e8f86, 8d19ed551837428eac56733d1ca5ce23; no voters: 
I20260709 12:22:03.066506 10176 raft_consensus.cc:2804] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:03.066983 10176 raft_consensus.cc:493] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.067543 10176 raft_consensus.cc:3060] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.069109 10085 raft_consensus.cc:2468] T 85cb505e935e4789a576c1004547f6c2 P 8d19ed551837428eac56733d1ca5ce23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a49120848b44bda3940155093e8f86 in term 1.
I20260709 12:22:03.069584 10139 leader_election.cc:290] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 1 election: Requested vote from peers fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897), 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059)
I20260709 12:22:03.064121 10140 leader_election.cc:290] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897)
I20260709 12:22:03.071910  9901 leader_election.cc:304] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82a49120848b44bda3940155093e8f86, 8d19ed551837428eac56733d1ca5ce23; no voters: 
I20260709 12:22:03.072799 10139 raft_consensus.cc:2804] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:03.073298 10139 raft_consensus.cc:697] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86 [term 1 LEADER]: Becoming Leader. State: Replica: 82a49120848b44bda3940155093e8f86, State: Running, Role: LEADER
I20260709 12:22:03.074167 10139 consensus_queue.cc:237] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:03.075605 10176 raft_consensus.cc:515] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:03.078402 10176 leader_election.cc:290] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 1 election: Requested vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897)
I20260709 12:22:03.078511  9933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1463f2c68c44829df48142a9dc4e23" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a49120848b44bda3940155093e8f86"
I20260709 12:22:03.079239  9933 raft_consensus.cc:3060] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.083362 10009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1463f2c68c44829df48142a9dc4e23" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
I20260709 12:22:03.084050 10009 raft_consensus.cc:3060] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:03.090183  9879 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:03.091892 10009 raft_consensus.cc:2468] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d19ed551837428eac56733d1ca5ce23 in term 1.
I20260709 12:22:03.093268 10048 leader_election.cc:304] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d19ed551837428eac56733d1ca5ce23, fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 
I20260709 12:22:03.094206 10176 raft_consensus.cc:2804] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:03.094894 10176 raft_consensus.cc:697] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [term 1 LEADER]: Becoming Leader. State: Replica: 8d19ed551837428eac56733d1ca5ce23, State: Running, Role: LEADER
I20260709 12:22:03.096060 10176 consensus_queue.cc:237] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:03.115715 10010 raft_consensus.cc:2468] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a49120848b44bda3940155093e8f86 in term 1.
I20260709 12:22:03.118069  9933 raft_consensus.cc:2468] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d19ed551837428eac56733d1ca5ce23 in term 1.
I20260709 12:22:03.123135  9831 catalog_manager.cc:5697] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195). New cstate: current_term: 1 leader_uuid: "8d19ed551837428eac56733d1ca5ce23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:03.142083  9831 catalog_manager.cc:5697] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86 reported cstate change: term changed from 0 to 1, leader changed from <none> to 82a49120848b44bda3940155093e8f86 (127.9.145.193). New cstate: current_term: 1 leader_uuid: "82a49120848b44bda3940155093e8f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:03.146349 10158 raft_consensus.cc:493] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.147029 10158 raft_consensus.cc:515] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:03.150969  9934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ecf8b74e41485a977d82e0801b276d" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a49120848b44bda3940155093e8f86" is_pre_election: true
I20260709 12:22:03.151820  9934 raft_consensus.cc:2468] T 82ecf8b74e41485a977d82e0801b276d P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbaeeb68dadd4c69a96dbc88b2b1507e in term 0.
I20260709 12:22:03.152056 10084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ecf8b74e41485a977d82e0801b276d" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d19ed551837428eac56733d1ca5ce23" is_pre_election: true
I20260709 12:22:03.152685 10084 raft_consensus.cc:2468] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbaeeb68dadd4c69a96dbc88b2b1507e in term 0.
I20260709 12:22:03.153893  9976 leader_election.cc:304] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d19ed551837428eac56733d1ca5ce23, fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 
I20260709 12:22:03.155596 10158 leader_election.cc:290] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059)
I20260709 12:22:03.156283 10158 raft_consensus.cc:2804] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:03.156648 10158 raft_consensus.cc:493] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.157083 10158 raft_consensus.cc:3060] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.159245 10139 consensus_queue.cc:1048] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:03.164533 10158 raft_consensus.cc:515] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:03.169220 10176 raft_consensus.cc:493] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.169768 10176 raft_consensus.cc:515] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } }
I20260709 12:22:03.170933  9933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ecf8b74e41485a977d82e0801b276d" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a49120848b44bda3940155093e8f86"
I20260709 12:22:03.171568  9933 raft_consensus.cc:3060] T 82ecf8b74e41485a977d82e0801b276d P 82a49120848b44bda3940155093e8f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.172107 10176 leader_election.cc:290] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897)
I20260709 12:22:03.173976 10084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ecf8b74e41485a977d82e0801b276d" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d19ed551837428eac56733d1ca5ce23"
I20260709 12:22:03.174703 10084 raft_consensus.cc:3060] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.177877 10158 leader_election.cc:290] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 1 election: Requested vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059)
I20260709 12:22:03.182399  9933 raft_consensus.cc:2468] T 82ecf8b74e41485a977d82e0801b276d P 82a49120848b44bda3940155093e8f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbaeeb68dadd4c69a96dbc88b2b1507e in term 1.
I20260709 12:22:03.183887  9976 leader_election.cc:304] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82a49120848b44bda3940155093e8f86, fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 
I20260709 12:22:03.185593 10158 raft_consensus.cc:2804] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:03.186203 10158 raft_consensus.cc:697] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 LEADER]: Becoming Leader. State: Replica: fbaeeb68dadd4c69a96dbc88b2b1507e, State: Running, Role: LEADER
I20260709 12:22:03.187060 10158 consensus_queue.cc:237] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:03.190984 10009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa0aa5fbe02488b8a62e6a40038d912" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" is_pre_election: true
I20260709 12:22:03.191848 10009 raft_consensus.cc:2393] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d19ed551837428eac56733d1ca5ce23 in current term 1: Already voted for candidate 82a49120848b44bda3940155093e8f86 in this term.
I20260709 12:22:03.195111  9933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa0aa5fbe02488b8a62e6a40038d912" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a49120848b44bda3940155093e8f86" is_pre_election: true
I20260709 12:22:03.196715 10051 leader_election.cc:304] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d19ed551837428eac56733d1ca5ce23; no voters: 82a49120848b44bda3940155093e8f86, fbaeeb68dadd4c69a96dbc88b2b1507e
I20260709 12:22:03.197432 10084 raft_consensus.cc:2468] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbaeeb68dadd4c69a96dbc88b2b1507e in term 1.
I20260709 12:22:03.198028 10176 raft_consensus.cc:3060] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.205334 10176 raft_consensus.cc:2749] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:03.210352  9831 catalog_manager.cc:5697] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e reported cstate change: term changed from 0 to 1, leader changed from <none> to fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194). New cstate: current_term: 1 leader_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:03.229650 10139 consensus_queue.cc:1048] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:03.241993 10138 consensus_queue.cc:1048] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:03.245119 10138 consensus_queue.cc:1048] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:03.263777 10138 consensus_queue.cc:1048] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:03.320075 10176 raft_consensus.cc:493] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.320601 10176 raft_consensus.cc:515] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:03.322402 10176 leader_election.cc:290] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897)
I20260709 12:22:03.323413  9933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f4115ad9f0b4f9ca0eb5b0ae157e4ca" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a49120848b44bda3940155093e8f86" is_pre_election: true
I20260709 12:22:03.323589 10010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f4115ad9f0b4f9ca0eb5b0ae157e4ca" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" is_pre_election: true
I20260709 12:22:03.324966 10048 leader_election.cc:304] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d19ed551837428eac56733d1ca5ce23; no voters: 82a49120848b44bda3940155093e8f86, fbaeeb68dadd4c69a96dbc88b2b1507e
I20260709 12:22:03.325662 10176 raft_consensus.cc:2749] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:03.344203 10085 raft_consensus.cc:3060] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 8d19ed551837428eac56733d1ca5ce23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.470355 10176 consensus_queue.cc:1048] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:03.481006 10140 consensus_queue.cc:1048] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:03.510313 10176 consensus_queue.cc:1048] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:03.522912 10140 consensus_queue.cc:1048] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:03.526567 10138 consensus_queue.cc:1048] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:03.545569 10194 consensus_queue.cc:1048] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:03.725311 10158 consensus_queue.cc:1048] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:03.730183 10158 consensus_queue.cc:1048] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:22:04.095165  9879 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:04.524397 10208 raft_consensus.cc:493] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.524976 10208 raft_consensus.cc:515] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:04.526969 10208 leader_election.cc:290] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059)
I20260709 12:22:04.527889  9933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3684752ed7ac4ca8a2c549f530aaa3cc" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a49120848b44bda3940155093e8f86" is_pre_election: true
I20260709 12:22:04.528077 10085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3684752ed7ac4ca8a2c549f530aaa3cc" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d19ed551837428eac56733d1ca5ce23" is_pre_election: true
I20260709 12:22:04.528436  9933 raft_consensus.cc:2468] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbaeeb68dadd4c69a96dbc88b2b1507e in term 1.
I20260709 12:22:04.528616 10085 raft_consensus.cc:2468] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbaeeb68dadd4c69a96dbc88b2b1507e in term 1.
I20260709 12:22:04.529608  9976 leader_election.cc:304] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82a49120848b44bda3940155093e8f86, fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 
I20260709 12:22:04.530371 10208 raft_consensus.cc:2804] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:04.530746 10208 raft_consensus.cc:493] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:04.531044 10208 raft_consensus.cc:3060] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.536156 10208 raft_consensus.cc:515] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:04.537817 10208 leader_election.cc:290] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 2 election: Requested vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059)
I20260709 12:22:04.538729  9933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3684752ed7ac4ca8a2c549f530aaa3cc" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a49120848b44bda3940155093e8f86"
I20260709 12:22:04.538908 10085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3684752ed7ac4ca8a2c549f530aaa3cc" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d19ed551837428eac56733d1ca5ce23"
I20260709 12:22:04.539359  9933 raft_consensus.cc:3060] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.539440 10085 raft_consensus.cc:3060] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.546212  9933 raft_consensus.cc:2468] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbaeeb68dadd4c69a96dbc88b2b1507e in term 2.
I20260709 12:22:04.546217 10085 raft_consensus.cc:2468] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbaeeb68dadd4c69a96dbc88b2b1507e in term 2.
I20260709 12:22:04.547524  9976 leader_election.cc:304] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d19ed551837428eac56733d1ca5ce23, fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 
I20260709 12:22:04.548188 10208 raft_consensus.cc:2804] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:04.548671 10208 raft_consensus.cc:697] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 LEADER]: Becoming Leader. State: Replica: fbaeeb68dadd4c69a96dbc88b2b1507e, State: Running, Role: LEADER
I20260709 12:22:04.550274 10208 consensus_queue.cc:237] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:04.557327  9831 catalog_manager.cc:5697] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e reported cstate change: term changed from 0 to 2, leader changed from <none> to fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194). New cstate: current_term: 2 leader_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:04.738970 10085 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d4d6d86011e48c6ad195acd1ba7ce87"
dest_uuid: "8d19ed551837428eac56733d1ca5ce23"
mode: GRACEFUL
new_leader_uuid: "82a49120848b44bda3940155093e8f86"
 from {username='slave'} at 127.0.0.1:54878
I20260709 12:22:04.739560 10085 raft_consensus.cc:606] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [term 1 LEADER]: Received request to transfer leadership to TS 82a49120848b44bda3940155093e8f86
I20260709 12:22:04.744814 10085 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c1463f2c68c44829df48142a9dc4e23"
dest_uuid: "8d19ed551837428eac56733d1ca5ce23"
mode: GRACEFUL
new_leader_uuid: "82a49120848b44bda3940155093e8f86"
 from {username='slave'} at 127.0.0.1:54878
I20260709 12:22:04.745342 10085 raft_consensus.cc:606] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [term 1 LEADER]: Received request to transfer leadership to TS 82a49120848b44bda3940155093e8f86
I20260709 12:22:04.766142  9933 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85cb505e935e4789a576c1004547f6c2"
dest_uuid: "82a49120848b44bda3940155093e8f86"
mode: GRACEFUL
new_leader_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
 from {username='slave'} at 127.0.0.1:41936
I20260709 12:22:04.766695  9933 raft_consensus.cc:606] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86 [term 1 LEADER]: Received request to transfer leadership to TS fbaeeb68dadd4c69a96dbc88b2b1507e
I20260709 12:22:04.774243  9933 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25e260872eeb455d95f2b95dd0b933e3"
dest_uuid: "82a49120848b44bda3940155093e8f86"
mode: GRACEFUL
new_leader_uuid: "8d19ed551837428eac56733d1ca5ce23"
 from {username='slave'} at 127.0.0.1:41936
I20260709 12:22:04.774755  9933 raft_consensus.cc:606] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [term 1 LEADER]: Received request to transfer leadership to TS 8d19ed551837428eac56733d1ca5ce23
I20260709 12:22:04.845265 10168 raft_consensus.cc:993] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86: : Instructing follower 8d19ed551837428eac56733d1ca5ce23 to start an election
I20260709 12:22:04.845729 10220 raft_consensus.cc:1081] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [term 1 LEADER]: Signalling peer 8d19ed551837428eac56733d1ca5ce23 to start an election
I20260709 12:22:04.847517 10085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25e260872eeb455d95f2b95dd0b933e3"
dest_uuid: "8d19ed551837428eac56733d1ca5ce23"
 from {username='slave'} at 127.0.0.1:54874
I20260709 12:22:04.848050 10085 raft_consensus.cc:493] T 25e260872eeb455d95f2b95dd0b933e3 P 8d19ed551837428eac56733d1ca5ce23 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:04.848371 10085 raft_consensus.cc:3060] T 25e260872eeb455d95f2b95dd0b933e3 P 8d19ed551837428eac56733d1ca5ce23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.853045 10085 raft_consensus.cc:515] T 25e260872eeb455d95f2b95dd0b933e3 P 8d19ed551837428eac56733d1ca5ce23 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:04.855137 10085 leader_election.cc:290] T 25e260872eeb455d95f2b95dd0b933e3 P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 2 election: Requested vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897)
I20260709 12:22:04.856037  9933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e260872eeb455d95f2b95dd0b933e3" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "82a49120848b44bda3940155093e8f86"
I20260709 12:22:04.856350 10010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e260872eeb455d95f2b95dd0b933e3" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
I20260709 12:22:04.856756  9933 raft_consensus.cc:3055] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:04.856959 10010 raft_consensus.cc:3060] T 25e260872eeb455d95f2b95dd0b933e3 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.857147  9933 raft_consensus.cc:740] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 82a49120848b44bda3940155093e8f86, State: Running, Role: LEADER
I20260709 12:22:04.857923  9933 consensus_queue.cc:260] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:04.859023  9933 raft_consensus.cc:3060] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.861821 10010 raft_consensus.cc:2468] T 25e260872eeb455d95f2b95dd0b933e3 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d19ed551837428eac56733d1ca5ce23 in term 2.
I20260709 12:22:04.863016 10048 leader_election.cc:304] T 25e260872eeb455d95f2b95dd0b933e3 P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d19ed551837428eac56733d1ca5ce23, fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 
I20260709 12:22:04.863722 10211 raft_consensus.cc:2804] T 25e260872eeb455d95f2b95dd0b933e3 P 8d19ed551837428eac56733d1ca5ce23 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:04.863883  9933 raft_consensus.cc:2468] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d19ed551837428eac56733d1ca5ce23 in term 2.
I20260709 12:22:04.864722 10211 raft_consensus.cc:697] T 25e260872eeb455d95f2b95dd0b933e3 P 8d19ed551837428eac56733d1ca5ce23 [term 2 LEADER]: Becoming Leader. State: Replica: 8d19ed551837428eac56733d1ca5ce23, State: Running, Role: LEADER
I20260709 12:22:04.865617 10211 consensus_queue.cc:237] T 25e260872eeb455d95f2b95dd0b933e3 P 8d19ed551837428eac56733d1ca5ce23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:04.872437  9831 catalog_manager.cc:5697] T 25e260872eeb455d95f2b95dd0b933e3 P 8d19ed551837428eac56733d1ca5ce23 reported cstate change: term changed from 1 to 2, leader changed from 82a49120848b44bda3940155093e8f86 (127.9.145.193) to 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195). New cstate: current_term: 2 leader_uuid: "8d19ed551837428eac56733d1ca5ce23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:04.934656 10168 raft_consensus.cc:993] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86: : Instructing follower fbaeeb68dadd4c69a96dbc88b2b1507e to start an election
I20260709 12:22:04.935091 10220 raft_consensus.cc:1081] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86 [term 1 LEADER]: Signalling peer fbaeeb68dadd4c69a96dbc88b2b1507e to start an election
I20260709 12:22:04.936517 10010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85cb505e935e4789a576c1004547f6c2"
dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
 from {username='slave'} at 127.0.0.1:37946
I20260709 12:22:04.936993 10010 raft_consensus.cc:493] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:04.937249 10010 raft_consensus.cc:3060] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.941713 10010 raft_consensus.cc:515] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:04.943465 10010 leader_election.cc:290] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 2 election: Requested vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059)
I20260709 12:22:04.944402  9933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85cb505e935e4789a576c1004547f6c2" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "82a49120848b44bda3940155093e8f86"
I20260709 12:22:04.944628 10085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85cb505e935e4789a576c1004547f6c2" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8d19ed551837428eac56733d1ca5ce23"
I20260709 12:22:04.945046  9933 raft_consensus.cc:3055] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:04.945134 10085 raft_consensus.cc:3060] T 85cb505e935e4789a576c1004547f6c2 P 8d19ed551837428eac56733d1ca5ce23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.945457  9933 raft_consensus.cc:740] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 82a49120848b44bda3940155093e8f86, State: Running, Role: LEADER
I20260709 12:22:04.946303  9933 consensus_queue.cc:260] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:04.947520  9933 raft_consensus.cc:3060] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.951963 10085 raft_consensus.cc:2468] T 85cb505e935e4789a576c1004547f6c2 P 8d19ed551837428eac56733d1ca5ce23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbaeeb68dadd4c69a96dbc88b2b1507e in term 2.
I20260709 12:22:04.953176  9976 leader_election.cc:304] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d19ed551837428eac56733d1ca5ce23, fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 
I20260709 12:22:04.953714  9933 raft_consensus.cc:2468] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbaeeb68dadd4c69a96dbc88b2b1507e in term 2.
I20260709 12:22:04.953917 10208 raft_consensus.cc:2804] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:04.954437 10208 raft_consensus.cc:697] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 LEADER]: Becoming Leader. State: Replica: fbaeeb68dadd4c69a96dbc88b2b1507e, State: Running, Role: LEADER
I20260709 12:22:04.955260 10208 consensus_queue.cc:237] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:04.962291  9831 catalog_manager.cc:5697] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e reported cstate change: term changed from 1 to 2, leader changed from 82a49120848b44bda3940155093e8f86 (127.9.145.193) to fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194). New cstate: current_term: 2 leader_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:05.027940 10085 raft_consensus.cc:1275] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23 [term 2 FOLLOWER]: Refusing update from remote peer fbaeeb68dadd4c69a96dbc88b2b1507e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:22:05.029258 10208 consensus_queue.cc:1048] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:05.035909 10221 raft_consensus.cc:993] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23: : Instructing follower 82a49120848b44bda3940155093e8f86 to start an election
I20260709 12:22:05.036397 10211 raft_consensus.cc:1081] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [term 1 LEADER]: Signalling peer 82a49120848b44bda3940155093e8f86 to start an election
I20260709 12:22:05.038223  9933 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d4d6d86011e48c6ad195acd1ba7ce87"
dest_uuid: "82a49120848b44bda3940155093e8f86"
 from {username='slave'} at 127.0.0.1:41934
I20260709 12:22:05.038806  9933 raft_consensus.cc:493] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:05.039181  9933 raft_consensus.cc:3060] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.041489  9934 raft_consensus.cc:1275] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86 [term 2 FOLLOWER]: Refusing update from remote peer fbaeeb68dadd4c69a96dbc88b2b1507e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:22:05.043022 10208 consensus_queue.cc:1048] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:05.046212  9933 raft_consensus.cc:515] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:05.048720  9933 leader_election.cc:290] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 2 election: Requested vote from peers fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897), 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059)
I20260709 12:22:05.049890 10010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4d6d86011e48c6ad195acd1ba7ce87" candidate_uuid: "82a49120848b44bda3940155093e8f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
I20260709 12:22:05.050508 10010 raft_consensus.cc:3060] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.050405 10084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4d6d86011e48c6ad195acd1ba7ce87" candidate_uuid: "82a49120848b44bda3940155093e8f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8d19ed551837428eac56733d1ca5ce23"
I20260709 12:22:05.051061 10084 raft_consensus.cc:3055] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:05.051374 10084 raft_consensus.cc:740] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8d19ed551837428eac56733d1ca5ce23, State: Running, Role: LEADER
I20260709 12:22:05.052155 10084 consensus_queue.cc:260] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:05.053413 10084 raft_consensus.cc:3060] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.057976 10010 raft_consensus.cc:2468] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a49120848b44bda3940155093e8f86 in term 2.
I20260709 12:22:05.059243  9898 leader_election.cc:304] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82a49120848b44bda3940155093e8f86, fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 
I20260709 12:22:05.060151 10220 raft_consensus.cc:2804] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:05.060644 10220 raft_consensus.cc:697] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [term 2 LEADER]: Becoming Leader. State: Replica: 82a49120848b44bda3940155093e8f86, State: Running, Role: LEADER
I20260709 12:22:05.060540 10084 raft_consensus.cc:2468] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a49120848b44bda3940155093e8f86 in term 2.
I20260709 12:22:05.061933 10220 consensus_queue.cc:237] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:05.073876  9831 catalog_manager.cc:5697] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 reported cstate change: term changed from 1 to 2, leader changed from 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195) to 82a49120848b44bda3940155093e8f86 (127.9.145.193). New cstate: current_term: 2 leader_uuid: "82a49120848b44bda3940155093e8f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:05.151674 10221 raft_consensus.cc:993] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23: : Instructing follower 82a49120848b44bda3940155093e8f86 to start an election
I20260709 12:22:05.152089 10211 raft_consensus.cc:1081] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [term 1 LEADER]: Signalling peer 82a49120848b44bda3940155093e8f86 to start an election
I20260709 12:22:05.153628  9934 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c1463f2c68c44829df48142a9dc4e23"
dest_uuid: "82a49120848b44bda3940155093e8f86"
 from {username='slave'} at 127.0.0.1:41934
I20260709 12:22:05.154183  9934 raft_consensus.cc:493] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:05.154481  9934 raft_consensus.cc:3060] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.159281  9934 raft_consensus.cc:515] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:05.161198  9934 leader_election.cc:290] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 2 election: Requested vote from peers fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897), 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059)
I20260709 12:22:05.161993 10010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1463f2c68c44829df48142a9dc4e23" candidate_uuid: "82a49120848b44bda3940155093e8f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
I20260709 12:22:05.162397 10084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1463f2c68c44829df48142a9dc4e23" candidate_uuid: "82a49120848b44bda3940155093e8f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8d19ed551837428eac56733d1ca5ce23"
I20260709 12:22:05.162520 10010 raft_consensus.cc:3060] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.162912 10084 raft_consensus.cc:3055] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:05.163187 10084 raft_consensus.cc:740] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8d19ed551837428eac56733d1ca5ce23, State: Running, Role: LEADER
I20260709 12:22:05.163883 10084 consensus_queue.cc:260] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:05.164841 10084 raft_consensus.cc:3060] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.167325 10010 raft_consensus.cc:2468] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a49120848b44bda3940155093e8f86 in term 2.
I20260709 12:22:05.168409  9898 leader_election.cc:304] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82a49120848b44bda3940155093e8f86, fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 
I20260709 12:22:05.169275 10220 raft_consensus.cc:2804] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:05.169981 10084 raft_consensus.cc:2468] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a49120848b44bda3940155093e8f86 in term 2.
I20260709 12:22:05.169673 10220 raft_consensus.cc:697] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 [term 2 LEADER]: Becoming Leader. State: Replica: 82a49120848b44bda3940155093e8f86, State: Running, Role: LEADER
I20260709 12:22:05.171043 10220 consensus_queue.cc:237] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:05.177942  9831 catalog_manager.cc:5697] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 reported cstate change: term changed from 1 to 2, leader changed from 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195) to 82a49120848b44bda3940155093e8f86 (127.9.145.193). New cstate: current_term: 2 leader_uuid: "82a49120848b44bda3940155093e8f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:05.256704  9934 raft_consensus.cc:1275] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [term 2 FOLLOWER]: Refusing update from remote peer 8d19ed551837428eac56733d1ca5ce23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.257972 10211 consensus_queue.cc:1048] T 25e260872eeb455d95f2b95dd0b933e3 P 8d19ed551837428eac56733d1ca5ce23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:05.261785 10010 raft_consensus.cc:1275] T 25e260872eeb455d95f2b95dd0b933e3 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 FOLLOWER]: Refusing update from remote peer 8d19ed551837428eac56733d1ca5ce23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.263499 10211 consensus_queue.cc:1048] T 25e260872eeb455d95f2b95dd0b933e3 P 8d19ed551837428eac56733d1ca5ce23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:05.353158 10084 raft_consensus.cc:1275] T 85cb505e935e4789a576c1004547f6c2 P 8d19ed551837428eac56733d1ca5ce23 [term 2 FOLLOWER]: Refusing update from remote peer fbaeeb68dadd4c69a96dbc88b2b1507e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.354455 10208 consensus_queue.cc:1048] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:05.365793  9934 raft_consensus.cc:1275] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86 [term 2 FOLLOWER]: Refusing update from remote peer fbaeeb68dadd4c69a96dbc88b2b1507e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.367128 10208 consensus_queue.cc:1048] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:05.532801 10010 raft_consensus.cc:1275] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 FOLLOWER]: Refusing update from remote peer 82a49120848b44bda3940155093e8f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.533977 10220 consensus_queue.cc:1048] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:05.545720 10084 raft_consensus.cc:1275] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [term 2 FOLLOWER]: Refusing update from remote peer 82a49120848b44bda3940155093e8f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.547165 10238 consensus_queue.cc:1048] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:05.566476 10010 raft_consensus.cc:1275] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 FOLLOWER]: Refusing update from remote peer 82a49120848b44bda3940155093e8f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.567718 10238 consensus_queue.cc:1048] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:05.578023 10084 raft_consensus.cc:1275] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [term 2 FOLLOWER]: Refusing update from remote peer 82a49120848b44bda3940155093e8f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.579418 10168 consensus_queue.cc:1048] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:07.806025  9799 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:22:07.806859  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:07.826901  9934 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6aa0aa5fbe02488b8a62e6a40038d912"
dest_uuid: "82a49120848b44bda3940155093e8f86"
mode: GRACEFUL
new_leader_uuid: "8d19ed551837428eac56733d1ca5ce23"
 from {username='slave'} at 127.0.0.1:41942
I20260709 12:22:07.827409  9934 raft_consensus.cc:606] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [term 1 LEADER]: Received request to transfer leadership to TS 8d19ed551837428eac56733d1ca5ce23
I20260709 12:22:07.838088 10010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82ecf8b74e41485a977d82e0801b276d"
dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
mode: GRACEFUL
new_leader_uuid: "8d19ed551837428eac56733d1ca5ce23"
 from {username='slave'} at 127.0.0.1:37962
I20260709 12:22:07.838663 10010 raft_consensus.cc:606] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 LEADER]: Received request to transfer leadership to TS 8d19ed551837428eac56733d1ca5ce23
I20260709 12:22:07.839804  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:07.840255  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:08.131048 10246 raft_consensus.cc:993] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e: : Instructing follower 8d19ed551837428eac56733d1ca5ce23 to start an election
I20260709 12:22:08.131480 10251 raft_consensus.cc:1081] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 LEADER]: Signalling peer 8d19ed551837428eac56733d1ca5ce23 to start an election
I20260709 12:22:08.133042 10085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82ecf8b74e41485a977d82e0801b276d"
dest_uuid: "8d19ed551837428eac56733d1ca5ce23"
 from {username='slave'} at 127.0.0.1:54860
I20260709 12:22:08.133644 10085 raft_consensus.cc:493] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:08.134029 10085 raft_consensus.cc:3060] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:08.141109 10085 raft_consensus.cc:515] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:08.143325 10085 leader_election.cc:290] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 2 election: Requested vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897)
I20260709 12:22:08.144312  9933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ecf8b74e41485a977d82e0801b276d" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "82a49120848b44bda3940155093e8f86"
I20260709 12:22:08.144312 10010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ecf8b74e41485a977d82e0801b276d" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
I20260709 12:22:08.145063  9933 raft_consensus.cc:3060] T 82ecf8b74e41485a977d82e0801b276d P 82a49120848b44bda3940155093e8f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:08.145095 10010 raft_consensus.cc:3055] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:08.145557 10010 raft_consensus.cc:740] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fbaeeb68dadd4c69a96dbc88b2b1507e, State: Running, Role: LEADER
I20260709 12:22:08.146209 10010 consensus_queue.cc:260] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:08.147071 10010 raft_consensus.cc:3060] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:08.150341  9933 raft_consensus.cc:2468] T 82ecf8b74e41485a977d82e0801b276d P 82a49120848b44bda3940155093e8f86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d19ed551837428eac56733d1ca5ce23 in term 2.
I20260709 12:22:08.151598 10051 leader_election.cc:304] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82a49120848b44bda3940155093e8f86, 8d19ed551837428eac56733d1ca5ce23; no voters: 
I20260709 12:22:08.152374 10245 raft_consensus.cc:2804] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:08.152552 10010 raft_consensus.cc:2468] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d19ed551837428eac56733d1ca5ce23 in term 2.
I20260709 12:22:08.153553 10245 raft_consensus.cc:697] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [term 2 LEADER]: Becoming Leader. State: Replica: 8d19ed551837428eac56733d1ca5ce23, State: Running, Role: LEADER
I20260709 12:22:08.154423 10245 consensus_queue.cc:237] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:08.160996  9829 catalog_manager.cc:5697] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 reported cstate change: term changed from 1 to 2, leader changed from fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194) to 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195). New cstate: current_term: 2 leader_uuid: "8d19ed551837428eac56733d1ca5ce23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:08.184257 10250 raft_consensus.cc:993] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86: : Instructing follower 8d19ed551837428eac56733d1ca5ce23 to start an election
I20260709 12:22:08.184691 10168 raft_consensus.cc:1081] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [term 1 LEADER]: Signalling peer 8d19ed551837428eac56733d1ca5ce23 to start an election
I20260709 12:22:08.186213 10085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6aa0aa5fbe02488b8a62e6a40038d912"
dest_uuid: "8d19ed551837428eac56733d1ca5ce23"
 from {username='slave'} at 127.0.0.1:54874
I20260709 12:22:08.186664 10085 raft_consensus.cc:493] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:08.186932 10085 raft_consensus.cc:3060] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:08.191324 10085 raft_consensus.cc:515] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } }
I20260709 12:22:08.192880 10085 leader_election.cc:290] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 2 election: Requested vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897)
I20260709 12:22:08.193786  9933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa0aa5fbe02488b8a62e6a40038d912" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "82a49120848b44bda3940155093e8f86"
I20260709 12:22:08.193938 10010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa0aa5fbe02488b8a62e6a40038d912" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
I20260709 12:22:08.194341  9933 raft_consensus.cc:3055] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:08.194468 10010 raft_consensus.cc:3060] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:08.194645  9933 raft_consensus.cc:740] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 82a49120848b44bda3940155093e8f86, State: Running, Role: LEADER
I20260709 12:22:08.195338  9933 consensus_queue.cc:260] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } }
I20260709 12:22:08.196242  9933 raft_consensus.cc:3060] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:08.198855 10010 raft_consensus.cc:2468] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d19ed551837428eac56733d1ca5ce23 in term 2.
I20260709 12:22:08.199918 10048 leader_election.cc:304] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d19ed551837428eac56733d1ca5ce23, fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 
I20260709 12:22:08.200752 10245 raft_consensus.cc:2804] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:08.201150 10245 raft_consensus.cc:697] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [term 2 LEADER]: Becoming Leader. State: Replica: 8d19ed551837428eac56733d1ca5ce23, State: Running, Role: LEADER
I20260709 12:22:08.201315  9933 raft_consensus.cc:2468] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d19ed551837428eac56733d1ca5ce23 in term 2.
I20260709 12:22:08.201963 10245 consensus_queue.cc:237] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } }
I20260709 12:22:08.208920  9829 catalog_manager.cc:5697] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 reported cstate change: term changed from 1 to 2, leader changed from 82a49120848b44bda3940155093e8f86 (127.9.145.193) to 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195). New cstate: current_term: 2 leader_uuid: "8d19ed551837428eac56733d1ca5ce23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:08.589578 10010 raft_consensus.cc:1275] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 FOLLOWER]: Refusing update from remote peer 8d19ed551837428eac56733d1ca5ce23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:08.590823 10245 consensus_queue.cc:1048] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:08.600239  9933 raft_consensus.cc:1275] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [term 2 FOLLOWER]: Refusing update from remote peer 8d19ed551837428eac56733d1ca5ce23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:08.602622 10262 consensus_queue.cc:1048] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:08.654700  9933 raft_consensus.cc:1275] T 82ecf8b74e41485a977d82e0801b276d P 82a49120848b44bda3940155093e8f86 [term 2 FOLLOWER]: Refusing update from remote peer 8d19ed551837428eac56733d1ca5ce23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:08.655925 10245 consensus_queue.cc:1048] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:08.665349 10010 raft_consensus.cc:1275] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 FOLLOWER]: Refusing update from remote peer 8d19ed551837428eac56733d1ca5ce23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:08.666944 10245 consensus_queue.cc:1048] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:08.841262  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:08.846320  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:08.846758  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:09.847913  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:09.853389  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:09.853777  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:10.854848  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:10.859944  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:10.860374  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:11.861347  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:11.866814  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:11.867250  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:12.868251  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:12.874127  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:12.874550  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:13.875504  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:13.880987  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:13.881448  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:14.882395  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:14.887149  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:14.887573  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:15.888514  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:15.893846  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:15.894328  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:16.895215  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:16.900130  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:16.900557  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:18.041071  9799 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:22:18.045714 10085 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6aa0aa5fbe02488b8a62e6a40038d912"
dest_uuid: "8d19ed551837428eac56733d1ca5ce23"
mode: GRACEFUL
new_leader_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
 from {username='slave'} at 127.0.0.1:54878
I20260709 12:22:18.046432 10085 raft_consensus.cc:606] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [term 2 LEADER]: Received request to transfer leadership to TS fbaeeb68dadd4c69a96dbc88b2b1507e
I20260709 12:22:18.051615  9935 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d4d6d86011e48c6ad195acd1ba7ce87"
dest_uuid: "82a49120848b44bda3940155093e8f86"
mode: GRACEFUL
new_leader_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
 from {username='slave'} at 127.0.0.1:41936
I20260709 12:22:18.052131  9935 raft_consensus.cc:606] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [term 2 LEADER]: Received request to transfer leadership to TS fbaeeb68dadd4c69a96dbc88b2b1507e
I20260709 12:22:18.057080  9935 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c1463f2c68c44829df48142a9dc4e23"
dest_uuid: "82a49120848b44bda3940155093e8f86"
mode: GRACEFUL
new_leader_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
 from {username='slave'} at 127.0.0.1:41936
I20260709 12:22:18.057570  9935 raft_consensus.cc:606] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 [term 2 LEADER]: Received request to transfer leadership to TS fbaeeb68dadd4c69a96dbc88b2b1507e
I20260709 12:22:18.062608  9935 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f4115ad9f0b4f9ca0eb5b0ae157e4ca"
dest_uuid: "82a49120848b44bda3940155093e8f86"
mode: GRACEFUL
new_leader_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
 from {username='slave'} at 127.0.0.1:41936
I20260709 12:22:18.063088  9935 raft_consensus.cc:606] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 [term 1 LEADER]: Received request to transfer leadership to TS fbaeeb68dadd4c69a96dbc88b2b1507e
I20260709 12:22:18.075752 10085 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82ecf8b74e41485a977d82e0801b276d"
dest_uuid: "8d19ed551837428eac56733d1ca5ce23"
mode: GRACEFUL
new_leader_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
 from {username='slave'} at 127.0.0.1:54878
I20260709 12:22:18.076229 10085 raft_consensus.cc:606] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [term 2 LEADER]: Received request to transfer leadership to TS fbaeeb68dadd4c69a96dbc88b2b1507e
I20260709 12:22:18.259729 10279 raft_consensus.cc:993] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86: : Instructing follower fbaeeb68dadd4c69a96dbc88b2b1507e to start an election
I20260709 12:22:18.260337 10278 raft_consensus.cc:1081] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [term 2 LEADER]: Signalling peer fbaeeb68dadd4c69a96dbc88b2b1507e to start an election
I20260709 12:22:18.262120 10010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d4d6d86011e48c6ad195acd1ba7ce87"
dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
 from {username='slave'} at 127.0.0.1:37946
I20260709 12:22:18.262573 10010 raft_consensus.cc:493] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:18.262847 10010 raft_consensus.cc:3060] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:18.267539 10010 raft_consensus.cc:515] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:18.269775 10010 leader_election.cc:290] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 3 election: Requested vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059)
I20260709 12:22:18.270901 10085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4d6d86011e48c6ad195acd1ba7ce87" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8d19ed551837428eac56733d1ca5ce23"
I20260709 12:22:18.270699  9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4d6d86011e48c6ad195acd1ba7ce87" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "82a49120848b44bda3940155093e8f86"
I20260709 12:22:18.271534 10085 raft_consensus.cc:3060] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:18.271603  9935 raft_consensus.cc:3055] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:18.271973  9935 raft_consensus.cc:740] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 82a49120848b44bda3940155093e8f86, State: Running, Role: LEADER
I20260709 12:22:18.272861  9935 consensus_queue.cc:260] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:18.274209  9935 raft_consensus.cc:3060] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:18.278409 10085 raft_consensus.cc:2468] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbaeeb68dadd4c69a96dbc88b2b1507e in term 3.
I20260709 12:22:18.279829  9976 leader_election.cc:304] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d19ed551837428eac56733d1ca5ce23, fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 
I20260709 12:22:18.280609 10284 raft_consensus.cc:2804] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:18.280690  9935 raft_consensus.cc:2468] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbaeeb68dadd4c69a96dbc88b2b1507e in term 3.
I20260709 12:22:18.281029 10284 raft_consensus.cc:697] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 LEADER]: Becoming Leader. State: Replica: fbaeeb68dadd4c69a96dbc88b2b1507e, State: Running, Role: LEADER
I20260709 12:22:18.282050 10284 consensus_queue.cc:237] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:18.291338  9829 catalog_manager.cc:5697] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e reported cstate change: term changed from 2 to 3, leader changed from 82a49120848b44bda3940155093e8f86 (127.9.145.193) to fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194). New cstate: current_term: 3 leader_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:18.398128 10279 raft_consensus.cc:993] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86: : Instructing follower fbaeeb68dadd4c69a96dbc88b2b1507e to start an election
I20260709 12:22:18.398592 10278 raft_consensus.cc:1081] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 [term 2 LEADER]: Signalling peer fbaeeb68dadd4c69a96dbc88b2b1507e to start an election
I20260709 12:22:18.400071 10010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c1463f2c68c44829df48142a9dc4e23"
dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
 from {username='slave'} at 127.0.0.1:37946
I20260709 12:22:18.400507 10010 raft_consensus.cc:493] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:18.400805 10010 raft_consensus.cc:3060] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:18.404986 10010 raft_consensus.cc:515] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:18.406625 10010 leader_election.cc:290] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 3 election: Requested vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059)
I20260709 12:22:18.407470  9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1463f2c68c44829df48142a9dc4e23" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "82a49120848b44bda3940155093e8f86"
I20260709 12:22:18.407582 10085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1463f2c68c44829df48142a9dc4e23" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8d19ed551837428eac56733d1ca5ce23"
I20260709 12:22:18.408136  9935 raft_consensus.cc:3055] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:18.408176 10085 raft_consensus.cc:3060] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:18.408617  9935 raft_consensus.cc:740] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 82a49120848b44bda3940155093e8f86, State: Running, Role: LEADER
I20260709 12:22:18.409338  9935 consensus_queue.cc:260] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:18.410295  9935 raft_consensus.cc:3060] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:18.412741 10085 raft_consensus.cc:2468] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbaeeb68dadd4c69a96dbc88b2b1507e in term 3.
I20260709 12:22:18.413712  9976 leader_election.cc:304] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d19ed551837428eac56733d1ca5ce23, fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 
I20260709 12:22:18.414393 10284 raft_consensus.cc:2804] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:18.414880 10284 raft_consensus.cc:697] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 LEADER]: Becoming Leader. State: Replica: fbaeeb68dadd4c69a96dbc88b2b1507e, State: Running, Role: LEADER
I20260709 12:22:18.415181  9935 raft_consensus.cc:2468] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbaeeb68dadd4c69a96dbc88b2b1507e in term 3.
I20260709 12:22:18.415812 10284 consensus_queue.cc:237] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:18.420184 10268 raft_consensus.cc:993] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23: : Instructing follower fbaeeb68dadd4c69a96dbc88b2b1507e to start an election
I20260709 12:22:18.420760 10283 raft_consensus.cc:1081] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [term 2 LEADER]: Signalling peer fbaeeb68dadd4c69a96dbc88b2b1507e to start an election
I20260709 12:22:18.422169 10010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82ecf8b74e41485a977d82e0801b276d"
dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
 from {username='slave'} at 127.0.0.1:37958
I20260709 12:22:18.422598 10010 raft_consensus.cc:493] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:18.422857 10010 raft_consensus.cc:3060] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:18.423367  9829 catalog_manager.cc:5697] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e reported cstate change: term changed from 2 to 3, leader changed from 82a49120848b44bda3940155093e8f86 (127.9.145.193) to fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194). New cstate: current_term: 3 leader_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:18.427909 10010 raft_consensus.cc:515] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:18.429558 10010 leader_election.cc:290] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 3 election: Requested vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059)
I20260709 12:22:18.430401  9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ecf8b74e41485a977d82e0801b276d" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "82a49120848b44bda3940155093e8f86"
I20260709 12:22:18.430588 10085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ecf8b74e41485a977d82e0801b276d" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8d19ed551837428eac56733d1ca5ce23"
I20260709 12:22:18.431056  9935 raft_consensus.cc:3060] T 82ecf8b74e41485a977d82e0801b276d P 82a49120848b44bda3940155093e8f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:18.431136 10085 raft_consensus.cc:3055] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:18.431550 10085 raft_consensus.cc:740] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d19ed551837428eac56733d1ca5ce23, State: Running, Role: LEADER
I20260709 12:22:18.432293 10085 consensus_queue.cc:260] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:18.433270 10085 raft_consensus.cc:3060] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:18.437019  9935 raft_consensus.cc:2468] T 82ecf8b74e41485a977d82e0801b276d P 82a49120848b44bda3940155093e8f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbaeeb68dadd4c69a96dbc88b2b1507e in term 3.
I20260709 12:22:18.437952  9976 leader_election.cc:304] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82a49120848b44bda3940155093e8f86, fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 
I20260709 12:22:18.438620 10284 raft_consensus.cc:2804] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:18.438835 10085 raft_consensus.cc:2468] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbaeeb68dadd4c69a96dbc88b2b1507e in term 3.
I20260709 12:22:18.439110 10284 raft_consensus.cc:697] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 LEADER]: Becoming Leader. State: Replica: fbaeeb68dadd4c69a96dbc88b2b1507e, State: Running, Role: LEADER
I20260709 12:22:18.440035 10284 consensus_queue.cc:237] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:18.446647  9829 catalog_manager.cc:5697] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e reported cstate change: term changed from 2 to 3, leader changed from 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195) to fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194). New cstate: current_term: 3 leader_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:18.573254 10268 raft_consensus.cc:993] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23: : Instructing follower fbaeeb68dadd4c69a96dbc88b2b1507e to start an election
I20260709 12:22:18.573650 10283 raft_consensus.cc:1081] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [term 2 LEADER]: Signalling peer fbaeeb68dadd4c69a96dbc88b2b1507e to start an election
I20260709 12:22:18.575168 10010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6aa0aa5fbe02488b8a62e6a40038d912"
dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
 from {username='slave'} at 127.0.0.1:37958
I20260709 12:22:18.575683 10010 raft_consensus.cc:493] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:18.575975 10010 raft_consensus.cc:3060] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:18.580266 10010 raft_consensus.cc:515] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } }
I20260709 12:22:18.581616 10010 leader_election.cc:290] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 3 election: Requested vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059)
I20260709 12:22:18.582598 10085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa0aa5fbe02488b8a62e6a40038d912" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8d19ed551837428eac56733d1ca5ce23"
I20260709 12:22:18.582533  9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa0aa5fbe02488b8a62e6a40038d912" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "82a49120848b44bda3940155093e8f86"
I20260709 12:22:18.583254 10085 raft_consensus.cc:3055] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:18.583315  9935 raft_consensus.cc:3060] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:18.583674 10085 raft_consensus.cc:740] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d19ed551837428eac56733d1ca5ce23, State: Running, Role: LEADER
I20260709 12:22:18.584434 10085 consensus_queue.cc:260] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } }
I20260709 12:22:18.585567 10085 raft_consensus.cc:3060] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:18.590451  9935 raft_consensus.cc:2468] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbaeeb68dadd4c69a96dbc88b2b1507e in term 3.
I20260709 12:22:18.591636 10085 raft_consensus.cc:2468] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbaeeb68dadd4c69a96dbc88b2b1507e in term 3.
I20260709 12:22:18.591667  9976 leader_election.cc:304] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82a49120848b44bda3940155093e8f86, fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 
I20260709 12:22:18.592584 10274 raft_consensus.cc:2804] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:18.593073 10274 raft_consensus.cc:697] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 LEADER]: Becoming Leader. State: Replica: fbaeeb68dadd4c69a96dbc88b2b1507e, State: Running, Role: LEADER
I20260709 12:22:18.593844 10274 consensus_queue.cc:237] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } }
I20260709 12:22:18.600178  9829 catalog_manager.cc:5697] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e reported cstate change: term changed from 2 to 3, leader changed from 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195) to fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194). New cstate: current_term: 3 leader_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:18.615887 10279 raft_consensus.cc:993] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86: : Instructing follower fbaeeb68dadd4c69a96dbc88b2b1507e to start an election
I20260709 12:22:18.616308 10278 raft_consensus.cc:1081] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 [term 1 LEADER]: Signalling peer fbaeeb68dadd4c69a96dbc88b2b1507e to start an election
I20260709 12:22:18.617633 10010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f4115ad9f0b4f9ca0eb5b0ae157e4ca"
dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
 from {username='slave'} at 127.0.0.1:37946
I20260709 12:22:18.618059 10010 raft_consensus.cc:493] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:18.618376 10010 raft_consensus.cc:3060] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:18.622967 10010 raft_consensus.cc:515] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:18.624497 10010 leader_election.cc:290] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 2 election: Requested vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059)
I20260709 12:22:18.625154  9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f4115ad9f0b4f9ca0eb5b0ae157e4ca" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "82a49120848b44bda3940155093e8f86"
I20260709 12:22:18.625368 10085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f4115ad9f0b4f9ca0eb5b0ae157e4ca" candidate_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8d19ed551837428eac56733d1ca5ce23"
I20260709 12:22:18.625765  9935 raft_consensus.cc:3055] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:18.625865 10085 raft_consensus.cc:3060] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 8d19ed551837428eac56733d1ca5ce23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:18.626055  9935 raft_consensus.cc:740] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 82a49120848b44bda3940155093e8f86, State: Running, Role: LEADER
I20260709 12:22:18.626814  9935 consensus_queue.cc:260] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:18.627717  9935 raft_consensus.cc:3060] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:18.630239 10085 raft_consensus.cc:2468] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 8d19ed551837428eac56733d1ca5ce23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbaeeb68dadd4c69a96dbc88b2b1507e in term 2.
I20260709 12:22:18.631219  9976 leader_election.cc:304] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P fbaeeb68dadd4c69a96dbc88b2b1507e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d19ed551837428eac56733d1ca5ce23, fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 
I20260709 12:22:18.632010 10274 raft_consensus.cc:2804] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:18.632372 10274 raft_consensus.cc:697] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 LEADER]: Becoming Leader. State: Replica: fbaeeb68dadd4c69a96dbc88b2b1507e, State: Running, Role: LEADER
I20260709 12:22:18.632642  9935 raft_consensus.cc:2468] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbaeeb68dadd4c69a96dbc88b2b1507e in term 2.
I20260709 12:22:18.633128 10274 consensus_queue.cc:237] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P fbaeeb68dadd4c69a96dbc88b2b1507e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
W20260709 12:22:18.635828  9956 debug-util.cc:398] Leaking SignalData structure 0x7b08000e7060 after lost signal to thread 9802
W20260709 12:22:18.636684  9956 debug-util.cc:398] Leaking SignalData structure 0x7b08000e7740 after lost signal to thread 9866
W20260709 12:22:18.637470  9956 debug-util.cc:398] Leaking SignalData structure 0x7b08001e7ec0 after lost signal to thread 9959
W20260709 12:22:18.638201  9956 debug-util.cc:398] Leaking SignalData structure 0x7b0800196960 after lost signal to thread 10035
W20260709 12:22:18.638986  9956 debug-util.cc:398] Leaking SignalData structure 0x7b0800198ea0 after lost signal to thread 10109
I20260709 12:22:18.640516  9829 catalog_manager.cc:5697] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P fbaeeb68dadd4c69a96dbc88b2b1507e reported cstate change: term changed from 1 to 2, leader changed from 82a49120848b44bda3940155093e8f86 (127.9.145.193) to fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194). New cstate: current_term: 2 leader_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:18.812718 10085 raft_consensus.cc:1275] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [term 3 FOLLOWER]: Refusing update from remote peer fbaeeb68dadd4c69a96dbc88b2b1507e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:18.814227 10274 consensus_queue.cc:1048] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:18.838310  9935 raft_consensus.cc:1275] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 [term 3 FOLLOWER]: Refusing update from remote peer fbaeeb68dadd4c69a96dbc88b2b1507e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:18.841051 10297 consensus_queue.cc:1048] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:18.852223  9934 raft_consensus.cc:1275] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [term 3 FOLLOWER]: Refusing update from remote peer fbaeeb68dadd4c69a96dbc88b2b1507e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:18.855852 10298 consensus_queue.cc:1048] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:18.869915 10085 raft_consensus.cc:1275] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [term 3 FOLLOWER]: Refusing update from remote peer fbaeeb68dadd4c69a96dbc88b2b1507e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:18.871469 10274 consensus_queue.cc:1048] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:18.943671  9934 raft_consensus.cc:1275] T 82ecf8b74e41485a977d82e0801b276d P 82a49120848b44bda3940155093e8f86 [term 3 FOLLOWER]: Refusing update from remote peer fbaeeb68dadd4c69a96dbc88b2b1507e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:18.944972 10274 consensus_queue.cc:1048] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:18.955801 10085 raft_consensus.cc:1275] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [term 3 FOLLOWER]: Refusing update from remote peer fbaeeb68dadd4c69a96dbc88b2b1507e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:18.957731 10274 consensus_queue.cc:1048] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:19.013659 10084 raft_consensus.cc:1275] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [term 3 FOLLOWER]: Refusing update from remote peer fbaeeb68dadd4c69a96dbc88b2b1507e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:19.015107 10297 consensus_queue.cc:1048] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:19.027280  9934 raft_consensus.cc:1275] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [term 3 FOLLOWER]: Refusing update from remote peer fbaeeb68dadd4c69a96dbc88b2b1507e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:19.028787 10274 consensus_queue.cc:1048] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:19.110620 10084 raft_consensus.cc:1275] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 8d19ed551837428eac56733d1ca5ce23 [term 2 FOLLOWER]: Refusing update from remote peer fbaeeb68dadd4c69a96dbc88b2b1507e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:19.112321 10274 consensus_queue.cc:1048] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P fbaeeb68dadd4c69a96dbc88b2b1507e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:19.123211  9934 raft_consensus.cc:1275] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 [term 2 FOLLOWER]: Refusing update from remote peer fbaeeb68dadd4c69a96dbc88b2b1507e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:19.124887 10284 consensus_queue.cc:1048] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P fbaeeb68dadd4c69a96dbc88b2b1507e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:21.109823  9799 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:22:21.110654  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:21.117743 10010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3684752ed7ac4ca8a2c549f530aaa3cc"
dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
mode: GRACEFUL
new_leader_uuid: "82a49120848b44bda3940155093e8f86"
 from {username='slave'} at 127.0.0.1:37962
I20260709 12:22:21.118602 10010 raft_consensus.cc:606] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 LEADER]: Received request to transfer leadership to TS 82a49120848b44bda3940155093e8f86
I20260709 12:22:21.121301 10010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6aa0aa5fbe02488b8a62e6a40038d912"
dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
mode: GRACEFUL
new_leader_uuid: "82a49120848b44bda3940155093e8f86"
 from {username='slave'} at 127.0.0.1:37962
I20260709 12:22:21.121757 10010 raft_consensus.cc:606] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 LEADER]: Received request to transfer leadership to TS 82a49120848b44bda3940155093e8f86
I20260709 12:22:21.123904 10010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82ecf8b74e41485a977d82e0801b276d"
dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
mode: GRACEFUL
new_leader_uuid: "8d19ed551837428eac56733d1ca5ce23"
 from {username='slave'} at 127.0.0.1:37962
I20260709 12:22:21.124361 10010 raft_consensus.cc:606] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 LEADER]: Received request to transfer leadership to TS 8d19ed551837428eac56733d1ca5ce23
I20260709 12:22:21.126595 10010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d4d6d86011e48c6ad195acd1ba7ce87"
dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
mode: GRACEFUL
new_leader_uuid: "82a49120848b44bda3940155093e8f86"
 from {username='slave'} at 127.0.0.1:37962
I20260709 12:22:21.127048 10010 raft_consensus.cc:606] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 LEADER]: Received request to transfer leadership to TS 82a49120848b44bda3940155093e8f86
I20260709 12:22:21.129259 10010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c1463f2c68c44829df48142a9dc4e23"
dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
mode: GRACEFUL
new_leader_uuid: "8d19ed551837428eac56733d1ca5ce23"
 from {username='slave'} at 127.0.0.1:37962
I20260709 12:22:21.129683 10010 raft_consensus.cc:606] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 LEADER]: Received request to transfer leadership to TS 8d19ed551837428eac56733d1ca5ce23
I20260709 12:22:21.130671  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:21.131086  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:21.221179 10310 raft_consensus.cc:993] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e: : Instructing follower 8d19ed551837428eac56733d1ca5ce23 to start an election
I20260709 12:22:21.221668 10298 raft_consensus.cc:1081] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 LEADER]: Signalling peer 8d19ed551837428eac56733d1ca5ce23 to start an election
I20260709 12:22:21.223265 10084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82ecf8b74e41485a977d82e0801b276d"
dest_uuid: "8d19ed551837428eac56733d1ca5ce23"
 from {username='slave'} at 127.0.0.1:54860
I20260709 12:22:21.223752 10084 raft_consensus.cc:493] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:21.224052 10084 raft_consensus.cc:3060] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:21.229338 10084 raft_consensus.cc:515] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:21.231391 10084 leader_election.cc:290] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 4 election: Requested vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897)
I20260709 12:22:21.232435 10010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ecf8b74e41485a977d82e0801b276d" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
I20260709 12:22:21.232514  9934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ecf8b74e41485a977d82e0801b276d" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "82a49120848b44bda3940155093e8f86"
I20260709 12:22:21.233153 10010 raft_consensus.cc:3055] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:21.233229  9934 raft_consensus.cc:3060] T 82ecf8b74e41485a977d82e0801b276d P 82a49120848b44bda3940155093e8f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:21.233408 10010 raft_consensus.cc:740] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fbaeeb68dadd4c69a96dbc88b2b1507e, State: Running, Role: LEADER
I20260709 12:22:21.234150 10010 consensus_queue.cc:260] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:21.235069 10010 raft_consensus.cc:3060] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:21.238265  9934 raft_consensus.cc:2468] T 82ecf8b74e41485a977d82e0801b276d P 82a49120848b44bda3940155093e8f86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d19ed551837428eac56733d1ca5ce23 in term 4.
I20260709 12:22:21.239450 10051 leader_election.cc:304] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82a49120848b44bda3940155093e8f86, 8d19ed551837428eac56733d1ca5ce23; no voters: 
I20260709 12:22:21.239884 10010 raft_consensus.cc:2468] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d19ed551837428eac56733d1ca5ce23 in term 4.
I20260709 12:22:21.240275 10283 raft_consensus.cc:2804] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:21.241328 10283 raft_consensus.cc:697] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [term 4 LEADER]: Becoming Leader. State: Replica: 8d19ed551837428eac56733d1ca5ce23, State: Running, Role: LEADER
I20260709 12:22:21.242282 10283 consensus_queue.cc:237] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:21.249150  9829 catalog_manager.cc:5697] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 reported cstate change: term changed from 3 to 4, leader changed from fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194) to 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195). New cstate: current_term: 4 leader_uuid: "8d19ed551837428eac56733d1ca5ce23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:21.406443 10298 raft_consensus.cc:993] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e: : Instructing follower 8d19ed551837428eac56733d1ca5ce23 to start an election
I20260709 12:22:21.407071 10317 raft_consensus.cc:1081] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 LEADER]: Signalling peer 8d19ed551837428eac56733d1ca5ce23 to start an election
I20260709 12:22:21.407902 10310 raft_consensus.cc:993] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e: : Instructing follower 82a49120848b44bda3940155093e8f86 to start an election
I20260709 12:22:21.408317 10298 raft_consensus.cc:1081] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 LEADER]: Signalling peer 82a49120848b44bda3940155093e8f86 to start an election
I20260709 12:22:21.408625 10084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c1463f2c68c44829df48142a9dc4e23"
dest_uuid: "8d19ed551837428eac56733d1ca5ce23"
 from {username='slave'} at 127.0.0.1:54860
I20260709 12:22:21.409075 10084 raft_consensus.cc:493] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:21.409332 10084 raft_consensus.cc:3060] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:21.409685  9934 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3684752ed7ac4ca8a2c549f530aaa3cc"
dest_uuid: "82a49120848b44bda3940155093e8f86"
 from {username='slave'} at 127.0.0.1:41922
I20260709 12:22:21.410149  9934 raft_consensus.cc:493] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:21.410411  9934 raft_consensus.cc:3060] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:21.413789 10084 raft_consensus.cc:515] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:21.414562  9934 raft_consensus.cc:515] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:21.415350 10084 leader_election.cc:290] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 4 election: Requested vote from peers 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957), fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897)
I20260709 12:22:21.416353 10010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1463f2c68c44829df48142a9dc4e23" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
I20260709 12:22:21.416740  9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1463f2c68c44829df48142a9dc4e23" candidate_uuid: "8d19ed551837428eac56733d1ca5ce23" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "82a49120848b44bda3940155093e8f86"
I20260709 12:22:21.416914 10010 raft_consensus.cc:3055] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:21.417304 10010 raft_consensus.cc:740] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fbaeeb68dadd4c69a96dbc88b2b1507e, State: Running, Role: LEADER
I20260709 12:22:21.417388  9935 raft_consensus.cc:3060] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:21.417846 10009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3684752ed7ac4ca8a2c549f530aaa3cc" candidate_uuid: "82a49120848b44bda3940155093e8f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
I20260709 12:22:21.418252  9934 leader_election.cc:290] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 3 election: Requested vote from peers fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897), 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059)
I20260709 12:22:21.418061 10010 consensus_queue.cc:260] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:21.418457 10009 raft_consensus.cc:3055] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:21.418838 10009 raft_consensus.cc:740] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fbaeeb68dadd4c69a96dbc88b2b1507e, State: Running, Role: LEADER
I20260709 12:22:21.419212 10010 raft_consensus.cc:3060] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:21.419675 10009 consensus_queue.cc:260] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:21.420918 10009 raft_consensus.cc:3060] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:21.423602 10010 raft_consensus.cc:2468] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d19ed551837428eac56733d1ca5ce23 in term 4.
I20260709 12:22:21.424721 10048 leader_election.cc:304] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d19ed551837428eac56733d1ca5ce23, fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 
I20260709 12:22:21.424805  9935 raft_consensus.cc:2468] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d19ed551837428eac56733d1ca5ce23 in term 4.
I20260709 12:22:21.425582 10283 raft_consensus.cc:2804] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:21.426083 10283 raft_consensus.cc:697] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [term 4 LEADER]: Becoming Leader. State: Replica: 8d19ed551837428eac56733d1ca5ce23, State: Running, Role: LEADER
I20260709 12:22:21.426323 10084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3684752ed7ac4ca8a2c549f530aaa3cc" candidate_uuid: "82a49120848b44bda3940155093e8f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "8d19ed551837428eac56733d1ca5ce23"
I20260709 12:22:21.426926 10084 raft_consensus.cc:3060] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:21.426963 10283 consensus_queue.cc:237] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:21.429391 10009 raft_consensus.cc:2468] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a49120848b44bda3940155093e8f86 in term 3.
I20260709 12:22:21.430920  9898 leader_election.cc:304] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82a49120848b44bda3940155093e8f86, fbaeeb68dadd4c69a96dbc88b2b1507e; no voters: 
I20260709 12:22:21.433657 10319 raft_consensus.cc:2804] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:21.434374 10084 raft_consensus.cc:2468] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a49120848b44bda3940155093e8f86 in term 3.
I20260709 12:22:21.435228  9829 catalog_manager.cc:5697] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 reported cstate change: term changed from 3 to 4, leader changed from fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194) to 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195). New cstate: current_term: 4 leader_uuid: "8d19ed551837428eac56733d1ca5ce23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:21.437098 10298 raft_consensus.cc:993] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e: : Instructing follower 82a49120848b44bda3940155093e8f86 to start an election
I20260709 12:22:21.437609 10317 raft_consensus.cc:1081] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 LEADER]: Signalling peer 82a49120848b44bda3940155093e8f86 to start an election
I20260709 12:22:21.438171 10319 raft_consensus.cc:697] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86 [term 3 LEADER]: Becoming Leader. State: Replica: 82a49120848b44bda3940155093e8f86, State: Running, Role: LEADER
I20260709 12:22:21.438946 10319 consensus_queue.cc:237] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:21.441018  9935 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d4d6d86011e48c6ad195acd1ba7ce87"
dest_uuid: "82a49120848b44bda3940155093e8f86"
 from {username='slave'} at 127.0.0.1:41922
I20260709 12:22:21.441653  9935 raft_consensus.cc:493] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:21.442070  9935 raft_consensus.cc:3060] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:21.447602  9829 catalog_manager.cc:5697] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86 reported cstate change: term changed from 2 to 3, leader changed from fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194) to 82a49120848b44bda3940155093e8f86 (127.9.145.193). New cstate: current_term: 3 leader_uuid: "82a49120848b44bda3940155093e8f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:21.449456  9935 raft_consensus.cc:515] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:21.451404  9935 leader_election.cc:290] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 4 election: Requested vote from peers fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897), 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059)
I20260709 12:22:21.452325 10009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4d6d86011e48c6ad195acd1ba7ce87" candidate_uuid: "82a49120848b44bda3940155093e8f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
I20260709 12:22:21.452494 10084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4d6d86011e48c6ad195acd1ba7ce87" candidate_uuid: "82a49120848b44bda3940155093e8f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8d19ed551837428eac56733d1ca5ce23"
I20260709 12:22:21.452958 10084 raft_consensus.cc:3060] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:21.452900 10009 raft_consensus.cc:3055] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:21.453408 10009 raft_consensus.cc:740] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fbaeeb68dadd4c69a96dbc88b2b1507e, State: Running, Role: LEADER
I20260709 12:22:21.454227 10009 consensus_queue.cc:260] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:21.455463 10009 raft_consensus.cc:3060] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:21.458045 10084 raft_consensus.cc:2468] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a49120848b44bda3940155093e8f86 in term 4.
I20260709 12:22:21.459143  9901 leader_election.cc:304] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82a49120848b44bda3940155093e8f86, 8d19ed551837428eac56733d1ca5ce23; no voters: 
I20260709 12:22:21.459836 10319 raft_consensus.cc:2804] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:21.460196 10319 raft_consensus.cc:697] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [term 4 LEADER]: Becoming Leader. State: Replica: 82a49120848b44bda3940155093e8f86, State: Running, Role: LEADER
I20260709 12:22:21.461014 10009 raft_consensus.cc:2468] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a49120848b44bda3940155093e8f86 in term 4.
I20260709 12:22:21.460999 10319 consensus_queue.cc:237] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } }
I20260709 12:22:21.467770  9829 catalog_manager.cc:5697] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 reported cstate change: term changed from 3 to 4, leader changed from fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194) to 82a49120848b44bda3940155093e8f86 (127.9.145.193). New cstate: current_term: 4 leader_uuid: "82a49120848b44bda3940155093e8f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:21.512458 10298 raft_consensus.cc:993] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e: : Instructing follower 82a49120848b44bda3940155093e8f86 to start an election
I20260709 12:22:21.512893 10317 raft_consensus.cc:1081] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 LEADER]: Signalling peer 82a49120848b44bda3940155093e8f86 to start an election
I20260709 12:22:21.514371  9935 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6aa0aa5fbe02488b8a62e6a40038d912"
dest_uuid: "82a49120848b44bda3940155093e8f86"
 from {username='slave'} at 127.0.0.1:41922
I20260709 12:22:21.514854  9935 raft_consensus.cc:493] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:21.515115  9935 raft_consensus.cc:3060] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:21.519824  9935 raft_consensus.cc:515] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } }
I20260709 12:22:21.521443  9935 leader_election.cc:290] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 4 election: Requested vote from peers 8d19ed551837428eac56733d1ca5ce23 (127.9.145.195:34059), fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897)
I20260709 12:22:21.522420 10084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa0aa5fbe02488b8a62e6a40038d912" candidate_uuid: "82a49120848b44bda3940155093e8f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8d19ed551837428eac56733d1ca5ce23"
I20260709 12:22:21.522498 10009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa0aa5fbe02488b8a62e6a40038d912" candidate_uuid: "82a49120848b44bda3940155093e8f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e"
I20260709 12:22:21.523059 10084 raft_consensus.cc:3060] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:21.523133 10009 raft_consensus.cc:3055] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:21.523455 10009 raft_consensus.cc:740] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fbaeeb68dadd4c69a96dbc88b2b1507e, State: Running, Role: LEADER
I20260709 12:22:21.524144 10009 consensus_queue.cc:260] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } }
I20260709 12:22:21.525098 10009 raft_consensus.cc:3060] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:21.527555 10084 raft_consensus.cc:2468] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a49120848b44bda3940155093e8f86 in term 4.
I20260709 12:22:21.528558  9901 leader_election.cc:304] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82a49120848b44bda3940155093e8f86, 8d19ed551837428eac56733d1ca5ce23; no voters: 
I20260709 12:22:21.529273 10319 raft_consensus.cc:2804] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:21.529770 10319 raft_consensus.cc:697] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [term 4 LEADER]: Becoming Leader. State: Replica: 82a49120848b44bda3940155093e8f86, State: Running, Role: LEADER
I20260709 12:22:21.530400 10009 raft_consensus.cc:2468] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a49120848b44bda3940155093e8f86 in term 4.
I20260709 12:22:21.530669 10319 consensus_queue.cc:237] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } }
I20260709 12:22:21.537853  9829 catalog_manager.cc:5697] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 reported cstate change: term changed from 3 to 4, leader changed from fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194) to 82a49120848b44bda3940155093e8f86 (127.9.145.193). New cstate: current_term: 4 leader_uuid: "82a49120848b44bda3940155093e8f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:21.702467  9935 raft_consensus.cc:1275] T 82ecf8b74e41485a977d82e0801b276d P 82a49120848b44bda3940155093e8f86 [term 4 FOLLOWER]: Refusing update from remote peer 8d19ed551837428eac56733d1ca5ce23: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:21.703738 10283 consensus_queue.cc:1048] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:21.715022 10009 raft_consensus.cc:1275] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 4 FOLLOWER]: Refusing update from remote peer 8d19ed551837428eac56733d1ca5ce23: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:21.716770 10326 consensus_queue.cc:1048] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:21.856442 10009 raft_consensus.cc:1275] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 4 FOLLOWER]: Refusing update from remote peer 82a49120848b44bda3940155093e8f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:21.857638 10319 consensus_queue.cc:1048] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:21.867122 10084 raft_consensus.cc:1275] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [term 4 FOLLOWER]: Refusing update from remote peer 82a49120848b44bda3940155093e8f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:21.868888 10331 consensus_queue.cc:1048] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:21.924522 10084 raft_consensus.cc:1275] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [term 4 FOLLOWER]: Refusing update from remote peer 82a49120848b44bda3940155093e8f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:21.925715 10331 consensus_queue.cc:1048] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:21.934994 10010 raft_consensus.cc:1275] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 4 FOLLOWER]: Refusing update from remote peer 82a49120848b44bda3940155093e8f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:21.936535 10331 consensus_queue.cc:1048] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:21.940716  9935 raft_consensus.cc:1275] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 [term 4 FOLLOWER]: Refusing update from remote peer 8d19ed551837428eac56733d1ca5ce23: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:21.942487 10326 consensus_queue.cc:1048] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82a49120848b44bda3940155093e8f86" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:21.953488 10010 raft_consensus.cc:1275] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 4 FOLLOWER]: Refusing update from remote peer 8d19ed551837428eac56733d1ca5ce23: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:21.955677 10283 consensus_queue.cc:1048] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:21.985908 10010 raft_consensus.cc:1275] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 FOLLOWER]: Refusing update from remote peer 82a49120848b44bda3940155093e8f86: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:21.987107 10319 consensus_queue.cc:1048] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbaeeb68dadd4c69a96dbc88b2b1507e" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:21.996596 10084 raft_consensus.cc:1275] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23 [term 3 FOLLOWER]: Refusing update from remote peer 82a49120848b44bda3940155093e8f86: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:21.998565 10331 consensus_queue.cc:1048] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d19ed551837428eac56733d1ca5ce23" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:22.132223  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:22.137120  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:22.137547  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:23.138616  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:23.144459  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:23.144974  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:24.145962  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:24.150803  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:24.151181  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:25.152165  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:25.157387  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:25.157771  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:26.158766  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:26.163651  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:26.164048  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:27.165215  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:27.170190  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:27.170644  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:28.171633  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:28.177536  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:28.177965  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:29.179059  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:29.184376  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:29.184850  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:30.186058  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:30.191515  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:30.191942  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:31.222710  9799 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:22:31.223255  9799 tablet_server.cc:179] TabletServer@127.9.145.193:0 shutting down...
W20260709 12:22:31.239454  9976 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:22:31.249436  9976 consensus_peers.cc:597] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P fbaeeb68dadd4c69a96dbc88b2b1507e -> Peer 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957): Couldn't send request to peer 82a49120848b44bda3940155093e8f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:31.251874  9799 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:31.252745  9799 tablet_replica.cc:333] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86: stopping tablet replica
I20260709 12:22:31.253938  9799 raft_consensus.cc:2243] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.255069  9799 raft_consensus.cc:2272] T 3684752ed7ac4ca8a2c549f530aaa3cc P 82a49120848b44bda3940155093e8f86 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.257625  9799 tablet_replica.cc:333] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86: stopping tablet replica
I20260709 12:22:31.258213  9799 raft_consensus.cc:2243] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.258663  9799 raft_consensus.cc:2272] T 85cb505e935e4789a576c1004547f6c2 P 82a49120848b44bda3940155093e8f86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.260483  9799 tablet_replica.cc:333] T 82ecf8b74e41485a977d82e0801b276d P 82a49120848b44bda3940155093e8f86: stopping tablet replica
I20260709 12:22:31.260974  9799 raft_consensus.cc:2243] T 82ecf8b74e41485a977d82e0801b276d P 82a49120848b44bda3940155093e8f86 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.261469  9799 raft_consensus.cc:2272] T 82ecf8b74e41485a977d82e0801b276d P 82a49120848b44bda3940155093e8f86 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.263350  9799 tablet_replica.cc:333] T 8be8e2238b7c4097a4c787eb91279601 P 82a49120848b44bda3940155093e8f86: stopping tablet replica
I20260709 12:22:31.263862  9799 raft_consensus.cc:2243] T 8be8e2238b7c4097a4c787eb91279601 P 82a49120848b44bda3940155093e8f86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.264256  9799 raft_consensus.cc:2272] T 8be8e2238b7c4097a4c787eb91279601 P 82a49120848b44bda3940155093e8f86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.265916  9799 tablet_replica.cc:333] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86: stopping tablet replica
I20260709 12:22:31.266635  9799 raft_consensus.cc:2243] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.267704  9799 raft_consensus.cc:2272] T 6aa0aa5fbe02488b8a62e6a40038d912 P 82a49120848b44bda3940155093e8f86 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.270215  9799 tablet_replica.cc:333] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86: stopping tablet replica
I20260709 12:22:31.270879  9799 raft_consensus.cc:2243] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.271351  9799 raft_consensus.cc:2272] T 25e260872eeb455d95f2b95dd0b933e3 P 82a49120848b44bda3940155093e8f86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.273583  9799 tablet_replica.cc:333] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86: stopping tablet replica
I20260709 12:22:31.274307  9799 raft_consensus.cc:2243] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.275341  9799 raft_consensus.cc:2272] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 82a49120848b44bda3940155093e8f86 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.277187  9799 tablet_replica.cc:333] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86: stopping tablet replica
I20260709 12:22:31.277704  9799 raft_consensus.cc:2243] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.278168  9799 raft_consensus.cc:2272] T 9c1463f2c68c44829df48142a9dc4e23 P 82a49120848b44bda3940155093e8f86 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.279759  9799 tablet_replica.cc:333] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86: stopping tablet replica
I20260709 12:22:31.280207  9799 raft_consensus.cc:2243] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.280625  9799 raft_consensus.cc:2272] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 82a49120848b44bda3940155093e8f86 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:31.374173 10051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:35957, user_credentials={real_user=slave}} blocked reactor thread for 74611.7us
W20260709 12:22:31.377470 10051 consensus_peers.cc:597] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 -> Peer 82a49120848b44bda3940155093e8f86 (127.9.145.193:35957): Couldn't send request to peer 82a49120848b44bda3940155093e8f86. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35957: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:31.394089  9799 tablet_server.cc:196] TabletServer@127.9.145.193:0 shutdown complete.
I20260709 12:22:31.413403  9799 tablet_server.cc:179] TabletServer@127.9.145.194:0 shutting down...
I20260709 12:22:31.438174  9799 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:31.438783  9799 tablet_replica.cc:333] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e: stopping tablet replica
I20260709 12:22:31.439419  9799 raft_consensus.cc:2243] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.439939  9799 raft_consensus.cc:2272] T 82ecf8b74e41485a977d82e0801b276d P fbaeeb68dadd4c69a96dbc88b2b1507e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.441916  9799 tablet_replica.cc:333] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e: stopping tablet replica
I20260709 12:22:31.442544  9799 raft_consensus.cc:2243] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.442965  9799 raft_consensus.cc:2272] T 3684752ed7ac4ca8a2c549f530aaa3cc P fbaeeb68dadd4c69a96dbc88b2b1507e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.444900  9799 tablet_replica.cc:333] T 25e260872eeb455d95f2b95dd0b933e3 P fbaeeb68dadd4c69a96dbc88b2b1507e: stopping tablet replica
I20260709 12:22:31.445459  9799 raft_consensus.cc:2243] T 25e260872eeb455d95f2b95dd0b933e3 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.445950  9799 raft_consensus.cc:2272] T 25e260872eeb455d95f2b95dd0b933e3 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:31.446164 10048 consensus_peers.cc:597] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 -> Peer fbaeeb68dadd4c69a96dbc88b2b1507e (127.9.145.194:44897): Couldn't send request to peer fbaeeb68dadd4c69a96dbc88b2b1507e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:31.447639  9799 tablet_replica.cc:333] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P fbaeeb68dadd4c69a96dbc88b2b1507e: stopping tablet replica
I20260709 12:22:31.448182  9799 raft_consensus.cc:2243] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.448987  9799 raft_consensus.cc:2272] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.450744  9799 tablet_replica.cc:333] T 8be8e2238b7c4097a4c787eb91279601 P fbaeeb68dadd4c69a96dbc88b2b1507e: stopping tablet replica
I20260709 12:22:31.451218  9799 raft_consensus.cc:2243] T 8be8e2238b7c4097a4c787eb91279601 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.451936  9799 raft_consensus.cc:2272] T 8be8e2238b7c4097a4c787eb91279601 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.453645  9799 tablet_replica.cc:333] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e: stopping tablet replica
I20260709 12:22:31.454228  9799 raft_consensus.cc:2243] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.454643  9799 raft_consensus.cc:2272] T 6aa0aa5fbe02488b8a62e6a40038d912 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.456257  9799 tablet_replica.cc:333] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e: stopping tablet replica
I20260709 12:22:31.456705  9799 raft_consensus.cc:2243] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.457494  9799 raft_consensus.cc:2272] T 85cb505e935e4789a576c1004547f6c2 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.459179  9799 tablet_replica.cc:333] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e: stopping tablet replica
I20260709 12:22:31.459609  9799 raft_consensus.cc:2243] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.459997  9799 raft_consensus.cc:2272] T 8d4d6d86011e48c6ad195acd1ba7ce87 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.461548  9799 tablet_replica.cc:333] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e: stopping tablet replica
I20260709 12:22:31.461951  9799 raft_consensus.cc:2243] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.462366  9799 raft_consensus.cc:2272] T 9c1463f2c68c44829df48142a9dc4e23 P fbaeeb68dadd4c69a96dbc88b2b1507e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.490583  9799 tablet_server.cc:196] TabletServer@127.9.145.194:0 shutdown complete.
I20260709 12:22:31.508229  9799 tablet_server.cc:179] TabletServer@127.9.145.195:0 shutting down...
I20260709 12:22:31.531261  9799 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:31.531984  9799 tablet_replica.cc:333] T 25e260872eeb455d95f2b95dd0b933e3 P 8d19ed551837428eac56733d1ca5ce23: stopping tablet replica
I20260709 12:22:31.532621  9799 raft_consensus.cc:2243] T 25e260872eeb455d95f2b95dd0b933e3 P 8d19ed551837428eac56733d1ca5ce23 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.533393  9799 raft_consensus.cc:2272] T 25e260872eeb455d95f2b95dd0b933e3 P 8d19ed551837428eac56733d1ca5ce23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.535037  9799 tablet_replica.cc:333] T 85cb505e935e4789a576c1004547f6c2 P 8d19ed551837428eac56733d1ca5ce23: stopping tablet replica
I20260709 12:22:31.535545  9799 raft_consensus.cc:2243] T 85cb505e935e4789a576c1004547f6c2 P 8d19ed551837428eac56733d1ca5ce23 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.535943  9799 raft_consensus.cc:2272] T 85cb505e935e4789a576c1004547f6c2 P 8d19ed551837428eac56733d1ca5ce23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.537499  9799 tablet_replica.cc:333] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 8d19ed551837428eac56733d1ca5ce23: stopping tablet replica
I20260709 12:22:31.537979  9799 raft_consensus.cc:2243] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 8d19ed551837428eac56733d1ca5ce23 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.538434  9799 raft_consensus.cc:2272] T 4f4115ad9f0b4f9ca0eb5b0ae157e4ca P 8d19ed551837428eac56733d1ca5ce23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.540014  9799 tablet_replica.cc:333] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23: stopping tablet replica
I20260709 12:22:31.540484  9799 raft_consensus.cc:2243] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.540928  9799 raft_consensus.cc:2272] T 6aa0aa5fbe02488b8a62e6a40038d912 P 8d19ed551837428eac56733d1ca5ce23 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.542665  9799 tablet_replica.cc:333] T 8be8e2238b7c4097a4c787eb91279601 P 8d19ed551837428eac56733d1ca5ce23: stopping tablet replica
I20260709 12:22:31.543119  9799 raft_consensus.cc:2243] T 8be8e2238b7c4097a4c787eb91279601 P 8d19ed551837428eac56733d1ca5ce23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.543493  9799 raft_consensus.cc:2272] T 8be8e2238b7c4097a4c787eb91279601 P 8d19ed551837428eac56733d1ca5ce23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.544992  9799 tablet_replica.cc:333] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23: stopping tablet replica
I20260709 12:22:31.545454  9799 raft_consensus.cc:2243] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.546231  9799 raft_consensus.cc:2272] T 9c1463f2c68c44829df48142a9dc4e23 P 8d19ed551837428eac56733d1ca5ce23 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.547809  9799 tablet_replica.cc:333] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23: stopping tablet replica
I20260709 12:22:31.548265  9799 raft_consensus.cc:2243] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.548696  9799 raft_consensus.cc:2272] T 8d4d6d86011e48c6ad195acd1ba7ce87 P 8d19ed551837428eac56733d1ca5ce23 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.550345  9799 tablet_replica.cc:333] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23: stopping tablet replica
I20260709 12:22:31.550794  9799 raft_consensus.cc:2243] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.551163  9799 raft_consensus.cc:2272] T 3684752ed7ac4ca8a2c549f530aaa3cc P 8d19ed551837428eac56733d1ca5ce23 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.552696  9799 tablet_replica.cc:333] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23: stopping tablet replica
I20260709 12:22:31.553133  9799 raft_consensus.cc:2243] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.553975  9799 raft_consensus.cc:2272] T 82ecf8b74e41485a977d82e0801b276d P 8d19ed551837428eac56733d1ca5ce23 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.581650  9799 tablet_server.cc:196] TabletServer@127.9.145.195:0 shutdown complete.
I20260709 12:22:31.600152  9799 master.cc:562] Master@127.9.145.254:39847 shutting down...
I20260709 12:22:31.747392  9799 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9847245531cf40159a35ba279d6c45ab [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.747972  9799 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9847245531cf40159a35ba279d6c45ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.748260  9799 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9847245531cf40159a35ba279d6c45ab: stopping tablet replica
I20260709 12:22:31.766908  9799 master.cc:584] Master@127.9.145.254:39847 shutdown complete.
82a49120848b44bda3940155093e8f86  4
8d19ed551837428eac56733d1ca5ce23  1
fbaeeb68dadd4c69a96dbc88b2b1507e  4
82a49120848b44bda3940155093e8f86  3
8d19ed551837428eac56733d1ca5ce23  3
fbaeeb68dadd4c69a96dbc88b2b1507e  3
82a49120848b44bda3940155093e8f86  0
8d19ed551837428eac56733d1ca5ce23  1
fbaeeb68dadd4c69a96dbc88b2b1507e  8
82a49120848b44bda3940155093e8f86  3
8d19ed551837428eac56733d1ca5ce23  3
fbaeeb68dadd4c69a96dbc88b2b1507e  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (32156 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:22:31.805954  9799 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.145.254:39107
I20260709 12:22:31.807091  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:31.812749 10354 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:31.812736 10355 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:31.813992 10357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:31.815515  9799 server_base.cc:1061] running on GCE node
I20260709 12:22:31.816447  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:31.816620  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:31.816784  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783599751816766 us; error 0 us; skew 500 ppm
I20260709 12:22:31.817291  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:31.820502  9799 webserver.cc:533] Webserver started at http://127.9.145.254:43543/ using document root <none> and password file <none>
I20260709 12:22:31.820989  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:31.821163  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:31.821431  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:31.822618  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599719482688-9799-0/minicluster-data/master-0-root/instance:
uuid: "2eed3518a88b44068446d0be2edcfee0"
format_stamp: "Formatted at 2026-07-09 12:22:31 on dist-test-slave-1sdq"
I20260709 12:22:31.827064  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 12:22:31.830536 10362 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:31.831282  9799 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 12:22:31.831568  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599719482688-9799-0/minicluster-data/master-0-root
uuid: "2eed3518a88b44068446d0be2edcfee0"
format_stamp: "Formatted at 2026-07-09 12:22:31 on dist-test-slave-1sdq"
I20260709 12:22:31.831844  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599719482688-9799-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599719482688-9799-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599719482688-9799-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:31.847069  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:31.848323  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:31.887195  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.254:39107
I20260709 12:22:31.887377 10413 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.254:39107 every 8 connection(s)
I20260709 12:22:31.891171 10414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:31.900925 10414 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2eed3518a88b44068446d0be2edcfee0: Bootstrap starting.
I20260709 12:22:31.905516 10414 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2eed3518a88b44068446d0be2edcfee0: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.909834 10414 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2eed3518a88b44068446d0be2edcfee0: No bootstrap required, opened a new log
I20260709 12:22:31.912065 10414 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2eed3518a88b44068446d0be2edcfee0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2eed3518a88b44068446d0be2edcfee0" member_type: VOTER }
I20260709 12:22:31.912554 10414 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2eed3518a88b44068446d0be2edcfee0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.912856 10414 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2eed3518a88b44068446d0be2edcfee0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2eed3518a88b44068446d0be2edcfee0, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.913518 10414 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2eed3518a88b44068446d0be2edcfee0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2eed3518a88b44068446d0be2edcfee0" member_type: VOTER }
I20260709 12:22:31.913976 10414 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2eed3518a88b44068446d0be2edcfee0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:22:31.914193 10414 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2eed3518a88b44068446d0be2edcfee0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:22:31.914412 10414 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2eed3518a88b44068446d0be2edcfee0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.918479 10414 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2eed3518a88b44068446d0be2edcfee0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2eed3518a88b44068446d0be2edcfee0" member_type: VOTER }
I20260709 12:22:31.918987 10414 leader_election.cc:304] T 00000000000000000000000000000000 P 2eed3518a88b44068446d0be2edcfee0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2eed3518a88b44068446d0be2edcfee0; no voters: 
I20260709 12:22:31.920122 10414 leader_election.cc:290] T 00000000000000000000000000000000 P 2eed3518a88b44068446d0be2edcfee0 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:22:31.920518 10417 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2eed3518a88b44068446d0be2edcfee0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:31.921813 10417 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2eed3518a88b44068446d0be2edcfee0 [term 1 LEADER]: Becoming Leader. State: Replica: 2eed3518a88b44068446d0be2edcfee0, State: Running, Role: LEADER
I20260709 12:22:31.922500 10417 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2eed3518a88b44068446d0be2edcfee0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2eed3518a88b44068446d0be2edcfee0" member_type: VOTER }
I20260709 12:22:31.923010 10414 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2eed3518a88b44068446d0be2edcfee0 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:22:31.927428 10418 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2eed3518a88b44068446d0be2edcfee0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2eed3518a88b44068446d0be2edcfee0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2eed3518a88b44068446d0be2edcfee0" member_type: VOTER } }
I20260709 12:22:31.927637 10419 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2eed3518a88b44068446d0be2edcfee0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2eed3518a88b44068446d0be2edcfee0. Latest consensus state: current_term: 1 leader_uuid: "2eed3518a88b44068446d0be2edcfee0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2eed3518a88b44068446d0be2edcfee0" member_type: VOTER } }
I20260709 12:22:31.928251 10419 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2eed3518a88b44068446d0be2edcfee0 [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:31.927959 10418 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2eed3518a88b44068446d0be2edcfee0 [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:31.931519 10425 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:22:31.936980 10425 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:22:31.939079  9799 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:22:31.946374 10425 catalog_manager.cc:1383] Generated new cluster ID: 19c3eebaa93a4119be488ddc2df0b44d
I20260709 12:22:31.946707 10425 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:22:31.958253 10425 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:22:31.959520 10425 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:22:31.971136 10425 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2eed3518a88b44068446d0be2edcfee0: Generated new TSK 0
I20260709 12:22:31.971840 10425 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:22:32.005481  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:32.011380 10435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:32.012447 10436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:32.014475  9799 server_base.cc:1061] running on GCE node
W20260709 12:22:32.015625 10438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:32.016434  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:32.016628  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:32.016785  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783599752016768 us; error 0 us; skew 500 ppm
I20260709 12:22:32.017306  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:32.019613  9799 webserver.cc:533] Webserver started at http://127.9.145.193:45449/ using document root <none> and password file <none>
I20260709 12:22:32.020079  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:32.020247  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:32.020515  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:32.021552  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599719482688-9799-0/minicluster-data/ts-0-root/instance:
uuid: "5bc3a8e244614134a6e8d79f08217866"
format_stamp: "Formatted at 2026-07-09 12:22:32 on dist-test-slave-1sdq"
I20260709 12:22:32.026193  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:22:32.029446 10443 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:32.030206  9799 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:22:32.030515  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599719482688-9799-0/minicluster-data/ts-0-root
uuid: "5bc3a8e244614134a6e8d79f08217866"
format_stamp: "Formatted at 2026-07-09 12:22:32 on dist-test-slave-1sdq"
I20260709 12:22:32.030810  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599719482688-9799-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599719482688-9799-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599719482688-9799-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:32.044795  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:32.046041  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:32.047569  9799 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:32.049896  9799 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:32.050165  9799 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:32.050405  9799 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:32.050590  9799 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:32.089879  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.193:37839
I20260709 12:22:32.089975 10505 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.193:37839 every 8 connection(s)
I20260709 12:22:32.094676  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:32.101456 10510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:32.103165 10511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:32.105391  9799 server_base.cc:1061] running on GCE node
W20260709 12:22:32.106375 10514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:32.107251  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:32.107450  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:32.107618  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783599752107603 us; error 0 us; skew 500 ppm
I20260709 12:22:32.108165  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:32.111177  9799 webserver.cc:533] Webserver started at http://127.9.145.194:42645/ using document root <none> and password file <none>
I20260709 12:22:32.111363 10506 heartbeater.cc:344] Connected to a master server at 127.9.145.254:39107
I20260709 12:22:32.111689  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:32.111733 10506 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:32.111979  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:32.112262  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:32.112586 10506 heartbeater.cc:507] Master 127.9.145.254:39107 requested a full tablet report, sending...
I20260709 12:22:32.113561  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599719482688-9799-0/minicluster-data/ts-1-root/instance:
uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
format_stamp: "Formatted at 2026-07-09 12:22:32 on dist-test-slave-1sdq"
I20260709 12:22:32.114903 10379 ts_manager.cc:194] Registered new tserver with Master: 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193:37839)
I20260709 12:22:32.116616 10379 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41556
I20260709 12:22:32.118585  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:22:32.122284 10518 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:32.123035  9799 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:22:32.123308  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599719482688-9799-0/minicluster-data/ts-1-root
uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
format_stamp: "Formatted at 2026-07-09 12:22:32 on dist-test-slave-1sdq"
I20260709 12:22:32.123575  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599719482688-9799-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599719482688-9799-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599719482688-9799-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:32.145108  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:32.146492  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:32.147989  9799 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:32.150382  9799 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:32.150619  9799 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:32.150842  9799 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:32.150997  9799 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:32.190848  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.194:42017
I20260709 12:22:32.190956 10580 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.194:42017 every 8 connection(s)
I20260709 12:22:32.195562  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:32.202795 10584 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:32.203425 10585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:32.205879  9799 server_base.cc:1061] running on GCE node
W20260709 12:22:32.206235 10587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:32.207177  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:32.207437  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:32.207655  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783599752207635 us; error 0 us; skew 500 ppm
I20260709 12:22:32.208344  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:32.209601 10581 heartbeater.cc:344] Connected to a master server at 127.9.145.254:39107
I20260709 12:22:32.209939 10581 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:32.210690 10581 heartbeater.cc:507] Master 127.9.145.254:39107 requested a full tablet report, sending...
I20260709 12:22:32.211100  9799 webserver.cc:533] Webserver started at http://127.9.145.195:39177/ using document root <none> and password file <none>
I20260709 12:22:32.211597  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:32.211790  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:32.212139  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:32.212792 10379 ts_manager.cc:194] Registered new tserver with Master: 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017)
I20260709 12:22:32.213354  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599719482688-9799-0/minicluster-data/ts-2-root/instance:
uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
format_stamp: "Formatted at 2026-07-09 12:22:32 on dist-test-slave-1sdq"
I20260709 12:22:32.214226 10379 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41572
I20260709 12:22:32.218000  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.001s
I20260709 12:22:32.221809 10592 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:32.222748  9799 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:22:32.223047  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599719482688-9799-0/minicluster-data/ts-2-root
uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
format_stamp: "Formatted at 2026-07-09 12:22:32 on dist-test-slave-1sdq"
I20260709 12:22:32.223325  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599719482688-9799-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599719482688-9799-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599719482688-9799-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:32.235318  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:32.236519  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:32.237952  9799 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:32.240193  9799 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:32.240406  9799 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:32.240628  9799 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:32.240780  9799 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:32.280272  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.195:40107
I20260709 12:22:32.280365 10655 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.195:40107 every 8 connection(s)
I20260709 12:22:32.294898 10656 heartbeater.cc:344] Connected to a master server at 127.9.145.254:39107
I20260709 12:22:32.295284 10656 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:32.296115 10656 heartbeater.cc:507] Master 127.9.145.254:39107 requested a full tablet report, sending...
I20260709 12:22:32.298182 10379 ts_manager.cc:194] Registered new tserver with Master: 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:32.298516  9799 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015002917s
I20260709 12:22:32.299970 10379 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41574
I20260709 12:22:32.324497 10379 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41590:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:32.327536 10379 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:32.396476 10471 tablet_service.cc:1511] Processing CreateTablet for tablet 608ebe9b962e4d27b37af29ad96df0bc (DEFAULT_TABLE table=test-workload [id=11a6c4d9d2314ce4a942947dbaf0e468]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:22:32.397995 10471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608ebe9b962e4d27b37af29ad96df0bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.397956 10470 tablet_service.cc:1511] Processing CreateTablet for tablet 4e7ccaea05564aed872d76358690228f (DEFAULT_TABLE table=test-workload [id=11a6c4d9d2314ce4a942947dbaf0e468]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:22:32.398501 10467 tablet_service.cc:1511] Processing CreateTablet for tablet d263d9eb057b4c1c9903d22c36d7eeae (DEFAULT_TABLE table=test-workload [id=11a6c4d9d2314ce4a942947dbaf0e468]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:22:32.399394 10470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e7ccaea05564aed872d76358690228f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.399993 10546 tablet_service.cc:1511] Processing CreateTablet for tablet 608ebe9b962e4d27b37af29ad96df0bc (DEFAULT_TABLE table=test-workload [id=11a6c4d9d2314ce4a942947dbaf0e468]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:22:32.400794 10468 tablet_service.cc:1511] Processing CreateTablet for tablet 63b02039e698478e8b8eb6f17c6ea91c (DEFAULT_TABLE table=test-workload [id=11a6c4d9d2314ce4a942947dbaf0e468]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:22:32.401332 10546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608ebe9b962e4d27b37af29ad96df0bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.403311 10469 tablet_service.cc:1511] Processing CreateTablet for tablet be364ca393d24f51b26f766d410342f0 (DEFAULT_TABLE table=test-workload [id=11a6c4d9d2314ce4a942947dbaf0e468]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:22:32.404408 10545 tablet_service.cc:1511] Processing CreateTablet for tablet 4e7ccaea05564aed872d76358690228f (DEFAULT_TABLE table=test-workload [id=11a6c4d9d2314ce4a942947dbaf0e468]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:22:32.405126 10468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63b02039e698478e8b8eb6f17c6ea91c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.405711 10545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e7ccaea05564aed872d76358690228f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.409396 10467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d263d9eb057b4c1c9903d22c36d7eeae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.410480 10469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be364ca393d24f51b26f766d410342f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.411389 10544 tablet_service.cc:1511] Processing CreateTablet for tablet be364ca393d24f51b26f766d410342f0 (DEFAULT_TABLE table=test-workload [id=11a6c4d9d2314ce4a942947dbaf0e468]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:22:32.412777 10544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be364ca393d24f51b26f766d410342f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.415243 10543 tablet_service.cc:1511] Processing CreateTablet for tablet 63b02039e698478e8b8eb6f17c6ea91c (DEFAULT_TABLE table=test-workload [id=11a6c4d9d2314ce4a942947dbaf0e468]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:22:32.416687 10543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63b02039e698478e8b8eb6f17c6ea91c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.429730 10617 tablet_service.cc:1511] Processing CreateTablet for tablet 63b02039e698478e8b8eb6f17c6ea91c (DEFAULT_TABLE table=test-workload [id=11a6c4d9d2314ce4a942947dbaf0e468]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:22:32.430238 10619 tablet_service.cc:1511] Processing CreateTablet for tablet 4e7ccaea05564aed872d76358690228f (DEFAULT_TABLE table=test-workload [id=11a6c4d9d2314ce4a942947dbaf0e468]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:22:32.431221 10617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63b02039e698478e8b8eb6f17c6ea91c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.432343 10618 tablet_service.cc:1511] Processing CreateTablet for tablet be364ca393d24f51b26f766d410342f0 (DEFAULT_TABLE table=test-workload [id=11a6c4d9d2314ce4a942947dbaf0e468]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:22:32.433718 10618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be364ca393d24f51b26f766d410342f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.435911 10620 tablet_service.cc:1511] Processing CreateTablet for tablet 608ebe9b962e4d27b37af29ad96df0bc (DEFAULT_TABLE table=test-workload [id=11a6c4d9d2314ce4a942947dbaf0e468]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:22:32.441045 10619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e7ccaea05564aed872d76358690228f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.447000 10542 tablet_service.cc:1511] Processing CreateTablet for tablet d263d9eb057b4c1c9903d22c36d7eeae (DEFAULT_TABLE table=test-workload [id=11a6c4d9d2314ce4a942947dbaf0e468]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:22:32.448561 10542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d263d9eb057b4c1c9903d22c36d7eeae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.449156 10620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608ebe9b962e4d27b37af29ad96df0bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.455359 10616 tablet_service.cc:1511] Processing CreateTablet for tablet d263d9eb057b4c1c9903d22c36d7eeae (DEFAULT_TABLE table=test-workload [id=11a6c4d9d2314ce4a942947dbaf0e468]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:22:32.456753 10616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d263d9eb057b4c1c9903d22c36d7eeae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.460793 10541 tablet_service.cc:1511] Processing CreateTablet for tablet 8fc2a62c9d164bac97e30583925c5818 (DEFAULT_TABLE table=test-workload [id=11a6c4d9d2314ce4a942947dbaf0e468]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:22:32.462229 10541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fc2a62c9d164bac97e30583925c5818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.464365 10615 tablet_service.cc:1511] Processing CreateTablet for tablet 8fc2a62c9d164bac97e30583925c5818 (DEFAULT_TABLE table=test-workload [id=11a6c4d9d2314ce4a942947dbaf0e468]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:22:32.465795 10615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fc2a62c9d164bac97e30583925c5818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.467396 10466 tablet_service.cc:1511] Processing CreateTablet for tablet 8fc2a62c9d164bac97e30583925c5818 (DEFAULT_TABLE table=test-workload [id=11a6c4d9d2314ce4a942947dbaf0e468]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:22:32.468828 10466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fc2a62c9d164bac97e30583925c5818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.479538 10465 tablet_service.cc:1511] Processing CreateTablet for tablet 4c45c01fcb344ea0a16f89b7f3c7bfb7 (DEFAULT_TABLE table=test-workload [id=11a6c4d9d2314ce4a942947dbaf0e468]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:22:32.489197 10544 tablet_service.cc:1511] Processing CreateTablet for tablet 4c45c01fcb344ea0a16f89b7f3c7bfb7 (DEFAULT_TABLE table=test-workload [id=11a6c4d9d2314ce4a942947dbaf0e468]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:22:32.490670 10544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c45c01fcb344ea0a16f89b7f3c7bfb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.493454 10465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c45c01fcb344ea0a16f89b7f3c7bfb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.504179 10671 tablet_bootstrap.cc:492] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866: Bootstrap starting.
I20260709 12:22:32.507511 10614 tablet_service.cc:1511] Processing CreateTablet for tablet 4c45c01fcb344ea0a16f89b7f3c7bfb7 (DEFAULT_TABLE table=test-workload [id=11a6c4d9d2314ce4a942947dbaf0e468]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:22:32.509006 10614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c45c01fcb344ea0a16f89b7f3c7bfb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.512437 10672 tablet_bootstrap.cc:492] T 4e7ccaea05564aed872d76358690228f P 4f1fd1428fbf4f01a112df4b8319bb97: Bootstrap starting.
I20260709 12:22:32.509851 10469 tablet_service.cc:1511] Processing CreateTablet for tablet a6b88354e73e493b933e7080ab70fb6f (DEFAULT_TABLE table=test-workload [id=11a6c4d9d2314ce4a942947dbaf0e468]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:22:32.512643 10540 tablet_service.cc:1511] Processing CreateTablet for tablet a6b88354e73e493b933e7080ab70fb6f (DEFAULT_TABLE table=test-workload [id=11a6c4d9d2314ce4a942947dbaf0e468]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:22:32.513747 10469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6b88354e73e493b933e7080ab70fb6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.517122 10671 tablet_bootstrap.cc:654] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.513803 10540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6b88354e73e493b933e7080ab70fb6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.540745 10617 tablet_service.cc:1511] Processing CreateTablet for tablet a6b88354e73e493b933e7080ab70fb6f (DEFAULT_TABLE table=test-workload [id=11a6c4d9d2314ce4a942947dbaf0e468]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:22:32.544062 10617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6b88354e73e493b933e7080ab70fb6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.547545 10671 tablet_bootstrap.cc:492] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866: No bootstrap required, opened a new log
I20260709 12:22:32.548064 10671 ts_tablet_manager.cc:1403] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866: Time spent bootstrapping tablet: real 0.044s	user 0.020s	sys 0.007s
I20260709 12:22:32.550459 10671 raft_consensus.cc:359] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.551222 10671 raft_consensus.cc:385] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.551519 10671 raft_consensus.cc:740] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.552235 10672 tablet_bootstrap.cc:654] T 4e7ccaea05564aed872d76358690228f P 4f1fd1428fbf4f01a112df4b8319bb97: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.552239 10671 consensus_queue.cc:260] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.566777 10506 heartbeater.cc:499] Master 127.9.145.254:39107 was elected leader, sending a full tablet report...
I20260709 12:22:32.567829 10671 ts_tablet_manager.cc:1434] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866: Time spent starting tablet: real 0.019s	user 0.012s	sys 0.007s
I20260709 12:22:32.568910 10671 tablet_bootstrap.cc:492] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866: Bootstrap starting.
I20260709 12:22:32.568920 10471 tablet_service.cc:1511] Processing CreateTablet for tablet a729467ab6c44459a6ddb0edf2213902 (DEFAULT_TABLE table=test-workload [id=11a6c4d9d2314ce4a942947dbaf0e468]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:22:32.566764 10677 raft_consensus.cc:493] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.570401 10471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a729467ab6c44459a6ddb0edf2213902. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.575549 10671 tablet_bootstrap.cc:654] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.570348 10677 raft_consensus.cc:515] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.580760 10677 leader_election.cc:290] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:32.590240 10673 tablet_bootstrap.cc:492] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8: Bootstrap starting.
I20260709 12:22:32.592221 10540 tablet_service.cc:1511] Processing CreateTablet for tablet a729467ab6c44459a6ddb0edf2213902 (DEFAULT_TABLE table=test-workload [id=11a6c4d9d2314ce4a942947dbaf0e468]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
W20260709 12:22:32.594049 10507 tablet.cc:2406] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:22:32.598903 10617 tablet_service.cc:1511] Processing CreateTablet for tablet a729467ab6c44459a6ddb0edf2213902 (DEFAULT_TABLE table=test-workload [id=11a6c4d9d2314ce4a942947dbaf0e468]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:22:32.600320 10617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a729467ab6c44459a6ddb0edf2213902. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.602526 10672 tablet_bootstrap.cc:492] T 4e7ccaea05564aed872d76358690228f P 4f1fd1428fbf4f01a112df4b8319bb97: No bootstrap required, opened a new log
I20260709 12:22:32.603223 10672 ts_tablet_manager.cc:1403] T 4e7ccaea05564aed872d76358690228f P 4f1fd1428fbf4f01a112df4b8319bb97: Time spent bootstrapping tablet: real 0.091s	user 0.009s	sys 0.011s
I20260709 12:22:32.606467 10672 raft_consensus.cc:359] T 4e7ccaea05564aed872d76358690228f P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.607326 10672 raft_consensus.cc:385] T 4e7ccaea05564aed872d76358690228f P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.607650 10672 raft_consensus.cc:740] T 4e7ccaea05564aed872d76358690228f P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1fd1428fbf4f01a112df4b8319bb97, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.608656 10672 consensus_queue.cc:260] T 4e7ccaea05564aed872d76358690228f P 4f1fd1428fbf4f01a112df4b8319bb97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.611882 10540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a729467ab6c44459a6ddb0edf2213902. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.629081 10673 tablet_bootstrap.cc:654] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.631693 10556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7ccaea05564aed872d76358690228f" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" is_pre_election: true
I20260709 12:22:32.640504 10542 tablet_service.cc:1511] Processing CreateTablet for tablet 22e7e51c13cd48d8a5e2eaba8d99e717 (DEFAULT_TABLE table=test-workload [id=11a6c4d9d2314ce4a942947dbaf0e468]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:22:32.641238 10556 raft_consensus.cc:2468] T 4e7ccaea05564aed872d76358690228f P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 0.
I20260709 12:22:32.641803 10542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22e7e51c13cd48d8a5e2eaba8d99e717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.642743 10444 leader_election.cc:304] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1fd1428fbf4f01a112df4b8319bb97, 5bc3a8e244614134a6e8d79f08217866; no voters: 
I20260709 12:22:32.633093 10671 tablet_bootstrap.cc:492] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866: No bootstrap required, opened a new log
I20260709 12:22:32.643749 10671 ts_tablet_manager.cc:1403] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866: Time spent bootstrapping tablet: real 0.075s	user 0.025s	sys 0.027s
I20260709 12:22:32.637862 10469 tablet_service.cc:1511] Processing CreateTablet for tablet 22e7e51c13cd48d8a5e2eaba8d99e717 (DEFAULT_TABLE table=test-workload [id=11a6c4d9d2314ce4a942947dbaf0e468]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:22:32.640332 10630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7ccaea05564aed872d76358690228f" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" is_pre_election: true
I20260709 12:22:32.645574 10675 raft_consensus.cc:2804] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:32.645980 10675 raft_consensus.cc:493] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.646323 10675 raft_consensus.cc:3060] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:32.646633 10444 leader_election.cc:343] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:32.648066 10469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22e7e51c13cd48d8a5e2eaba8d99e717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.653349 10675 raft_consensus.cc:515] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.655542 10671 raft_consensus.cc:359] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.658242 10671 raft_consensus.cc:385] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.658675 10671 raft_consensus.cc:740] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.657775 10675 leader_election.cc:290] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 election: Requested vote from peers 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:32.659138 10556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7ccaea05564aed872d76358690228f" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
I20260709 12:22:32.659065 10617 tablet_service.cc:1511] Processing CreateTablet for tablet 22e7e51c13cd48d8a5e2eaba8d99e717 (DEFAULT_TABLE table=test-workload [id=11a6c4d9d2314ce4a942947dbaf0e468]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:22:32.660036 10556 raft_consensus.cc:3060] T 4e7ccaea05564aed872d76358690228f P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.659518 10671 consensus_queue.cc:260] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.660919 10617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22e7e51c13cd48d8a5e2eaba8d99e717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.662627 10671 ts_tablet_manager.cc:1434] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:22:32.663698 10671 tablet_bootstrap.cc:492] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866: Bootstrap starting.
I20260709 12:22:32.667423 10630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7ccaea05564aed872d76358690228f" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
W20260709 12:22:32.669102 10444 leader_election.cc:343] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:32.670329 10671 tablet_bootstrap.cc:654] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.671605 10556 raft_consensus.cc:2468] T 4e7ccaea05564aed872d76358690228f P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 1.
I20260709 12:22:32.672866 10444 leader_election.cc:304] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1fd1428fbf4f01a112df4b8319bb97, 5bc3a8e244614134a6e8d79f08217866; no voters: 481b8f3a30ac44e59e23d3182b3f74c8
I20260709 12:22:32.673770 10675 raft_consensus.cc:2804] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:32.674355 10675 raft_consensus.cc:697] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Running, Role: LEADER
I20260709 12:22:32.675252 10675 consensus_queue.cc:237] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.682358 10673 tablet_bootstrap.cc:492] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8: No bootstrap required, opened a new log
I20260709 12:22:32.682873 10673 ts_tablet_manager.cc:1403] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8: Time spent bootstrapping tablet: real 0.104s	user 0.012s	sys 0.000s
I20260709 12:22:32.684906 10379 catalog_manager.cc:5697] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193). New cstate: current_term: 1 leader_uuid: "5bc3a8e244614134a6e8d79f08217866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.685853 10673 raft_consensus.cc:359] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.686635 10673 raft_consensus.cc:385] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.686944 10673 raft_consensus.cc:740] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481b8f3a30ac44e59e23d3182b3f74c8, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.690332 10671 tablet_bootstrap.cc:492] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866: No bootstrap required, opened a new log
I20260709 12:22:32.690929 10671 ts_tablet_manager.cc:1403] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.016s
I20260709 12:22:32.693251 10673 consensus_queue.cc:260] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.693790 10671 raft_consensus.cc:359] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.694582 10671 raft_consensus.cc:385] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.694846 10671 raft_consensus.cc:740] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.695842 10671 consensus_queue.cc:260] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.697587 10671 ts_tablet_manager.cc:1434] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:22:32.697732 10673 ts_tablet_manager.cc:1434] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:22:32.698542 10671 tablet_bootstrap.cc:492] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866: Bootstrap starting.
I20260709 12:22:32.698503 10656 heartbeater.cc:499] Master 127.9.145.254:39107 was elected leader, sending a full tablet report...
I20260709 12:22:32.698746 10673 tablet_bootstrap.cc:492] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8: Bootstrap starting.
I20260709 12:22:32.709393 10671 tablet_bootstrap.cc:654] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.713855 10581 heartbeater.cc:499] Master 127.9.145.254:39107 was elected leader, sending a full tablet report...
I20260709 12:22:32.714257 10672 ts_tablet_manager.cc:1434] T 4e7ccaea05564aed872d76358690228f P 4f1fd1428fbf4f01a112df4b8319bb97: Time spent starting tablet: real 0.111s	user 0.032s	sys 0.033s
I20260709 12:22:32.715265 10672 tablet_bootstrap.cc:492] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97: Bootstrap starting.
I20260709 12:22:32.720319 10673 tablet_bootstrap.cc:654] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.726583 10672 tablet_bootstrap.cc:654] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.732043 10671 tablet_bootstrap.cc:492] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866: No bootstrap required, opened a new log
I20260709 12:22:32.732268 10672 tablet_bootstrap.cc:492] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97: No bootstrap required, opened a new log
I20260709 12:22:32.732533 10671 ts_tablet_manager.cc:1403] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.012s
I20260709 12:22:32.732775 10672 ts_tablet_manager.cc:1403] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97: Time spent bootstrapping tablet: real 0.018s	user 0.001s	sys 0.009s
I20260709 12:22:32.735615 10671 raft_consensus.cc:359] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.736496 10671 raft_consensus.cc:385] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.736478 10672 raft_consensus.cc:359] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.737054 10671 raft_consensus.cc:740] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.737411 10672 raft_consensus.cc:385] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.737756 10672 raft_consensus.cc:740] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1fd1428fbf4f01a112df4b8319bb97, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.738517 10672 consensus_queue.cc:260] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.741062 10672 ts_tablet_manager.cc:1434] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:22:32.742050 10672 tablet_bootstrap.cc:492] T 63b02039e698478e8b8eb6f17c6ea91c P 4f1fd1428fbf4f01a112df4b8319bb97: Bootstrap starting.
I20260709 12:22:32.738061 10671 consensus_queue.cc:260] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.748346 10672 tablet_bootstrap.cc:654] T 63b02039e698478e8b8eb6f17c6ea91c P 4f1fd1428fbf4f01a112df4b8319bb97: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.753751 10671 ts_tablet_manager.cc:1434] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.004s
I20260709 12:22:32.754891 10671 tablet_bootstrap.cc:492] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866: Bootstrap starting.
I20260709 12:22:32.755007 10673 tablet_bootstrap.cc:492] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8: No bootstrap required, opened a new log
I20260709 12:22:32.755594 10673 ts_tablet_manager.cc:1403] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8: Time spent bootstrapping tablet: real 0.057s	user 0.020s	sys 0.009s
I20260709 12:22:32.758858 10673 raft_consensus.cc:359] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.759693 10673 raft_consensus.cc:385] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.760000 10673 raft_consensus.cc:740] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481b8f3a30ac44e59e23d3182b3f74c8, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.760794 10673 consensus_queue.cc:260] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.761694 10671 tablet_bootstrap.cc:654] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.763447 10673 ts_tablet_manager.cc:1434] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:22:32.764541 10673 tablet_bootstrap.cc:492] T 8fc2a62c9d164bac97e30583925c5818 P 481b8f3a30ac44e59e23d3182b3f74c8: Bootstrap starting.
I20260709 12:22:32.771385 10673 tablet_bootstrap.cc:654] T 8fc2a62c9d164bac97e30583925c5818 P 481b8f3a30ac44e59e23d3182b3f74c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.773782 10671 tablet_bootstrap.cc:492] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866: No bootstrap required, opened a new log
I20260709 12:22:32.774351 10671 ts_tablet_manager.cc:1403] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 12:22:32.775245 10672 tablet_bootstrap.cc:492] T 63b02039e698478e8b8eb6f17c6ea91c P 4f1fd1428fbf4f01a112df4b8319bb97: No bootstrap required, opened a new log
I20260709 12:22:32.775736 10672 ts_tablet_manager.cc:1403] T 63b02039e698478e8b8eb6f17c6ea91c P 4f1fd1428fbf4f01a112df4b8319bb97: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.014s
I20260709 12:22:32.777395 10671 raft_consensus.cc:359] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.778268 10671 raft_consensus.cc:385] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.778540 10671 raft_consensus.cc:740] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.778685 10672 raft_consensus.cc:359] T 63b02039e698478e8b8eb6f17c6ea91c P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.779443 10672 raft_consensus.cc:385] T 63b02039e698478e8b8eb6f17c6ea91c P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.779156 10671 consensus_queue.cc:260] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.779695 10672 raft_consensus.cc:740] T 63b02039e698478e8b8eb6f17c6ea91c P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1fd1428fbf4f01a112df4b8319bb97, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.780799 10673 tablet_bootstrap.cc:492] T 8fc2a62c9d164bac97e30583925c5818 P 481b8f3a30ac44e59e23d3182b3f74c8: No bootstrap required, opened a new log
I20260709 12:22:32.780625 10672 consensus_queue.cc:260] T 63b02039e698478e8b8eb6f17c6ea91c P 4f1fd1428fbf4f01a112df4b8319bb97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.781291 10673 ts_tablet_manager.cc:1403] T 8fc2a62c9d164bac97e30583925c5818 P 481b8f3a30ac44e59e23d3182b3f74c8: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.007s
I20260709 12:22:32.781383 10671 ts_tablet_manager.cc:1434] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:22:32.782508 10671 tablet_bootstrap.cc:492] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866: Bootstrap starting.
I20260709 12:22:32.784274 10673 raft_consensus.cc:359] T 8fc2a62c9d164bac97e30583925c5818 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.785001 10673 raft_consensus.cc:385] T 8fc2a62c9d164bac97e30583925c5818 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.785094 10672 ts_tablet_manager.cc:1434] T 63b02039e698478e8b8eb6f17c6ea91c P 4f1fd1428fbf4f01a112df4b8319bb97: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 12:22:32.785336 10673 raft_consensus.cc:740] T 8fc2a62c9d164bac97e30583925c5818 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481b8f3a30ac44e59e23d3182b3f74c8, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.786358 10672 tablet_bootstrap.cc:492] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97: Bootstrap starting.
I20260709 12:22:32.786224 10673 consensus_queue.cc:260] T 8fc2a62c9d164bac97e30583925c5818 P 481b8f3a30ac44e59e23d3182b3f74c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.788017 10673 ts_tablet_manager.cc:1434] T 8fc2a62c9d164bac97e30583925c5818 P 481b8f3a30ac44e59e23d3182b3f74c8: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:22:32.788936 10671 tablet_bootstrap.cc:654] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.788980 10673 tablet_bootstrap.cc:492] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 481b8f3a30ac44e59e23d3182b3f74c8: Bootstrap starting.
I20260709 12:22:32.790117 10680 raft_consensus.cc:493] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.790637 10680 raft_consensus.cc:515] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.796439 10673 tablet_bootstrap.cc:654] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 481b8f3a30ac44e59e23d3182b3f74c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.798283 10675 raft_consensus.cc:493] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.798851 10675 raft_consensus.cc:515] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.801007 10675 leader_election.cc:290] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:32.802640 10556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ebe9b962e4d27b37af29ad96df0bc" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" is_pre_election: true
I20260709 12:22:32.803990 10630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ebe9b962e4d27b37af29ad96df0bc" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" is_pre_election: true
I20260709 12:22:32.804647 10630 raft_consensus.cc:2468] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 0.
W20260709 12:22:32.806289 10444 leader_election.cc:343] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:32.806972 10444 leader_election.cc:304] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481b8f3a30ac44e59e23d3182b3f74c8, 5bc3a8e244614134a6e8d79f08217866; no voters: 4f1fd1428fbf4f01a112df4b8319bb97
I20260709 12:22:32.807952 10680 leader_election.cc:290] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193:37839), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:32.808985 10675 raft_consensus.cc:2804] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:32.809357 10675 raft_consensus.cc:493] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.809677 10675 raft_consensus.cc:3060] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.825929 10675 raft_consensus.cc:515] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.828878 10556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ebe9b962e4d27b37af29ad96df0bc" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
W20260709 12:22:32.830390 10444 leader_election.cc:343] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:32.832062 10630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be364ca393d24f51b26f766d410342f0" candidate_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" is_pre_election: true
I20260709 12:22:32.832619 10672 tablet_bootstrap.cc:654] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.833168 10671 tablet_bootstrap.cc:492] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866: No bootstrap required, opened a new log
I20260709 12:22:32.833741 10671 ts_tablet_manager.cc:1403] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.028s
W20260709 12:22:32.834290 10519 leader_election.cc:343] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:32.836373 10675 leader_election.cc:290] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 election: Requested vote from peers 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:32.837028 10630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ebe9b962e4d27b37af29ad96df0bc" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
I20260709 12:22:32.836957 10671 raft_consensus.cc:359] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.837934 10671 raft_consensus.cc:385] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.837877 10630 raft_consensus.cc:3060] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.838371 10671 raft_consensus.cc:740] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.839697 10671 consensus_queue.cc:260] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.840570 10481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be364ca393d24f51b26f766d410342f0" candidate_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc3a8e244614134a6e8d79f08217866" is_pre_election: true
I20260709 12:22:32.841269 10481 raft_consensus.cc:2468] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1fd1428fbf4f01a112df4b8319bb97 in term 0.
I20260709 12:22:32.842185 10671 ts_tablet_manager.cc:1434] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:22:32.842770 10520 leader_election.cc:304] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1fd1428fbf4f01a112df4b8319bb97, 5bc3a8e244614134a6e8d79f08217866; no voters: 481b8f3a30ac44e59e23d3182b3f74c8
I20260709 12:22:32.843968 10680 raft_consensus.cc:2804] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:32.844318 10680 raft_consensus.cc:493] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.844631 10680 raft_consensus.cc:3060] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.846230 10671 tablet_bootstrap.cc:492] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866: Bootstrap starting.
I20260709 12:22:32.845227 10630 raft_consensus.cc:2468] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 1.
I20260709 12:22:32.851039 10444 leader_election.cc:304] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481b8f3a30ac44e59e23d3182b3f74c8, 5bc3a8e244614134a6e8d79f08217866; no voters: 4f1fd1428fbf4f01a112df4b8319bb97
I20260709 12:22:32.851649 10680 raft_consensus.cc:515] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.852541 10677 raft_consensus.cc:2804] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:32.852996 10677 raft_consensus.cc:697] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Running, Role: LEADER
I20260709 12:22:32.853343 10671 tablet_bootstrap.cc:654] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.853798 10677 consensus_queue.cc:237] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.854617 10481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be364ca393d24f51b26f766d410342f0" candidate_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
I20260709 12:22:32.855181 10481 raft_consensus.cc:3060] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.862366 10672 tablet_bootstrap.cc:492] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97: No bootstrap required, opened a new log
I20260709 12:22:32.862890 10672 ts_tablet_manager.cc:1403] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97: Time spent bootstrapping tablet: real 0.077s	user 0.007s	sys 0.004s
I20260709 12:22:32.867003 10671 tablet_bootstrap.cc:492] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866: No bootstrap required, opened a new log
I20260709 12:22:32.867585 10671 ts_tablet_manager.cc:1403] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.006s
I20260709 12:22:32.867862 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be364ca393d24f51b26f766d410342f0" candidate_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
W20260709 12:22:32.869524 10519 leader_election.cc:343] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:32.870425 10481 raft_consensus.cc:2468] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1fd1428fbf4f01a112df4b8319bb97 in term 1.
I20260709 12:22:32.870738 10671 raft_consensus.cc:359] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.871591 10671 raft_consensus.cc:385] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.871840 10671 raft_consensus.cc:740] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.872457 10671 consensus_queue.cc:260] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.873427 10520 leader_election.cc:304] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1fd1428fbf4f01a112df4b8319bb97, 5bc3a8e244614134a6e8d79f08217866; no voters: 481b8f3a30ac44e59e23d3182b3f74c8
I20260709 12:22:32.873948 10673 tablet_bootstrap.cc:492] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 481b8f3a30ac44e59e23d3182b3f74c8: No bootstrap required, opened a new log
I20260709 12:22:32.874502 10673 ts_tablet_manager.cc:1403] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 481b8f3a30ac44e59e23d3182b3f74c8: Time spent bootstrapping tablet: real 0.086s	user 0.027s	sys 0.048s
I20260709 12:22:32.875061 10671 ts_tablet_manager.cc:1434] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:32.876084 10671 tablet_bootstrap.cc:492] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866: Bootstrap starting.
I20260709 12:22:32.877439 10673 raft_consensus.cc:359] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.878227 10673 raft_consensus.cc:385] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.870980 10680 leader_election.cc:290] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [CANDIDATE]: Term 1 election: Requested vote from peers 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193:37839), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:32.878677 10673 raft_consensus.cc:740] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481b8f3a30ac44e59e23d3182b3f74c8, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.879271 10680 raft_consensus.cc:2804] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:32.879798 10680 raft_consensus.cc:697] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 LEADER]: Becoming Leader. State: Replica: 4f1fd1428fbf4f01a112df4b8319bb97, State: Running, Role: LEADER
I20260709 12:22:32.879663 10673 consensus_queue.cc:260] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 481b8f3a30ac44e59e23d3182b3f74c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.880744 10680 consensus_queue.cc:237] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.882632 10671 tablet_bootstrap.cc:654] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.884042 10673 ts_tablet_manager.cc:1434] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 481b8f3a30ac44e59e23d3182b3f74c8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:22:32.885144 10673 tablet_bootstrap.cc:492] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8: Bootstrap starting.
I20260709 12:22:32.865885 10672 raft_consensus.cc:359] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.887456 10672 raft_consensus.cc:385] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.887768 10672 raft_consensus.cc:740] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1fd1428fbf4f01a112df4b8319bb97, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.888760 10675 raft_consensus.cc:493] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.889349 10675 raft_consensus.cc:515] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.891510 10675 leader_election.cc:290] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:32.894013 10556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc2a62c9d164bac97e30583925c5818" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" is_pre_election: true
I20260709 12:22:32.895143 10630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc2a62c9d164bac97e30583925c5818" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" is_pre_election: true
W20260709 12:22:32.896951 10444 leader_election.cc:343] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:32.894411 10672 consensus_queue.cc:260] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.897701 10630 raft_consensus.cc:2468] T 8fc2a62c9d164bac97e30583925c5818 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 0.
I20260709 12:22:32.899173 10444 leader_election.cc:304] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481b8f3a30ac44e59e23d3182b3f74c8, 5bc3a8e244614134a6e8d79f08217866; no voters: 4f1fd1428fbf4f01a112df4b8319bb97
I20260709 12:22:32.898587 10378 catalog_manager.cc:5697] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193). New cstate: current_term: 1 leader_uuid: "5bc3a8e244614134a6e8d79f08217866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.900383 10677 raft_consensus.cc:2804] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:32.900780 10677 raft_consensus.cc:493] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.901131 10677 raft_consensus.cc:3060] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.901296 10672 ts_tablet_manager.cc:1434] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 12:22:32.902451 10672 tablet_bootstrap.cc:492] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97: Bootstrap starting.
I20260709 12:22:32.908581 10672 tablet_bootstrap.cc:654] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.908454 10677 raft_consensus.cc:515] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.909956 10673 tablet_bootstrap.cc:654] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.913511 10556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc2a62c9d164bac97e30583925c5818" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
I20260709 12:22:32.914462 10630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc2a62c9d164bac97e30583925c5818" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
W20260709 12:22:32.914987 10444 leader_election.cc:343] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:32.915277 10671 tablet_bootstrap.cc:492] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866: No bootstrap required, opened a new log
I20260709 12:22:32.915047 10630 raft_consensus.cc:3060] T 8fc2a62c9d164bac97e30583925c5818 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.915508 10677 leader_election.cc:290] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 election: Requested vote from peers 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:32.915752 10671 ts_tablet_manager.cc:1403] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.007s
I20260709 12:22:32.918886 10671 raft_consensus.cc:359] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.919575 10671 raft_consensus.cc:385] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.919854 10671 raft_consensus.cc:740] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.920506 10671 consensus_queue.cc:260] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.922246 10630 raft_consensus.cc:2468] T 8fc2a62c9d164bac97e30583925c5818 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 1.
I20260709 12:22:32.922572 10671 ts_tablet_manager.cc:1434] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:22:32.923610 10444 leader_election.cc:304] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481b8f3a30ac44e59e23d3182b3f74c8, 5bc3a8e244614134a6e8d79f08217866; no voters: 4f1fd1428fbf4f01a112df4b8319bb97
I20260709 12:22:32.924816 10677 raft_consensus.cc:2804] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:32.925459 10677 raft_consensus.cc:697] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Running, Role: LEADER
I20260709 12:22:32.926368 10677 consensus_queue.cc:237] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.928632 10379 catalog_manager.cc:5697] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.929827 10671 tablet_bootstrap.cc:492] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866: Bootstrap starting.
W20260709 12:22:32.936094 10427 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:32.939810 10671 tablet_bootstrap.cc:654] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.949836 10671 tablet_bootstrap.cc:492] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866: No bootstrap required, opened a new log
I20260709 12:22:32.949743 10379 catalog_manager.cc:5697] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193). New cstate: current_term: 1 leader_uuid: "5bc3a8e244614134a6e8d79f08217866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.950446 10677 raft_consensus.cc:493] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.951001 10677 raft_consensus.cc:515] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.951855 10671 ts_tablet_manager.cc:1403] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.000s
I20260709 12:22:32.953157 10677 leader_election.cc:290] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:32.954698 10671 raft_consensus.cc:359] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.955437 10671 raft_consensus.cc:385] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.955453 10672 tablet_bootstrap.cc:492] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97: No bootstrap required, opened a new log
I20260709 12:22:32.953271 10673 tablet_bootstrap.cc:492] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8: No bootstrap required, opened a new log
I20260709 12:22:32.955915 10671 raft_consensus.cc:740] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.955598 10556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c45c01fcb344ea0a16f89b7f3c7bfb7" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" is_pre_election: true
I20260709 12:22:32.956435 10672 ts_tablet_manager.cc:1403] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.003s
I20260709 12:22:32.956715 10556 raft_consensus.cc:2468] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 0.
I20260709 12:22:32.956928 10671 consensus_queue.cc:260] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.958134 10444 leader_election.cc:304] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1fd1428fbf4f01a112df4b8319bb97, 5bc3a8e244614134a6e8d79f08217866; no voters: 
I20260709 12:22:32.959390 10671 ts_tablet_manager.cc:1434] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:22:32.956019 10630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c45c01fcb344ea0a16f89b7f3c7bfb7" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" is_pre_election: true
I20260709 12:22:32.960111 10630 raft_consensus.cc:2468] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 0.
I20260709 12:22:32.959707 10672 raft_consensus.cc:359] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.960602 10671 tablet_bootstrap.cc:492] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 5bc3a8e244614134a6e8d79f08217866: Bootstrap starting.
I20260709 12:22:32.960678 10672 raft_consensus.cc:385] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.961609 10672 raft_consensus.cc:740] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1fd1428fbf4f01a112df4b8319bb97, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.961342 10673 ts_tablet_manager.cc:1403] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8: Time spent bootstrapping tablet: real 0.076s	user 0.040s	sys 0.001s
I20260709 12:22:32.961771 10677 raft_consensus.cc:493] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.962265 10677 raft_consensus.cc:515] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.965129 10556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b02039e698478e8b8eb6f17c6ea91c" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" is_pre_election: true
I20260709 12:22:32.965812 10556 raft_consensus.cc:2468] T 63b02039e698478e8b8eb6f17c6ea91c P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 0.
I20260709 12:22:32.964882 10673 raft_consensus.cc:359] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.966537 10673 raft_consensus.cc:385] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.967013 10671 tablet_bootstrap.cc:654] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 5bc3a8e244614134a6e8d79f08217866: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.967320 10444 leader_election.cc:304] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1fd1428fbf4f01a112df4b8319bb97, 5bc3a8e244614134a6e8d79f08217866; no voters: 
I20260709 12:22:32.967541 10673 raft_consensus.cc:740] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481b8f3a30ac44e59e23d3182b3f74c8, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.966116 10672 consensus_queue.cc:260] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.959231 10675 raft_consensus.cc:2804] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:32.968597 10675 raft_consensus.cc:493] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.968974 10675 raft_consensus.cc:3060] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.969800 10705 raft_consensus.cc:2804] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:32.970250 10705 raft_consensus.cc:493] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.970602 10705 raft_consensus.cc:3060] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.971408 10673 consensus_queue.cc:260] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.973937 10684 raft_consensus.cc:493] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.974411 10684 raft_consensus.cc:515] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.977226 10677 leader_election.cc:290] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:32.979096 10684 leader_election.cc:290] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193:37839), 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017)
I20260709 12:22:32.979712 10684 raft_consensus.cc:493] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.980182 10684 raft_consensus.cc:515] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.982270 10684 leader_election.cc:290] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193:37839), 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017)
I20260709 12:22:32.982926 10705 raft_consensus.cc:515] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:32.973457 10672 ts_tablet_manager.cc:1434] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:22:32.984707 10672 tablet_bootstrap.cc:492] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97: Bootstrap starting.
I20260709 12:22:32.984923 10705 leader_election.cc:290] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 election: Requested vote from peers 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:32.985684 10673 ts_tablet_manager.cc:1434] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 12:22:32.987214 10673 tablet_bootstrap.cc:492] T 4e7ccaea05564aed872d76358690228f P 481b8f3a30ac44e59e23d3182b3f74c8: Bootstrap starting.
I20260709 12:22:32.988669 10556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b02039e698478e8b8eb6f17c6ea91c" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
I20260709 12:22:32.989315 10556 raft_consensus.cc:3060] T 63b02039e698478e8b8eb6f17c6ea91c P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.996671 10673 tablet_bootstrap.cc:654] T 4e7ccaea05564aed872d76358690228f P 481b8f3a30ac44e59e23d3182b3f74c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.997005 10671 tablet_bootstrap.cc:492] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 5bc3a8e244614134a6e8d79f08217866: No bootstrap required, opened a new log
I20260709 12:22:32.997473 10671 ts_tablet_manager.cc:1403] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 5bc3a8e244614134a6e8d79f08217866: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.006s
I20260709 12:22:32.997799 10675 raft_consensus.cc:515] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.000206 10671 raft_consensus.cc:359] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.001009 10671 raft_consensus.cc:385] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:33.001297 10671 raft_consensus.cc:740] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.001204 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c45c01fcb344ea0a16f89b7f3c7bfb7" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
I20260709 12:22:33.002012 10555 raft_consensus.cc:3060] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.007062 10672 tablet_bootstrap.cc:654] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:33.010218 10673 tablet_bootstrap.cc:492] T 4e7ccaea05564aed872d76358690228f P 481b8f3a30ac44e59e23d3182b3f74c8: No bootstrap required, opened a new log
I20260709 12:22:33.010798 10673 ts_tablet_manager.cc:1403] T 4e7ccaea05564aed872d76358690228f P 481b8f3a30ac44e59e23d3182b3f74c8: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.007s
I20260709 12:22:33.013833 10673 raft_consensus.cc:359] T 4e7ccaea05564aed872d76358690228f P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.014622 10673 raft_consensus.cc:385] T 4e7ccaea05564aed872d76358690228f P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:33.014935 10673 raft_consensus.cc:740] T 4e7ccaea05564aed872d76358690228f P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481b8f3a30ac44e59e23d3182b3f74c8, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.015713 10673 consensus_queue.cc:260] T 4e7ccaea05564aed872d76358690228f P 481b8f3a30ac44e59e23d3182b3f74c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.009949 10555 raft_consensus.cc:2468] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 1.
I20260709 12:22:33.018302 10444 leader_election.cc:304] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1fd1428fbf4f01a112df4b8319bb97, 5bc3a8e244614134a6e8d79f08217866; no voters: 
I20260709 12:22:33.018813 10671 consensus_queue.cc:260] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 5bc3a8e244614134a6e8d79f08217866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.019472 10705 raft_consensus.cc:2804] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:33.018370 10673 ts_tablet_manager.cc:1434] T 4e7ccaea05564aed872d76358690228f P 481b8f3a30ac44e59e23d3182b3f74c8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:22:33.020933 10671 ts_tablet_manager.cc:1434] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 5bc3a8e244614134a6e8d79f08217866: Time spent starting tablet: real 0.023s	user 0.002s	sys 0.005s
I20260709 12:22:33.024178 10705 raft_consensus.cc:697] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Running, Role: LEADER
I20260709 12:22:33.025209 10705 consensus_queue.cc:237] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.026437 10672 tablet_bootstrap.cc:492] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97: No bootstrap required, opened a new log
I20260709 12:22:33.026448 10675 leader_election.cc:290] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 election: Requested vote from peers 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:33.027107 10672 ts_tablet_manager.cc:1403] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.002s
I20260709 12:22:33.029314 10630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b02039e698478e8b8eb6f17c6ea91c" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" is_pre_election: true
I20260709 12:22:33.029978 10630 raft_consensus.cc:2468] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 0.
I20260709 12:22:33.021425 10673 tablet_bootstrap.cc:492] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8: Bootstrap starting.
I20260709 12:22:33.031535 10630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b02039e698478e8b8eb6f17c6ea91c" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
I20260709 12:22:33.032119 10630 raft_consensus.cc:3060] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.031819 10672 raft_consensus.cc:359] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.034058 10672 raft_consensus.cc:385] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:33.034844 10672 raft_consensus.cc:740] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1fd1428fbf4f01a112df4b8319bb97, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.035648 10672 consensus_queue.cc:260] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.036113 10705 raft_consensus.cc:493] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.037886 10672 ts_tablet_manager.cc:1434] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 12:22:33.038919 10672 tablet_bootstrap.cc:492] T d263d9eb057b4c1c9903d22c36d7eeae P 4f1fd1428fbf4f01a112df4b8319bb97: Bootstrap starting.
I20260709 12:22:33.038925 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c45c01fcb344ea0a16f89b7f3c7bfb7" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
I20260709 12:22:33.039597 10629 raft_consensus.cc:3060] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.039119 10705 raft_consensus.cc:515] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.045965 10673 tablet_bootstrap.cc:654] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:33.051528 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263d9eb057b4c1c9903d22c36d7eeae" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" is_pre_election: true
I20260709 12:22:33.048879 10481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263d9eb057b4c1c9903d22c36d7eeae" candidate_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc3a8e244614134a6e8d79f08217866" is_pre_election: true
I20260709 12:22:33.053540 10481 raft_consensus.cc:2468] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481b8f3a30ac44e59e23d3182b3f74c8 in term 0.
I20260709 12:22:33.039734 10379 catalog_manager.cc:5697] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193). New cstate: current_term: 1 leader_uuid: "5bc3a8e244614134a6e8d79f08217866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:33.048557 10705 leader_election.cc:290] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:33.053113 10672 tablet_bootstrap.cc:654] T d263d9eb057b4c1c9903d22c36d7eeae P 4f1fd1428fbf4f01a112df4b8319bb97: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:33.047456 10629 raft_consensus.cc:2468] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 1.
I20260709 12:22:33.058000 10554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b02039e698478e8b8eb6f17c6ea91c" candidate_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" is_pre_election: true
I20260709 12:22:33.059204 10630 raft_consensus.cc:2468] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 1.
W20260709 12:22:33.060276 10444 leader_election.cc:343] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:33.061906 10481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b02039e698478e8b8eb6f17c6ea91c" candidate_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc3a8e244614134a6e8d79f08217866" is_pre_election: true
I20260709 12:22:33.062891 10481 raft_consensus.cc:2393] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 481b8f3a30ac44e59e23d3182b3f74c8 in current term 1: Already voted for candidate 5bc3a8e244614134a6e8d79f08217866 in this term.
I20260709 12:22:33.065312 10594 leader_election.cc:304] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481b8f3a30ac44e59e23d3182b3f74c8, 5bc3a8e244614134a6e8d79f08217866; no voters: 
I20260709 12:22:33.067265 10556 raft_consensus.cc:2468] T 63b02039e698478e8b8eb6f17c6ea91c P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 1.
I20260709 12:22:33.068645 10444 leader_election.cc:304] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1fd1428fbf4f01a112df4b8319bb97, 5bc3a8e244614134a6e8d79f08217866; no voters: 
I20260709 12:22:33.069713 10630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263d9eb057b4c1c9903d22c36d7eeae" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" is_pre_election: true
I20260709 12:22:33.070461 10630 raft_consensus.cc:2468] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 0.
I20260709 12:22:33.071367 10705 raft_consensus.cc:2804] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:33.071904 10705 raft_consensus.cc:697] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Running, Role: LEADER
I20260709 12:22:33.073240 10672 tablet_bootstrap.cc:492] T d263d9eb057b4c1c9903d22c36d7eeae P 4f1fd1428fbf4f01a112df4b8319bb97: No bootstrap required, opened a new log
I20260709 12:22:33.072747 10705 consensus_queue.cc:237] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.073947 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263d9eb057b4c1c9903d22c36d7eeae" candidate_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" is_pre_election: true
I20260709 12:22:33.074934 10684 raft_consensus.cc:2804] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:33.075320 10684 raft_consensus.cc:493] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.075640 10684 raft_consensus.cc:3060] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:33.075583 10593 leader_election.cc:343] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:33.079435 10673 tablet_bootstrap.cc:492] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8: No bootstrap required, opened a new log
I20260709 12:22:33.079888 10673 ts_tablet_manager.cc:1403] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8: Time spent bootstrapping tablet: real 0.059s	user 0.018s	sys 0.014s
I20260709 12:22:33.082082 10673 raft_consensus.cc:359] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.082737 10672 ts_tablet_manager.cc:1403] T d263d9eb057b4c1c9903d22c36d7eeae P 4f1fd1428fbf4f01a112df4b8319bb97: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.000s
I20260709 12:22:33.082858 10673 raft_consensus.cc:385] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:33.083344 10673 raft_consensus.cc:740] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481b8f3a30ac44e59e23d3182b3f74c8, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.084128 10673 consensus_queue.cc:260] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.084900 10594 leader_election.cc:304] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 481b8f3a30ac44e59e23d3182b3f74c8; no voters: 4f1fd1428fbf4f01a112df4b8319bb97, 5bc3a8e244614134a6e8d79f08217866
I20260709 12:22:33.086679 10673 ts_tablet_manager.cc:1434] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:22:33.086287 10672 raft_consensus.cc:359] T d263d9eb057b4c1c9903d22c36d7eeae P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.087180 10672 raft_consensus.cc:385] T d263d9eb057b4c1c9903d22c36d7eeae P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:33.083364 10684 raft_consensus.cc:515] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.087742 10673 tablet_bootstrap.cc:492] T a6b88354e73e493b933e7080ab70fb6f P 481b8f3a30ac44e59e23d3182b3f74c8: Bootstrap starting.
I20260709 12:22:33.087577 10672 raft_consensus.cc:740] T d263d9eb057b4c1c9903d22c36d7eeae P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1fd1428fbf4f01a112df4b8319bb97, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.088814 10672 consensus_queue.cc:260] T d263d9eb057b4c1c9903d22c36d7eeae P 4f1fd1428fbf4f01a112df4b8319bb97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.090776 10556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263d9eb057b4c1c9903d22c36d7eeae" candidate_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
I20260709 12:22:33.091419 10556 raft_consensus.cc:3060] T d263d9eb057b4c1c9903d22c36d7eeae P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.093760 10672 ts_tablet_manager.cc:1434] T d263d9eb057b4c1c9903d22c36d7eeae P 4f1fd1428fbf4f01a112df4b8319bb97: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:22:33.094811 10673 tablet_bootstrap.cc:654] T a6b88354e73e493b933e7080ab70fb6f P 481b8f3a30ac44e59e23d3182b3f74c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:33.094962 10672 tablet_bootstrap.cc:492] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97: Bootstrap starting.
I20260709 12:22:33.102180 10672 tablet_bootstrap.cc:654] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:33.103487 10684 leader_election.cc:290] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [CANDIDATE]: Term 1 election: Requested vote from peers 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193:37839), 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017)
I20260709 12:22:33.104092 10684 raft_consensus.cc:2749] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:33.108372 10556 raft_consensus.cc:2468] T d263d9eb057b4c1c9903d22c36d7eeae P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481b8f3a30ac44e59e23d3182b3f74c8 in term 1.
I20260709 12:22:33.109072 10444 leader_election.cc:304] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481b8f3a30ac44e59e23d3182b3f74c8, 5bc3a8e244614134a6e8d79f08217866; no voters: 4f1fd1428fbf4f01a112df4b8319bb97
I20260709 12:22:33.111135 10673 tablet_bootstrap.cc:492] T a6b88354e73e493b933e7080ab70fb6f P 481b8f3a30ac44e59e23d3182b3f74c8: No bootstrap required, opened a new log
I20260709 12:22:33.111676 10673 ts_tablet_manager.cc:1403] T a6b88354e73e493b933e7080ab70fb6f P 481b8f3a30ac44e59e23d3182b3f74c8: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.003s
I20260709 12:22:33.112895 10593 leader_election.cc:304] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481b8f3a30ac44e59e23d3182b3f74c8, 4f1fd1428fbf4f01a112df4b8319bb97; no voters: 
I20260709 12:22:33.114279 10675 raft_consensus.cc:2804] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:33.114713 10675 raft_consensus.cc:493] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.114414 10673 raft_consensus.cc:359] T a6b88354e73e493b933e7080ab70fb6f P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.115106 10675 raft_consensus.cc:3060] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.115231 10673 raft_consensus.cc:385] T a6b88354e73e493b933e7080ab70fb6f P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:33.115598 10673 raft_consensus.cc:740] T a6b88354e73e493b933e7080ab70fb6f P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481b8f3a30ac44e59e23d3182b3f74c8, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.116539 10717 raft_consensus.cc:2804] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:33.117324 10717 raft_consensus.cc:697] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 LEADER]: Becoming Leader. State: Replica: 481b8f3a30ac44e59e23d3182b3f74c8, State: Running, Role: LEADER
I20260709 12:22:33.118312 10717 consensus_queue.cc:237] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.120584 10673 consensus_queue.cc:260] T a6b88354e73e493b933e7080ab70fb6f P 481b8f3a30ac44e59e23d3182b3f74c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.125782 10673 ts_tablet_manager.cc:1434] T a6b88354e73e493b933e7080ab70fb6f P 481b8f3a30ac44e59e23d3182b3f74c8: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:22:33.126855 10481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263d9eb057b4c1c9903d22c36d7eeae" candidate_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
I20260709 12:22:33.128539 10630 raft_consensus.cc:3060] T 4e7ccaea05564aed872d76358690228f P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.128741 10673 tablet_bootstrap.cc:492] T a729467ab6c44459a6ddb0edf2213902 P 481b8f3a30ac44e59e23d3182b3f74c8: Bootstrap starting.
I20260709 12:22:33.128412 10675 raft_consensus.cc:515] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.129751 10481 raft_consensus.cc:2393] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 481b8f3a30ac44e59e23d3182b3f74c8 in current term 1: Already voted for candidate 5bc3a8e244614134a6e8d79f08217866 in this term.
I20260709 12:22:33.130945 10675 leader_election.cc:290] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 election: Requested vote from peers 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:33.130177 10379 catalog_manager.cc:5697] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193). New cstate: current_term: 1 leader_uuid: "5bc3a8e244614134a6e8d79f08217866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:33.127877 10672 tablet_bootstrap.cc:492] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97: No bootstrap required, opened a new log
I20260709 12:22:33.132122 10672 ts_tablet_manager.cc:1403] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.013s
I20260709 12:22:33.134032 10556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263d9eb057b4c1c9903d22c36d7eeae" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
I20260709 12:22:33.134868 10556 raft_consensus.cc:2393] T d263d9eb057b4c1c9903d22c36d7eeae P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bc3a8e244614134a6e8d79f08217866 in current term 1: Already voted for candidate 481b8f3a30ac44e59e23d3182b3f74c8 in this term.
I20260709 12:22:33.139472 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263d9eb057b4c1c9903d22c36d7eeae" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
I20260709 12:22:33.144057 10672 raft_consensus.cc:359] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.143052 10444 leader_election.cc:304] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc3a8e244614134a6e8d79f08217866; no voters: 481b8f3a30ac44e59e23d3182b3f74c8, 4f1fd1428fbf4f01a112df4b8319bb97
I20260709 12:22:33.144804 10672 raft_consensus.cc:385] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:33.145215 10672 raft_consensus.cc:740] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1fd1428fbf4f01a112df4b8319bb97, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.146023 10672 consensus_queue.cc:260] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.146821 10705 raft_consensus.cc:2749] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:33.147478 10705 consensus_queue.cc:1048] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:33.152567 10672 ts_tablet_manager.cc:1434] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:22:33.153774 10672 tablet_bootstrap.cc:492] T a729467ab6c44459a6ddb0edf2213902 P 4f1fd1428fbf4f01a112df4b8319bb97: Bootstrap starting.
I20260709 12:22:33.155678 10673 tablet_bootstrap.cc:654] T a729467ab6c44459a6ddb0edf2213902 P 481b8f3a30ac44e59e23d3182b3f74c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:33.160861 10378 catalog_manager.cc:5697] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195). New cstate: current_term: 1 leader_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:33.164028 10672 tablet_bootstrap.cc:654] T a729467ab6c44459a6ddb0edf2213902 P 4f1fd1428fbf4f01a112df4b8319bb97: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:33.170317 10673 tablet_bootstrap.cc:492] T a729467ab6c44459a6ddb0edf2213902 P 481b8f3a30ac44e59e23d3182b3f74c8: No bootstrap required, opened a new log
I20260709 12:22:33.170868 10673 ts_tablet_manager.cc:1403] T a729467ab6c44459a6ddb0edf2213902 P 481b8f3a30ac44e59e23d3182b3f74c8: Time spent bootstrapping tablet: real 0.042s	user 0.019s	sys 0.000s
I20260709 12:22:33.173636 10673 raft_consensus.cc:359] T a729467ab6c44459a6ddb0edf2213902 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.174367 10673 raft_consensus.cc:385] T a729467ab6c44459a6ddb0edf2213902 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:33.174651 10673 raft_consensus.cc:740] T a729467ab6c44459a6ddb0edf2213902 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481b8f3a30ac44e59e23d3182b3f74c8, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.175726 10673 consensus_queue.cc:260] T a729467ab6c44459a6ddb0edf2213902 P 481b8f3a30ac44e59e23d3182b3f74c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.177783 10673 ts_tablet_manager.cc:1434] T a729467ab6c44459a6ddb0edf2213902 P 481b8f3a30ac44e59e23d3182b3f74c8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:22:33.179091 10673 tablet_bootstrap.cc:492] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 481b8f3a30ac44e59e23d3182b3f74c8: Bootstrap starting.
I20260709 12:22:33.180310 10672 tablet_bootstrap.cc:492] T a729467ab6c44459a6ddb0edf2213902 P 4f1fd1428fbf4f01a112df4b8319bb97: No bootstrap required, opened a new log
I20260709 12:22:33.180703 10672 ts_tablet_manager.cc:1403] T a729467ab6c44459a6ddb0edf2213902 P 4f1fd1428fbf4f01a112df4b8319bb97: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.006s
I20260709 12:22:33.183254 10672 raft_consensus.cc:359] T a729467ab6c44459a6ddb0edf2213902 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.183947 10672 raft_consensus.cc:385] T a729467ab6c44459a6ddb0edf2213902 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:33.184237 10672 raft_consensus.cc:740] T a729467ab6c44459a6ddb0edf2213902 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1fd1428fbf4f01a112df4b8319bb97, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.184993 10673 tablet_bootstrap.cc:654] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 481b8f3a30ac44e59e23d3182b3f74c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:33.184955 10672 consensus_queue.cc:260] T a729467ab6c44459a6ddb0edf2213902 P 4f1fd1428fbf4f01a112df4b8319bb97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.186511 10705 consensus_queue.cc:1048] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:33.191777 10705 raft_consensus.cc:493] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.192312 10705 raft_consensus.cc:515] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.194595 10705 leader_election.cc:290] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:33.199084 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b88354e73e493b933e7080ab70fb6f" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" is_pre_election: true
I20260709 12:22:33.199826 10555 raft_consensus.cc:2468] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 0.
I20260709 12:22:33.200022 10673 tablet_bootstrap.cc:492] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 481b8f3a30ac44e59e23d3182b3f74c8: No bootstrap required, opened a new log
I20260709 12:22:33.200505 10673 ts_tablet_manager.cc:1403] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 481b8f3a30ac44e59e23d3182b3f74c8: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.008s
I20260709 12:22:33.202595 10672 ts_tablet_manager.cc:1434] T a729467ab6c44459a6ddb0edf2213902 P 4f1fd1428fbf4f01a112df4b8319bb97: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 12:22:33.203845 10672 tablet_bootstrap.cc:492] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97: Bootstrap starting.
I20260709 12:22:33.203476 10673 raft_consensus.cc:359] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.205188 10673 raft_consensus.cc:385] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:33.205626 10673 raft_consensus.cc:740] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481b8f3a30ac44e59e23d3182b3f74c8, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.206564 10673 consensus_queue.cc:260] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 481b8f3a30ac44e59e23d3182b3f74c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.209221 10673 ts_tablet_manager.cc:1434] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 481b8f3a30ac44e59e23d3182b3f74c8: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:22:33.209756 10628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b88354e73e493b933e7080ab70fb6f" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" is_pre_election: true
I20260709 12:22:33.210490 10628 raft_consensus.cc:2468] T a6b88354e73e493b933e7080ab70fb6f P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 0.
I20260709 12:22:33.210455 10444 leader_election.cc:304] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1fd1428fbf4f01a112df4b8319bb97, 5bc3a8e244614134a6e8d79f08217866; no voters: 
I20260709 12:22:33.211845 10675 raft_consensus.cc:2804] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:33.213604 10675 raft_consensus.cc:493] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.213984 10675 raft_consensus.cc:3060] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.219067 10672 tablet_bootstrap.cc:654] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:33.220501 10675 raft_consensus.cc:515] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.222496 10675 leader_election.cc:290] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 election: Requested vote from peers 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:33.223229 10556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b88354e73e493b933e7080ab70fb6f" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
I20260709 12:22:33.223938 10556 raft_consensus.cc:3060] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.224154 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b88354e73e493b933e7080ab70fb6f" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
I20260709 12:22:33.224727 10629 raft_consensus.cc:3060] T a6b88354e73e493b933e7080ab70fb6f P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.231985 10556 raft_consensus.cc:2468] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 1.
I20260709 12:22:33.232240 10629 raft_consensus.cc:2468] T a6b88354e73e493b933e7080ab70fb6f P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 1.
I20260709 12:22:33.233304 10444 leader_election.cc:304] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481b8f3a30ac44e59e23d3182b3f74c8, 5bc3a8e244614134a6e8d79f08217866; no voters: 
I20260709 12:22:33.233678 10672 tablet_bootstrap.cc:492] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97: No bootstrap required, opened a new log
I20260709 12:22:33.234210 10672 ts_tablet_manager.cc:1403] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.003s
I20260709 12:22:33.234045 10675 raft_consensus.cc:2804] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:33.234745 10675 raft_consensus.cc:697] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Running, Role: LEADER
I20260709 12:22:33.235440 10675 consensus_queue.cc:237] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.236519 10672 raft_consensus.cc:359] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.237049 10672 raft_consensus.cc:385] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:33.237303 10672 raft_consensus.cc:740] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1fd1428fbf4f01a112df4b8319bb97, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.237888 10672 consensus_queue.cc:260] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.239785 10672 ts_tablet_manager.cc:1434] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:22:33.243088 10378 catalog_manager.cc:5697] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193). New cstate: current_term: 1 leader_uuid: "5bc3a8e244614134a6e8d79f08217866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:33.251437 10556 raft_consensus.cc:3060] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.257385 10675 consensus_queue.cc:1048] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:33.269809 10675 consensus_queue.cc:1048] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:33.317655 10680 raft_consensus.cc:493] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.318248 10680 raft_consensus.cc:515] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.319886 10680 leader_election.cc:290] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193:37839), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:33.320874 10481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e7e51c13cd48d8a5e2eaba8d99e717" candidate_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc3a8e244614134a6e8d79f08217866" is_pre_election: true
I20260709 12:22:33.321038 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e7e51c13cd48d8a5e2eaba8d99e717" candidate_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" is_pre_election: true
I20260709 12:22:33.321586 10481 raft_consensus.cc:2468] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1fd1428fbf4f01a112df4b8319bb97 in term 0.
I20260709 12:22:33.321583 10629 raft_consensus.cc:2468] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1fd1428fbf4f01a112df4b8319bb97 in term 0.
I20260709 12:22:33.322932 10520 leader_election.cc:304] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1fd1428fbf4f01a112df4b8319bb97, 5bc3a8e244614134a6e8d79f08217866; no voters: 
I20260709 12:22:33.323830 10680 raft_consensus.cc:2804] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:33.324185 10680 raft_consensus.cc:493] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.324563 10680 raft_consensus.cc:3060] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.329769 10680 raft_consensus.cc:515] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.331568 10680 leader_election.cc:290] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97 [CANDIDATE]: Term 1 election: Requested vote from peers 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193:37839), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:33.332650 10481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e7e51c13cd48d8a5e2eaba8d99e717" candidate_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
I20260709 12:22:33.332650 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e7e51c13cd48d8a5e2eaba8d99e717" candidate_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
I20260709 12:22:33.333591 10481 raft_consensus.cc:3060] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.333658 10629 raft_consensus.cc:3060] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.340909 10675 raft_consensus.cc:493] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.341022 10629 raft_consensus.cc:2468] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1fd1428fbf4f01a112df4b8319bb97 in term 1.
I20260709 12:22:33.341022 10481 raft_consensus.cc:2468] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1fd1428fbf4f01a112df4b8319bb97 in term 1.
I20260709 12:22:33.341429 10675 raft_consensus.cc:515] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.342447 10520 leader_election.cc:304] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1fd1428fbf4f01a112df4b8319bb97, 5bc3a8e244614134a6e8d79f08217866; no voters: 
I20260709 12:22:33.343328 10680 raft_consensus.cc:2804] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:33.343745 10675 leader_election.cc:290] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:33.343837 10680 raft_consensus.cc:697] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 LEADER]: Becoming Leader. State: Replica: 4f1fd1428fbf4f01a112df4b8319bb97, State: Running, Role: LEADER
I20260709 12:22:33.344580 10556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a729467ab6c44459a6ddb0edf2213902" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" is_pre_election: true
I20260709 12:22:33.344748 10680 consensus_queue.cc:237] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.344978 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a729467ab6c44459a6ddb0edf2213902" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" is_pre_election: true
I20260709 12:22:33.345245 10556 raft_consensus.cc:2468] T a729467ab6c44459a6ddb0edf2213902 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 0.
I20260709 12:22:33.345677 10629 raft_consensus.cc:2468] T a729467ab6c44459a6ddb0edf2213902 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 0.
I20260709 12:22:33.346493 10444 leader_election.cc:304] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1fd1428fbf4f01a112df4b8319bb97, 5bc3a8e244614134a6e8d79f08217866; no voters: 
I20260709 12:22:33.347256 10675 raft_consensus.cc:2804] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:33.347636 10675 raft_consensus.cc:493] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.347968 10675 raft_consensus.cc:3060] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.353317 10675 raft_consensus.cc:515] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.353574 10378 catalog_manager.cc:5697] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:33.355073 10675 leader_election.cc:290] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 election: Requested vote from peers 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:33.355973 10556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a729467ab6c44459a6ddb0edf2213902" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
I20260709 12:22:33.356215 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a729467ab6c44459a6ddb0edf2213902" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
I20260709 12:22:33.356513 10556 raft_consensus.cc:3060] T a729467ab6c44459a6ddb0edf2213902 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.356803 10629 raft_consensus.cc:3060] T a729467ab6c44459a6ddb0edf2213902 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.362969 10556 raft_consensus.cc:2468] T a729467ab6c44459a6ddb0edf2213902 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 1.
I20260709 12:22:33.363140 10629 raft_consensus.cc:2468] T a729467ab6c44459a6ddb0edf2213902 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 1.
I20260709 12:22:33.364553 10444 leader_election.cc:304] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481b8f3a30ac44e59e23d3182b3f74c8, 5bc3a8e244614134a6e8d79f08217866; no voters: 
I20260709 12:22:33.365355 10675 raft_consensus.cc:2804] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:33.365747 10675 raft_consensus.cc:697] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Running, Role: LEADER
I20260709 12:22:33.366557 10675 consensus_queue.cc:237] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.373502 10378 catalog_manager.cc:5697] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193). New cstate: current_term: 1 leader_uuid: "5bc3a8e244614134a6e8d79f08217866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:33.410804 10680 raft_consensus.cc:493] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.411398 10680 raft_consensus.cc:515] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.413069 10680 leader_election.cc:290] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193:37839), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:33.413892 10481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc2a62c9d164bac97e30583925c5818" candidate_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc3a8e244614134a6e8d79f08217866" is_pre_election: true
I20260709 12:22:33.414229 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc2a62c9d164bac97e30583925c5818" candidate_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" is_pre_election: true
I20260709 12:22:33.414880 10629 raft_consensus.cc:2393] T 8fc2a62c9d164bac97e30583925c5818 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1fd1428fbf4f01a112df4b8319bb97 in current term 1: Already voted for candidate 5bc3a8e244614134a6e8d79f08217866 in this term.
I20260709 12:22:33.415709 10519 leader_election.cc:304] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1fd1428fbf4f01a112df4b8319bb97; no voters: 481b8f3a30ac44e59e23d3182b3f74c8, 5bc3a8e244614134a6e8d79f08217866
I20260709 12:22:33.416404 10680 raft_consensus.cc:3060] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.421051 10680 raft_consensus.cc:2749] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:33.421700 10707 raft_consensus.cc:493] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.422223 10707 raft_consensus.cc:515] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.423910 10707 leader_election.cc:290] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193:37839), 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017)
I20260709 12:22:33.424854 10481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be364ca393d24f51b26f766d410342f0" candidate_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc3a8e244614134a6e8d79f08217866" is_pre_election: true
I20260709 12:22:33.425110 10556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be364ca393d24f51b26f766d410342f0" candidate_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" is_pre_election: true
I20260709 12:22:33.425606 10481 raft_consensus.cc:2393] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 481b8f3a30ac44e59e23d3182b3f74c8 in current term 1: Already voted for candidate 4f1fd1428fbf4f01a112df4b8319bb97 in this term.
I20260709 12:22:33.426538 10594 leader_election.cc:304] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 481b8f3a30ac44e59e23d3182b3f74c8; no voters: 4f1fd1428fbf4f01a112df4b8319bb97, 5bc3a8e244614134a6e8d79f08217866
I20260709 12:22:33.427186 10707 raft_consensus.cc:3060] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.432053 10707 raft_consensus.cc:2749] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:33.436784 10675 consensus_queue.cc:1048] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:33.438426 10675 consensus_queue.cc:1048] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:33.464644 10680 consensus_queue.cc:1048] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:33.476643 10698 consensus_queue.cc:1048] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:33.477568 10705 consensus_queue.cc:1048] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:33.493806 10675 consensus_queue.cc:1048] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:33.531234 10556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be364ca393d24f51b26f766d410342f0"
dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
mode: GRACEFUL
new_leader_uuid: "5bc3a8e244614134a6e8d79f08217866"
 from {username='slave'} at 127.0.0.1:60136
I20260709 12:22:33.531796 10556 raft_consensus.cc:606] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 LEADER]: Received request to transfer leadership to TS 5bc3a8e244614134a6e8d79f08217866
I20260709 12:22:33.548954 10628 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d263d9eb057b4c1c9903d22c36d7eeae"
dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
mode: GRACEFUL
new_leader_uuid: "5bc3a8e244614134a6e8d79f08217866"
 from {username='slave'} at 127.0.0.1:60656
I20260709 12:22:33.549600 10628 raft_consensus.cc:606] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 LEADER]: Received request to transfer leadership to TS 5bc3a8e244614134a6e8d79f08217866
I20260709 12:22:33.551347 10707 consensus_queue.cc:1048] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:33.558849 10717 raft_consensus.cc:993] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8: : Instructing follower 5bc3a8e244614134a6e8d79f08217866 to start an election
I20260709 12:22:33.559355 10717 raft_consensus.cc:1081] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 LEADER]: Signalling peer 5bc3a8e244614134a6e8d79f08217866 to start an election
I20260709 12:22:33.561968 10480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d263d9eb057b4c1c9903d22c36d7eeae"
dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
 from {username='slave'} at 127.0.0.1:57922
I20260709 12:22:33.562718 10480 raft_consensus.cc:493] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:33.563112 10480 raft_consensus.cc:3060] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:33.567440 10479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fc2a62c9d164bac97e30583925c5818"
dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
mode: GRACEFUL
new_leader_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
 from {username='slave'} at 127.0.0.1:57934
I20260709 12:22:33.568172 10479 raft_consensus.cc:606] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Received request to transfer leadership to TS 4f1fd1428fbf4f01a112df4b8319bb97
I20260709 12:22:33.569772 10717 consensus_queue.cc:1048] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:33.574385 10479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c45c01fcb344ea0a16f89b7f3c7bfb7"
dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
mode: GRACEFUL
new_leader_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
 from {username='slave'} at 127.0.0.1:57934
I20260709 12:22:33.575065 10479 raft_consensus.cc:606] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Received request to transfer leadership to TS 4f1fd1428fbf4f01a112df4b8319bb97
I20260709 12:22:33.576186 10480 raft_consensus.cc:515] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.577310 10481 raft_consensus.cc:1240] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Rejecting Update request from peer 481b8f3a30ac44e59e23d3182b3f74c8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:33.580576 10556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263d9eb057b4c1c9903d22c36d7eeae" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
I20260709 12:22:33.580751 10480 leader_election.cc:290] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 2 election: Requested vote from peers 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:33.581234 10556 raft_consensus.cc:3060] T d263d9eb057b4c1c9903d22c36d7eeae P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:33.582485 10628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263d9eb057b4c1c9903d22c36d7eeae" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
I20260709 12:22:33.582994 10628 raft_consensus.cc:3055] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:33.583237 10628 raft_consensus.cc:740] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 481b8f3a30ac44e59e23d3182b3f74c8, State: Running, Role: LEADER
I20260709 12:22:33.583875 10628 consensus_queue.cc:260] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.584669 10628 raft_consensus.cc:3060] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:33.586403 10479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6b88354e73e493b933e7080ab70fb6f"
dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
mode: GRACEFUL
new_leader_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
 from {username='slave'} at 127.0.0.1:57934
I20260709 12:22:33.587045 10479 raft_consensus.cc:606] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Received request to transfer leadership to TS 4f1fd1428fbf4f01a112df4b8319bb97
I20260709 12:22:33.586512 10556 raft_consensus.cc:2468] T d263d9eb057b4c1c9903d22c36d7eeae P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 2.
I20260709 12:22:33.590054 10628 raft_consensus.cc:2468] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 2.
I20260709 12:22:33.591117 10444 leader_election.cc:304] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481b8f3a30ac44e59e23d3182b3f74c8, 5bc3a8e244614134a6e8d79f08217866; no voters: 
I20260709 12:22:33.591902 10675 raft_consensus.cc:2804] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:33.592360 10675 raft_consensus.cc:697] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [term 2 LEADER]: Becoming Leader. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Running, Role: LEADER
I20260709 12:22:33.593160 10675 consensus_queue.cc:237] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.593242 10481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a729467ab6c44459a6ddb0edf2213902"
dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
mode: GRACEFUL
new_leader_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
 from {username='slave'} at 127.0.0.1:57934
I20260709 12:22:33.593904 10481 raft_consensus.cc:606] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Received request to transfer leadership to TS 4f1fd1428fbf4f01a112df4b8319bb97
I20260709 12:22:33.599607 10556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22e7e51c13cd48d8a5e2eaba8d99e717"
dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
mode: GRACEFUL
new_leader_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
 from {username='slave'} at 127.0.0.1:60136
I20260709 12:22:33.600224 10556 raft_consensus.cc:606] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 LEADER]: Received request to transfer leadership to TS 481b8f3a30ac44e59e23d3182b3f74c8
I20260709 12:22:33.601142 10379 catalog_manager.cc:5697] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 reported cstate change: term changed from 1 to 2, leader changed from 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195) to 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193). New cstate: current_term: 2 leader_uuid: "5bc3a8e244614134a6e8d79f08217866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:33.633076 10675 consensus_queue.cc:1048] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:33.640005 10677 raft_consensus.cc:993] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866: : Instructing follower 4f1fd1428fbf4f01a112df4b8319bb97 to start an election
I20260709 12:22:33.640618 10712 raft_consensus.cc:1081] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Signalling peer 4f1fd1428fbf4f01a112df4b8319bb97 to start an election
I20260709 12:22:33.642319 10555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c45c01fcb344ea0a16f89b7f3c7bfb7"
dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
 from {username='slave'} at 127.0.0.1:60122
I20260709 12:22:33.643569 10555 raft_consensus.cc:493] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:33.643963 10555 raft_consensus.cc:3060] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:33.646512 10677 consensus_queue.cc:1048] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:33.650849 10555 raft_consensus.cc:515] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.654116 10555 leader_election.cc:290] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97 [CANDIDATE]: Term 2 election: Requested vote from peers 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193:37839), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:33.654129 10481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c45c01fcb344ea0a16f89b7f3c7bfb7" candidate_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
I20260709 12:22:33.654850 10481 raft_consensus.cc:3055] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:33.655186 10481 raft_consensus.cc:740] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Running, Role: LEADER
I20260709 12:22:33.655328 10628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c45c01fcb344ea0a16f89b7f3c7bfb7" candidate_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
I20260709 12:22:33.656096 10628 raft_consensus.cc:3060] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:33.656035 10481 consensus_queue.cc:260] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.657378 10481 raft_consensus.cc:3060] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:33.662525 10481 raft_consensus.cc:2468] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1fd1428fbf4f01a112df4b8319bb97 in term 2.
I20260709 12:22:33.663345 10628 raft_consensus.cc:2468] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1fd1428fbf4f01a112df4b8319bb97 in term 2.
I20260709 12:22:33.663672 10520 leader_election.cc:304] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1fd1428fbf4f01a112df4b8319bb97, 5bc3a8e244614134a6e8d79f08217866; no voters: 
I20260709 12:22:33.664680 10698 raft_consensus.cc:2804] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:33.665189 10698 raft_consensus.cc:697] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 LEADER]: Becoming Leader. State: Replica: 4f1fd1428fbf4f01a112df4b8319bb97, State: Running, Role: LEADER
I20260709 12:22:33.666011 10698 consensus_queue.cc:237] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.672545 10376 catalog_manager.cc:5697] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97 reported cstate change: term changed from 1 to 2, leader changed from 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193) to 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194). New cstate: current_term: 2 leader_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:33.734525 10677 consensus_queue.cc:1048] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:33.740624 10675 raft_consensus.cc:993] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866: : Instructing follower 4f1fd1428fbf4f01a112df4b8319bb97 to start an election
I20260709 12:22:33.741130 10705 raft_consensus.cc:1081] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Signalling peer 4f1fd1428fbf4f01a112df4b8319bb97 to start an election
I20260709 12:22:33.744598 10556 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6b88354e73e493b933e7080ab70fb6f"
dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
 from {username='slave'} at 127.0.0.1:60122
I20260709 12:22:33.745224 10556 raft_consensus.cc:493] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:33.745615 10556 raft_consensus.cc:3060] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:33.747320 10675 consensus_queue.cc:1048] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:33.752156 10556 raft_consensus.cc:515] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.755297 10481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b88354e73e493b933e7080ab70fb6f" candidate_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
I20260709 12:22:33.755936 10481 raft_consensus.cc:3055] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:33.756115 10628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b88354e73e493b933e7080ab70fb6f" candidate_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
I20260709 12:22:33.756314 10481 raft_consensus.cc:740] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Running, Role: LEADER
I20260709 12:22:33.757054 10556 leader_election.cc:290] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97 [CANDIDATE]: Term 2 election: Requested vote from peers 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193:37839), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:33.757179 10481 consensus_queue.cc:260] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.756719 10628 raft_consensus.cc:3060] T a6b88354e73e493b933e7080ab70fb6f P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:33.758179 10481 raft_consensus.cc:3060] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:33.763598 10675 consensus_queue.cc:1048] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:33.765175 10481 raft_consensus.cc:2468] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1fd1428fbf4f01a112df4b8319bb97 in term 2.
I20260709 12:22:33.766084 10628 raft_consensus.cc:2468] T a6b88354e73e493b933e7080ab70fb6f P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1fd1428fbf4f01a112df4b8319bb97 in term 2.
I20260709 12:22:33.766325 10520 leader_election.cc:304] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1fd1428fbf4f01a112df4b8319bb97, 5bc3a8e244614134a6e8d79f08217866; no voters: 
I20260709 12:22:33.767166 10698 raft_consensus.cc:2804] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:33.767634 10698 raft_consensus.cc:697] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 LEADER]: Becoming Leader. State: Replica: 4f1fd1428fbf4f01a112df4b8319bb97, State: Running, Role: LEADER
I20260709 12:22:33.768477 10698 consensus_queue.cc:237] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.773448 10712 raft_consensus.cc:993] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866: : Instructing follower 4f1fd1428fbf4f01a112df4b8319bb97 to start an election
I20260709 12:22:33.773921 10705 raft_consensus.cc:1081] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Signalling peer 4f1fd1428fbf4f01a112df4b8319bb97 to start an election
I20260709 12:22:33.775555 10555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a729467ab6c44459a6ddb0edf2213902"
dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
 from {username='slave'} at 127.0.0.1:60122
I20260709 12:22:33.778452 10712 consensus_queue.cc:1048] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:33.779743 10555 raft_consensus.cc:493] T a729467ab6c44459a6ddb0edf2213902 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:33.780194 10555 raft_consensus.cc:3060] T a729467ab6c44459a6ddb0edf2213902 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:33.786520 10376 catalog_manager.cc:5697] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97 reported cstate change: term changed from 1 to 2, leader changed from 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193) to 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194). New cstate: current_term: 2 leader_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:33.787166 10555 raft_consensus.cc:515] T a729467ab6c44459a6ddb0edf2213902 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.792027 10481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a729467ab6c44459a6ddb0edf2213902" candidate_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
I20260709 12:22:33.792675 10481 raft_consensus.cc:3055] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:33.792949 10628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a729467ab6c44459a6ddb0edf2213902" candidate_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
I20260709 12:22:33.793617 10628 raft_consensus.cc:3060] T a729467ab6c44459a6ddb0edf2213902 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:33.793005 10481 raft_consensus.cc:740] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Running, Role: LEADER
I20260709 12:22:33.794638 10481 consensus_queue.cc:260] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.795776 10481 raft_consensus.cc:3060] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:33.798249 10555 leader_election.cc:290] T a729467ab6c44459a6ddb0edf2213902 P 4f1fd1428fbf4f01a112df4b8319bb97 [CANDIDATE]: Term 2 election: Requested vote from peers 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193:37839), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:33.799111 10628 raft_consensus.cc:2468] T a729467ab6c44459a6ddb0edf2213902 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1fd1428fbf4f01a112df4b8319bb97 in term 2.
I20260709 12:22:33.800345 10519 leader_election.cc:304] T a729467ab6c44459a6ddb0edf2213902 P 4f1fd1428fbf4f01a112df4b8319bb97 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481b8f3a30ac44e59e23d3182b3f74c8, 4f1fd1428fbf4f01a112df4b8319bb97; no voters: 
I20260709 12:22:33.801252 10698 raft_consensus.cc:2804] T a729467ab6c44459a6ddb0edf2213902 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:33.801723 10698 raft_consensus.cc:697] T a729467ab6c44459a6ddb0edf2213902 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 LEADER]: Becoming Leader. State: Replica: 4f1fd1428fbf4f01a112df4b8319bb97, State: Running, Role: LEADER
I20260709 12:22:33.802301 10481 raft_consensus.cc:2468] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1fd1428fbf4f01a112df4b8319bb97 in term 2.
I20260709 12:22:33.802559 10698 consensus_queue.cc:237] T a729467ab6c44459a6ddb0edf2213902 P 4f1fd1428fbf4f01a112df4b8319bb97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.812383 10376 catalog_manager.cc:5697] T a729467ab6c44459a6ddb0edf2213902 P 4f1fd1428fbf4f01a112df4b8319bb97 reported cstate change: term changed from 1 to 2, leader changed from 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193) to 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194). New cstate: current_term: 2 leader_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:33.847754 10712 raft_consensus.cc:993] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866: : Instructing follower 4f1fd1428fbf4f01a112df4b8319bb97 to start an election
I20260709 12:22:33.848176 10675 raft_consensus.cc:1081] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Signalling peer 4f1fd1428fbf4f01a112df4b8319bb97 to start an election
I20260709 12:22:33.849632 10555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8fc2a62c9d164bac97e30583925c5818"
dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
 from {username='slave'} at 127.0.0.1:60122
I20260709 12:22:33.850126 10555 raft_consensus.cc:493] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:33.850445 10555 raft_consensus.cc:3060] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:33.854925 10555 raft_consensus.cc:515] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.856485 10555 leader_election.cc:290] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 [CANDIDATE]: Term 2 election: Requested vote from peers 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193:37839), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:33.857420 10481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc2a62c9d164bac97e30583925c5818" candidate_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
I20260709 12:22:33.857602 10628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc2a62c9d164bac97e30583925c5818" candidate_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
I20260709 12:22:33.858508 10481 raft_consensus.cc:3055] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:33.858592 10628 raft_consensus.cc:3060] T 8fc2a62c9d164bac97e30583925c5818 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:33.858932 10481 raft_consensus.cc:740] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Running, Role: LEADER
I20260709 12:22:33.859812 10481 consensus_queue.cc:260] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.861101 10481 raft_consensus.cc:3060] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:33.861704 10698 consensus_queue.cc:1048] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:33.865833 10628 raft_consensus.cc:2468] T 8fc2a62c9d164bac97e30583925c5818 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1fd1428fbf4f01a112df4b8319bb97 in term 2.
I20260709 12:22:33.867825 10519 leader_election.cc:304] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481b8f3a30ac44e59e23d3182b3f74c8, 4f1fd1428fbf4f01a112df4b8319bb97; no voters: 
I20260709 12:22:33.868901 10739 raft_consensus.cc:2804] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:33.869390 10739 raft_consensus.cc:697] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 LEADER]: Becoming Leader. State: Replica: 4f1fd1428fbf4f01a112df4b8319bb97, State: Running, Role: LEADER
I20260709 12:22:33.869804 10481 raft_consensus.cc:2468] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1fd1428fbf4f01a112df4b8319bb97 in term 2.
I20260709 12:22:33.869856 10680 consensus_queue.cc:1048] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:33.870270 10739 consensus_queue.cc:237] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.876428 10680 raft_consensus.cc:993] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97: : Instructing follower 481b8f3a30ac44e59e23d3182b3f74c8 to start an election
I20260709 12:22:33.876901 10680 raft_consensus.cc:1081] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 LEADER]: Signalling peer 481b8f3a30ac44e59e23d3182b3f74c8 to start an election
I20260709 12:22:33.879892 10379 catalog_manager.cc:5697] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 reported cstate change: term changed from 1 to 2, leader changed from 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193) to 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194). New cstate: current_term: 2 leader_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:33.885447 10628 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22e7e51c13cd48d8a5e2eaba8d99e717"
dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
 from {username='slave'} at 127.0.0.1:60646
I20260709 12:22:33.886082 10628 raft_consensus.cc:493] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:33.886511 10628 raft_consensus.cc:3060] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:33.893693 10628 raft_consensus.cc:515] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.896747 10628 leader_election.cc:290] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 481b8f3a30ac44e59e23d3182b3f74c8 [CANDIDATE]: Term 2 election: Requested vote from peers 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193:37839), 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017)
I20260709 12:22:33.896747 10481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e7e51c13cd48d8a5e2eaba8d99e717" candidate_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
I20260709 12:22:33.897657 10481 raft_consensus.cc:3060] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:33.897969 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e7e51c13cd48d8a5e2eaba8d99e717" candidate_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
I20260709 12:22:33.898593 10555 raft_consensus.cc:3055] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:33.898921 10555 raft_consensus.cc:740] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f1fd1428fbf4f01a112df4b8319bb97, State: Running, Role: LEADER
I20260709 12:22:33.899722 10555 consensus_queue.cc:260] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.900978 10555 raft_consensus.cc:3060] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:33.905364 10481 raft_consensus.cc:2468] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481b8f3a30ac44e59e23d3182b3f74c8 in term 2.
I20260709 12:22:33.907881 10555 raft_consensus.cc:2468] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481b8f3a30ac44e59e23d3182b3f74c8 in term 2.
I20260709 12:22:33.908861 10594 leader_election.cc:304] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 481b8f3a30ac44e59e23d3182b3f74c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481b8f3a30ac44e59e23d3182b3f74c8, 5bc3a8e244614134a6e8d79f08217866; no voters: 
I20260709 12:22:33.909615 10717 raft_consensus.cc:2804] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:33.910087 10717 raft_consensus.cc:697] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 LEADER]: Becoming Leader. State: Replica: 481b8f3a30ac44e59e23d3182b3f74c8, State: Running, Role: LEADER
I20260709 12:22:33.910923 10717 consensus_queue.cc:237] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 481b8f3a30ac44e59e23d3182b3f74c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.916991 10379 catalog_manager.cc:5697] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 481b8f3a30ac44e59e23d3182b3f74c8 reported cstate change: term changed from 1 to 2, leader changed from 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194) to 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195). New cstate: current_term: 2 leader_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:33.938009 10698 raft_consensus.cc:993] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97: : Instructing follower 5bc3a8e244614134a6e8d79f08217866 to start an election
I20260709 12:22:33.938446 10739 raft_consensus.cc:1081] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 LEADER]: Signalling peer 5bc3a8e244614134a6e8d79f08217866 to start an election
I20260709 12:22:33.940019 10481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be364ca393d24f51b26f766d410342f0"
dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
 from {username='slave'} at 127.0.0.1:57916
I20260709 12:22:33.940500 10481 raft_consensus.cc:493] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:33.940805 10481 raft_consensus.cc:3060] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:33.945601 10481 raft_consensus.cc:515] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.947286 10481 leader_election.cc:290] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 2 election: Requested vote from peers 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:33.948683 10628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be364ca393d24f51b26f766d410342f0" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
I20260709 12:22:33.949334 10628 raft_consensus.cc:3060] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:33.950222 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be364ca393d24f51b26f766d410342f0" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
I20260709 12:22:33.950865 10555 raft_consensus.cc:3055] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:33.951224 10555 raft_consensus.cc:740] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f1fd1428fbf4f01a112df4b8319bb97, State: Running, Role: LEADER
I20260709 12:22:33.952059 10555 consensus_queue.cc:260] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.953034 10555 raft_consensus.cc:3060] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:33.956390 10628 raft_consensus.cc:2468] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 2.
I20260709 12:22:33.956943 10630 raft_consensus.cc:1240] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Rejecting Update request from peer 4f1fd1428fbf4f01a112df4b8319bb97 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:33.958976 10444 leader_election.cc:304] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481b8f3a30ac44e59e23d3182b3f74c8, 5bc3a8e244614134a6e8d79f08217866; no voters: 
I20260709 12:22:33.959540 10555 raft_consensus.cc:2468] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 2.
I20260709 12:22:33.959823 10675 raft_consensus.cc:2804] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:33.960330 10675 raft_consensus.cc:697] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 2 LEADER]: Becoming Leader. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Running, Role: LEADER
I20260709 12:22:33.961149 10675 consensus_queue.cc:237] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:33.967231 10379 catalog_manager.cc:5697] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 reported cstate change: term changed from 1 to 2, leader changed from 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194) to 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193). New cstate: current_term: 2 leader_uuid: "5bc3a8e244614134a6e8d79f08217866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:34.012777 10555 raft_consensus.cc:1275] T d263d9eb057b4c1c9903d22c36d7eeae P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 FOLLOWER]: Refusing update from remote peer 5bc3a8e244614134a6e8d79f08217866: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:34.014226 10712 consensus_queue.cc:1048] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:34.021004 10628 raft_consensus.cc:1275] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Refusing update from remote peer 5bc3a8e244614134a6e8d79f08217866: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:34.023348 10712 consensus_queue.cc:1048] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:34.089298 10628 raft_consensus.cc:1275] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Refusing update from remote peer 4f1fd1428fbf4f01a112df4b8319bb97: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:34.090633 10739 consensus_queue.cc:1048] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:34.097918 10481 raft_consensus.cc:1275] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Refusing update from remote peer 4f1fd1428fbf4f01a112df4b8319bb97: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:34.099828 10680 consensus_queue.cc:1048] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:34.230052 10481 raft_consensus.cc:1275] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Refusing update from remote peer 4f1fd1428fbf4f01a112df4b8319bb97: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:34.231451 10680 consensus_queue.cc:1048] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:34.238610 10628 raft_consensus.cc:1275] T a6b88354e73e493b933e7080ab70fb6f P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Refusing update from remote peer 4f1fd1428fbf4f01a112df4b8319bb97: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:34.240255 10739 consensus_queue.cc:1048] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:34.274791 10481 raft_consensus.cc:1275] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Refusing update from remote peer 4f1fd1428fbf4f01a112df4b8319bb97: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:34.276072 10739 consensus_queue.cc:1048] T a729467ab6c44459a6ddb0edf2213902 P 4f1fd1428fbf4f01a112df4b8319bb97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:34.287617 10628 raft_consensus.cc:1275] T a729467ab6c44459a6ddb0edf2213902 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Refusing update from remote peer 4f1fd1428fbf4f01a112df4b8319bb97: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:34.289810 10756 consensus_queue.cc:1048] T a729467ab6c44459a6ddb0edf2213902 P 4f1fd1428fbf4f01a112df4b8319bb97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:34.343967 10481 raft_consensus.cc:1275] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Refusing update from remote peer 481b8f3a30ac44e59e23d3182b3f74c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:34.345273 10717 consensus_queue.cc:1048] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 481b8f3a30ac44e59e23d3182b3f74c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:34.353238 10555 raft_consensus.cc:1275] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 FOLLOWER]: Refusing update from remote peer 481b8f3a30ac44e59e23d3182b3f74c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:34.355259 10757 consensus_queue.cc:1048] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 481b8f3a30ac44e59e23d3182b3f74c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:34.363700 10555 raft_consensus.cc:1275] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 FOLLOWER]: Refusing update from remote peer 5bc3a8e244614134a6e8d79f08217866: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:34.365190 10712 consensus_queue.cc:1048] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:34.373345 10628 raft_consensus.cc:1275] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Refusing update from remote peer 5bc3a8e244614134a6e8d79f08217866: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:34.375504 10712 consensus_queue.cc:1048] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:34.402946 10630 raft_consensus.cc:1275] T 8fc2a62c9d164bac97e30583925c5818 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Refusing update from remote peer 4f1fd1428fbf4f01a112df4b8319bb97: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:34.404191 10756 consensus_queue.cc:1048] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:34.411945 10481 raft_consensus.cc:1275] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Refusing update from remote peer 4f1fd1428fbf4f01a112df4b8319bb97: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:34.413589 10680 consensus_queue.cc:1048] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:36.634488  9799 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:22:36.635278  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:36.650815 10479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "608ebe9b962e4d27b37af29ad96df0bc"
dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
mode: GRACEFUL
new_leader_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
 from {username='slave'} at 127.0.0.1:57940
I20260709 12:22:36.651336 10479 raft_consensus.cc:606] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Received request to transfer leadership to TS 481b8f3a30ac44e59e23d3182b3f74c8
I20260709 12:22:36.654088 10479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be364ca393d24f51b26f766d410342f0"
dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
mode: GRACEFUL
new_leader_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
 from {username='slave'} at 127.0.0.1:57940
I20260709 12:22:36.654739 10479 raft_consensus.cc:606] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 2 LEADER]: Received request to transfer leadership to TS 481b8f3a30ac44e59e23d3182b3f74c8
I20260709 12:22:36.655936  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:36.656399  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:36.772513 10761 raft_consensus.cc:993] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866: : Instructing follower 481b8f3a30ac44e59e23d3182b3f74c8 to start an election
I20260709 12:22:36.772989 10712 raft_consensus.cc:1081] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Signalling peer 481b8f3a30ac44e59e23d3182b3f74c8 to start an election
I20260709 12:22:36.774569 10628 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "608ebe9b962e4d27b37af29ad96df0bc"
dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
 from {username='slave'} at 127.0.0.1:60638
I20260709 12:22:36.775034 10628 raft_consensus.cc:493] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:36.775288 10628 raft_consensus.cc:3060] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:36.779986 10628 raft_consensus.cc:515] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:36.781584 10628 leader_election.cc:290] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 [CANDIDATE]: Term 2 election: Requested vote from peers 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193:37839), 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017)
I20260709 12:22:36.782879 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ebe9b962e4d27b37af29ad96df0bc" candidate_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
I20260709 12:22:36.782938 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ebe9b962e4d27b37af29ad96df0bc" candidate_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
I20260709 12:22:36.783684 10555 raft_consensus.cc:3060] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:36.783931 10479 raft_consensus.cc:3055] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:36.784312 10479 raft_consensus.cc:740] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Running, Role: LEADER
I20260709 12:22:36.785174 10479 consensus_queue.cc:260] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:36.786465 10479 raft_consensus.cc:3060] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:36.789554 10555 raft_consensus.cc:2468] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481b8f3a30ac44e59e23d3182b3f74c8 in term 2.
I20260709 12:22:36.790665 10593 leader_election.cc:304] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481b8f3a30ac44e59e23d3182b3f74c8, 4f1fd1428fbf4f01a112df4b8319bb97; no voters: 
I20260709 12:22:36.791385 10757 raft_consensus.cc:2804] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:36.791844 10479 raft_consensus.cc:2468] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481b8f3a30ac44e59e23d3182b3f74c8 in term 2.
I20260709 12:22:36.792660 10757 raft_consensus.cc:697] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 LEADER]: Becoming Leader. State: Replica: 481b8f3a30ac44e59e23d3182b3f74c8, State: Running, Role: LEADER
I20260709 12:22:36.793525 10757 consensus_queue.cc:237] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:36.800275 10376 catalog_manager.cc:5697] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 reported cstate change: term changed from 1 to 2, leader changed from 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193) to 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195). New cstate: current_term: 2 leader_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:37.098006 10761 raft_consensus.cc:993] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866: : Instructing follower 481b8f3a30ac44e59e23d3182b3f74c8 to start an election
I20260709 12:22:37.098498 10712 raft_consensus.cc:1081] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 2 LEADER]: Signalling peer 481b8f3a30ac44e59e23d3182b3f74c8 to start an election
I20260709 12:22:37.100133 10628 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be364ca393d24f51b26f766d410342f0"
dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
 from {username='slave'} at 127.0.0.1:60638
I20260709 12:22:37.100674 10628 raft_consensus.cc:493] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:37.100942 10628 raft_consensus.cc:3060] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:37.105571 10628 raft_consensus.cc:515] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:37.107138 10628 leader_election.cc:290] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [CANDIDATE]: Term 3 election: Requested vote from peers 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193:37839), 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017)
I20260709 12:22:37.107960 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be364ca393d24f51b26f766d410342f0" candidate_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
I20260709 12:22:37.108278 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be364ca393d24f51b26f766d410342f0" candidate_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
I20260709 12:22:37.108619 10479 raft_consensus.cc:3055] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:37.108819 10555 raft_consensus.cc:3060] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:37.108973 10479 raft_consensus.cc:740] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Running, Role: LEADER
I20260709 12:22:37.109889 10479 consensus_queue.cc:260] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:37.111182 10479 raft_consensus.cc:3060] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:37.115903 10555 raft_consensus.cc:2468] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481b8f3a30ac44e59e23d3182b3f74c8 in term 3.
I20260709 12:22:37.117136 10593 leader_election.cc:304] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481b8f3a30ac44e59e23d3182b3f74c8, 4f1fd1428fbf4f01a112df4b8319bb97; no voters: 
I20260709 12:22:37.118134 10757 raft_consensus.cc:2804] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:37.118412 10479 raft_consensus.cc:2468] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481b8f3a30ac44e59e23d3182b3f74c8 in term 3.
I20260709 12:22:37.118592 10757 raft_consensus.cc:697] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 3 LEADER]: Becoming Leader. State: Replica: 481b8f3a30ac44e59e23d3182b3f74c8, State: Running, Role: LEADER
I20260709 12:22:37.119499 10757 consensus_queue.cc:237] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:37.127055 10376 catalog_manager.cc:5697] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 reported cstate change: term changed from 2 to 3, leader changed from 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193) to 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195). New cstate: current_term: 3 leader_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:37.301057 10479 raft_consensus.cc:1275] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Refusing update from remote peer 481b8f3a30ac44e59e23d3182b3f74c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:37.302435 10757 consensus_queue.cc:1048] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:37.312172 10555 raft_consensus.cc:1275] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 FOLLOWER]: Refusing update from remote peer 481b8f3a30ac44e59e23d3182b3f74c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:37.314600 10757 consensus_queue.cc:1048] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:37.577559 10555 raft_consensus.cc:1275] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 3 FOLLOWER]: Refusing update from remote peer 481b8f3a30ac44e59e23d3182b3f74c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:37.578859 10762 consensus_queue.cc:1048] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:37.587296 10479 raft_consensus.cc:1275] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 3 FOLLOWER]: Refusing update from remote peer 481b8f3a30ac44e59e23d3182b3f74c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:37.589290 10757 consensus_queue.cc:1048] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:37.657384  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:37.663089  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:37.663545  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:38.664548  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:38.671157  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:38.671708  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:39.672806  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:39.678198  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:39.678635  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:40.679840  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:40.686419  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:40.686895  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:41.687961  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:41.693583  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:41.694067  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:42.695207  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:42.700448  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:42.700937  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:43.701954  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:43.708623  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:43.709036  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:44.709924  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:44.715240  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:44.715677  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:45.716650  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:45.722195  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:45.722643  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:46.753741  9799 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:22:46.758713 10630 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "608ebe9b962e4d27b37af29ad96df0bc"
dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
mode: GRACEFUL
new_leader_uuid: "5bc3a8e244614134a6e8d79f08217866"
 from {username='slave'} at 127.0.0.1:60656
I20260709 12:22:46.759485 10630 raft_consensus.cc:606] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 LEADER]: Received request to transfer leadership to TS 5bc3a8e244614134a6e8d79f08217866
I20260709 12:22:46.767359 10630 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be364ca393d24f51b26f766d410342f0"
dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
mode: GRACEFUL
new_leader_uuid: "5bc3a8e244614134a6e8d79f08217866"
 from {username='slave'} at 127.0.0.1:60656
I20260709 12:22:46.767858 10630 raft_consensus.cc:606] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 3 LEADER]: Received request to transfer leadership to TS 5bc3a8e244614134a6e8d79f08217866
I20260709 12:22:46.777572 10555 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fc2a62c9d164bac97e30583925c5818"
dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
mode: GRACEFUL
new_leader_uuid: "5bc3a8e244614134a6e8d79f08217866"
 from {username='slave'} at 127.0.0.1:60136
I20260709 12:22:46.778020 10555 raft_consensus.cc:606] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 LEADER]: Received request to transfer leadership to TS 5bc3a8e244614134a6e8d79f08217866
I20260709 12:22:46.782913 10555 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c45c01fcb344ea0a16f89b7f3c7bfb7"
dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
mode: GRACEFUL
new_leader_uuid: "5bc3a8e244614134a6e8d79f08217866"
 from {username='slave'} at 127.0.0.1:60136
I20260709 12:22:46.783352 10555 raft_consensus.cc:606] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 LEADER]: Received request to transfer leadership to TS 5bc3a8e244614134a6e8d79f08217866
I20260709 12:22:46.787855 10555 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6b88354e73e493b933e7080ab70fb6f"
dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
mode: GRACEFUL
new_leader_uuid: "5bc3a8e244614134a6e8d79f08217866"
 from {username='slave'} at 127.0.0.1:60136
I20260709 12:22:46.788278 10555 raft_consensus.cc:606] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 LEADER]: Received request to transfer leadership to TS 5bc3a8e244614134a6e8d79f08217866
I20260709 12:22:46.848485 10782 raft_consensus.cc:993] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8: : Instructing follower 5bc3a8e244614134a6e8d79f08217866 to start an election
I20260709 12:22:46.848888 10782 raft_consensus.cc:1081] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 3 LEADER]: Signalling peer 5bc3a8e244614134a6e8d79f08217866 to start an election
I20260709 12:22:46.850487 10481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be364ca393d24f51b26f766d410342f0"
dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
 from {username='slave'} at 127.0.0.1:57922
I20260709 12:22:46.850935 10481 raft_consensus.cc:493] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:46.851231 10481 raft_consensus.cc:3060] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:46.856290 10481 raft_consensus.cc:515] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:46.858008 10481 leader_election.cc:290] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 4 election: Requested vote from peers 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:46.858860 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be364ca393d24f51b26f766d410342f0" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
I20260709 12:22:46.859275 10630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be364ca393d24f51b26f766d410342f0" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
I20260709 12:22:46.859673 10555 raft_consensus.cc:3060] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:46.859809 10630 raft_consensus.cc:3055] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:46.860149 10630 raft_consensus.cc:740] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 481b8f3a30ac44e59e23d3182b3f74c8, State: Running, Role: LEADER
I20260709 12:22:46.861084 10630 consensus_queue.cc:260] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:46.862447 10630 raft_consensus.cc:3060] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:46.866912 10555 raft_consensus.cc:2468] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 4.
I20260709 12:22:46.868343 10444 leader_election.cc:304] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1fd1428fbf4f01a112df4b8319bb97, 5bc3a8e244614134a6e8d79f08217866; no voters: 
I20260709 12:22:46.869072 10784 raft_consensus.cc:2804] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:46.869141 10630 raft_consensus.cc:2468] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 4.
I20260709 12:22:46.869505 10784 raft_consensus.cc:697] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 4 LEADER]: Becoming Leader. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Running, Role: LEADER
I20260709 12:22:46.870498 10784 consensus_queue.cc:237] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:46.877310 10378 catalog_manager.cc:5697] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 reported cstate change: term changed from 3 to 4, leader changed from 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195) to 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193). New cstate: current_term: 4 leader_uuid: "5bc3a8e244614134a6e8d79f08217866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:46.883426 10789 raft_consensus.cc:993] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97: : Instructing follower 5bc3a8e244614134a6e8d79f08217866 to start an election
I20260709 12:22:46.883978 10783 raft_consensus.cc:1081] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 LEADER]: Signalling peer 5bc3a8e244614134a6e8d79f08217866 to start an election
I20260709 12:22:46.885751 10481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c45c01fcb344ea0a16f89b7f3c7bfb7"
dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
 from {username='slave'} at 127.0.0.1:57916
I20260709 12:22:46.886257 10481 raft_consensus.cc:493] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:46.886612 10481 raft_consensus.cc:3060] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:46.892663 10481 raft_consensus.cc:515] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:46.894042 10481 leader_election.cc:290] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 3 election: Requested vote from peers 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:46.894896 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c45c01fcb344ea0a16f89b7f3c7bfb7" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
I20260709 12:22:46.895084 10630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c45c01fcb344ea0a16f89b7f3c7bfb7" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
I20260709 12:22:46.895402 10555 raft_consensus.cc:3055] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:46.895615 10630 raft_consensus.cc:3060] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:46.895711 10555 raft_consensus.cc:740] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f1fd1428fbf4f01a112df4b8319bb97, State: Running, Role: LEADER
I20260709 12:22:46.896586 10555 consensus_queue.cc:260] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:46.897876 10555 raft_consensus.cc:3060] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:46.901433 10630 raft_consensus.cc:2468] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 3.
I20260709 12:22:46.902679 10444 leader_election.cc:304] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481b8f3a30ac44e59e23d3182b3f74c8, 5bc3a8e244614134a6e8d79f08217866; no voters: 
I20260709 12:22:46.903375 10784 raft_consensus.cc:2804] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:46.903367 10555 raft_consensus.cc:2468] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 3.
I20260709 12:22:46.903983 10784 raft_consensus.cc:697] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [term 3 LEADER]: Becoming Leader. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Running, Role: LEADER
I20260709 12:22:46.905227 10784 consensus_queue.cc:237] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:46.911831 10378 catalog_manager.cc:5697] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 reported cstate change: term changed from 2 to 3, leader changed from 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194) to 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193). New cstate: current_term: 3 leader_uuid: "5bc3a8e244614134a6e8d79f08217866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:47.134310 10789 raft_consensus.cc:993] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97: : Instructing follower 5bc3a8e244614134a6e8d79f08217866 to start an election
I20260709 12:22:47.134740 10783 raft_consensus.cc:1081] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 LEADER]: Signalling peer 5bc3a8e244614134a6e8d79f08217866 to start an election
I20260709 12:22:47.136255 10481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6b88354e73e493b933e7080ab70fb6f"
dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
 from {username='slave'} at 127.0.0.1:57916
I20260709 12:22:47.136669 10481 raft_consensus.cc:493] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:47.136904 10481 raft_consensus.cc:3060] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:47.140977 10481 raft_consensus.cc:515] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:47.142400 10481 leader_election.cc:290] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 3 election: Requested vote from peers 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:47.143278 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b88354e73e493b933e7080ab70fb6f" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
I20260709 12:22:47.143329 10630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b88354e73e493b933e7080ab70fb6f" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
I20260709 12:22:47.143985 10555 raft_consensus.cc:3055] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:47.144025 10630 raft_consensus.cc:3060] T a6b88354e73e493b933e7080ab70fb6f P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:47.144428 10555 raft_consensus.cc:740] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f1fd1428fbf4f01a112df4b8319bb97, State: Running, Role: LEADER
I20260709 12:22:47.145219 10555 consensus_queue.cc:260] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:47.146400 10555 raft_consensus.cc:3060] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:47.151149 10630 raft_consensus.cc:2468] T a6b88354e73e493b933e7080ab70fb6f P 481b8f3a30ac44e59e23d3182b3f74c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 3.
I20260709 12:22:47.152346 10444 leader_election.cc:304] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481b8f3a30ac44e59e23d3182b3f74c8, 5bc3a8e244614134a6e8d79f08217866; no voters: 
I20260709 12:22:47.152675 10555 raft_consensus.cc:2468] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 3.
I20260709 12:22:47.153168 10784 raft_consensus.cc:2804] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:47.153689 10784 raft_consensus.cc:697] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [term 3 LEADER]: Becoming Leader. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Running, Role: LEADER
I20260709 12:22:47.154539 10784 consensus_queue.cc:237] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:47.162022 10378 catalog_manager.cc:5697] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 reported cstate change: term changed from 2 to 3, leader changed from 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194) to 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193). New cstate: current_term: 3 leader_uuid: "5bc3a8e244614134a6e8d79f08217866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:47.254623 10782 raft_consensus.cc:993] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8: : Instructing follower 5bc3a8e244614134a6e8d79f08217866 to start an election
I20260709 12:22:47.255203 10786 raft_consensus.cc:1081] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 LEADER]: Signalling peer 5bc3a8e244614134a6e8d79f08217866 to start an election
I20260709 12:22:47.256788 10481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "608ebe9b962e4d27b37af29ad96df0bc"
dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
 from {username='slave'} at 127.0.0.1:57922
I20260709 12:22:47.257238 10481 raft_consensus.cc:493] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:47.257530 10481 raft_consensus.cc:3060] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:47.261796 10481 raft_consensus.cc:515] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:47.263485 10481 leader_election.cc:290] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 3 election: Requested vote from peers 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:47.264619 10630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ebe9b962e4d27b37af29ad96df0bc" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
I20260709 12:22:47.264619 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ebe9b962e4d27b37af29ad96df0bc" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
I20260709 12:22:47.265393 10630 raft_consensus.cc:3055] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:47.265820 10630 raft_consensus.cc:740] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 481b8f3a30ac44e59e23d3182b3f74c8, State: Running, Role: LEADER
I20260709 12:22:47.265460 10555 raft_consensus.cc:3060] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:47.267156 10630 consensus_queue.cc:260] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:47.268432 10630 raft_consensus.cc:3060] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:47.272324 10556 raft_consensus.cc:1275] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 4 FOLLOWER]: Refusing update from remote peer 5bc3a8e244614134a6e8d79f08217866: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:47.274317 10784 consensus_queue.cc:1048] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:47.275617 10630 raft_consensus.cc:2468] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 3.
I20260709 12:22:47.275617 10555 raft_consensus.cc:2468] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 3.
I20260709 12:22:47.281731 10444 leader_election.cc:304] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481b8f3a30ac44e59e23d3182b3f74c8, 5bc3a8e244614134a6e8d79f08217866; no voters: 
I20260709 12:22:47.285125 10784 raft_consensus.cc:2804] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:47.285725 10784 raft_consensus.cc:697] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 3 LEADER]: Becoming Leader. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Running, Role: LEADER
I20260709 12:22:47.286734 10784 consensus_queue.cc:237] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:47.297150 10630 raft_consensus.cc:1275] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 4 FOLLOWER]: Refusing update from remote peer 5bc3a8e244614134a6e8d79f08217866: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:47.298081 10378 catalog_manager.cc:5697] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 reported cstate change: term changed from 2 to 3, leader changed from 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195) to 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193). New cstate: current_term: 3 leader_uuid: "5bc3a8e244614134a6e8d79f08217866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:47.298954 10796 consensus_queue.cc:1048] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:47.355242 10630 raft_consensus.cc:1275] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 3 FOLLOWER]: Refusing update from remote peer 5bc3a8e244614134a6e8d79f08217866: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:47.356621 10785 consensus_queue.cc:1048] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:47.364048 10556 raft_consensus.cc:1275] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 3 FOLLOWER]: Refusing update from remote peer 5bc3a8e244614134a6e8d79f08217866: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:47.366008 10784 consensus_queue.cc:1048] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:47.375226 10783 raft_consensus.cc:993] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97: : Instructing follower 5bc3a8e244614134a6e8d79f08217866 to start an election
I20260709 12:22:47.375676 10789 raft_consensus.cc:1081] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 LEADER]: Signalling peer 5bc3a8e244614134a6e8d79f08217866 to start an election
I20260709 12:22:47.377138 10481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8fc2a62c9d164bac97e30583925c5818"
dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
 from {username='slave'} at 127.0.0.1:57916
I20260709 12:22:47.377574 10481 raft_consensus.cc:493] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:47.377890 10481 raft_consensus.cc:3060] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:47.382594 10481 raft_consensus.cc:515] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:47.384024 10481 leader_election.cc:290] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 3 election: Requested vote from peers 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:47.384876 10556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc2a62c9d164bac97e30583925c5818" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
I20260709 12:22:47.384960 10630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc2a62c9d164bac97e30583925c5818" candidate_uuid: "5bc3a8e244614134a6e8d79f08217866" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
I20260709 12:22:47.385612 10556 raft_consensus.cc:3055] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:47.385641 10630 raft_consensus.cc:3060] T 8fc2a62c9d164bac97e30583925c5818 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:47.386083 10556 raft_consensus.cc:740] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f1fd1428fbf4f01a112df4b8319bb97, State: Running, Role: LEADER
I20260709 12:22:47.386945 10556 consensus_queue.cc:260] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:47.388264 10556 raft_consensus.cc:3060] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:47.393101 10630 raft_consensus.cc:2468] T 8fc2a62c9d164bac97e30583925c5818 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 3.
I20260709 12:22:47.394375 10444 leader_election.cc:304] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481b8f3a30ac44e59e23d3182b3f74c8, 5bc3a8e244614134a6e8d79f08217866; no voters: 
I20260709 12:22:47.395076 10784 raft_consensus.cc:2804] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:47.395167 10556 raft_consensus.cc:2468] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc3a8e244614134a6e8d79f08217866 in term 3.
I20260709 12:22:47.395507 10784 raft_consensus.cc:697] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [term 3 LEADER]: Becoming Leader. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Running, Role: LEADER
I20260709 12:22:47.396365 10784 consensus_queue.cc:237] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:47.403246 10376 catalog_manager.cc:5697] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 reported cstate change: term changed from 2 to 3, leader changed from 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194) to 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193). New cstate: current_term: 3 leader_uuid: "5bc3a8e244614134a6e8d79f08217866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:47.657460 10630 raft_consensus.cc:1275] T a6b88354e73e493b933e7080ab70fb6f P 481b8f3a30ac44e59e23d3182b3f74c8 [term 3 FOLLOWER]: Refusing update from remote peer 5bc3a8e244614134a6e8d79f08217866: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:47.658859 10784 consensus_queue.cc:1048] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:47.668226 10556 raft_consensus.cc:1275] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97 [term 3 FOLLOWER]: Refusing update from remote peer 5bc3a8e244614134a6e8d79f08217866: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:47.670655 10797 consensus_queue.cc:1048] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:47.712321 10556 raft_consensus.cc:1275] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97 [term 3 FOLLOWER]: Refusing update from remote peer 5bc3a8e244614134a6e8d79f08217866: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:47.713544 10797 consensus_queue.cc:1048] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:47.722733 10630 raft_consensus.cc:1275] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 [term 3 FOLLOWER]: Refusing update from remote peer 5bc3a8e244614134a6e8d79f08217866: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:47.724655 10796 consensus_queue.cc:1048] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:47.943526 10628 raft_consensus.cc:1275] T 8fc2a62c9d164bac97e30583925c5818 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 3 FOLLOWER]: Refusing update from remote peer 5bc3a8e244614134a6e8d79f08217866: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:47.944818 10796 consensus_queue.cc:1048] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:47.953888 10556 raft_consensus.cc:1275] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 3 FOLLOWER]: Refusing update from remote peer 5bc3a8e244614134a6e8d79f08217866: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:47.955457 10784 consensus_queue.cc:1048] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:49.849820  9799 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:22:49.850764  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:49.858914 10481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "608ebe9b962e4d27b37af29ad96df0bc"
dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
mode: GRACEFUL
new_leader_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
 from {username='slave'} at 127.0.0.1:57940
I20260709 12:22:49.859668 10481 raft_consensus.cc:606] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 3 LEADER]: Received request to transfer leadership to TS 4f1fd1428fbf4f01a112df4b8319bb97
I20260709 12:22:49.862875 10481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63b02039e698478e8b8eb6f17c6ea91c"
dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
mode: GRACEFUL
new_leader_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
 from {username='slave'} at 127.0.0.1:57940
I20260709 12:22:49.863472 10481 raft_consensus.cc:606] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Received request to transfer leadership to TS 481b8f3a30ac44e59e23d3182b3f74c8
I20260709 12:22:49.865957 10481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be364ca393d24f51b26f766d410342f0"
dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
mode: GRACEFUL
new_leader_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
 from {username='slave'} at 127.0.0.1:57940
I20260709 12:22:49.866657 10481 raft_consensus.cc:606] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 4 LEADER]: Received request to transfer leadership to TS 4f1fd1428fbf4f01a112df4b8319bb97
I20260709 12:22:49.869311 10481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d263d9eb057b4c1c9903d22c36d7eeae"
dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
mode: GRACEFUL
new_leader_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
 from {username='slave'} at 127.0.0.1:57940
I20260709 12:22:49.869848 10481 raft_consensus.cc:606] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [term 2 LEADER]: Received request to transfer leadership to TS 481b8f3a30ac44e59e23d3182b3f74c8
I20260709 12:22:49.871394  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:22:49.872181  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:49.901166 10816 raft_consensus.cc:993] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866: : Instructing follower 4f1fd1428fbf4f01a112df4b8319bb97 to start an election
I20260709 12:22:49.901738 10784 raft_consensus.cc:1081] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 4 LEADER]: Signalling peer 4f1fd1428fbf4f01a112df4b8319bb97 to start an election
I20260709 12:22:49.903409 10555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be364ca393d24f51b26f766d410342f0"
dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
 from {username='slave'} at 127.0.0.1:60122
I20260709 12:22:49.903878 10555 raft_consensus.cc:493] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:49.904150 10555 raft_consensus.cc:3060] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:49.910140 10555 raft_consensus.cc:515] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:49.912230 10555 leader_election.cc:290] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [CANDIDATE]: Term 5 election: Requested vote from peers 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193:37839), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:49.913478 10481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be364ca393d24f51b26f766d410342f0" candidate_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
I20260709 12:22:49.913658 10628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be364ca393d24f51b26f766d410342f0" candidate_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
I20260709 12:22:49.914350 10481 raft_consensus.cc:3055] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:49.914517 10628 raft_consensus.cc:3060] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:49.914712 10481 raft_consensus.cc:740] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Running, Role: LEADER
I20260709 12:22:49.915642 10481 consensus_queue.cc:260] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:49.916823 10481 raft_consensus.cc:3060] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:49.920002 10628 raft_consensus.cc:2468] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1fd1428fbf4f01a112df4b8319bb97 in term 5.
I20260709 12:22:49.921293 10519 leader_election.cc:304] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481b8f3a30ac44e59e23d3182b3f74c8, 4f1fd1428fbf4f01a112df4b8319bb97; no voters: 
I20260709 12:22:49.922088 10481 raft_consensus.cc:2468] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1fd1428fbf4f01a112df4b8319bb97 in term 5.
I20260709 12:22:49.922263 10814 raft_consensus.cc:2804] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:49.923404 10814 raft_consensus.cc:697] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 5 LEADER]: Becoming Leader. State: Replica: 4f1fd1428fbf4f01a112df4b8319bb97, State: Running, Role: LEADER
I20260709 12:22:49.924427 10814 consensus_queue.cc:237] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:49.932372 10376 catalog_manager.cc:5697] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 reported cstate change: term changed from 4 to 5, leader changed from 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193) to 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194). New cstate: current_term: 5 leader_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:50.228961 10816 raft_consensus.cc:993] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866: : Instructing follower 481b8f3a30ac44e59e23d3182b3f74c8 to start an election
I20260709 12:22:50.229394 10784 raft_consensus.cc:1081] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Signalling peer 481b8f3a30ac44e59e23d3182b3f74c8 to start an election
I20260709 12:22:50.230922 10628 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63b02039e698478e8b8eb6f17c6ea91c"
dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
 from {username='slave'} at 127.0.0.1:60638
I20260709 12:22:50.231387 10628 raft_consensus.cc:493] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:50.231624 10628 raft_consensus.cc:3060] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:50.236310 10628 raft_consensus.cc:515] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:50.238355 10628 leader_election.cc:290] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8 [CANDIDATE]: Term 2 election: Requested vote from peers 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193:37839), 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017)
I20260709 12:22:50.239346 10481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b02039e698478e8b8eb6f17c6ea91c" candidate_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
I20260709 12:22:50.239444 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b02039e698478e8b8eb6f17c6ea91c" candidate_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
I20260709 12:22:50.240060 10481 raft_consensus.cc:3055] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:50.240157 10555 raft_consensus.cc:3060] T 63b02039e698478e8b8eb6f17c6ea91c P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:50.240370 10481 raft_consensus.cc:740] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Running, Role: LEADER
I20260709 12:22:50.241130 10481 consensus_queue.cc:260] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:50.242244 10481 raft_consensus.cc:3060] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:50.244881 10555 raft_consensus.cc:2468] T 63b02039e698478e8b8eb6f17c6ea91c P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481b8f3a30ac44e59e23d3182b3f74c8 in term 2.
I20260709 12:22:50.246206 10593 leader_election.cc:304] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481b8f3a30ac44e59e23d3182b3f74c8, 4f1fd1428fbf4f01a112df4b8319bb97; no voters: 
I20260709 12:22:50.247152 10481 raft_consensus.cc:2468] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481b8f3a30ac44e59e23d3182b3f74c8 in term 2.
I20260709 12:22:50.247169 10786 raft_consensus.cc:2804] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:50.248557 10786 raft_consensus.cc:697] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 LEADER]: Becoming Leader. State: Replica: 481b8f3a30ac44e59e23d3182b3f74c8, State: Running, Role: LEADER
I20260709 12:22:50.249383 10786 consensus_queue.cc:237] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:50.258024 10376 catalog_manager.cc:5697] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8 reported cstate change: term changed from 1 to 2, leader changed from 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193) to 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195). New cstate: current_term: 2 leader_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:50.287675 10816 raft_consensus.cc:993] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866: : Instructing follower 481b8f3a30ac44e59e23d3182b3f74c8 to start an election
I20260709 12:22:50.288097 10784 raft_consensus.cc:1081] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [term 2 LEADER]: Signalling peer 481b8f3a30ac44e59e23d3182b3f74c8 to start an election
I20260709 12:22:50.289598 10628 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d263d9eb057b4c1c9903d22c36d7eeae"
dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
 from {username='slave'} at 127.0.0.1:60638
I20260709 12:22:50.290140 10628 raft_consensus.cc:493] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:50.290446 10628 raft_consensus.cc:3060] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:50.294912 10628 raft_consensus.cc:515] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:50.296347 10628 leader_election.cc:290] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [CANDIDATE]: Term 3 election: Requested vote from peers 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193:37839), 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017)
I20260709 12:22:50.297199 10481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263d9eb057b4c1c9903d22c36d7eeae" candidate_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
I20260709 12:22:50.297411 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263d9eb057b4c1c9903d22c36d7eeae" candidate_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
I20260709 12:22:50.297696 10481 raft_consensus.cc:3055] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:50.297899 10555 raft_consensus.cc:3060] T d263d9eb057b4c1c9903d22c36d7eeae P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:50.297981 10481 raft_consensus.cc:740] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Running, Role: LEADER
I20260709 12:22:50.298779 10481 consensus_queue.cc:260] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:50.299700 10481 raft_consensus.cc:3060] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:50.302371 10555 raft_consensus.cc:2468] T d263d9eb057b4c1c9903d22c36d7eeae P 4f1fd1428fbf4f01a112df4b8319bb97 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481b8f3a30ac44e59e23d3182b3f74c8 in term 3.
I20260709 12:22:50.303406 10593 leader_election.cc:304] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481b8f3a30ac44e59e23d3182b3f74c8, 4f1fd1428fbf4f01a112df4b8319bb97; no voters: 
I20260709 12:22:50.304073 10786 raft_consensus.cc:2804] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:50.304476 10786 raft_consensus.cc:697] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [term 3 LEADER]: Becoming Leader. State: Replica: 481b8f3a30ac44e59e23d3182b3f74c8, State: Running, Role: LEADER
I20260709 12:22:50.304472 10481 raft_consensus.cc:2468] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481b8f3a30ac44e59e23d3182b3f74c8 in term 3.
I20260709 12:22:50.305413 10786 consensus_queue.cc:237] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:50.312913 10376 catalog_manager.cc:5697] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 reported cstate change: term changed from 2 to 3, leader changed from 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193) to 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195). New cstate: current_term: 3 leader_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:50.351719 10816 raft_consensus.cc:993] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866: : Instructing follower 4f1fd1428fbf4f01a112df4b8319bb97 to start an election
I20260709 12:22:50.352185 10784 raft_consensus.cc:1081] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 3 LEADER]: Signalling peer 4f1fd1428fbf4f01a112df4b8319bb97 to start an election
I20260709 12:22:50.353945 10555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "608ebe9b962e4d27b37af29ad96df0bc"
dest_uuid: "4f1fd1428fbf4f01a112df4b8319bb97"
 from {username='slave'} at 127.0.0.1:60122
I20260709 12:22:50.354430 10555 raft_consensus.cc:493] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:50.354699 10555 raft_consensus.cc:3060] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:50.359042 10555 raft_consensus.cc:515] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:50.360509 10555 leader_election.cc:290] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97 [CANDIDATE]: Term 4 election: Requested vote from peers 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193:37839), 481b8f3a30ac44e59e23d3182b3f74c8 (127.9.145.195:40107)
I20260709 12:22:50.361474 10481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ebe9b962e4d27b37af29ad96df0bc" candidate_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5bc3a8e244614134a6e8d79f08217866"
I20260709 12:22:50.361616 10628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ebe9b962e4d27b37af29ad96df0bc" candidate_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "481b8f3a30ac44e59e23d3182b3f74c8"
I20260709 12:22:50.362002 10481 raft_consensus.cc:3055] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:50.362138 10628 raft_consensus.cc:3060] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:50.362303 10481 raft_consensus.cc:740] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5bc3a8e244614134a6e8d79f08217866, State: Running, Role: LEADER
I20260709 12:22:50.363044 10481 consensus_queue.cc:260] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:50.363933 10481 raft_consensus.cc:3060] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:50.367035 10628 raft_consensus.cc:2468] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1fd1428fbf4f01a112df4b8319bb97 in term 4.
I20260709 12:22:50.368355 10519 leader_election.cc:304] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481b8f3a30ac44e59e23d3182b3f74c8, 4f1fd1428fbf4f01a112df4b8319bb97; no voters: 
I20260709 12:22:50.369005 10481 raft_consensus.cc:2468] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1fd1428fbf4f01a112df4b8319bb97 in term 4.
I20260709 12:22:50.369632 10817 raft_consensus.cc:2804] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:50.371203 10817 raft_consensus.cc:697] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97 [term 4 LEADER]: Becoming Leader. State: Replica: 4f1fd1428fbf4f01a112df4b8319bb97, State: Running, Role: LEADER
I20260709 12:22:50.372251 10817 consensus_queue.cc:237] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } }
I20260709 12:22:50.379467 10376 catalog_manager.cc:5697] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97 reported cstate change: term changed from 3 to 4, leader changed from 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193) to 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194). New cstate: current_term: 4 leader_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:50.388461 10628 raft_consensus.cc:1275] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 5 FOLLOWER]: Refusing update from remote peer 4f1fd1428fbf4f01a112df4b8319bb97: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:50.389608 10817 consensus_queue.cc:1048] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:50.399869 10481 raft_consensus.cc:1275] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 5 FOLLOWER]: Refusing update from remote peer 4f1fd1428fbf4f01a112df4b8319bb97: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:50.401638 10826 consensus_queue.cc:1048] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:50.726404 10555 raft_consensus.cc:1275] T d263d9eb057b4c1c9903d22c36d7eeae P 4f1fd1428fbf4f01a112df4b8319bb97 [term 3 FOLLOWER]: Refusing update from remote peer 481b8f3a30ac44e59e23d3182b3f74c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:50.727696 10786 consensus_queue.cc:1048] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:50.737038 10481 raft_consensus.cc:1275] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [term 3 FOLLOWER]: Refusing update from remote peer 481b8f3a30ac44e59e23d3182b3f74c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:50.738989 10834 consensus_queue.cc:1048] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:50.753345 10481 raft_consensus.cc:1275] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Refusing update from remote peer 481b8f3a30ac44e59e23d3182b3f74c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:50.754539 10834 consensus_queue.cc:1048] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:50.762997 10555 raft_consensus.cc:1275] T 63b02039e698478e8b8eb6f17c6ea91c P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 FOLLOWER]: Refusing update from remote peer 481b8f3a30ac44e59e23d3182b3f74c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:50.765321 10823 consensus_queue.cc:1048] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1fd1428fbf4f01a112df4b8319bb97" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:50.849213 10628 raft_consensus.cc:1275] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 [term 4 FOLLOWER]: Refusing update from remote peer 4f1fd1428fbf4f01a112df4b8319bb97: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:50.850574 10817 consensus_queue.cc:1048] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481b8f3a30ac44e59e23d3182b3f74c8" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 40107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:50.860090 10481 raft_consensus.cc:1275] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 4 FOLLOWER]: Refusing update from remote peer 4f1fd1428fbf4f01a112df4b8319bb97: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:50.861588 10826 consensus_queue.cc:1048] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc3a8e244614134a6e8d79f08217866" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 37839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:50.873355  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:50.879482  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:50.879959  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:51.880931  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:51.888252  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:51.888724  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:52.889643  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:52.895289  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:52.895821  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:53.896715  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:53.902230  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:53.902686  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:54.903640  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:54.910607  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:54.911034  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:55.912109  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:55.918938  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:55.919400  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:56.920372  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:56.926355  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:56.926793  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:57.927673  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:57.933257  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:57.933758  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:58.934657  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:58.940125  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:58.940620  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:59.978865  9799 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:22:59.979518  9799 tablet_server.cc:179] TabletServer@127.9.145.193:0 shutting down...
W20260709 12:23:00.001129 10520 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
W20260709 12:23:00.007591 10520 consensus_peers.cc:597] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 -> Peer 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193:37839): Couldn't send request to peer 5bc3a8e244614134a6e8d79f08217866. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:00.008114  9799 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:00.008993  9799 tablet_replica.cc:333] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866: stopping tablet replica
I20260709 12:23:00.010031  9799 raft_consensus.cc:2243] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:00.011195  9799 raft_consensus.cc:2272] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 5bc3a8e244614134a6e8d79f08217866 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:00.013260  9799 tablet_replica.cc:333] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866: stopping tablet replica
I20260709 12:23:00.013820  9799 raft_consensus.cc:2243] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:00.015062  9799 raft_consensus.cc:2272] T 8fc2a62c9d164bac97e30583925c5818 P 5bc3a8e244614134a6e8d79f08217866 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:00.017102  9799 tablet_replica.cc:333] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866: stopping tablet replica
I20260709 12:23:00.017627  9799 raft_consensus.cc:2243] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:00.018181  9799 raft_consensus.cc:2272] T a729467ab6c44459a6ddb0edf2213902 P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:00.019997  9799 tablet_replica.cc:333] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866: stopping tablet replica
I20260709 12:23:00.020470  9799 raft_consensus.cc:2243] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:00.020896  9799 raft_consensus.cc:2272] T 608ebe9b962e4d27b37af29ad96df0bc P 5bc3a8e244614134a6e8d79f08217866 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:00.022723  9799 tablet_replica.cc:333] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866: stopping tablet replica
I20260709 12:23:00.023208  9799 raft_consensus.cc:2243] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:00.023687  9799 raft_consensus.cc:2272] T be364ca393d24f51b26f766d410342f0 P 5bc3a8e244614134a6e8d79f08217866 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:00.025790  9799 tablet_replica.cc:333] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 5bc3a8e244614134a6e8d79f08217866: stopping tablet replica
I20260709 12:23:00.026374  9799 raft_consensus.cc:2243] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:00.026829  9799 raft_consensus.cc:2272] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:00.028692  9799 tablet_replica.cc:333] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866: stopping tablet replica
I20260709 12:23:00.029233  9799 raft_consensus.cc:2243] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:00.029711  9799 raft_consensus.cc:2272] T d263d9eb057b4c1c9903d22c36d7eeae P 5bc3a8e244614134a6e8d79f08217866 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:00.031651  9799 tablet_replica.cc:333] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866: stopping tablet replica
I20260709 12:23:00.032125  9799 raft_consensus.cc:2243] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:00.033427  9799 raft_consensus.cc:2272] T a6b88354e73e493b933e7080ab70fb6f P 5bc3a8e244614134a6e8d79f08217866 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:00.035271  9799 tablet_replica.cc:333] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866: stopping tablet replica
I20260709 12:23:00.035727  9799 raft_consensus.cc:2243] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:00.036192  9799 raft_consensus.cc:2272] T 63b02039e698478e8b8eb6f17c6ea91c P 5bc3a8e244614134a6e8d79f08217866 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:00.037961  9799 tablet_replica.cc:333] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866: stopping tablet replica
I20260709 12:23:00.038446  9799 raft_consensus.cc:2243] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:00.039397  9799 raft_consensus.cc:2272] T 4e7ccaea05564aed872d76358690228f P 5bc3a8e244614134a6e8d79f08217866 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:00.061852  9799 tablet_server.cc:196] TabletServer@127.9.145.193:0 shutdown complete.
W20260709 12:23:00.065359 10594 consensus_peers.cc:597] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 -> Peer 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193:37839): Couldn't send request to peer 5bc3a8e244614134a6e8d79f08217866. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:37839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:00.085512  9799 tablet_server.cc:179] TabletServer@127.9.145.194:0 shutting down...
W20260709 12:23:00.105584 10520 consensus_peers.cc:597] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97 -> Peer 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193:37839): Couldn't send request to peer 5bc3a8e244614134a6e8d79f08217866. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:37839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:00.114583  9799 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:00.115322  9799 tablet_replica.cc:333] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97: stopping tablet replica
I20260709 12:23:00.115953  9799 raft_consensus.cc:2243] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:00.116477  9799 raft_consensus.cc:2272] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:00.118500  9799 tablet_replica.cc:333] T d263d9eb057b4c1c9903d22c36d7eeae P 4f1fd1428fbf4f01a112df4b8319bb97: stopping tablet replica
I20260709 12:23:00.119073  9799 raft_consensus.cc:2243] T d263d9eb057b4c1c9903d22c36d7eeae P 4f1fd1428fbf4f01a112df4b8319bb97 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:00.119581  9799 raft_consensus.cc:2272] T d263d9eb057b4c1c9903d22c36d7eeae P 4f1fd1428fbf4f01a112df4b8319bb97 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:00.121354  9799 tablet_replica.cc:333] T a729467ab6c44459a6ddb0edf2213902 P 4f1fd1428fbf4f01a112df4b8319bb97: stopping tablet replica
I20260709 12:23:00.121938  9799 raft_consensus.cc:2243] T a729467ab6c44459a6ddb0edf2213902 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:00.122876  9799 raft_consensus.cc:2272] T a729467ab6c44459a6ddb0edf2213902 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:00.124923  9799 tablet_replica.cc:333] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97: stopping tablet replica
I20260709 12:23:00.125595  9799 raft_consensus.cc:2243] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:23:00.126603  9799 raft_consensus.cc:2272] T 608ebe9b962e4d27b37af29ad96df0bc P 4f1fd1428fbf4f01a112df4b8319bb97 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:00.128598  9799 tablet_replica.cc:333] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97: stopping tablet replica
I20260709 12:23:00.129361  9799 raft_consensus.cc:2243] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:00.130049  9799 raft_consensus.cc:2272] T 8fc2a62c9d164bac97e30583925c5818 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:00.132414  9799 tablet_replica.cc:333] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97: stopping tablet replica
W20260709 12:23:00.133229 10593 consensus_peers.cc:597] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 481b8f3a30ac44e59e23d3182b3f74c8 -> Peer 4f1fd1428fbf4f01a112df4b8319bb97 (127.9.145.194:42017): Couldn't send request to peer 4f1fd1428fbf4f01a112df4b8319bb97. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:00.133396  9799 raft_consensus.cc:2243] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:00.134027  9799 raft_consensus.cc:2272] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:00.136049  9799 tablet_replica.cc:333] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97: stopping tablet replica
I20260709 12:23:00.136786  9799 raft_consensus.cc:2243] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:23:00.137722  9799 raft_consensus.cc:2272] T be364ca393d24f51b26f766d410342f0 P 4f1fd1428fbf4f01a112df4b8319bb97 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:00.139705  9799 tablet_replica.cc:333] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97: stopping tablet replica
I20260709 12:23:00.140203  9799 raft_consensus.cc:2243] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:00.140702  9799 raft_consensus.cc:2272] T a6b88354e73e493b933e7080ab70fb6f P 4f1fd1428fbf4f01a112df4b8319bb97 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:00.142489  9799 tablet_replica.cc:333] T 63b02039e698478e8b8eb6f17c6ea91c P 4f1fd1428fbf4f01a112df4b8319bb97: stopping tablet replica
I20260709 12:23:00.143154  9799 raft_consensus.cc:2243] T 63b02039e698478e8b8eb6f17c6ea91c P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:00.143640  9799 raft_consensus.cc:2272] T 63b02039e698478e8b8eb6f17c6ea91c P 4f1fd1428fbf4f01a112df4b8319bb97 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:00.145617  9799 tablet_replica.cc:333] T 4e7ccaea05564aed872d76358690228f P 4f1fd1428fbf4f01a112df4b8319bb97: stopping tablet replica
I20260709 12:23:00.146142  9799 raft_consensus.cc:2243] T 4e7ccaea05564aed872d76358690228f P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:00.146670  9799 raft_consensus.cc:2272] T 4e7ccaea05564aed872d76358690228f P 4f1fd1428fbf4f01a112df4b8319bb97 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:00.175644  9799 tablet_server.cc:196] TabletServer@127.9.145.194:0 shutdown complete.
I20260709 12:23:00.196684  9799 tablet_server.cc:179] TabletServer@127.9.145.195:0 shutting down...
I20260709 12:23:00.224614  9799 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:00.225440  9799 tablet_replica.cc:333] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8: stopping tablet replica
I20260709 12:23:00.226164  9799 raft_consensus.cc:2243] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:00.226764  9799 raft_consensus.cc:2272] T be364ca393d24f51b26f766d410342f0 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:00.228645  9799 tablet_replica.cc:333] T 4e7ccaea05564aed872d76358690228f P 481b8f3a30ac44e59e23d3182b3f74c8: stopping tablet replica
I20260709 12:23:00.229199  9799 raft_consensus.cc:2243] T 4e7ccaea05564aed872d76358690228f P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:00.229663  9799 raft_consensus.cc:2272] T 4e7ccaea05564aed872d76358690228f P 481b8f3a30ac44e59e23d3182b3f74c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:00.231513  9799 tablet_replica.cc:333] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 481b8f3a30ac44e59e23d3182b3f74c8: stopping tablet replica
I20260709 12:23:00.232072  9799 raft_consensus.cc:2243] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:00.232939  9799 raft_consensus.cc:2272] T 22e7e51c13cd48d8a5e2eaba8d99e717 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:00.235049  9799 tablet_replica.cc:333] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8: stopping tablet replica
I20260709 12:23:00.235586  9799 raft_consensus.cc:2243] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:00.236344  9799 raft_consensus.cc:2272] T d263d9eb057b4c1c9903d22c36d7eeae P 481b8f3a30ac44e59e23d3182b3f74c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:00.238073  9799 tablet_replica.cc:333] T 8fc2a62c9d164bac97e30583925c5818 P 481b8f3a30ac44e59e23d3182b3f74c8: stopping tablet replica
I20260709 12:23:00.238596  9799 raft_consensus.cc:2243] T 8fc2a62c9d164bac97e30583925c5818 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:00.239108  9799 raft_consensus.cc:2272] T 8fc2a62c9d164bac97e30583925c5818 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:00.241194  9799 tablet_replica.cc:333] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 481b8f3a30ac44e59e23d3182b3f74c8: stopping tablet replica
I20260709 12:23:00.241760  9799 raft_consensus.cc:2243] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:00.242347  9799 raft_consensus.cc:2272] T 4c45c01fcb344ea0a16f89b7f3c7bfb7 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:00.244092  9799 tablet_replica.cc:333] T a729467ab6c44459a6ddb0edf2213902 P 481b8f3a30ac44e59e23d3182b3f74c8: stopping tablet replica
I20260709 12:23:00.244570  9799 raft_consensus.cc:2243] T a729467ab6c44459a6ddb0edf2213902 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:00.244983  9799 raft_consensus.cc:2272] T a729467ab6c44459a6ddb0edf2213902 P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:00.246748  9799 tablet_replica.cc:333] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8: stopping tablet replica
I20260709 12:23:00.247375  9799 raft_consensus.cc:2243] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:00.247983  9799 raft_consensus.cc:2272] T 608ebe9b962e4d27b37af29ad96df0bc P 481b8f3a30ac44e59e23d3182b3f74c8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:00.250340  9799 tablet_replica.cc:333] T a6b88354e73e493b933e7080ab70fb6f P 481b8f3a30ac44e59e23d3182b3f74c8: stopping tablet replica
I20260709 12:23:00.250978  9799 raft_consensus.cc:2243] T a6b88354e73e493b933e7080ab70fb6f P 481b8f3a30ac44e59e23d3182b3f74c8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:00.251583  9799 raft_consensus.cc:2272] T a6b88354e73e493b933e7080ab70fb6f P 481b8f3a30ac44e59e23d3182b3f74c8 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:00.252058 10594 consensus_peers.cc:597] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8 -> Peer 5bc3a8e244614134a6e8d79f08217866 (127.9.145.193:37839): Couldn't send request to peer 5bc3a8e244614134a6e8d79f08217866. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:37839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:00.253494  9799 tablet_replica.cc:333] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8: stopping tablet replica
I20260709 12:23:00.253954  9799 raft_consensus.cc:2243] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:00.254714  9799 raft_consensus.cc:2272] T 63b02039e698478e8b8eb6f17c6ea91c P 481b8f3a30ac44e59e23d3182b3f74c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:00.283125  9799 tablet_server.cc:196] TabletServer@127.9.145.195:0 shutdown complete.
I20260709 12:23:00.302699  9799 master.cc:562] Master@127.9.145.254:39107 shutting down...
I20260709 12:23:00.325119  9799 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2eed3518a88b44068446d0be2edcfee0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:00.325695  9799 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2eed3518a88b44068446d0be2edcfee0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:00.325997  9799 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2eed3518a88b44068446d0be2edcfee0: stopping tablet replica
I20260709 12:23:00.345065  9799 master.cc:584] Master@127.9.145.254:39107 shutdown complete.
481b8f3a30ac44e59e23d3182b3f74c8  1
4f1fd1428fbf4f01a112df4b8319bb97  4
5bc3a8e244614134a6e8d79f08217866  5
481b8f3a30ac44e59e23d3182b3f74c8  3
4f1fd1428fbf4f01a112df4b8319bb97  4
5bc3a8e244614134a6e8d79f08217866  3
481b8f3a30ac44e59e23d3182b3f74c8  1
4f1fd1428fbf4f01a112df4b8319bb97  1
5bc3a8e244614134a6e8d79f08217866  8
481b8f3a30ac44e59e23d3182b3f74c8  3
4f1fd1428fbf4f01a112df4b8319bb97  3
5bc3a8e244614134a6e8d79f08217866  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28579 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:23:00.385627  9799 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.145.254:35687
I20260709 12:23:00.386859  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:00.392480 10856 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:00.392691 10857 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:00.393328 10859 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:00.394663  9799 server_base.cc:1061] running on GCE node
I20260709 12:23:00.395642  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:00.395833  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:00.395990  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783599780395971 us; error 0 us; skew 500 ppm
I20260709 12:23:00.396495  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:00.399060  9799 webserver.cc:533] Webserver started at http://127.9.145.254:36143/ using document root <none> and password file <none>
I20260709 12:23:00.399569  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:00.399747  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:00.400033  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:00.401211  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/master-0-root/instance:
uuid: "67a911ac695143c380a7065b971eb9b7"
format_stamp: "Formatted at 2026-07-09 12:23:00 on dist-test-slave-1sdq"
I20260709 12:23:00.406080  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:23:00.409570 10865 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:00.410326  9799 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:23:00.410633  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/master-0-root
uuid: "67a911ac695143c380a7065b971eb9b7"
format_stamp: "Formatted at 2026-07-09 12:23:00 on dist-test-slave-1sdq"
I20260709 12:23:00.410923  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:00.425123  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:00.426487  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:00.465994  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.254:35687
I20260709 12:23:00.466086 10916 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.254:35687 every 8 connection(s)
I20260709 12:23:00.470012 10917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.480787 10917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7: Bootstrap starting.
I20260709 12:23:00.485561 10917 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.489876 10917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7: No bootstrap required, opened a new log
I20260709 12:23:00.492129 10917 raft_consensus.cc:359] T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67a911ac695143c380a7065b971eb9b7" member_type: VOTER }
I20260709 12:23:00.492583 10917 raft_consensus.cc:385] T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.492774 10917 raft_consensus.cc:740] T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67a911ac695143c380a7065b971eb9b7, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.493304 10917 consensus_queue.cc:260] T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67a911ac695143c380a7065b971eb9b7" member_type: VOTER }
I20260709 12:23:00.493783 10917 raft_consensus.cc:399] T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:23:00.494011 10917 raft_consensus.cc:493] T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:23:00.494346 10917 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:00.498605 10917 raft_consensus.cc:515] T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67a911ac695143c380a7065b971eb9b7" member_type: VOTER }
I20260709 12:23:00.499153 10917 leader_election.cc:304] T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 67a911ac695143c380a7065b971eb9b7; no voters: 
I20260709 12:23:00.500299 10917 leader_election.cc:290] T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:23:00.500685 10920 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:00.501972 10920 raft_consensus.cc:697] T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7 [term 1 LEADER]: Becoming Leader. State: Replica: 67a911ac695143c380a7065b971eb9b7, State: Running, Role: LEADER
I20260709 12:23:00.502739 10920 consensus_queue.cc:237] T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67a911ac695143c380a7065b971eb9b7" member_type: VOTER }
I20260709 12:23:00.503269 10917 sys_catalog.cc:565] T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:23:00.507961 10921 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "67a911ac695143c380a7065b971eb9b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67a911ac695143c380a7065b971eb9b7" member_type: VOTER } }
I20260709 12:23:00.508704 10921 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7 [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:00.507949 10922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 67a911ac695143c380a7065b971eb9b7. Latest consensus state: current_term: 1 leader_uuid: "67a911ac695143c380a7065b971eb9b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67a911ac695143c380a7065b971eb9b7" member_type: VOTER } }
I20260709 12:23:00.510486 10922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7 [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:00.517793 10927 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:23:00.523190 10927 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:23:00.526952  9799 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:23:00.532459 10927 catalog_manager.cc:1383] Generated new cluster ID: a7594607994d4045ae440aba59ea90bc
I20260709 12:23:00.532699 10927 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:23:00.545032 10927 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:23:00.546363 10927 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:23:00.561179 10927 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7: Generated new TSK 0
I20260709 12:23:00.561811 10927 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:23:00.593760  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:00.599794 10938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:00.601019 10939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:00.604094 10941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:00.606230  9799 server_base.cc:1061] running on GCE node
I20260709 12:23:00.607163  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:00.607383  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:00.607550  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783599780607531 us; error 0 us; skew 500 ppm
I20260709 12:23:00.608076  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:00.610505  9799 webserver.cc:533] Webserver started at http://127.9.145.193:39891/ using document root <none> and password file <none>
I20260709 12:23:00.610986  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:00.611167  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:00.611474  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:00.612612  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-0-root/instance:
uuid: "bc01179655564f29b83babe396377cbb"
format_stamp: "Formatted at 2026-07-09 12:23:00 on dist-test-slave-1sdq"
I20260709 12:23:00.617393  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:23:00.621025 10946 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:00.621819  9799 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:23:00.622134  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-0-root
uuid: "bc01179655564f29b83babe396377cbb"
format_stamp: "Formatted at 2026-07-09 12:23:00 on dist-test-slave-1sdq"
I20260709 12:23:00.622426  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:00.638410  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:00.639652  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:00.641126  9799 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:00.643443  9799 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:00.643651  9799 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:00.643890  9799 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:00.644058  9799 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:00.684890  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.193:46777
I20260709 12:23:00.684995 11009 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.193:46777 every 8 connection(s)
I20260709 12:23:00.689868  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:00.696871 11014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:00.698145 11015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:00.700999 11017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:00.701380  9799 server_base.cc:1061] running on GCE node
I20260709 12:23:00.703261 11010 heartbeater.cc:344] Connected to a master server at 127.9.145.254:35687
I20260709 12:23:00.703334  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:00.703792  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:00.703809 11010 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:00.704139  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783599780704119 us; error 0 us; skew 500 ppm
I20260709 12:23:00.704926  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:00.704886 11010 heartbeater.cc:507] Master 127.9.145.254:35687 requested a full tablet report, sending...
I20260709 12:23:00.708117  9799 webserver.cc:533] Webserver started at http://127.9.145.194:34805/ using document root <none> and password file <none>
I20260709 12:23:00.708047 10882 ts_manager.cc:194] Registered new tserver with Master: bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
I20260709 12:23:00.708984  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:00.709265  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:00.709535  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:00.710434 10882 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41098
I20260709 12:23:00.710774  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-1-root/instance:
uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
format_stamp: "Formatted at 2026-07-09 12:23:00 on dist-test-slave-1sdq"
I20260709 12:23:00.716107  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:23:00.719709 11022 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:00.720588  9799 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:23:00.720894  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-1-root
uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
format_stamp: "Formatted at 2026-07-09 12:23:00 on dist-test-slave-1sdq"
I20260709 12:23:00.721175  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:00.738447  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:00.739663  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:00.741096  9799 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:00.743355  9799 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:00.743567  9799 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:00.743793  9799 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:00.743955  9799 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:00.783056  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.194:44483
I20260709 12:23:00.783174 11084 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.194:44483 every 8 connection(s)
I20260709 12:23:00.787724  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:00.795097 11088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:00.796787 11089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:00.799904 11091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:00.800357  9799 server_base.cc:1061] running on GCE node
I20260709 12:23:00.801126 11085 heartbeater.cc:344] Connected to a master server at 127.9.145.254:35687
I20260709 12:23:00.801406  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:23:00.801539 11085 heartbeater.cc:461] Registering TS with master...
W20260709 12:23:00.801692  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:00.801900  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783599780801884 us; error 0 us; skew 500 ppm
I20260709 12:23:00.802477 11085 heartbeater.cc:507] Master 127.9.145.254:35687 requested a full tablet report, sending...
I20260709 12:23:00.802657  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:00.804774 10882 ts_manager.cc:194] Registered new tserver with Master: c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:00.805488  9799 webserver.cc:533] Webserver started at http://127.9.145.195:45371/ using document root <none> and password file <none>
I20260709 12:23:00.805981  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:00.806191  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:00.806285 10882 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41106
I20260709 12:23:00.806433  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:00.807756  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-2-root/instance:
uuid: "7518bdeb78f24e67a530754ae48547eb"
format_stamp: "Formatted at 2026-07-09 12:23:00 on dist-test-slave-1sdq"
I20260709 12:23:00.812223  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 12:23:00.815692 11096 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:00.816460  9799 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:23:00.816784  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-2-root
uuid: "7518bdeb78f24e67a530754ae48547eb"
format_stamp: "Formatted at 2026-07-09 12:23:00 on dist-test-slave-1sdq"
I20260709 12:23:00.817071  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:00.843186  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:00.844417  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:00.845839  9799 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:00.848083  9799 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:00.848281  9799 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:00.848524  9799 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:00.848671  9799 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:00.887585  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.195:42537
I20260709 12:23:00.887741 11159 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.195:42537 every 8 connection(s)
I20260709 12:23:00.906409 11160 heartbeater.cc:344] Connected to a master server at 127.9.145.254:35687
I20260709 12:23:00.906773 11160 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:00.907505 11160 heartbeater.cc:507] Master 127.9.145.254:35687 requested a full tablet report, sending...
I20260709 12:23:00.909502 10882 ts_manager.cc:194] Registered new tserver with Master: 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:00.910245  9799 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019398402s
I20260709 12:23:00.911010 10882 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41120
I20260709 12:23:00.936060 10882 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41134:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:23:00.942252 10882 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:23:01.131983 10973 tablet_service.cc:1511] Processing CreateTablet for tablet 1e22af520a9e4eb795f4a0e920b05a3b (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:23:01.132336 10974 tablet_service.cc:1511] Processing CreateTablet for tablet 49ef051819cd4f229ac2b37858ee3db5 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:23:01.133653 10973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e22af520a9e4eb795f4a0e920b05a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.134361 10972 tablet_service.cc:1511] Processing CreateTablet for tablet 8390bc6d251348e398da3cb9bee4bd2c (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:23:01.135264 11122 tablet_service.cc:1511] Processing CreateTablet for tablet 8390bc6d251348e398da3cb9bee4bd2c (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:23:01.135252 11124 tablet_service.cc:1511] Processing CreateTablet for tablet 49ef051819cd4f229ac2b37858ee3db5 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:23:01.136726 11122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8390bc6d251348e398da3cb9bee4bd2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.137518 10972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8390bc6d251348e398da3cb9bee4bd2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.138183 11124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49ef051819cd4f229ac2b37858ee3db5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.137894 11123 tablet_service.cc:1511] Processing CreateTablet for tablet 1e22af520a9e4eb795f4a0e920b05a3b (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:23:01.139259 11123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e22af520a9e4eb795f4a0e920b05a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.140754 10974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49ef051819cd4f229ac2b37858ee3db5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.144160 10971 tablet_service.cc:1511] Processing CreateTablet for tablet c7865a5cff5849a2bd74dddc1bcdd8f3 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:23:01.145571 10971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7865a5cff5849a2bd74dddc1bcdd8f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.160347 11050 tablet_service.cc:1511] Processing CreateTablet for tablet 49ef051819cd4f229ac2b37858ee3db5 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:23:01.162060 11050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49ef051819cd4f229ac2b37858ee3db5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.167516 11049 tablet_service.cc:1511] Processing CreateTablet for tablet 1e22af520a9e4eb795f4a0e920b05a3b (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:23:01.169152 11049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e22af520a9e4eb795f4a0e920b05a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.171936 11048 tablet_service.cc:1511] Processing CreateTablet for tablet 8390bc6d251348e398da3cb9bee4bd2c (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:23:01.172816 10970 tablet_service.cc:1511] Processing CreateTablet for tablet 5d049c89d78443e886fd95f8df54f02b (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:23:01.174221 10970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d049c89d78443e886fd95f8df54f02b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.174589 11047 tablet_service.cc:1511] Processing CreateTablet for tablet c7865a5cff5849a2bd74dddc1bcdd8f3 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:23:01.178237 11048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8390bc6d251348e398da3cb9bee4bd2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.182847 11047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7865a5cff5849a2bd74dddc1bcdd8f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.183518 10969 tablet_service.cc:1511] Processing CreateTablet for tablet 1d0463b3e1c746218d71d6d8eb843dc8 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:23:01.185024 10969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d0463b3e1c746218d71d6d8eb843dc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.188138 11121 tablet_service.cc:1511] Processing CreateTablet for tablet 5d049c89d78443e886fd95f8df54f02b (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:23:01.189970 11121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d049c89d78443e886fd95f8df54f02b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.195261 11122 tablet_service.cc:1511] Processing CreateTablet for tablet c7865a5cff5849a2bd74dddc1bcdd8f3 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:23:01.197243 11176 tablet_bootstrap.cc:492] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:01.200570 11122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7865a5cff5849a2bd74dddc1bcdd8f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.203966 11176 tablet_bootstrap.cc:654] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:01.206298 11046 tablet_service.cc:1511] Processing CreateTablet for tablet 5d049c89d78443e886fd95f8df54f02b (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:23:01.207720 11046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d049c89d78443e886fd95f8df54f02b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.209000 10974 tablet_service.cc:1511] Processing CreateTablet for tablet dabbb0c174364b1ea4126a4f3d5bb4c2 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:23:01.210465 10974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dabbb0c174364b1ea4126a4f3d5bb4c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.212463 11045 tablet_service.cc:1511] Processing CreateTablet for tablet 1d0463b3e1c746218d71d6d8eb843dc8 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:23:01.213958 11045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d0463b3e1c746218d71d6d8eb843dc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.219110 11177 tablet_bootstrap.cc:492] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:01.213990 11123 tablet_service.cc:1511] Processing CreateTablet for tablet 1d0463b3e1c746218d71d6d8eb843dc8 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:23:01.222462 11123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d0463b3e1c746218d71d6d8eb843dc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.246724 11176 tablet_bootstrap.cc:492] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:01.247268 11176 ts_tablet_manager.cc:1403] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.017s
I20260709 12:23:01.249596 11044 tablet_service.cc:1511] Processing CreateTablet for tablet dabbb0c174364b1ea4126a4f3d5bb4c2 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:23:01.250366 11176 raft_consensus.cc:359] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:01.251123 11044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dabbb0c174364b1ea4126a4f3d5bb4c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.251153 11176 raft_consensus.cc:385] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:01.258713 11176 raft_consensus.cc:740] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:01.259599 11176 consensus_queue.cc:260] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:01.262135 11160 heartbeater.cc:499] Master 127.9.145.254:35687 was elected leader, sending a full tablet report...
I20260709 12:23:01.265673 10974 tablet_service.cc:1511] Processing CreateTablet for tablet 265677e547f5428e992bc91650ec60e2 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:23:01.266458 11120 tablet_service.cc:1511] Processing CreateTablet for tablet dabbb0c174364b1ea4126a4f3d5bb4c2 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:23:01.267273 10974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 265677e547f5428e992bc91650ec60e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.272765 11177 tablet_bootstrap.cc:654] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:01.274307 11179 tablet_bootstrap.cc:492] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:01.276616 11120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dabbb0c174364b1ea4126a4f3d5bb4c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.282084 11177 tablet_bootstrap.cc:492] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:01.283540 11177 ts_tablet_manager.cc:1403] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.065s	user 0.008s	sys 0.007s
I20260709 12:23:01.283427 10973 tablet_service.cc:1511] Processing CreateTablet for tablet 03bda770d3504576acc9bfb2923fb9ff (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:23:01.284765 10973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03bda770d3504576acc9bfb2923fb9ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.286623 11177 raft_consensus.cc:359] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:01.287432 11177 raft_consensus.cc:385] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:01.287853 11177 raft_consensus.cc:740] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:01.282298 11121 tablet_service.cc:1511] Processing CreateTablet for tablet 265677e547f5428e992bc91650ec60e2 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:23:01.289269 11121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 265677e547f5428e992bc91650ec60e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.292573 11049 tablet_service.cc:1511] Processing CreateTablet for tablet 265677e547f5428e992bc91650ec60e2 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:23:01.294912 11049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 265677e547f5428e992bc91650ec60e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.295374 11176 ts_tablet_manager.cc:1434] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.001s
I20260709 12:23:01.296487 11176 tablet_bootstrap.cc:492] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:01.296846 11177 consensus_queue.cc:260] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:01.306471 11044 tablet_service.cc:1511] Processing CreateTablet for tablet 03bda770d3504576acc9bfb2923fb9ff (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:23:01.307855 11044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03bda770d3504576acc9bfb2923fb9ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.312850 11179 tablet_bootstrap.cc:654] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:01.323766 11120 tablet_service.cc:1511] Processing CreateTablet for tablet 03bda770d3504576acc9bfb2923fb9ff (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:23:01.325259 11120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03bda770d3504576acc9bfb2923fb9ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.328722 11176 tablet_bootstrap.cc:654] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:01.334458 10973 tablet_service.cc:1511] Processing CreateTablet for tablet 8383ba7a20f343a2bf66fc93ad293a56 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:23:01.336055 10973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8383ba7a20f343a2bf66fc93ad293a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.336004 11123 tablet_service.cc:1511] Processing CreateTablet for tablet 8383ba7a20f343a2bf66fc93ad293a56 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:23:01.337517 11123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8383ba7a20f343a2bf66fc93ad293a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.339115 11010 heartbeater.cc:499] Master 127.9.145.254:35687 was elected leader, sending a full tablet report...
I20260709 12:23:01.339768 11177 ts_tablet_manager.cc:1434] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.056s	user 0.025s	sys 0.019s
I20260709 12:23:01.340900 11177 tablet_bootstrap.cc:492] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:01.347517 11177 tablet_bootstrap.cc:654] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:01.349370 10969 tablet_service.cc:1511] Processing CreateTablet for tablet c5ceb1aa25414d24b15ed1bff03f40c4 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:23:01.347090 11049 tablet_service.cc:1511] Processing CreateTablet for tablet 8383ba7a20f343a2bf66fc93ad293a56 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:23:01.350826 10969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5ceb1aa25414d24b15ed1bff03f40c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.350826 11049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8383ba7a20f343a2bf66fc93ad293a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.362674 11180 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.363371 11180 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:01.368446 11179 tablet_bootstrap.cc:492] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:01.368999 11179 ts_tablet_manager.cc:1403] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.095s	user 0.010s	sys 0.004s
I20260709 12:23:01.372131 11179 raft_consensus.cc:359] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:01.372915 11179 raft_consensus.cc:385] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:01.373234 11179 raft_consensus.cc:740] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:01.377758 11180 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:01.378372 11122 tablet_service.cc:1511] Processing CreateTablet for tablet c5ceb1aa25414d24b15ed1bff03f40c4 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:23:01.378499 11047 tablet_service.cc:1511] Processing CreateTablet for tablet c5ceb1aa25414d24b15ed1bff03f40c4 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:23:01.379791 11047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5ceb1aa25414d24b15ed1bff03f40c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.379842 11122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5ceb1aa25414d24b15ed1bff03f40c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.391726 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:23:01.393591 11097 leader_election.cc:343] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:01.394364 11179 consensus_queue.cc:260] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:01.398533 11049 tablet_service.cc:1511] Processing CreateTablet for tablet 634832ddce4348f1bb6c7bbf1b9045f0 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:23:01.399904 11049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 634832ddce4348f1bb6c7bbf1b9045f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.401077 10974 tablet_service.cc:1511] Processing CreateTablet for tablet 634832ddce4348f1bb6c7bbf1b9045f0 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:23:01.402432 10974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 634832ddce4348f1bb6c7bbf1b9045f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.408061 11123 tablet_service.cc:1511] Processing CreateTablet for tablet 634832ddce4348f1bb6c7bbf1b9045f0 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:23:01.409430 11123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 634832ddce4348f1bb6c7bbf1b9045f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.410068 11047 tablet_service.cc:1511] Processing CreateTablet for tablet af28bcf443bc457bacfe081d037b6d9c (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:23:01.411409 11047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af28bcf443bc457bacfe081d037b6d9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.412012 11120 tablet_service.cc:1511] Processing CreateTablet for tablet af28bcf443bc457bacfe081d037b6d9c (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:23:01.411329 11176 tablet_bootstrap.cc:492] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:01.413252 11176 ts_tablet_manager.cc:1403] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.117s	user 0.010s	sys 0.003s
I20260709 12:23:01.413285 11120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af28bcf443bc457bacfe081d037b6d9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.415307 10969 tablet_service.cc:1511] Processing CreateTablet for tablet af28bcf443bc457bacfe081d037b6d9c (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:23:01.419898 10972 tablet_service.cc:1511] Processing CreateTablet for tablet d10de3c352ba4d7c805da1ea559bfcb5 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:23:01.421120 11044 tablet_service.cc:1511] Processing CreateTablet for tablet d10de3c352ba4d7c805da1ea559bfcb5 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:23:01.422458 11044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d10de3c352ba4d7c805da1ea559bfcb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.424911 11176 raft_consensus.cc:359] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:01.425684 11176 raft_consensus.cc:385] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:01.426018 11176 raft_consensus.cc:740] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:01.436479 11121 tablet_service.cc:1511] Processing CreateTablet for tablet d10de3c352ba4d7c805da1ea559bfcb5 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:23:01.437855 11121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d10de3c352ba4d7c805da1ea559bfcb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.438560 10969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af28bcf443bc457bacfe081d037b6d9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.439198 10972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d10de3c352ba4d7c805da1ea559bfcb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.439884 11085 heartbeater.cc:499] Master 127.9.145.254:35687 was elected leader, sending a full tablet report...
I20260709 12:23:01.441481 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:23:01.443313 11098 leader_election.cc:343] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:01.443805 11098 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:01.444607 11180 raft_consensus.cc:2749] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:01.451380 11179 ts_tablet_manager.cc:1434] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.082s	user 0.014s	sys 0.001s
I20260709 12:23:01.452504 11182 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.453032 11182 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:01.455633 11182 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:01.452504 11179 tablet_bootstrap.cc:492] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:01.478127 11176 consensus_queue.cc:260] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:01.479878 11179 tablet_bootstrap.cc:654] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:01.480428 11176 ts_tablet_manager.cc:1434] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.064s	user 0.005s	sys 0.000s
I20260709 12:23:01.481467 11176 tablet_bootstrap.cc:492] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:01.492398 11180 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.493009 11180 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:01.495355 11180 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:01.495105 11049 tablet_service.cc:1511] Processing CreateTablet for tablet cf134f8026dd4c7c8bbdf22ddca4edf2 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:23:01.496462 11049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf134f8026dd4c7c8bbdf22ddca4edf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.497044 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:01.496651 10971 tablet_service.cc:1511] Processing CreateTablet for tablet 6875ad729dd0416d88035fd642f6b3bd (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:23:01.497699 10984 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 0.
I20260709 12:23:01.499734 11097 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:01.498229 10971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6875ad729dd0416d88035fd642f6b3bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.500622 11180 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:01.502508 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:01.503149 11060 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 0.
I20260709 12:23:01.500828 11123 tablet_service.cc:1511] Processing CreateTablet for tablet 6875ad729dd0416d88035fd642f6b3bd (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:23:01.506078 11123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6875ad729dd0416d88035fd642f6b3bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.501117 11180 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:01.514402 11121 tablet_service.cc:1511] Processing CreateTablet for tablet cf134f8026dd4c7c8bbdf22ddca4edf2 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:23:01.515878 11121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf134f8026dd4c7c8bbdf22ddca4edf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.522989 10974 tablet_service.cc:1511] Processing CreateTablet for tablet cf134f8026dd4c7c8bbdf22ddca4edf2 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:23:01.523768 11177 tablet_bootstrap.cc:492] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:01.524317 11177 ts_tablet_manager.cc:1403] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.184s	user 0.035s	sys 0.061s
I20260709 12:23:01.527482 11177 raft_consensus.cc:359] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } }
I20260709 12:23:01.528209 11177 raft_consensus.cc:385] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:01.528532 11177 raft_consensus.cc:740] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:01.524364 10974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf134f8026dd4c7c8bbdf22ddca4edf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.531062 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:01.513664 11180 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:01.539577 10930 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:01.539796 11176 tablet_bootstrap.cc:654] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:01.540864 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:01.541550 11060 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 0.
I20260709 12:23:01.542814 11177 consensus_queue.cc:260] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } }
I20260709 12:23:01.543285 10948 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:01.542219 10972 tablet_service.cc:1511] Processing CreateTablet for tablet 2721401e0fa944aea90572c7ec29c134 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:23:01.553341 11182 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:01.553756 11182 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:01.554127 11182 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:01.555375 10972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2721401e0fa944aea90572c7ec29c134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.544490 11047 tablet_service.cc:1511] Processing CreateTablet for tablet 6875ad729dd0416d88035fd642f6b3bd (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:23:01.546083 11120 tablet_service.cc:1511] Processing CreateTablet for tablet 2721401e0fa944aea90572c7ec29c134 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:23:01.560156 11047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6875ad729dd0416d88035fd642f6b3bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.560673 11120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2721401e0fa944aea90572c7ec29c134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.547187 10969 tablet_service.cc:1511] Processing CreateTablet for tablet 42f9fb63946447bdadbb789c9398031d (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:23:01.562024 10969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42f9fb63946447bdadbb789c9398031d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.562795 11182 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:01.549211 11049 tablet_service.cc:1511] Processing CreateTablet for tablet 2721401e0fa944aea90572c7ec29c134 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:23:01.569329 11049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2721401e0fa944aea90572c7ec29c134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.573724 11044 tablet_service.cc:1511] Processing CreateTablet for tablet 42f9fb63946447bdadbb789c9398031d (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:23:01.575202 11044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42f9fb63946447bdadbb789c9398031d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.581228 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:01.583282 11123 tablet_service.cc:1511] Processing CreateTablet for tablet 42f9fb63946447bdadbb789c9398031d (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:23:01.565164 11177 ts_tablet_manager.cc:1434] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.000s
I20260709 12:23:01.584802 11123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42f9fb63946447bdadbb789c9398031d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.585695 11182 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:01.586133 11176 tablet_bootstrap.cc:492] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:01.587375 11176 ts_tablet_manager.cc:1403] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.106s	user 0.015s	sys 0.000s
I20260709 12:23:01.590231 10971 tablet_service.cc:1511] Processing CreateTablet for tablet 5635e70df91d469ca24e987e2a28c27d (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:23:01.590498 11176 raft_consensus.cc:359] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } }
I20260709 12:23:01.591207 11176 raft_consensus.cc:385] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:01.591518 11176 raft_consensus.cc:740] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:01.592350 11176 consensus_queue.cc:260] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } }
I20260709 12:23:01.593457 11180 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:01.594878 11134 raft_consensus.cc:2393] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 1: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:01.598992 11180 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:01.601258 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:01.601915 11060 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:01.586550 11177 tablet_bootstrap.cc:492] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:01.605151 11122 tablet_service.cc:1511] Processing CreateTablet for tablet 5635e70df91d469ca24e987e2a28c27d (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:23:01.599692 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:01.591665 10971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5635e70df91d469ca24e987e2a28c27d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.606547 10984 raft_consensus.cc:2393] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 1: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:01.610823 11122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5635e70df91d469ca24e987e2a28c27d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.614782 10972 tablet_service.cc:1511] Processing CreateTablet for tablet 87a7b71cfb864c1b9ab4c85887ca32ad (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:23:01.625214 10972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87a7b71cfb864c1b9ab4c85887ca32ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.625423 11060 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:01.626993 11098 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:01.628333 11180 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:01.628435 11179 tablet_bootstrap.cc:492] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:01.628968 11180 raft_consensus.cc:697] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:01.620049 11047 tablet_service.cc:1511] Processing CreateTablet for tablet 87a7b71cfb864c1b9ab4c85887ca32ad (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:23:01.616246 11124 tablet_service.cc:1511] Processing CreateTablet for tablet 87a7b71cfb864c1b9ab4c85887ca32ad (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:23:01.629081 11179 ts_tablet_manager.cc:1403] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.177s	user 0.009s	sys 0.004s
I20260709 12:23:01.632632 11047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87a7b71cfb864c1b9ab4c85887ca32ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.631542 11177 tablet_bootstrap.cc:654] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:01.630074 11180 consensus_queue.cc:237] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:01.642004 11048 tablet_service.cc:1511] Processing CreateTablet for tablet ed6bc26e6dfc446c9b989b8483864ae4 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:23:01.643405 11048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed6bc26e6dfc446c9b989b8483864ae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.645562 11121 tablet_service.cc:1511] Processing CreateTablet for tablet ed6bc26e6dfc446c9b989b8483864ae4 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:23:01.646276 11124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87a7b71cfb864c1b9ab4c85887ca32ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.647285 11179 raft_consensus.cc:359] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:01.647852 11179 raft_consensus.cc:385] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:01.648087 11179 raft_consensus.cc:740] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:01.648741 11179 consensus_queue.cc:260] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:01.612861 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 69757.4us
I20260709 12:23:01.621019 11049 tablet_service.cc:1511] Processing CreateTablet for tablet 5635e70df91d469ca24e987e2a28c27d (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:23:01.653546 10974 tablet_service.cc:1511] Processing CreateTablet for tablet ed6bc26e6dfc446c9b989b8483864ae4 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:23:01.655366 10974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed6bc26e6dfc446c9b989b8483864ae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.657094 11050 tablet_service.cc:1511] Processing CreateTablet for tablet d938b7067315410aa8ef1ecddf452945 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:23:01.657858 11120 tablet_service.cc:1511] Processing CreateTablet for tablet d938b7067315410aa8ef1ecddf452945 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:23:01.658457 11050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d938b7067315410aa8ef1ecddf452945. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.660326 10969 tablet_service.cc:1511] Processing CreateTablet for tablet d938b7067315410aa8ef1ecddf452945 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:23:01.661597 10969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d938b7067315410aa8ef1ecddf452945. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.662539 10973 tablet_service.cc:1511] Processing CreateTablet for tablet f81a3074c9b841b6a602953195c8ef98 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:23:01.663794 10973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f81a3074c9b841b6a602953195c8ef98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.665473 11179 ts_tablet_manager.cc:1434] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.000s
I20260709 12:23:01.666299 11121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed6bc26e6dfc446c9b989b8483864ae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.666561 11179 tablet_bootstrap.cc:492] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:01.670480 11049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5635e70df91d469ca24e987e2a28c27d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.672098 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:01.672775 11120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d938b7067315410aa8ef1ecddf452945. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.672914 11060 raft_consensus.cc:2393] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 1: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:01.675132 11176 ts_tablet_manager.cc:1434] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.087s	user 0.030s	sys 0.001s
I20260709 12:23:01.675834 10948 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:01.683701 11045 tablet_service.cc:1511] Processing CreateTablet for tablet f81a3074c9b841b6a602953195c8ef98 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:23:01.684199 11192 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:01.676190 11176 tablet_bootstrap.cc:492] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:01.686590 11045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f81a3074c9b841b6a602953195c8ef98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.691128 11122 tablet_service.cc:1511] Processing CreateTablet for tablet f81a3074c9b841b6a602953195c8ef98 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:23:01.692518 11122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f81a3074c9b841b6a602953195c8ef98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.714829 10970 tablet_service.cc:1511] Processing CreateTablet for tablet 46989f4f6130442698a2028fb5bcbf0e (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:23:01.716364 10970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46989f4f6130442698a2028fb5bcbf0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.723302 10880 catalog_manager.cc:5697] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:01.733520 11119 tablet_service.cc:1511] Processing CreateTablet for tablet 46989f4f6130442698a2028fb5bcbf0e (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:23:01.734470 11176 tablet_bootstrap.cc:654] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:01.736094 11119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46989f4f6130442698a2028fb5bcbf0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.738914 11044 tablet_service.cc:1511] Processing CreateTablet for tablet 46989f4f6130442698a2028fb5bcbf0e (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:23:01.751760 11044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46989f4f6130442698a2028fb5bcbf0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.752663 11118 tablet_service.cc:1511] Processing CreateTablet for tablet 6aa9f4fbf45b4a0a88651d571f7b49e4 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:23:01.753491 11047 tablet_service.cc:1511] Processing CreateTablet for tablet 6aa9f4fbf45b4a0a88651d571f7b49e4 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:23:01.754933 11118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aa9f4fbf45b4a0a88651d571f7b49e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.753026 10973 tablet_service.cc:1511] Processing CreateTablet for tablet 6aa9f4fbf45b4a0a88651d571f7b49e4 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:23:01.756174 10973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aa9f4fbf45b4a0a88651d571f7b49e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.758390 11047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aa9f4fbf45b4a0a88651d571f7b49e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.780591 11177 tablet_bootstrap.cc:492] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:01.781250 11177 ts_tablet_manager.cc:1403] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.196s	user 0.020s	sys 0.024s
I20260709 12:23:01.785573 11177 raft_consensus.cc:359] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:01.787034 11177 raft_consensus.cc:385] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:01.787364 11177 raft_consensus.cc:740] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:01.787563 10969 tablet_service.cc:1511] Processing CreateTablet for tablet 6dff0ae92c5347b59bfed7b76061d189 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:23:01.787758 11049 tablet_service.cc:1511] Processing CreateTablet for tablet 6dff0ae92c5347b59bfed7b76061d189 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:23:01.788247 11177 consensus_queue.cc:260] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:01.788971 10969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dff0ae92c5347b59bfed7b76061d189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.794691 11049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dff0ae92c5347b59bfed7b76061d189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.795838 11121 tablet_service.cc:1511] Processing CreateTablet for tablet 6dff0ae92c5347b59bfed7b76061d189 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:23:01.797134 11121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dff0ae92c5347b59bfed7b76061d189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.799336 11192 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.799857 11192 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:01.803839 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:01.803996 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:01.804584 11060 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 0.
I20260709 12:23:01.804888 11176 tablet_bootstrap.cc:492] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:01.805414 11176 ts_tablet_manager.cc:1403] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.129s	user 0.011s	sys 0.000s
I20260709 12:23:01.805910 10948 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:01.806952 11182 raft_consensus.cc:2804] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:01.807348 11182 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:01.807691 11182 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:01.810420 10949 leader_election.cc:343] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:01.814869 11176 raft_consensus.cc:359] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:01.815691 11176 raft_consensus.cc:385] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:01.816022 11176 raft_consensus.cc:740] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:01.815202 11192 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:01.819442 11176 consensus_queue.cc:260] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:01.823433 11176 ts_tablet_manager.cc:1434] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 12:23:01.824625 11176 tablet_bootstrap.cc:492] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:01.822167 11182 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:01.829023 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:01.829697 11060 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:01.831959 11176 tablet_bootstrap.cc:654] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:01.834581 11192 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.835076 11192 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } }
I20260709 12:23:01.839090 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:01.840857 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:01.841528 11134 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 0.
I20260709 12:23:01.842662 10949 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:01.839099 11192 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:23:01.856590 10948 leader_election.cc:343] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:01.846297 11192 raft_consensus.cc:2804] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:01.843544 11060 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:01.857532 11192 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:01.857913 11192 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:01.858767 11182 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:01.859539 10948 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:01.860392 11182 raft_consensus.cc:2804] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:01.860839 11182 raft_consensus.cc:697] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:01.861627 11182 consensus_queue.cc:237] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:01.863005 11177 ts_tablet_manager.cc:1434] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.081s	user 0.009s	sys 0.001s
I20260709 12:23:01.864187 11177 tablet_bootstrap.cc:492] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:01.870257 11176 tablet_bootstrap.cc:492] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:01.870822 11176 ts_tablet_manager.cc:1403] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.030s
I20260709 12:23:01.875275 10974 tablet_service.cc:1511] Processing CreateTablet for tablet ceabf3208ccf4abbad90d81586377118 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:23:01.876678 10974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceabf3208ccf4abbad90d81586377118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.878994 11179 tablet_bootstrap.cc:654] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:01.882597 10970 tablet_service.cc:1511] Processing CreateTablet for tablet cfc5f0c97d6e4662b2fe7ef12f7e7284 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:23:01.884068 10970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfc5f0c97d6e4662b2fe7ef12f7e7284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.889112 11120 tablet_service.cc:1511] Processing CreateTablet for tablet ceabf3208ccf4abbad90d81586377118 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:23:01.891628 11049 tablet_service.cc:1511] Processing CreateTablet for tablet ceabf3208ccf4abbad90d81586377118 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:23:01.892828 11049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceabf3208ccf4abbad90d81586377118. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:01.896832 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 54259.6us
I20260709 12:23:01.900585 11120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceabf3208ccf4abbad90d81586377118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.910037 11192 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } }
I20260709 12:23:01.915902 11119 tablet_service.cc:1511] Processing CreateTablet for tablet cfc5f0c97d6e4662b2fe7ef12f7e7284 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:23:01.916038 11176 raft_consensus.cc:359] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:01.916754 11176 raft_consensus.cc:385] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:01.917057 11176 raft_consensus.cc:740] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:01.931036 11049 tablet_service.cc:1511] Processing CreateTablet for tablet cfc5f0c97d6e4662b2fe7ef12f7e7284 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:23:01.931957 11049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfc5f0c97d6e4662b2fe7ef12f7e7284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.923985 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:01.934177 11134 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:01.917354 11119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfc5f0c97d6e4662b2fe7ef12f7e7284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.940989 10881 catalog_manager.cc:5697] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 0 to 1, leader changed from <none> to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:01.944360 11177 tablet_bootstrap.cc:654] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:01.950543 11192 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:01.951793 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:01.952432 11133 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:01.943583 11179 tablet_bootstrap.cc:492] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:01.955401 11048 tablet_service.cc:1511] Processing CreateTablet for tablet 1edc7e1c10ce4d21b4ad909d703ace3e (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:23:01.968024 11048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1edc7e1c10ce4d21b4ad909d703ace3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.967767 10969 tablet_service.cc:1511] Processing CreateTablet for tablet ec4be143c296464e86202c1a42e3d3ee (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:23:01.968997 10969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec4be143c296464e86202c1a42e3d3ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.969486 11134 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:01.956677 11118 tablet_service.cc:1511] Processing CreateTablet for tablet 1edc7e1c10ce4d21b4ad909d703ace3e (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:23:01.971161 11118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1edc7e1c10ce4d21b4ad909d703ace3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.959100 11047 tablet_service.cc:1511] Processing CreateTablet for tablet 709d2903489748c8a8490194704bc3ca (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:23:01.972326 11044 tablet_service.cc:1511] Processing CreateTablet for tablet ec4be143c296464e86202c1a42e3d3ee (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:23:01.973330 11047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 709d2903489748c8a8490194704bc3ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.921806 11176 consensus_queue.cc:260] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:01.973963 11044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec4be143c296464e86202c1a42e3d3ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.960114 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:23:01.975674 10948 leader_election.cc:343] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:01.960282 11122 tablet_service.cc:1511] Processing CreateTablet for tablet 709d2903489748c8a8490194704bc3ca (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:23:01.977244 10971 tablet_service.cc:1511] Processing CreateTablet for tablet 65c91dadbee643c4bc2ef982cc40ffe8 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:23:01.978570 10971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65c91dadbee643c4bc2ef982cc40ffe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.978457 11121 tablet_service.cc:1511] Processing CreateTablet for tablet ec4be143c296464e86202c1a42e3d3ee (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:23:01.979782 11122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 709d2903489748c8a8490194704bc3ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.964310 10974 tablet_service.cc:1511] Processing CreateTablet for tablet f28a3d1504ca450d9efd93115b1164f9 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:23:01.982054 10974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f28a3d1504ca450d9efd93115b1164f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.965058 11133 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:01.988915 10949 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:01.990171 11192 raft_consensus.cc:2804] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:01.990670 11192 raft_consensus.cc:697] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:01.991452 11192 consensus_queue.cc:237] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } }
I20260709 12:23:01.995481 11048 tablet_service.cc:1511] Processing CreateTablet for tablet 65c91dadbee643c4bc2ef982cc40ffe8 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:23:01.965691 11179 ts_tablet_manager.cc:1403] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.299s	user 0.020s	sys 0.003s
I20260709 12:23:01.916320 10972 tablet_service.cc:1511] Processing CreateTablet for tablet 1edc7e1c10ce4d21b4ad909d703ace3e (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:23:01.966693 11049 tablet_service.cc:1511] Processing CreateTablet for tablet f28a3d1504ca450d9efd93115b1164f9 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:23:01.966557 11120 tablet_service.cc:1511] Processing CreateTablet for tablet f28a3d1504ca450d9efd93115b1164f9 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:23:01.998088 11124 tablet_service.cc:1511] Processing CreateTablet for tablet 65c91dadbee643c4bc2ef982cc40ffe8 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:23:01.987252 11121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec4be143c296464e86202c1a42e3d3ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.000005 11124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65c91dadbee643c4bc2ef982cc40ffe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.000623 11120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f28a3d1504ca450d9efd93115b1164f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.001039 11176 ts_tablet_manager.cc:1434] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.130s	user 0.012s	sys 0.004s
I20260709 12:23:02.002771 10972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1edc7e1c10ce4d21b4ad909d703ace3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.003837 11179 raft_consensus.cc:359] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.004570 11179 raft_consensus.cc:385] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:02.004866 11179 raft_consensus.cc:740] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:02.011829 10973 tablet_service.cc:1511] Processing CreateTablet for tablet 494450549bab41b6a4c557c9d2afddc7 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:23:02.013161 10973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 494450549bab41b6a4c557c9d2afddc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.026450 11050 tablet_service.cc:1511] Processing CreateTablet for tablet 494450549bab41b6a4c557c9d2afddc7 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:23:02.030071 11180 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.030629 11180 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.031932 11123 tablet_service.cc:1511] Processing CreateTablet for tablet 494450549bab41b6a4c557c9d2afddc7 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:23:02.032876 10968 tablet_service.cc:1511] Processing CreateTablet for tablet 497ca545c71446259b5dc17afceaaf59 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:23:02.033390 11123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 494450549bab41b6a4c557c9d2afddc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.034192 10968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 497ca545c71446259b5dc17afceaaf59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.035029 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:02.034873 10970 tablet_service.cc:1511] Processing CreateTablet for tablet 709d2903489748c8a8490194704bc3ca (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:23:02.036487 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:02.028671 11048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65c91dadbee643c4bc2ef982cc40ffe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.039002 11049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f28a3d1504ca450d9efd93115b1164f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.036798 11176 tablet_bootstrap.cc:492] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:02.032821 11180 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:02.039655 11050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 494450549bab41b6a4c557c9d2afddc7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:02.038079 11098 leader_election.cc:343] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:02.041231 11097 leader_election.cc:343] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:02.042209 11097 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:02.043418 11180 raft_consensus.cc:2749] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:02.046839 11180 consensus_queue.cc:1048] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:02.042634 10970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 709d2903489748c8a8490194704bc3ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.056706 11177 tablet_bootstrap.cc:492] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:02.035808 11179 consensus_queue.cc:260] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.057261 11177 ts_tablet_manager.cc:1403] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.193s	user 0.007s	sys 0.015s
I20260709 12:23:02.064090 10881 catalog_manager.cc:5697] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 0 to 1, leader changed from <none> to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:02.065382 10967 tablet_service.cc:1511] Processing CreateTablet for tablet 702d64a1236147a784daa11e58563721 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:23:02.065798 11049 tablet_service.cc:1511] Processing CreateTablet for tablet 497ca545c71446259b5dc17afceaaf59 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:23:02.067057 11049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 497ca545c71446259b5dc17afceaaf59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.067991 10967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 702d64a1236147a784daa11e58563721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.071570 11176 tablet_bootstrap.cc:654] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:02.073328 11193 consensus_queue.cc:1048] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:02.079183 11177 raft_consensus.cc:359] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.080010 11177 raft_consensus.cc:385] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:02.080734 11045 tablet_service.cc:1511] Processing CreateTablet for tablet 702d64a1236147a784daa11e58563721 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:23:02.087198 11045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 702d64a1236147a784daa11e58563721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.087934 11122 tablet_service.cc:1511] Processing CreateTablet for tablet 702d64a1236147a784daa11e58563721 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:23:02.091312 10966 tablet_service.cc:1511] Processing CreateTablet for tablet a84c56f62e0a4a9990f4969bc324dd7e (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:23:02.094643 10966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a84c56f62e0a4a9990f4969bc324dd7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.095441 11186 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.095937 11186 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.089570 11122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 702d64a1236147a784daa11e58563721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.085160 11177 raft_consensus.cc:740] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:02.109359 11186 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:02.112440 11049 tablet_service.cc:1511] Processing CreateTablet for tablet a84c56f62e0a4a9990f4969bc324dd7e (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:23:02.113413 11049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a84c56f62e0a4a9990f4969bc324dd7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.143570 11117 tablet_service.cc:1511] Processing CreateTablet for tablet a84c56f62e0a4a9990f4969bc324dd7e (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:23:02.144124 11046 tablet_service.cc:1511] Processing CreateTablet for tablet 9824def13ff74f65931445e01ea9cb84 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:23:02.145006 11117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a84c56f62e0a4a9990f4969bc324dd7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.145331 11046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9824def13ff74f65931445e01ea9cb84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.140062 11177 consensus_queue.cc:260] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.146994 10965 tablet_service.cc:1511] Processing CreateTablet for tablet 9824def13ff74f65931445e01ea9cb84 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:23:02.148334 10965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9824def13ff74f65931445e01ea9cb84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.148576 11177 ts_tablet_manager.cc:1434] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.085s	user 0.005s	sys 0.001s
I20260709 12:23:02.149622 11177 tablet_bootstrap.cc:492] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:02.151113 11119 tablet_service.cc:1511] Processing CreateTablet for tablet 497ca545c71446259b5dc17afceaaf59 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:23:02.152454 11119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 497ca545c71446259b5dc17afceaaf59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.153110 11116 tablet_service.cc:1511] Processing CreateTablet for tablet 9824def13ff74f65931445e01ea9cb84 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:23:02.158996 11116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9824def13ff74f65931445e01ea9cb84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.167712 11179 ts_tablet_manager.cc:1434] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.167s	user 0.007s	sys 0.001s
I20260709 12:23:02.168890 11179 tablet_bootstrap.cc:492] T 49ef051819cd4f229ac2b37858ee3db5 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:02.175251 11176 tablet_bootstrap.cc:492] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:02.175784 11176 ts_tablet_manager.cc:1403] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.140s	user 0.022s	sys 0.011s
I20260709 12:23:02.188560 11043 tablet_service.cc:1511] Processing CreateTablet for tablet 820ab313402049dfa58d12167763953e (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:23:02.198668 11043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 820ab313402049dfa58d12167763953e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.202062 11179 tablet_bootstrap.cc:654] T 49ef051819cd4f229ac2b37858ee3db5 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:02.217005 10971 tablet_service.cc:1511] Processing CreateTablet for tablet 820ab313402049dfa58d12167763953e (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:23:02.218443 10971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 820ab313402049dfa58d12167763953e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.223711 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:23:02.229837 11025 leader_election.cc:343] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:02.228328 11124 tablet_service.cc:1511] Processing CreateTablet for tablet 820ab313402049dfa58d12167763953e (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:23:02.231145 11124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 820ab313402049dfa58d12167763953e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.244979 10974 tablet_service.cc:1511] Processing CreateTablet for tablet a5d087871c7847629fca3c40460a08b1 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:23:02.246261 10974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5d087871c7847629fca3c40460a08b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.282052 11115 tablet_service.cc:1511] Processing CreateTablet for tablet a5d087871c7847629fca3c40460a08b1 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:23:02.283529 11115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5d087871c7847629fca3c40460a08b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.292560 11179 tablet_bootstrap.cc:492] T 49ef051819cd4f229ac2b37858ee3db5 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:02.293450 11179 ts_tablet_manager.cc:1403] T 49ef051819cd4f229ac2b37858ee3db5 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.125s	user 0.018s	sys 0.004s
I20260709 12:23:02.251683 11176 raft_consensus.cc:359] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.302433 11179 raft_consensus.cc:359] T 49ef051819cd4f229ac2b37858ee3db5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } }
I20260709 12:23:02.303243 11179 raft_consensus.cc:385] T 49ef051819cd4f229ac2b37858ee3db5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:02.303560 11179 raft_consensus.cc:740] T 49ef051819cd4f229ac2b37858ee3db5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:02.304354 11179 consensus_queue.cc:260] T 49ef051819cd4f229ac2b37858ee3db5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } }
I20260709 12:23:02.308526 11177 tablet_bootstrap.cc:654] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:02.315618 11049 tablet_service.cc:1511] Processing CreateTablet for tablet d50eacd0821047a9930a0698124ba4f0 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:23:02.316861 11049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d50eacd0821047a9930a0698124ba4f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.319065 10972 tablet_service.cc:1511] Processing CreateTablet for tablet d50eacd0821047a9930a0698124ba4f0 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:23:02.320442 10972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d50eacd0821047a9930a0698124ba4f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.329958 11117 tablet_service.cc:1511] Processing CreateTablet for tablet d50eacd0821047a9930a0698124ba4f0 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:23:02.331449 11117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d50eacd0821047a9930a0698124ba4f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.332430 10973 tablet_service.cc:1511] Processing CreateTablet for tablet c2dcd574d9d144ce853b29000889507e (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:23:02.333827 10973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2dcd574d9d144ce853b29000889507e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.334168 11176 raft_consensus.cc:385] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:02.334076 11042 tablet_service.cc:1511] Processing CreateTablet for tablet c2dcd574d9d144ce853b29000889507e (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:23:02.334619 11176 raft_consensus.cc:740] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:02.343636 11042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2dcd574d9d144ce853b29000889507e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.346801 11179 ts_tablet_manager.cc:1434] T 49ef051819cd4f229ac2b37858ee3db5 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 12:23:02.355221 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:23:02.356884 11023 leader_election.cc:343] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:02.357367 11023 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:02.358644 11208 raft_consensus.cc:2749] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:02.356596 11041 tablet_service.cc:1511] Processing CreateTablet for tablet 6c233c491e1b4126b9d776bfd98023b6 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:23:02.360726 11049 tablet_service.cc:1511] Processing CreateTablet for tablet 0bb096cdb35c45e785fda6900a7999f7 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:23:02.361354 11041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c233c491e1b4126b9d776bfd98023b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.367538 11049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bb096cdb35c45e785fda6900a7999f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.353535 10966 tablet_service.cc:1511] Processing CreateTablet for tablet 0bb096cdb35c45e785fda6900a7999f7 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:23:02.371083 10966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bb096cdb35c45e785fda6900a7999f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.376317 11179 tablet_bootstrap.cc:492] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:02.380208 11118 tablet_service.cc:1511] Processing CreateTablet for tablet 6c233c491e1b4126b9d776bfd98023b6 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:23:02.388576 11047 tablet_service.cc:1511] Processing CreateTablet for tablet a5d087871c7847629fca3c40460a08b1 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:23:02.360378 11176 consensus_queue.cc:260] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.390033 11047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5d087871c7847629fca3c40460a08b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.390419 11182 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.390522 11118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c233c491e1b4126b9d776bfd98023b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.399123 11049 tablet_service.cc:1511] Processing CreateTablet for tablet e8083bc5cbd34d98a24be9a390262c19 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:23:02.391520 11124 tablet_service.cc:1511] Processing CreateTablet for tablet 0bb096cdb35c45e785fda6900a7999f7 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:23:02.396713 11179 tablet_bootstrap.cc:654] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:02.396221 11176 ts_tablet_manager.cc:1434] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.220s	user 0.009s	sys 0.000s
I20260709 12:23:02.403937 11182 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.381826 11192 consensus_queue.cc:1048] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 12:23:02.420181 11124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bb096cdb35c45e785fda6900a7999f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.391817 10965 tablet_service.cc:1511] Processing CreateTablet for tablet e8083bc5cbd34d98a24be9a390262c19 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:23:02.424085 10970 tablet_service.cc:1511] Processing CreateTablet for tablet 839b2afaa86144938bdfb973011c3303 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:23:02.390267 10967 tablet_service.cc:1511] Processing CreateTablet for tablet 6c233c491e1b4126b9d776bfd98023b6 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:23:02.426493 11045 tablet_service.cc:1511] Processing CreateTablet for tablet 839b2afaa86144938bdfb973011c3303 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:23:02.438925 11119 tablet_service.cc:1511] Processing CreateTablet for tablet e8083bc5cbd34d98a24be9a390262c19 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:23:02.442147 11045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 839b2afaa86144938bdfb973011c3303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.442677 11115 tablet_service.cc:1511] Processing CreateTablet for tablet 839b2afaa86144938bdfb973011c3303 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:23:02.443917 11115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 839b2afaa86144938bdfb973011c3303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.446887 11182 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:02.448622 11048 tablet_service.cc:1511] Processing CreateTablet for tablet 2f4458a30aab4e97ae1d0e1d465fae04 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:23:02.449728 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:02.450474 11133 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 0.
I20260709 12:23:02.450673 11048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f4458a30aab4e97ae1d0e1d465fae04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.451840 10949 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:02.442202 11176 tablet_bootstrap.cc:492] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:02.454896 10965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8083bc5cbd34d98a24be9a390262c19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.456161 11192 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:02.456615 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:02.396351 11122 tablet_service.cc:1511] Processing CreateTablet for tablet c2dcd574d9d144ce853b29000889507e (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
W20260709 12:23:02.458405 10948 leader_election.cc:343] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:02.459167 11122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2dcd574d9d144ce853b29000889507e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.466010 11182 consensus_queue.cc:1048] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:02.474463 10967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c233c491e1b4126b9d776bfd98023b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.474551 11176 tablet_bootstrap.cc:654] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:02.456657 11192 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:02.487370 11049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8083bc5cbd34d98a24be9a390262c19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.498840 11119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8083bc5cbd34d98a24be9a390262c19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.504145 11208 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.504685 11208 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } }
I20260709 12:23:02.495391 11192 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:02.516165 11208 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
I20260709 12:23:02.516705 11179 tablet_bootstrap.cc:492] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:02.517434 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:02.522943 11182 consensus_queue.cc:1048] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:02.517724 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:02.524348 11134 raft_consensus.cc:2393] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 1: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:02.525509 11047 tablet_service.cc:1511] Processing CreateTablet for tablet 5d1c6709dd7d464db6e30b204580fe75 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:23:02.525641 11025 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:02.526718 11047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d1c6709dd7d464db6e30b204580fe75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.526901 11208 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:02.518509 11120 tablet_service.cc:1511] Processing CreateTablet for tablet 2f4458a30aab4e97ae1d0e1d465fae04 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:23:02.530892 11120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f4458a30aab4e97ae1d0e1d465fae04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.534255 10970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 839b2afaa86144938bdfb973011c3303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.521817 10973 tablet_service.cc:1511] Processing CreateTablet for tablet 5d1c6709dd7d464db6e30b204580fe75 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:23:02.524003 11121 tablet_service.cc:1511] Processing CreateTablet for tablet 5d1c6709dd7d464db6e30b204580fe75 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:23:02.519651 10966 tablet_service.cc:1511] Processing CreateTablet for tablet 2f4458a30aab4e97ae1d0e1d465fae04 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:23:02.539500 11179 ts_tablet_manager.cc:1403] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.163s	user 0.011s	sys 0.015s
I20260709 12:23:02.540143 10966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f4458a30aab4e97ae1d0e1d465fae04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.541965 11049 tablet_service.cc:1511] Processing CreateTablet for tablet 0a21734672b8441faae7b5d5d050d2b2 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:23:02.543395 11049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a21734672b8441faae7b5d5d050d2b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.540117 11121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d1c6709dd7d464db6e30b204580fe75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.552198 10968 tablet_service.cc:1511] Processing CreateTablet for tablet 0a21734672b8441faae7b5d5d050d2b2 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:23:02.555281 11123 tablet_service.cc:1511] Processing CreateTablet for tablet 0a21734672b8441faae7b5d5d050d2b2 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:23:02.556690 11123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a21734672b8441faae7b5d5d050d2b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.558657 10973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d1c6709dd7d464db6e30b204580fe75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.558981 10974 tablet_service.cc:1511] Processing CreateTablet for tablet d2205be6a7c94913a366d683de188a31 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:23:02.559386 10968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a21734672b8441faae7b5d5d050d2b2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:02.560846 10930 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:02.566440 10974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2205be6a7c94913a366d683de188a31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.587426 11042 tablet_service.cc:1511] Processing CreateTablet for tablet d2205be6a7c94913a366d683de188a31 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:23:02.592298 11177 tablet_bootstrap.cc:492] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:02.592896 11177 ts_tablet_manager.cc:1403] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.443s	user 0.057s	sys 0.044s
I20260709 12:23:02.622669 10969 tablet_service.cc:1511] Processing CreateTablet for tablet ad5b1fe8f9f246d791d03da03e5c44ee (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:23:02.624055 10969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad5b1fe8f9f246d791d03da03e5c44ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.625725 11047 tablet_service.cc:1511] Processing CreateTablet for tablet ad5b1fe8f9f246d791d03da03e5c44ee (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:23:02.631582 11208 raft_consensus.cc:2749] T 49ef051819cd4f229ac2b37858ee3db5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:02.631639 11121 tablet_service.cc:1511] Processing CreateTablet for tablet d2205be6a7c94913a366d683de188a31 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:23:02.637208 11121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2205be6a7c94913a366d683de188a31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.639561 11182 consensus_queue.cc:1048] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:02.604049 11192 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.649111 11042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2205be6a7c94913a366d683de188a31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.654630 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:02.654871 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:02.656610 11047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad5b1fe8f9f246d791d03da03e5c44ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.655412 11117 tablet_service.cc:1511] Processing CreateTablet for tablet ad5b1fe8f9f246d791d03da03e5c44ee (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:23:02.658336 11132 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:02.661022 11117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad5b1fe8f9f246d791d03da03e5c44ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.655339 11192 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:02.646960 11179 raft_consensus.cc:359] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.674568 10971 tablet_service.cc:1511] Processing CreateTablet for tablet 0bb240ba9bd84493aa3cda1c24e646f1 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:23:02.676111 10971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bb240ba9bd84493aa3cda1c24e646f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.661000 11177 raft_consensus.cc:359] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.677707 11177 raft_consensus.cc:385] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:02.678210 11177 raft_consensus.cc:740] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:02.678992 11177 consensus_queue.cc:260] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.674556 11179 raft_consensus.cc:385] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:02.679924 11179 raft_consensus.cc:740] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:02.680665 11179 consensus_queue.cc:260] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.681339 11177 ts_tablet_manager.cc:1434] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.088s	user 0.006s	sys 0.002s
I20260709 12:23:02.681557 11060 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:02.697836 11177 tablet_bootstrap.cc:492] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
W20260709 12:23:02.713482 11011 tablet.cc:2406] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:23:02.727718 11132 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:02.729220 10949 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:02.730060 11192 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:02.730618 11192 raft_consensus.cc:697] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:02.731469 11192 consensus_queue.cc:237] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.732246 11060 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:02.748257 11047 tablet_service.cc:1511] Processing CreateTablet for tablet 0bb240ba9bd84493aa3cda1c24e646f1 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:23:02.749330 11047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bb240ba9bd84493aa3cda1c24e646f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.751282 11177 tablet_bootstrap.cc:654] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:02.748589 11176 tablet_bootstrap.cc:492] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:02.752446 11176 ts_tablet_manager.cc:1403] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.310s	user 0.025s	sys 0.017s
I20260709 12:23:02.755169 11176 raft_consensus.cc:359] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.755775 11176 raft_consensus.cc:385] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:02.756017 11176 raft_consensus.cc:740] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:02.756646 11176 consensus_queue.cc:260] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.761653 10969 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9fad3893d845fa9208a48c76eb609f (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:23:02.762069 11123 tablet_service.cc:1511] Processing CreateTablet for tablet 0bb240ba9bd84493aa3cda1c24e646f1 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:23:02.763036 10969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9fad3893d845fa9208a48c76eb609f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.763173 11123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bb240ba9bd84493aa3cda1c24e646f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.764195 10880 catalog_manager.cc:5697] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 0 to 1, leader changed from <none> to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:02.765679 11179 ts_tablet_manager.cc:1434] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.225s	user 0.008s	sys 0.001s
I20260709 12:23:02.769199 11179 tablet_bootstrap.cc:492] T 1e22af520a9e4eb795f4a0e920b05a3b P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:02.771041 11218 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.771555 11218 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.773772 11218 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:02.775254 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:02.776952 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:02.777649 11059 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 0.
I20260709 12:23:02.766361 11176 ts_tablet_manager.cc:1434] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
W20260709 12:23:02.778720 11097 leader_election.cc:343] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:02.779155 11121 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9fad3893d845fa9208a48c76eb609f (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:23:02.779584 11098 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:02.780488 11121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9fad3893d845fa9208a48c76eb609f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.780866 11218 raft_consensus.cc:2804] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:02.781329 11218 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:02.781755 11218 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:02.779861 11176 tablet_bootstrap.cc:492] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:02.792235 11179 tablet_bootstrap.cc:654] T 1e22af520a9e4eb795f4a0e920b05a3b P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:02.781018 11048 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9fad3893d845fa9208a48c76eb609f (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:23:02.797585 11218 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.801059 10971 tablet_service.cc:1511] Processing CreateTablet for tablet 227d10a1bcd84a0e9845113d5b0a2495 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:23:02.801925 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:02.801842 11047 tablet_service.cc:1511] Processing CreateTablet for tablet 227d10a1bcd84a0e9845113d5b0a2495 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:23:02.802469 10971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 227d10a1bcd84a0e9845113d5b0a2495. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.803026 11047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 227d10a1bcd84a0e9845113d5b0a2495. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:02.803557 11097 leader_election.cc:343] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:02.819661 10969 tablet_service.cc:1511] Processing CreateTablet for tablet 6506ec2922c24d099538b52b0df81502 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:23:02.821477 11123 tablet_service.cc:1511] Processing CreateTablet for tablet 227d10a1bcd84a0e9845113d5b0a2495 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:23:02.822759 11218 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:02.823491 10969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6506ec2922c24d099538b52b0df81502. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.829568 10966 tablet_service.cc:1511] Processing CreateTablet for tablet d3ee878370114c8d8434e02b9c0aa6be (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:23:02.830186 11047 tablet_service.cc:1511] Processing CreateTablet for tablet d3ee878370114c8d8434e02b9c0aa6be (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:23:02.830925 10966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3ee878370114c8d8434e02b9c0aa6be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.823935 11179 tablet_bootstrap.cc:492] T 1e22af520a9e4eb795f4a0e920b05a3b P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:02.834908 11179 ts_tablet_manager.cc:1403] T 1e22af520a9e4eb795f4a0e920b05a3b P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.000s
I20260709 12:23:02.837085 11117 tablet_service.cc:1511] Processing CreateTablet for tablet d3ee878370114c8d8434e02b9c0aa6be (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:23:02.823583 11042 tablet_service.cc:1511] Processing CreateTablet for tablet 6506ec2922c24d099538b52b0df81502 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:23:02.838204 11179 raft_consensus.cc:359] T 1e22af520a9e4eb795f4a0e920b05a3b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.838958 11179 raft_consensus.cc:385] T 1e22af520a9e4eb795f4a0e920b05a3b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:02.824712 11123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 227d10a1bcd84a0e9845113d5b0a2495. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.824590 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:02.845063 11179 raft_consensus.cc:740] T 1e22af520a9e4eb795f4a0e920b05a3b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:02.825803 11176 tablet_bootstrap.cc:654] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:02.825269 11192 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.826669 11048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9fad3893d845fa9208a48c76eb609f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.847188 11117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3ee878370114c8d8434e02b9c0aa6be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.825680 11121 tablet_service.cc:1511] Processing CreateTablet for tablet 6506ec2922c24d099538b52b0df81502 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:23:02.846498 11059 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:02.849917 11121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6506ec2922c24d099538b52b0df81502. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.850082 11042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6506ec2922c24d099538b52b0df81502. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.851150 11045 tablet_service.cc:1511] Processing CreateTablet for tablet e37077b3b6d34e6f9558c96b2d955211 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:23:02.852478 11045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e37077b3b6d34e6f9558c96b2d955211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.829075 11177 tablet_bootstrap.cc:492] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:02.854513 11177 ts_tablet_manager.cc:1403] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.169s	user 0.012s	sys 0.000s
I20260709 12:23:02.856720 11059 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:02.858135 11098 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:02.859334 11193 raft_consensus.cc:2804] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:02.847242 11192 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.861423 11047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3ee878370114c8d8434e02b9c0aa6be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.863768 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:02.864496 11132 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 0.
I20260709 12:23:02.865904 10949 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:02.866845 11182 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:02.867242 11182 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:02.867601 11182 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:02.863404 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:02.874571 11192 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:02.854465 11218 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.875217 11182 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.875514 11218 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.877651 11218 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:02.878322 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:02.878322 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:02.879930 11179 consensus_queue.cc:260] T 1e22af520a9e4eb795f4a0e920b05a3b P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.857602 11177 raft_consensus.cc:359] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.882200 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:02.886745 11177 raft_consensus.cc:385] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:02.886910 11059 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 0.
I20260709 12:23:02.887161 11177 raft_consensus.cc:740] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:02.887431 10966 tablet_service.cc:1511] Processing CreateTablet for tablet 2cdd07e6995141b68c257e6c93f15f2e (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
W20260709 12:23:02.888036 11098 leader_election.cc:343] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:02.888792 10966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cdd07e6995141b68c257e6c93f15f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.890671 11179 ts_tablet_manager.cc:1434] T 1e22af520a9e4eb795f4a0e920b05a3b P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.003s
I20260709 12:23:02.893865 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:02.899540 11132 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:02.900053 11179 tablet_bootstrap.cc:492] T dabbb0c174364b1ea4126a4f3d5bb4c2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:02.902266 11049 tablet_service.cc:1511] Processing CreateTablet for tablet 2cdd07e6995141b68c257e6c93f15f2e (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:23:02.903527 11049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cdd07e6995141b68c257e6c93f15f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.905920 10969 tablet_service.cc:1511] Processing CreateTablet for tablet e37077b3b6d34e6f9558c96b2d955211 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:23:02.902318 11121 tablet_service.cc:1511] Processing CreateTablet for tablet e37077b3b6d34e6f9558c96b2d955211 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:23:02.907250 10969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e37077b3b6d34e6f9558c96b2d955211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.909350 11132 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:02.907334 11121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e37077b3b6d34e6f9558c96b2d955211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.910703 10949 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:02.911623 11192 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:02.912928 11192 raft_consensus.cc:697] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:02.913820 11192 consensus_queue.cc:237] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.918020 11179 tablet_bootstrap.cc:654] T dabbb0c174364b1ea4126a4f3d5bb4c2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:02.891165 11177 consensus_queue.cc:260] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.898198 11193 raft_consensus.cc:697] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:02.934358 11193 consensus_queue.cc:237] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.935488 10966 tablet_service.cc:1511] Processing CreateTablet for tablet d9e6122a57324bc79c68d46f4cc18aa7 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:23:02.936816 10966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9e6122a57324bc79c68d46f4cc18aa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.938573 10984 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 0.
I20260709 12:23:02.941097 11097 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:02.944949 11177 ts_tablet_manager.cc:1434] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.090s	user 0.007s	sys 0.000s
I20260709 12:23:02.895902 11182 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:02.931475 11119 tablet_service.cc:1511] Processing CreateTablet for tablet 2cdd07e6995141b68c257e6c93f15f2e (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:23:02.947100 11119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cdd07e6995141b68c257e6c93f15f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.950618 11179 tablet_bootstrap.cc:492] T dabbb0c174364b1ea4126a4f3d5bb4c2 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:02.951264 11179 ts_tablet_manager.cc:1403] T dabbb0c174364b1ea4126a4f3d5bb4c2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.000s
I20260709 12:23:02.954299 11177 tablet_bootstrap.cc:492] T 1d0463b3e1c746218d71d6d8eb843dc8 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:02.954324 11179 raft_consensus.cc:359] T dabbb0c174364b1ea4126a4f3d5bb4c2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.955510 11179 raft_consensus.cc:385] T dabbb0c174364b1ea4126a4f3d5bb4c2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:02.955889 11179 raft_consensus.cc:740] T dabbb0c174364b1ea4126a4f3d5bb4c2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:02.958793 11179 consensus_queue.cc:260] T dabbb0c174364b1ea4126a4f3d5bb4c2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.958781 11235 raft_consensus.cc:2804] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:02.960466 11235 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:02.960932 11235 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:02.968428 11235 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.970865 11179 ts_tablet_manager.cc:1434] T dabbb0c174364b1ea4126a4f3d5bb4c2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:23:02.971972 11179 tablet_bootstrap.cc:492] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:02.971369 10880 catalog_manager.cc:5697] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 0 to 1, leader changed from <none> to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:02.961107 11176 tablet_bootstrap.cc:492] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:02.974529 11176 ts_tablet_manager.cc:1403] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.195s	user 0.029s	sys 0.045s
I20260709 12:23:02.975001 11047 tablet_service.cc:1511] Processing CreateTablet for tablet d9e6122a57324bc79c68d46f4cc18aa7 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:23:02.977283 11176 raft_consensus.cc:359] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.981918 11179 tablet_bootstrap.cc:654] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:02.969583 11177 tablet_bootstrap.cc:654] T 1d0463b3e1c746218d71d6d8eb843dc8 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:02.985183 11121 tablet_service.cc:1511] Processing CreateTablet for tablet d9e6122a57324bc79c68d46f4cc18aa7 (DEFAULT_TABLE table=test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:23:02.985994 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:02.986392 11121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9e6122a57324bc79c68d46f4cc18aa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.986702 10984 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:02.977950 11176 raft_consensus.cc:385] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:02.987188 11176 raft_consensus.cc:740] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:02.985528 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:02.989917 11059 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:02.990532 11176 consensus_queue.cc:260] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.992527 11176 ts_tablet_manager.cc:1434] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 12:23:02.993487 11176 tablet_bootstrap.cc:492] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:02.983335 11047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9e6122a57324bc79c68d46f4cc18aa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.983695 11235 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:02.997002 11177 tablet_bootstrap.cc:492] T 1d0463b3e1c746218d71d6d8eb843dc8 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:02.997900 11177 ts_tablet_manager.cc:1403] T 1d0463b3e1c746218d71d6d8eb843dc8 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.002s
I20260709 12:23:02.999230 11176 tablet_bootstrap.cc:654] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.001518 11059 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:03.003469 11179 tablet_bootstrap.cc:492] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:03.004024 11179 ts_tablet_manager.cc:1403] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.005s
I20260709 12:23:03.006820 11179 raft_consensus.cc:359] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.012856 11179 raft_consensus.cc:385] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.013739 11179 raft_consensus.cc:740] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.001768 11177 raft_consensus.cc:359] T 1d0463b3e1c746218d71d6d8eb843dc8 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.014492 11177 raft_consensus.cc:385] T 1d0463b3e1c746218d71d6d8eb843dc8 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.015113 11177 raft_consensus.cc:740] T 1d0463b3e1c746218d71d6d8eb843dc8 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.016916 11177 consensus_queue.cc:260] T 1d0463b3e1c746218d71d6d8eb843dc8 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:02.965247 10881 catalog_manager.cc:5697] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:03.017290 10984 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:03.015684 11179 consensus_queue.cc:260] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.024243 11098 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:03.025909 11179 ts_tablet_manager.cc:1434] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:23:03.026947 11179 tablet_bootstrap.cc:492] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:03.029366 11193 raft_consensus.cc:2804] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:03.029942 11193 raft_consensus.cc:697] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:03.030956 11176 tablet_bootstrap.cc:492] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:03.030807 11193 consensus_queue.cc:237] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.031422 11176 ts_tablet_manager.cc:1403] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.038s	user 0.017s	sys 0.012s
I20260709 12:23:03.032480 11179 tablet_bootstrap.cc:654] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.034036 11176 raft_consensus.cc:359] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.034736 11176 raft_consensus.cc:385] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.035035 11177 ts_tablet_manager.cc:1434] T 1d0463b3e1c746218d71d6d8eb843dc8 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.001s
I20260709 12:23:03.036109 11177 tablet_bootstrap.cc:492] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:03.042495 11177 tablet_bootstrap.cc:654] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.035038 11176 raft_consensus.cc:740] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.046077 11176 consensus_queue.cc:260] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.048301 11176 ts_tablet_manager.cc:1434] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.002s
I20260709 12:23:03.049422 11176 tablet_bootstrap.cc:492] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:03.055270 11176 tablet_bootstrap.cc:654] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.063710 11177 tablet_bootstrap.cc:492] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:03.064383 11177 ts_tablet_manager.cc:1403] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.010s
I20260709 12:23:03.067379 11177 raft_consensus.cc:359] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.067597 10880 catalog_manager.cc:5697] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:03.069569 11177 raft_consensus.cc:385] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.069924 11177 raft_consensus.cc:740] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.070696 11177 consensus_queue.cc:260] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.071879 11179 tablet_bootstrap.cc:492] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:03.072395 11179 ts_tablet_manager.cc:1403] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.046s	user 0.032s	sys 0.011s
I20260709 12:23:03.075124 11179 raft_consensus.cc:359] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.077090 11179 raft_consensus.cc:385] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.077325 11179 raft_consensus.cc:740] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.076749 11177 ts_tablet_manager.cc:1434] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:23:03.077922 11179 consensus_queue.cc:260] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.079823 11179 ts_tablet_manager.cc:1434] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:23:03.080549 11177 tablet_bootstrap.cc:492] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:03.082937 11176 tablet_bootstrap.cc:492] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:03.083171 11208 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.083431 11176 ts_tablet_manager.cc:1403] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.012s
I20260709 12:23:03.083691 11208 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.085819 11208 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:03.086366 11177 tablet_bootstrap.cc:654] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.086189 11176 raft_consensus.cc:359] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.086946 11176 raft_consensus.cc:385] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.087234 11176 raft_consensus.cc:740] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.087522 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:03.088436 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:03.089301 11193 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:03.089998 11023 leader_election.cc:343] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:03.089807 11193 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.090698 11179 tablet_bootstrap.cc:492] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:03.092520 11193 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:03.094087 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:03.094782 10984 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 0.
I20260709 12:23:03.094904 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:03.095954 11176 consensus_queue.cc:260] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.095996 11097 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:03.096906 11132 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
I20260709 12:23:03.097421 11179 tablet_bootstrap.cc:654] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:03.097782 11098 leader_election.cc:343] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:03.099014 11025 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:03.100178 11208 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:03.100901 11235 raft_consensus.cc:2804] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:03.101285 11235 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.102180 11208 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.102619 11208 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:03.102201 11176 ts_tablet_manager.cc:1434] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:23:03.103994 11176 tablet_bootstrap.cc:492] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:03.104734 11177 tablet_bootstrap.cc:492] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:03.105208 11177 ts_tablet_manager.cc:1403] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.009s
I20260709 12:23:03.106228 11235 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:03.107955 11177 raft_consensus.cc:359] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.108657 11177 raft_consensus.cc:385] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.108946 11177 raft_consensus.cc:740] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.109753 11177 consensus_queue.cc:260] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.110656 11176 tablet_bootstrap.cc:654] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.112103 11177 ts_tablet_manager.cc:1434] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:23:03.113114 11177 tablet_bootstrap.cc:492] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:03.122823 11176 tablet_bootstrap.cc:492] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:03.123596 11176 ts_tablet_manager.cc:1403] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 12:23:03.126824 11208 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.126722 11176 raft_consensus.cc:359] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.122831 11177 tablet_bootstrap.cc:654] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.127627 11176 raft_consensus.cc:385] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.128219 11176 raft_consensus.cc:740] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.129128 11176 consensus_queue.cc:260] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.149190 11176 ts_tablet_manager.cc:1434] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.025s	user 0.016s	sys 0.007s
I20260709 12:23:03.149701 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:03.150349 11176 tablet_bootstrap.cc:492] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
W20260709 12:23:03.151247 11023 leader_election.cc:343] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:03.152281 11235 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.156601 11176 tablet_bootstrap.cc:654] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.158179 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:03.158635 11177 tablet_bootstrap.cc:492] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:03.158821 11134 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:03.159126 11177 ts_tablet_manager.cc:1403] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.046s	user 0.019s	sys 0.015s
I20260709 12:23:03.161907 11177 raft_consensus.cc:359] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.162616 11177 raft_consensus.cc:385] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.162912 11177 raft_consensus.cc:740] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.163566 11177 consensus_queue.cc:260] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.165670 11177 ts_tablet_manager.cc:1434] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:03.166760 11134 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:03.168287 11025 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:03.168702 11176 tablet_bootstrap.cc:492] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:03.169361 11176 ts_tablet_manager.cc:1403] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:23:03.171368 11177 tablet_bootstrap.cc:492] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:03.172708 11176 raft_consensus.cc:359] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.173592 11176 raft_consensus.cc:385] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.173348 11208 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:03.173960 11176 raft_consensus.cc:740] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.174959 11176 consensus_queue.cc:260] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.177011 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:03.177641 10984 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:03.177771 11176 ts_tablet_manager.cc:1434] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:23:03.179375 11176 tablet_bootstrap.cc:492] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:03.185384 11176 tablet_bootstrap.cc:654] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.186329 10984 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:03.187808 11097 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:03.188841 11193 raft_consensus.cc:2804] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:03.189419 11193 raft_consensus.cc:697] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:03.177963 11177 tablet_bootstrap.cc:654] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.190325 11193 consensus_queue.cc:237] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.197418 11251 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.198414 11176 tablet_bootstrap.cc:492] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:03.198990 11176 ts_tablet_manager.cc:1403] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.005s
I20260709 12:23:03.197964 11251 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.174302 11208 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:03.202075 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:03.202049 11176 raft_consensus.cc:359] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.203009 11176 raft_consensus.cc:385] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.203012 10983 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
I20260709 12:23:03.203536 11176 raft_consensus.cc:740] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.204535 11023 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:03.205155 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:23:03.206895 11098 leader_election.cc:343] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:03.207988 11177 tablet_bootstrap.cc:492] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:03.208612 11177 ts_tablet_manager.cc:1403] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.001s
I20260709 12:23:03.208560 11235 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:03.211735 11177 raft_consensus.cc:359] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.205098 11176 consensus_queue.cc:260] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.214641 11176 ts_tablet_manager.cc:1434] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:23:03.215636 11176 tablet_bootstrap.cc:492] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:03.217099 11255 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:03.217566 11255 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.217909 11255 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:03.218570 11177 raft_consensus.cc:385] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.218876 11177 raft_consensus.cc:740] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.219563 11177 consensus_queue.cc:260] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.221233 11179 tablet_bootstrap.cc:492] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:03.221534 11192 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.221689 11179 ts_tablet_manager.cc:1403] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.139s	user 0.038s	sys 0.065s
I20260709 12:23:03.221983 11192 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.215758 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:03.223935 11177 ts_tablet_manager.cc:1434] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:23:03.224745 11134 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
I20260709 12:23:03.224974 11192 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:03.225204 11179 raft_consensus.cc:359] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.223497 11208 raft_consensus.cc:697] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:03.225911 11179 raft_consensus.cc:385] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.226285 11179 raft_consensus.cc:740] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.226200 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:03.226861 11208 consensus_queue.cc:237] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.228835 10881 catalog_manager.cc:5697] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:03.227044 11179 consensus_queue.cc:260] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.228818 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:03.231316 11177 tablet_bootstrap.cc:492] T af28bcf443bc457bacfe081d037b6d9c P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:03.232725 11059 raft_consensus.cc:2393] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 1: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:03.233307 11179 ts_tablet_manager.cc:1434] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:23:03.234283 11179 tablet_bootstrap.cc:492] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:03.230624 11251 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:03.238667 10948 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:03.239595 11192 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:03.249210 11192 raft_consensus.cc:2749] T 1d0463b3e1c746218d71d6d8eb843dc8 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:03.250820 11176 tablet_bootstrap.cc:654] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.254778 11255 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.258659 11177 tablet_bootstrap.cc:654] T af28bcf443bc457bacfe081d037b6d9c P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.260737 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:03.261387 10984 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:03.264853 11255 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:03.265837 11179 tablet_bootstrap.cc:654] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.277896 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:03.278611 11134 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:03.279582 11192 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:03.287720 11134 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:03.287356 10984 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:03.293242 11025 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:03.297834 11177 tablet_bootstrap.cc:492] T af28bcf443bc457bacfe081d037b6d9c P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:03.298611 11177 ts_tablet_manager.cc:1403] T af28bcf443bc457bacfe081d037b6d9c P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.005s
I20260709 12:23:03.287434 10880 catalog_manager.cc:5697] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:03.299122 11255 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:03.301244 11255 raft_consensus.cc:697] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:03.314546 11255 consensus_queue.cc:237] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.306072 11176 tablet_bootstrap.cc:492] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:03.332566 11176 ts_tablet_manager.cc:1403] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.117s	user 0.017s	sys 0.001s
I20260709 12:23:03.335450 11179 tablet_bootstrap.cc:492] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:03.335530 11177 raft_consensus.cc:359] T af28bcf443bc457bacfe081d037b6d9c P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.336139 11179 ts_tablet_manager.cc:1403] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.102s	user 0.027s	sys 0.022s
I20260709 12:23:03.336359 11177 raft_consensus.cc:385] T af28bcf443bc457bacfe081d037b6d9c P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.336638 11177 raft_consensus.cc:740] T af28bcf443bc457bacfe081d037b6d9c P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.337291 11177 consensus_queue.cc:260] T af28bcf443bc457bacfe081d037b6d9c P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.340231 11179 raft_consensus.cc:359] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.340762 11179 raft_consensus.cc:385] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.340991 11179 raft_consensus.cc:740] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.341014 11177 ts_tablet_manager.cc:1434] T af28bcf443bc457bacfe081d037b6d9c P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.041s	user 0.003s	sys 0.004s
I20260709 12:23:03.341662 11179 consensus_queue.cc:260] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.343667 11179 ts_tablet_manager.cc:1434] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:03.344686 11179 tablet_bootstrap.cc:492] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:03.348277 11182 consensus_queue.cc:1048] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:03.348644 11192 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:03.349321 11177 tablet_bootstrap.cc:492] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:03.350188 11192 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.350704 11192 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.353053 11192 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:03.356124 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:03.357789 11179 tablet_bootstrap.cc:654] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:03.362489 10948 leader_election.cc:343] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:03.364575 11177 tablet_bootstrap.cc:654] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.376116 10880 catalog_manager.cc:5697] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:03.379097 11193 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.379658 11193 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.382781 11193 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:03.384135 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:03.384361 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:03.384915 11060 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 0.
I20260709 12:23:03.385069 11132 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 0.
I20260709 12:23:03.386994 11098 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:03.387966 11193 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:03.388113 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:03.388926 10984 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 0.
I20260709 12:23:03.388406 11193 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.392376 11176 raft_consensus.cc:359] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.393188 11176 raft_consensus.cc:385] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.393512 11176 raft_consensus.cc:740] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.392964 10949 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:03.396780 11176 consensus_queue.cc:260] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.402268 11176 ts_tablet_manager.cc:1434] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.001s
I20260709 12:23:03.394995 11193 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:03.407503 11182 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:03.408394 11182 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.409201 11182 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:03.409793 11235 consensus_queue.cc:1048] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:03.438714 11218 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.440922 11218 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.492390 11255 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.503984 11255 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.521209 11182 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.533968 11176 tablet_bootstrap.cc:492] T 6875ad729dd0416d88035fd642f6b3bd P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:03.541951 11179 tablet_bootstrap.cc:492] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:03.542515 11179 ts_tablet_manager.cc:1403] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.198s	user 0.017s	sys 0.011s
I20260709 12:23:03.544930 11176 tablet_bootstrap.cc:654] T 6875ad729dd0416d88035fd642f6b3bd P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.545475 11179 raft_consensus.cc:359] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.546198 11179 raft_consensus.cc:385] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.546489 11179 raft_consensus.cc:740] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.547281 11179 consensus_queue.cc:260] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.549703 11179 ts_tablet_manager.cc:1434] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:03.550869 11179 tablet_bootstrap.cc:492] T 634832ddce4348f1bb6c7bbf1b9045f0 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:03.558413 11255 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:03.537823 11271 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:03.501855 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 64079.6us
I20260709 12:23:03.565521 11255 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.565899 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:03.566179 11255 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.570010 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:03.570930 11133 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
W20260709 12:23:03.571619 10948 leader_election.cc:343] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:03.537972 11182 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:03.538491 11218 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:03.580049 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:03.581020 10984 raft_consensus.cc:2393] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 1: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:03.569984 11255 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:03.599498 11177 tablet_bootstrap.cc:492] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:03.600121 11177 ts_tablet_manager.cc:1403] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.255s	user 0.038s	sys 0.038s
I20260709 12:23:03.572345 11025 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:03.582834 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:03.602974 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:03.603695 11059 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 0.
I20260709 12:23:03.577654 11271 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.606963 11098 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:03.607544 11218 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.621142 11179 tablet_bootstrap.cc:654] T 634832ddce4348f1bb6c7bbf1b9045f0 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.618692 11255 raft_consensus.cc:2804] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:03.623041 11255 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.624441 11255 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:03.621937 11235 raft_consensus.cc:2804] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:03.627143 11235 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.627503 11235 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:03.615109 11218 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.633065 11218 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:03.633616 11218 consensus_queue.cc:1048] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:03.629463 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:03.638424 11271 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:03.639109 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:03.644230 10984 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 0.
I20260709 12:23:03.645663 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:03.647259 11235 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.650637 11280 consensus_queue.cc:1048] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:23:03.641398 11255 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.637477 11025 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:03.657310 11177 raft_consensus.cc:359] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.658090 11177 raft_consensus.cc:385] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.658499 11177 raft_consensus.cc:740] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.659237 11177 consensus_queue.cc:260] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.661840 11208 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:03.667992 11177 ts_tablet_manager.cc:1434] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.001s
I20260709 12:23:03.675598 11176 tablet_bootstrap.cc:492] T 6875ad729dd0416d88035fd642f6b3bd P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:03.676059 11176 ts_tablet_manager.cc:1403] T 6875ad729dd0416d88035fd642f6b3bd P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.142s	user 0.020s	sys 0.039s
I20260709 12:23:03.673856 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:03.651732 11193 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.681897 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:03.682619 10983 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 0.
I20260709 12:23:03.678728 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:03.685091 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:03.685565 11133 raft_consensus.cc:2393] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 1: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:03.685658 10983 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:03.685897 11193 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:03.679181 11132 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:03.676968 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 46936us
I20260709 12:23:03.691380 11097 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:03.691622 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:03.690482 11218 consensus_queue.cc:1048] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:03.692627 11193 raft_consensus.cc:2804] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:03.692207 10984 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:03.693017 11193 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.693373 11193 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:03.695236 11235 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:03.697817 11059 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:03.686595 11176 raft_consensus.cc:359] T 6875ad729dd0416d88035fd642f6b3bd P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.698541 11176 raft_consensus.cc:385] T 6875ad729dd0416d88035fd642f6b3bd P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.698846 11176 raft_consensus.cc:740] T 6875ad729dd0416d88035fd642f6b3bd P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.700995 11176 consensus_queue.cc:260] T 6875ad729dd0416d88035fd642f6b3bd P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.701364 11177 tablet_bootstrap.cc:492] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:03.703505 11179 tablet_bootstrap.cc:492] T 634832ddce4348f1bb6c7bbf1b9045f0 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
W20260709 12:23:03.703797 11098 leader_election.cc:343] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:03.703944 11179 ts_tablet_manager.cc:1403] T 634832ddce4348f1bb6c7bbf1b9045f0 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.153s	user 0.011s	sys 0.011s
I20260709 12:23:03.699409 11251 consensus_queue.cc:1048] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:03.705578 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:03.706426 11058 raft_consensus.cc:2393] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 1: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:03.702138 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:03.710448 11176 ts_tablet_manager.cc:1434] T 6875ad729dd0416d88035fd642f6b3bd P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 12:23:03.712461 11255 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:03.727303 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:03.741057 10948 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:03.747399 11208 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:03.747684 11133 raft_consensus.cc:2393] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 1: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:03.746801 11179 raft_consensus.cc:359] T 634832ddce4348f1bb6c7bbf1b9045f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.749171 11179 raft_consensus.cc:385] T 634832ddce4348f1bb6c7bbf1b9045f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.749452 11179 raft_consensus.cc:740] T 634832ddce4348f1bb6c7bbf1b9045f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.750137 11176 tablet_bootstrap.cc:492] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:03.753141 11179 consensus_queue.cc:260] T 634832ddce4348f1bb6c7bbf1b9045f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.731379 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:03.739307 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:03.736593 10984 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:03.755492 11271 consensus_queue.cc:1048] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:03.764503 11177 tablet_bootstrap.cc:654] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.767571 11058 raft_consensus.cc:2393] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 1: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:03.769855 11057 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:03.772028 10930 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:03.773700 11097 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:03.772586 11132 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:03.775890 11282 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:03.776499 11282 raft_consensus.cc:697] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:03.777514 11282 consensus_queue.cc:237] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.755822 11193 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.775034 11098 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:03.811812 11179 ts_tablet_manager.cc:1434] T 634832ddce4348f1bb6c7bbf1b9045f0 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.106s	user 0.005s	sys 0.002s
I20260709 12:23:03.809914 11283 raft_consensus.cc:2749] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:03.816694 11235 consensus_queue.cc:1048] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:03.808871 11251 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.817438 11251 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.819463 11251 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:03.820262 10949 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:03.821060 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:03.822021 10982 raft_consensus.cc:2393] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 1: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:03.824545 11271 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:03.825062 11271 raft_consensus.cc:697] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:03.825968 11271 consensus_queue.cc:237] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.826879 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:03.827728 11132 raft_consensus.cc:2393] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 1: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:03.833871 11193 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:03.834893 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:03.835570 10982 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:03.829074 11025 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:03.840916 11255 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:03.845841 11023 consensus_peers.cc:597] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:03.847934 10983 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:03.848906 11279 raft_consensus.cc:2749] T af28bcf443bc457bacfe081d037b6d9c P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:03.855188 11255 raft_consensus.cc:2749] T 634832ddce4348f1bb6c7bbf1b9045f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:03.860054 11023 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:03.864034 10982 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:03.858439 11057 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:03.865360 11255 raft_consensus.cc:2804] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:03.866904 11255 raft_consensus.cc:697] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:03.867777 11255 consensus_queue.cc:237] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.874565 11177 tablet_bootstrap.cc:492] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:03.875051 11177 ts_tablet_manager.cc:1403] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.174s	user 0.026s	sys 0.028s
I20260709 12:23:03.878571 11097 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:03.879177 11251 consensus_queue.cc:1048] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:03.883674 11179 tablet_bootstrap.cc:492] T d10de3c352ba4d7c805da1ea559bfcb5 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:03.890544 11218 raft_consensus.cc:2804] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:03.891095 11218 raft_consensus.cc:697] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:03.891258 11177 raft_consensus.cc:359] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.892488 11176 tablet_bootstrap.cc:654] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.892002 11218 consensus_queue.cc:237] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.892015 11177 raft_consensus.cc:385] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.893286 11177 raft_consensus.cc:740] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.872417 11282 consensus_queue.cc:1048] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:23:03.905303 11177 consensus_queue.cc:260] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.875595 10881 catalog_manager.cc:5697] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:03.913726 10880 catalog_manager.cc:5697] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 0 to 1, leader changed from <none> to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:03.906801 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:03.926061 11179 tablet_bootstrap.cc:654] T d10de3c352ba4d7c805da1ea559bfcb5 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.928001 11177 ts_tablet_manager.cc:1434] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.001s
I20260709 12:23:03.929134 11177 tablet_bootstrap.cc:492] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:03.925729 11208 consensus_queue.cc:1048] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
W20260709 12:23:03.935048 11098 leader_election.cc:343] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:03.942289 10882 catalog_manager.cc:5697] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:03.969925 11282 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.970494 11282 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:03.973290 11282 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:03.975099 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:03.979388 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:03.983471 11177 tablet_bootstrap.cc:654] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:03.986145 11097 leader_election.cc:343] T 6875ad729dd0416d88035fd642f6b3bd P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:03.987547 11098 leader_election.cc:343] T 6875ad729dd0416d88035fd642f6b3bd P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:03.988052 11098 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:03.989774 11235 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:04.015100 11177 tablet_bootstrap.cc:492] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:04.015847 11176 tablet_bootstrap.cc:492] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:04.015864 11177 ts_tablet_manager.cc:1403] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.087s	user 0.013s	sys 0.005s
I20260709 12:23:04.016456 11176 ts_tablet_manager.cc:1403] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.267s	user 0.017s	sys 0.025s
I20260709 12:23:04.017076 10879 catalog_manager.cc:5697] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:04.019517 11176 raft_consensus.cc:359] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.020190 11176 raft_consensus.cc:385] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.020468 11176 raft_consensus.cc:740] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.021121 11176 consensus_queue.cc:260] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.021687 11177 raft_consensus.cc:359] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.022396 11177 raft_consensus.cc:385] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.022680 11177 raft_consensus.cc:740] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.023801 11176 ts_tablet_manager.cc:1434] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:23:04.023440 11177 consensus_queue.cc:260] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.024843 11176 tablet_bootstrap.cc:492] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:04.021114 11179 tablet_bootstrap.cc:492] T d10de3c352ba4d7c805da1ea559bfcb5 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:04.025457 11179 ts_tablet_manager.cc:1403] T d10de3c352ba4d7c805da1ea559bfcb5 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.142s	user 0.020s	sys 0.006s
I20260709 12:23:04.028350 11179 raft_consensus.cc:359] T d10de3c352ba4d7c805da1ea559bfcb5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.029021 11179 raft_consensus.cc:385] T d10de3c352ba4d7c805da1ea559bfcb5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.029348 11179 raft_consensus.cc:740] T d10de3c352ba4d7c805da1ea559bfcb5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.030503 11179 consensus_queue.cc:260] T d10de3c352ba4d7c805da1ea559bfcb5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.032545 11179 ts_tablet_manager.cc:1434] T d10de3c352ba4d7c805da1ea559bfcb5 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:23:04.033527 11179 tablet_bootstrap.cc:492] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:04.028960 11177 ts_tablet_manager.cc:1434] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:23:04.038630 11177 tablet_bootstrap.cc:492] T 2721401e0fa944aea90572c7ec29c134 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:04.039455 11179 tablet_bootstrap.cc:654] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.041036 11176 tablet_bootstrap.cc:654] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.044726 11177 tablet_bootstrap.cc:654] T 2721401e0fa944aea90572c7ec29c134 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.053272 11179 tablet_bootstrap.cc:492] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:04.053920 11179 ts_tablet_manager.cc:1403] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 12:23:04.059588 11179 raft_consensus.cc:359] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.060465 11179 raft_consensus.cc:385] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.060817 11179 raft_consensus.cc:740] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.060214 11176 tablet_bootstrap.cc:492] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:04.061525 11179 consensus_queue.cc:260] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.062196 11176 ts_tablet_manager.cc:1403] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.008s
I20260709 12:23:04.063375 11177 tablet_bootstrap.cc:492] T 2721401e0fa944aea90572c7ec29c134 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:04.063833 11179 ts_tablet_manager.cc:1434] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:23:04.063900 11177 ts_tablet_manager.cc:1403] T 2721401e0fa944aea90572c7ec29c134 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.016s
I20260709 12:23:04.064994 11179 tablet_bootstrap.cc:492] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:04.064935 11176 raft_consensus.cc:359] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.065721 11176 raft_consensus.cc:385] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.065999 11176 raft_consensus.cc:740] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.066847 11176 consensus_queue.cc:260] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.066962 11177 raft_consensus.cc:359] T 2721401e0fa944aea90572c7ec29c134 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.067737 11177 raft_consensus.cc:385] T 2721401e0fa944aea90572c7ec29c134 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.068100 11177 raft_consensus.cc:740] T 2721401e0fa944aea90572c7ec29c134 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.068920 11177 consensus_queue.cc:260] T 2721401e0fa944aea90572c7ec29c134 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.069375 11176 ts_tablet_manager.cc:1434] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:23:04.072081 11179 tablet_bootstrap.cc:654] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.079186 11176 tablet_bootstrap.cc:492] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:04.080085 11177 ts_tablet_manager.cc:1434] T 2721401e0fa944aea90572c7ec29c134 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:23:04.081079 11177 tablet_bootstrap.cc:492] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:04.079209 11179 tablet_bootstrap.cc:492] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:04.083827 11179 ts_tablet_manager.cc:1403] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.008s
I20260709 12:23:04.086014 11176 tablet_bootstrap.cc:654] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.086948 11177 tablet_bootstrap.cc:654] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.086882 11179 raft_consensus.cc:359] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.087945 11179 raft_consensus.cc:385] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.088243 11179 raft_consensus.cc:740] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.088963 11179 consensus_queue.cc:260] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.091259 11179 ts_tablet_manager.cc:1434] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:04.092945 11179 tablet_bootstrap.cc:492] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:04.099562 11179 tablet_bootstrap.cc:654] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.105211 11176 tablet_bootstrap.cc:492] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:04.105705 11176 ts_tablet_manager.cc:1403] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.027s	user 0.005s	sys 0.020s
I20260709 12:23:04.106238 11177 tablet_bootstrap.cc:492] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:04.106612 11179 tablet_bootstrap.cc:492] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:04.106760 11177 ts_tablet_manager.cc:1403] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.011s
I20260709 12:23:04.107148 11179 ts_tablet_manager.cc:1403] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:23:04.108376 11176 raft_consensus.cc:359] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.109066 11176 raft_consensus.cc:385] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.109350 11176 raft_consensus.cc:740] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.109645 11177 raft_consensus.cc:359] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.109890 11179 raft_consensus.cc:359] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.110467 11177 raft_consensus.cc:385] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.110149 11176 consensus_queue.cc:260] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.110690 11179 raft_consensus.cc:385] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.110930 11177 raft_consensus.cc:740] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.111153 11179 raft_consensus.cc:740] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.111737 11177 consensus_queue.cc:260] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.111994 11179 consensus_queue.cc:260] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.112681 11176 ts_tablet_manager.cc:1434] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:04.114617 11179 ts_tablet_manager.cc:1434] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:04.115604 11179 tablet_bootstrap.cc:492] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:04.115895 11176 tablet_bootstrap.cc:492] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:04.117015 11177 ts_tablet_manager.cc:1434] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:23:04.118000 11177 tablet_bootstrap.cc:492] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:04.121502 11179 tablet_bootstrap.cc:654] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.121762 11176 tablet_bootstrap.cc:654] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.127405 11177 tablet_bootstrap.cc:654] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.133426 11176 tablet_bootstrap.cc:492] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:04.133913 11176 ts_tablet_manager.cc:1403] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.005s
I20260709 12:23:04.136515 11176 raft_consensus.cc:359] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.137172 11176 raft_consensus.cc:385] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.137449 11176 raft_consensus.cc:740] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.139747 11176 consensus_queue.cc:260] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.141208 11179 tablet_bootstrap.cc:492] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:04.141687 11179 ts_tablet_manager.cc:1403] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.011s
I20260709 12:23:04.141841 11176 ts_tablet_manager.cc:1434] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.004s
I20260709 12:23:04.144881 11176 tablet_bootstrap.cc:492] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:04.144625 11179 raft_consensus.cc:359] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.145365 11179 raft_consensus.cc:385] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.145648 11179 raft_consensus.cc:740] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.145782 11177 tablet_bootstrap.cc:492] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:04.146296 11177 ts_tablet_manager.cc:1403] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.011s
I20260709 12:23:04.146442 11179 consensus_queue.cc:260] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.148751 11179 ts_tablet_manager.cc:1434] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:23:04.148885 11177 raft_consensus.cc:359] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.149576 11177 raft_consensus.cc:385] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.149744 11179 tablet_bootstrap.cc:492] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:04.149891 11177 raft_consensus.cc:740] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.150652 11177 consensus_queue.cc:260] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.152562 11176 tablet_bootstrap.cc:654] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.152730 11177 ts_tablet_manager.cc:1434] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:04.156466 11179 tablet_bootstrap.cc:654] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.159268 11208 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.159801 11208 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.162011 11208 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:04.163790 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:04.164597 10980 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
I20260709 12:23:04.165055 11177 tablet_bootstrap.cc:492] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:04.166491 11023 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:04.167512 11208 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:04.167933 11208 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.168287 11208 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.172101 11177 tablet_bootstrap.cc:654] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.175918 11208 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.178889 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:04.179536 10980 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.187228 10980 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:04.168372 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:04.188024 11134 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
I20260709 12:23:04.190060 11023 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:04.192757 11177 tablet_bootstrap.cc:492] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:04.192862 11296 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:04.193261 11208 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:04.193372 11177 ts_tablet_manager.cc:1403] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.003s
I20260709 12:23:04.193498 11296 raft_consensus.cc:697] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:04.194744 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:04.194602 11296 consensus_queue.cc:237] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.195372 11134 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.196273 11177 raft_consensus.cc:359] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.196933 11177 raft_consensus.cc:385] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.197190 11177 raft_consensus.cc:740] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.197860 11177 consensus_queue.cc:260] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.202199 11177 ts_tablet_manager.cc:1434] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:23:04.203191 11177 tablet_bootstrap.cc:492] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:04.203368 11179 tablet_bootstrap.cc:492] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:04.203948 11179 ts_tablet_manager.cc:1403] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.007s
I20260709 12:23:04.206427 11176 tablet_bootstrap.cc:492] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:04.206848 11176 ts_tablet_manager.cc:1403] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.062s	user 0.028s	sys 0.003s
I20260709 12:23:04.208295 11179 raft_consensus.cc:359] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.209088 11179 raft_consensus.cc:385] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.209364 11179 raft_consensus.cc:740] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.210583 11179 consensus_queue.cc:260] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.212462 11296 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.213258 11179 ts_tablet_manager.cc:1434] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:23:04.213712 11177 tablet_bootstrap.cc:654] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.214429 11179 tablet_bootstrap.cc:492] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:04.213056 11296 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.217057 11176 raft_consensus.cc:359] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.217826 11176 raft_consensus.cc:385] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.218247 11176 raft_consensus.cc:740] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.218509 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:04.218895 11176 consensus_queue.cc:260] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.219250 10980 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
I20260709 12:23:04.220633 11023 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:04.214872 10881 catalog_manager.cc:5697] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:04.220901 11176 ts_tablet_manager.cc:1434] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.002s
I20260709 12:23:04.221457 11208 raft_consensus.cc:2804] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:04.223253 11208 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.223671 11208 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.224213 11176 tablet_bootstrap.cc:492] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:04.220983 11134 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:04.230856 11176 tablet_bootstrap.cc:654] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.232048 11296 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:04.233201 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:04.233901 11134 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
I20260709 12:23:04.235289 11221 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.233345 11208 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.235860 11221 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.238991 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:04.239599 10980 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.242975 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:04.243696 11059 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 0.
I20260709 12:23:04.245020 11221 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:04.245180 10948 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:04.249547 11271 raft_consensus.cc:2804] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:04.249428 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:04.250016 11271 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.250288 11132 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 0.
I20260709 12:23:04.250816 11271 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.254472 11179 tablet_bootstrap.cc:654] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.254791 11279 consensus_queue.cc:1048] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:04.257812 11279 consensus_queue.cc:1048] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:04.262279 11279 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.262832 11279 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.263593 11235 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.264186 11235 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.265192 11279 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:04.266486 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:04.267004 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:04.268610 11235 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:04.269857 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:04.270665 11057 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 0.
I20260709 12:23:04.271591 10949 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:04.271950 11098 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:04.272773 10980 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:04.272863 11235 raft_consensus.cc:2804] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:04.273061 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:04.273370 11235 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.273808 10983 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 0.
I20260709 12:23:04.273881 11235 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.273378 11221 raft_consensus.cc:2749] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:04.274443 11271 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.277707 11179 tablet_bootstrap.cc:492] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:04.278359 11023 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:04.289163 11179 ts_tablet_manager.cc:1403] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.012s
I20260709 12:23:04.280588 11282 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.290323 11282 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.292454 11282 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:04.292177 11179 raft_consensus.cc:359] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.292977 11179 raft_consensus.cc:385] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.293303 11179 raft_consensus.cc:740] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.282889 11251 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.293751 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:04.294063 11179 consensus_queue.cc:260] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.295204 11255 raft_consensus.cc:2804] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:04.295477 11251 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.297353 11057 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.297698 11251 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:04.300139 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:04.302366 11179 ts_tablet_manager.cc:1434] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.004s
I20260709 12:23:04.309386 11179 tablet_bootstrap.cc:492] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:04.304893 11208 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:04.305126 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:04.314316 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:04.314723 10983 raft_consensus.cc:2393] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 1: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:04.314963 11059 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:04.305935 11098 leader_election.cc:343] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:04.307651 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:04.308000 11177 tablet_bootstrap.cc:492] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:04.316462 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:04.316906 11177 ts_tablet_manager.cc:1403] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.114s	user 0.013s	sys 0.030s
I20260709 12:23:04.317087 11133 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.307695 11251 consensus_queue.cc:1048] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:04.316143 11023 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:04.316772 11134 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.304327 11271 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:04.322799 11235 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.324357 11177 raft_consensus.cc:359] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.325937 11177 raft_consensus.cc:385] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.326246 11177 raft_consensus.cc:740] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.326979 11177 consensus_queue.cc:260] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.327072 11218 consensus_queue.cc:1048] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:23:04.327402 11251 raft_consensus.cc:2749] T d10de3c352ba4d7c805da1ea559bfcb5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:04.332986 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:04.333722 10982 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.337756 11133 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:04.329654 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:04.352486 11282 consensus_queue.cc:1048] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:23:04.356034 11235 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:04.358170 10982 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:04.359457 11097 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:04.366084 11282 raft_consensus.cc:2804] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:04.370622 10949 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:23:04.396426 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 86047.7us
I20260709 12:23:04.369518 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:04.397434 11255 raft_consensus.cc:697] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:04.402299 11282 raft_consensus.cc:697] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:04.427513 11177 ts_tablet_manager.cc:1434] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.110s	user 0.021s	sys 0.010s
I20260709 12:23:04.418943 11056 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.431094 11177 tablet_bootstrap.cc:492] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:04.421188 11325 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.436172 11328 raft_consensus.cc:2804] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:04.436721 11328 raft_consensus.cc:697] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:04.432932 10980 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.462459 11059 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:04.443257 11328 consensus_queue.cc:237] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.439772 11325 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:04.459518 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 90516.4us
I20260709 12:23:04.507530 11176 tablet_bootstrap.cc:492] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:04.508147 11176 ts_tablet_manager.cc:1403] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.284s	user 0.074s	sys 0.075s
W20260709 12:23:04.512032 11097 leader_election.cc:343] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:04.512543 11097 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:04.513392 11176 raft_consensus.cc:359] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.514611 11176 raft_consensus.cc:385] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.515048 11176 raft_consensus.cc:740] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.445962 11255 consensus_queue.cc:237] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.498070 11282 consensus_queue.cc:237] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.510876 11251 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.542986 11176 consensus_queue.cc:260] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.540928 11235 raft_consensus.cc:2749] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:04.550817 11208 consensus_queue.cc:1048] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:04.563126 11179 tablet_bootstrap.cc:654] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:04.564771 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 49082.8us
I20260709 12:23:04.568005 11176 ts_tablet_manager.cc:1434] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.001s
I20260709 12:23:04.568813 11176 tablet_bootstrap.cc:492] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:04.545372 11251 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:04.566992 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 55001.8us
I20260709 12:23:04.591564 11177 tablet_bootstrap.cc:654] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.599362 11251 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:04.600618 11325 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:04.601179 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:04.602358 11056 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:04.604018 11235 consensus_queue.cc:1048] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:23:04.604924 11023 leader_election.cc:343] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:04.610031 11336 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.620244 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:04.602370 11218 consensus_queue.cc:1048] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
W20260709 12:23:04.629106 10949 leader_election.cc:343] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:04.610759 11336 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.632124 10882 catalog_manager.cc:5697] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:04.654846 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:23:04.657378 11025 leader_election.cc:343] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:04.661463 11134 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:04.658123 11025 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:04.664656 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:04.665467 11056 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 0.
I20260709 12:23:04.666559 11251 raft_consensus.cc:2749] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:04.669610 11336 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:04.677747 11176 tablet_bootstrap.cc:654] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:04.672528 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 50305.9us
I20260709 12:23:04.684800 10880 catalog_manager.cc:5697] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 0 to 1, leader changed from <none> to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:04.686396 10948 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:04.685834 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:04.690500 11327 raft_consensus.cc:2804] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:04.691613 11327 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.692010 11255 consensus_queue.cc:1048] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:04.692061 11327 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.695874 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:04.699079 11179 tablet_bootstrap.cc:492] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:04.699605 11179 ts_tablet_manager.cc:1403] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.390s	user 0.020s	sys 0.020s
I20260709 12:23:04.701617 10882 catalog_manager.cc:5697] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:04.700623 11097 leader_election.cc:343] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:04.715590 11177 tablet_bootstrap.cc:492] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:04.716054 11177 ts_tablet_manager.cc:1403] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.287s	user 0.037s	sys 0.039s
I20260709 12:23:04.716866 11255 consensus_queue.cc:1048] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:23:04.710692 11098 leader_election.cc:343] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:04.718766 11177 raft_consensus.cc:359] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.719512 11177 raft_consensus.cc:385] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.719774 11177 raft_consensus.cc:740] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.721385 11098 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:04.720443 11177 consensus_queue.cc:260] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.726471 11335 raft_consensus.cc:2749] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:04.730779 11179 raft_consensus.cc:359] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.736073 11179 raft_consensus.cc:385] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.736438 11179 raft_consensus.cc:740] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.738998 11177 ts_tablet_manager.cc:1434] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.003s
I20260709 12:23:04.740301 11177 tablet_bootstrap.cc:492] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:04.748898 11179 consensus_queue.cc:260] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.761556 11179 ts_tablet_manager.cc:1434] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.062s	user 0.004s	sys 0.003s
I20260709 12:23:04.762416 11176 tablet_bootstrap.cc:492] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:04.762703 11179 tablet_bootstrap.cc:492] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:04.762913 11176 ts_tablet_manager.cc:1403] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.194s	user 0.022s	sys 0.015s
I20260709 12:23:04.767091 11327 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.780994 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:04.781634 11056 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.790746 11327 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:04.791978 11177 tablet_bootstrap.cc:654] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.792644 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:23:04.794054 10949 leader_election.cc:343] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:04.789943 11056 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:04.799161 10948 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:04.800275 11326 raft_consensus.cc:2804] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:04.800855 11326 raft_consensus.cc:697] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:04.801800 11326 consensus_queue.cc:237] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.820832 11176 raft_consensus.cc:359] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.823510 11176 raft_consensus.cc:385] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.823798 11176 raft_consensus.cc:740] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.822680 11179 tablet_bootstrap.cc:654] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.819936 11327 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.825189 11176 consensus_queue.cc:260] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.825418 11327 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:04.827495 10930 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:04.828889 11327 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:04.830134 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:04.830780 11056 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 0.
I20260709 12:23:04.831650 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:04.832283 11133 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 0.
I20260709 12:23:04.831964 10948 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:04.833446 11327 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:04.833806 11327 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.834218 11327 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.831967 11176 ts_tablet_manager.cc:1434] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.000s
I20260709 12:23:04.835559 11176 tablet_bootstrap.cc:492] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:04.835923 10881 catalog_manager.cc:5697] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 0 to 1, leader changed from <none> to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:04.839754 11177 tablet_bootstrap.cc:492] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:04.840701 11177 ts_tablet_manager.cc:1403] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.101s	user 0.017s	sys 0.013s
I20260709 12:23:04.841260 11176 tablet_bootstrap.cc:654] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.843364 11177 raft_consensus.cc:359] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.844092 11177 raft_consensus.cc:385] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.844368 11177 raft_consensus.cc:740] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.845077 11177 consensus_queue.cc:260] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.847281 11177 ts_tablet_manager.cc:1434] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:23:04.848294 11177 tablet_bootstrap.cc:492] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:04.850415 11179 tablet_bootstrap.cc:492] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:04.850930 11179 ts_tablet_manager.cc:1403] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.088s	user 0.007s	sys 0.008s
I20260709 12:23:04.853610 11179 raft_consensus.cc:359] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.854077 11177 tablet_bootstrap.cc:654] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.854367 11179 raft_consensus.cc:385] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.854641 11179 raft_consensus.cc:740] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.857339 11176 tablet_bootstrap.cc:492] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:04.857906 11176 ts_tablet_manager.cc:1403] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.023s	user 0.004s	sys 0.004s
I20260709 12:23:04.850009 11327 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.860440 11327 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:04.861068 11176 raft_consensus.cc:359] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.861608 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:04.861900 11176 raft_consensus.cc:385] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.862212 11056 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.862253 11176 raft_consensus.cc:740] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.862510 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:04.863108 11133 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.862986 11179 consensus_queue.cc:260] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.865832 11177 tablet_bootstrap.cc:492] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:04.866091 11179 ts_tablet_manager.cc:1434] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:23:04.866348 11177 ts_tablet_manager.cc:1403] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 12:23:04.867098 11179 tablet_bootstrap.cc:492] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:04.868976 11177 raft_consensus.cc:359] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.869673 11177 raft_consensus.cc:385] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.869958 11177 raft_consensus.cc:740] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.870918 11177 consensus_queue.cc:260] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.873049 11177 ts_tablet_manager.cc:1434] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:04.873231 11179 tablet_bootstrap.cc:654] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.873365 11133 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:04.873983 11177 tablet_bootstrap.cc:492] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:04.874641 11176 consensus_queue.cc:260] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.876806 11176 ts_tablet_manager.cc:1434] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:23:04.880035 11176 tablet_bootstrap.cc:492] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:04.881283 11177 tablet_bootstrap.cc:654] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.883795 10949 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:04.884654 11327 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:04.885113 11327 raft_consensus.cc:697] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:04.886297 11176 tablet_bootstrap.cc:654] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.885905 11327 consensus_queue.cc:237] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.888948 11056 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:04.893410 11179 tablet_bootstrap.cc:492] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:04.893980 11179 ts_tablet_manager.cc:1403] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.002s
I20260709 12:23:04.898039 11179 raft_consensus.cc:359] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.898911 11179 raft_consensus.cc:385] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.899204 11179 raft_consensus.cc:740] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.900015 11179 consensus_queue.cc:260] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.904060 11176 tablet_bootstrap.cc:492] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:04.904534 11176 ts_tablet_manager.cc:1403] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.001s
I20260709 12:23:04.906407 11177 tablet_bootstrap.cc:492] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:04.906867 11177 ts_tablet_manager.cc:1403] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.033s	user 0.027s	sys 0.004s
I20260709 12:23:04.907238 11176 raft_consensus.cc:359] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.906983 10880 catalog_manager.cc:5697] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 0 to 1, leader changed from <none> to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:04.907902 11176 raft_consensus.cc:385] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.908236 11176 raft_consensus.cc:740] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.909111 11177 raft_consensus.cc:359] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.909040 11176 consensus_queue.cc:260] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.909649 11177 raft_consensus.cc:385] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.909968 11177 raft_consensus.cc:740] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.911070 11179 ts_tablet_manager.cc:1434] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.003s
I20260709 12:23:04.910785 11177 consensus_queue.cc:260] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.912887 11176 ts_tablet_manager.cc:1434] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:23:04.913018 11177 ts_tablet_manager.cc:1434] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 12:23:04.914016 11177 tablet_bootstrap.cc:492] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:04.914180 11176 tablet_bootstrap.cc:492] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:04.919700 11176 tablet_bootstrap.cc:654] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.920042 11177 tablet_bootstrap.cc:654] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.922420 11324 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.922952 11324 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.932623 11179 tablet_bootstrap.cc:492] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:04.936349 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:04.936918 11255 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:04.939186 11023 leader_election.cc:343] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:04.937516 11255 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.943709 11324 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:04.947198 11179 tablet_bootstrap.cc:654] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.951363 11343 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.956755 11177 tablet_bootstrap.cc:492] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:04.957268 11177 ts_tablet_manager.cc:1403] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.015s
I20260709 12:23:04.951933 11343 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.957943 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:04.957571 11176 tablet_bootstrap.cc:492] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:04.958642 11134 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
I20260709 12:23:04.959249 11176 ts_tablet_manager.cc:1403] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.007s
I20260709 12:23:04.959769 11343 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:04.960126 11255 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:04.961133 11025 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:04.961381 11177 raft_consensus.cc:359] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.961941 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:04.962227 11177 raft_consensus.cc:385] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.961468 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:04.962643 11177 raft_consensus.cc:740] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.963150 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:23:04.963615 11098 leader_election.cc:343] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:04.963361 11177 consensus_queue.cc:260] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.963764 10981 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
I20260709 12:23:04.965051 11023 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:04.965512 11177 ts_tablet_manager.cc:1434] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
W20260709 12:23:04.966389 11097 leader_election.cc:343] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:04.966706 11177 tablet_bootstrap.cc:492] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:04.967628 11324 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:04.968012 11324 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.968367 11324 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.969385 11208 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:04.969820 11208 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.970193 11208 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.973618 11177 tablet_bootstrap.cc:654] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.974925 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:04.977555 11179 tablet_bootstrap.cc:492] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:04.978066 11179 ts_tablet_manager.cc:1403] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.002s
I20260709 12:23:04.980301 11251 consensus_queue.cc:1048] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:04.980978 11179 raft_consensus.cc:359] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.981647 11179 raft_consensus.cc:385] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.981943 11179 raft_consensus.cc:740] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.982676 11179 consensus_queue.cc:260] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.985225 11179 ts_tablet_manager.cc:1434] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:23:04.966856 11097 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:04.988361 11208 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.989120 11324 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:04.990114 11179 tablet_bootstrap.cc:492] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:04.990078 11343 raft_consensus.cc:2749] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:04.994822 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:04.994971 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:04.995523 10983 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.995602 10980 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.996477 11179 tablet_bootstrap.cc:654] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.998718 11327 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.000268 11327 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.003006 10980 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:05.004451 11023 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:05.005345 11327 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:05.005846 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:05.006688 11056 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 0.
I20260709 12:23:05.007315 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:05.007666 11255 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:05.007993 11130 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 0.
I20260709 12:23:05.008505 11255 raft_consensus.cc:697] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:05.009191 10949 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:05.009493 11255 consensus_queue.cc:237] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.015075 11328 raft_consensus.cc:2804] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:05.015601 11328 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.016077 11328 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.019138 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:05.019791 11130 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.004565 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:05.015561 11208 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:05.024250 11328 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.031862 11130 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:05.032191 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:05.032904 11056 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.033110 11025 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:05.034238 11208 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:05.034751 11208 raft_consensus.cc:697] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:05.035580 11208 consensus_queue.cc:237] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.039444 11335 consensus_queue.cc:1048] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:05.043339 10983 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:05.044123 11251 consensus_queue.cc:1048] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:05.045284 11324 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:23:05.045837 11025 leader_election.cc:343] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.047431 11176 raft_consensus.cc:359] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.048207 11176 raft_consensus.cc:385] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.048512 11176 raft_consensus.cc:740] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.053478 11336 consensus_queue.cc:1048] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:05.058203 11176 consensus_queue.cc:260] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.060456 11176 ts_tablet_manager.cc:1434] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.101s	user 0.005s	sys 0.001s
I20260709 12:23:05.061478 11176 tablet_bootstrap.cc:492] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:05.065249 11133 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.076077 11179 tablet_bootstrap.cc:492] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:05.076608 11179 ts_tablet_manager.cc:1403] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.087s	user 0.018s	sys 0.025s
I20260709 12:23:05.079381 11179 raft_consensus.cc:359] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.081099 11179 raft_consensus.cc:385] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.081416 11179 raft_consensus.cc:740] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.082221 11179 consensus_queue.cc:260] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.084595 11179 ts_tablet_manager.cc:1434] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:05.085592 11179 tablet_bootstrap.cc:492] T 6dff0ae92c5347b59bfed7b76061d189 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:05.092558 11333 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.092949 11177 tablet_bootstrap.cc:492] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:05.092604 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:05.093689 11177 ts_tablet_manager.cc:1403] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.127s	user 0.028s	sys 0.026s
I20260709 12:23:05.093194 11333 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.095261 11328 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:05.085529 11133 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:05.096207 11333 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:05.096743 11177 raft_consensus.cc:359] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.097412 11177 raft_consensus.cc:385] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.097683 11177 raft_consensus.cc:740] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.097900 11056 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:05.098073 11134 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.098579 11177 consensus_queue.cc:260] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.099143 10948 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:05.100841 11177 ts_tablet_manager.cc:1434] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:05.100976 11325 raft_consensus.cc:2804] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:05.101449 11325 raft_consensus.cc:697] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:05.102006 11177 tablet_bootstrap.cc:492] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:05.102535 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:05.105409 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:05.106283 11060 raft_consensus.cc:2393] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 1: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:05.105178 11325 consensus_queue.cc:237] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.109707 11176 tablet_bootstrap.cc:654] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.111685 11177 tablet_bootstrap.cc:654] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.112643 11134 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:05.111322 11098 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:05.114662 11333 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.119427 11176 tablet_bootstrap.cc:492] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:05.119956 11176 ts_tablet_manager.cc:1403] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.059s	user 0.007s	sys 0.003s
I20260709 12:23:05.113459 11179 tablet_bootstrap.cc:654] T 6dff0ae92c5347b59bfed7b76061d189 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.131259 11176 raft_consensus.cc:359] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.132571 11176 raft_consensus.cc:385] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.132891 11176 raft_consensus.cc:740] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.135102 11176 consensus_queue.cc:260] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.138564 11176 ts_tablet_manager.cc:1434] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 12:23:05.156021 11333 raft_consensus.cc:2749] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:05.163955 11177 tablet_bootstrap.cc:492] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:05.164508 11177 ts_tablet_manager.cc:1403] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.063s	user 0.018s	sys 0.026s
I20260709 12:23:05.164832 11328 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.165338 11328 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.165815 11325 consensus_queue.cc:1048] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:05.167027 11177 raft_consensus.cc:359] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.167398 11328 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:05.167725 11177 raft_consensus.cc:385] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.168018 11177 raft_consensus.cc:740] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.168640 11177 consensus_queue.cc:260] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.163389 10880 catalog_manager.cc:5697] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:05.170418 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:05.171190 11057 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 0.
I20260709 12:23:05.167232 11325 consensus_queue.cc:1048] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:05.172616 10948 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:05.173568 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:05.174256 11130 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 0.
I20260709 12:23:05.170689 11176 tablet_bootstrap.cc:492] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:05.175853 11325 raft_consensus.cc:2804] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:05.176642 11325 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.177057 11325 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.185374 11177 ts_tablet_manager.cc:1434] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.002s
I20260709 12:23:05.186600 11177 tablet_bootstrap.cc:492] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:05.190084 10881 catalog_manager.cc:5697] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 0 to 1, leader changed from <none> to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:05.202589 11325 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.210160 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:05.211545 11056 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.214641 11176 tablet_bootstrap.cc:654] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.211479 11325 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:05.218708 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:05.219340 11130 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.223523 11179 tablet_bootstrap.cc:492] T 6dff0ae92c5347b59bfed7b76061d189 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:05.224059 11179 ts_tablet_manager.cc:1403] T 6dff0ae92c5347b59bfed7b76061d189 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.139s	user 0.013s	sys 0.015s
I20260709 12:23:05.227133 11179 raft_consensus.cc:359] T 6dff0ae92c5347b59bfed7b76061d189 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.227854 11179 raft_consensus.cc:385] T 6dff0ae92c5347b59bfed7b76061d189 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.228107 11130 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:05.228135 11179 raft_consensus.cc:740] T 6dff0ae92c5347b59bfed7b76061d189 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.230888 10949 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:05.229665 11179 consensus_queue.cc:260] T 6dff0ae92c5347b59bfed7b76061d189 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.231885 11327 raft_consensus.cc:2804] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:05.232370 11327 raft_consensus.cc:697] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:05.232754 11179 ts_tablet_manager.cc:1434] T 6dff0ae92c5347b59bfed7b76061d189 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 12:23:05.233695 11179 tablet_bootstrap.cc:492] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:05.233208 11327 consensus_queue.cc:237] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.235865 11325 consensus_queue.cc:1048] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:05.244735 11328 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.245450 11328 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.229874 11056 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:05.264655 11328 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:05.266402 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:05.267277 11130 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 0.
I20260709 12:23:05.268977 10949 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:05.270165 11328 raft_consensus.cc:2804] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:05.270637 11328 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.270972 11328 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.294471 11177 tablet_bootstrap.cc:654] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.298561 11327 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.302772 11327 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.306042 11176 tablet_bootstrap.cc:492] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:05.306777 11176 ts_tablet_manager.cc:1403] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.136s	user 0.019s	sys 0.013s
I20260709 12:23:05.308465 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:05.309128 11133 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 0.
I20260709 12:23:05.310635 10949 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:05.311246 11326 consensus_queue.cc:1048] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:05.311880 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:05.312505 11056 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 0.
I20260709 12:23:05.313788 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:05.314458 11057 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 0.
I20260709 12:23:05.315826 11326 raft_consensus.cc:2804] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:05.316834 11326 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.317257 11326 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.318841 11221 consensus_queue.cc:1048] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:05.305990 11327 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:05.323673 11176 raft_consensus.cc:359] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.324402 11176 raft_consensus.cc:385] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.324673 11176 raft_consensus.cc:740] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.325361 11176 consensus_queue.cc:260] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.295007 11328 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.332334 10881 catalog_manager.cc:5697] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:05.337786 11176 ts_tablet_manager.cc:1434] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 12:23:05.338761 11176 tablet_bootstrap.cc:492] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:05.344206 11326 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.349964 11326 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:05.356045 10879 catalog_manager.cc:5697] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 0 to 1, leader changed from <none> to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:05.357757 11179 tablet_bootstrap.cc:654] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.359887 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:05.360767 11133 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.361822 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:05.362187 11326 consensus_queue.cc:1048] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:05.362496 11060 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.364037 11328 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:05.359983 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:05.366421 11057 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.373183 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:05.377391 11132 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.385036 11132 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:05.386698 10949 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:05.387773 11328 raft_consensus.cc:2804] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:05.392290 11177 tablet_bootstrap.cc:492] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:05.392802 11177 ts_tablet_manager.cc:1403] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.206s	user 0.012s	sys 0.002s
I20260709 12:23:05.394451 11255 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:05.397533 11328 raft_consensus.cc:697] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:05.406863 11133 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:05.401458 11328 consensus_queue.cc:237] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.411008 10949 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:05.412478 11381 raft_consensus.cc:2804] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:05.412981 11381 raft_consensus.cc:697] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:05.413901 11381 consensus_queue.cc:237] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.409614 11057 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:05.419581 11255 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:23:05.419895 11060 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:05.449895 11176 tablet_bootstrap.cc:654] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.459697 11177 raft_consensus.cc:359] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.497356 11177 raft_consensus.cc:385] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.497665 11177 raft_consensus.cc:740] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.484222 10881 catalog_manager.cc:5697] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 0 to 1, leader changed from <none> to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:05.498677 11177 consensus_queue.cc:260] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.507323 11177 ts_tablet_manager.cc:1434] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.114s	user 0.014s	sys 0.004s
I20260709 12:23:05.509804 11177 tablet_bootstrap.cc:492] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:05.504014 11381 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.511425 11381 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.514135 11381 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:23:05.522692 11388 log.cc:927] Time spent T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:23:05.515652 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:23:05.533579 10948 leader_election.cc:343] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.541148 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:05.542137 11134 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 0.
I20260709 12:23:05.553618 11177 tablet_bootstrap.cc:654] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.556974 11381 consensus_queue.cc:1048] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:05.558302 10949 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:05.559131 11179 tablet_bootstrap.cc:492] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:05.561685 11296 consensus_queue.cc:1048] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:05.562628 11179 ts_tablet_manager.cc:1403] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.329s	user 0.037s	sys 0.033s
I20260709 12:23:05.563238 11325 raft_consensus.cc:2804] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:05.563632 11325 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.563946 11325 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.565308 11179 raft_consensus.cc:359] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.566005 11179 raft_consensus.cc:385] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.566313 11179 raft_consensus.cc:740] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.566972 11179 consensus_queue.cc:260] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.561661 11177 tablet_bootstrap.cc:492] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:05.562016 11176 tablet_bootstrap.cc:492] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:05.568326 11177 ts_tablet_manager.cc:1403] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.060s	user 0.014s	sys 0.001s
I20260709 12:23:05.573061 11179 ts_tablet_manager.cc:1434] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 12:23:05.574029 11179 tablet_bootstrap.cc:492] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:05.579926 11179 tablet_bootstrap.cc:654] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.582397 11176 ts_tablet_manager.cc:1403] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.244s	user 0.015s	sys 0.011s
I20260709 12:23:05.583246 11177 raft_consensus.cc:359] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.583978 11177 raft_consensus.cc:385] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.584270 11177 raft_consensus.cc:740] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.584940 11177 consensus_queue.cc:260] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.587054 11177 ts_tablet_manager.cc:1434] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:23:05.588022 11177 tablet_bootstrap.cc:492] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:05.588495 11176 raft_consensus.cc:359] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.589198 11176 raft_consensus.cc:385] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.589478 11176 raft_consensus.cc:740] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.591223 11176 consensus_queue.cc:260] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.593348 11176 ts_tablet_manager.cc:1434] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260709 12:23:05.594326 11176 tablet_bootstrap.cc:492] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:05.594449 11325 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.598378 11177 tablet_bootstrap.cc:654] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.605870 10882 catalog_manager.cc:5697] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 0 to 1, leader changed from <none> to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:05.617015 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:05.620283 11060 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.623334 11325 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:05.641474 11060 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:05.642871 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:05.643586 11132 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.644243 11177 tablet_bootstrap.cc:492] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:05.644721 11177 ts_tablet_manager.cc:1403] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.057s	user 0.000s	sys 0.014s
I20260709 12:23:05.646154 11179 tablet_bootstrap.cc:492] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:05.646632 11179 ts_tablet_manager.cc:1403] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.073s	user 0.020s	sys 0.004s
I20260709 12:23:05.647810 11177 raft_consensus.cc:359] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.648486 11177 raft_consensus.cc:385] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.648766 11177 raft_consensus.cc:740] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.649461 11177 consensus_queue.cc:260] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.649628 11179 raft_consensus.cc:359] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.650331 11179 raft_consensus.cc:385] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.650640 11179 raft_consensus.cc:740] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.651274 11179 consensus_queue.cc:260] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.652123 11177 ts_tablet_manager.cc:1434] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:23:05.653486 11179 ts_tablet_manager.cc:1434] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:23:05.644670 11176 tablet_bootstrap.cc:654] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.653774 11177 tablet_bootstrap.cc:492] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:05.654229 11132 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:05.650513 11296 consensus_queue.cc:1048] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:23:05.655375 10949 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:05.657922 11381 raft_consensus.cc:2804] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:05.658440 11381 raft_consensus.cc:697] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:05.658915 11179 tablet_bootstrap.cc:492] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:05.659245 11381 consensus_queue.cc:237] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.665189 11179 tablet_bootstrap.cc:654] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.668849 11325 consensus_queue.cc:1048] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:05.686525 11177 tablet_bootstrap.cc:654] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.692041 11176 tablet_bootstrap.cc:492] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:05.692638 11176 ts_tablet_manager.cc:1403] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.099s	user 0.011s	sys 0.014s
I20260709 12:23:05.695787 11176 raft_consensus.cc:359] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.696578 11176 raft_consensus.cc:385] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.696861 11176 raft_consensus.cc:740] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.697573 11176 consensus_queue.cc:260] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.702497 11176 ts_tablet_manager.cc:1434] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:23:05.703692 11176 tablet_bootstrap.cc:492] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:05.725199 11179 tablet_bootstrap.cc:492] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:05.725697 11179 ts_tablet_manager.cc:1403] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.026s
I20260709 12:23:05.728250 11343 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.727597 10878 catalog_manager.cc:5697] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 0 to 1, leader changed from <none> to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:05.729303 11343 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.723793 11333 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.730973 11333 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.728646 11179 raft_consensus.cc:359] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.732126 11179 raft_consensus.cc:385] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.732335 11179 raft_consensus.cc:740] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.733719 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:23:05.739333 11098 leader_election.cc:343] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.741228 11333 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:05.741853 11177 tablet_bootstrap.cc:492] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:05.742281 11177 ts_tablet_manager.cc:1403] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.089s	user 0.010s	sys 0.009s
I20260709 12:23:05.743338 11179 consensus_queue.cc:260] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.744964 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:05.745406 11179 ts_tablet_manager.cc:1434] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.004s
I20260709 12:23:05.745664 11060 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 0.
I20260709 12:23:05.746412 11179 tablet_bootstrap.cc:492] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:05.747049 11176 tablet_bootstrap.cc:654] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.747112 11098 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:05.747978 11343 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:05.748417 11343 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:05.748688 11343 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.748944 11343 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.750313 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:05.757694 11379 consensus_queue.cc:1048] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:05.759824 11379 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.760421 11379 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.764456 11379 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:05.765558 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:05.765802 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:23:05.767237 10949 leader_election.cc:343] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.769562 11179 tablet_bootstrap.cc:654] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:05.770661 11097 leader_election.cc:343] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.771169 11097 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:05.772565 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:05.773298 10983 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 0.
W20260709 12:23:05.773837 10948 leader_election.cc:343] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.774333 10948 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:05.776724 11326 raft_consensus.cc:2749] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:05.777379 11336 raft_consensus.cc:2749] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:05.780453 11343 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.784682 11177 raft_consensus.cc:359] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.786890 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:05.787961 10983 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.788728 11343 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:05.791350 11179 tablet_bootstrap.cc:492] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:05.791802 11179 ts_tablet_manager.cc:1403] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.013s
I20260709 12:23:05.793782 11179 raft_consensus.cc:359] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.794482 11179 raft_consensus.cc:385] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.794754 11179 raft_consensus.cc:740] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.795497 11179 consensus_queue.cc:260] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.798245 11179 ts_tablet_manager.cc:1434] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:23:05.799141 11179 tablet_bootstrap.cc:492] T 497ca545c71446259b5dc17afceaaf59 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:05.801317 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:05.802006 11060 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.804781 11179 tablet_bootstrap.cc:654] T 497ca545c71446259b5dc17afceaaf59 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.810601 10983 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:05.812144 11097 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:05.813201 11343 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:05.813722 11343 raft_consensus.cc:697] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:05.814452 11060 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:05.814608 11343 consensus_queue.cc:237] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.816555 11177 raft_consensus.cc:385] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.816449 11379 consensus_queue.cc:1048] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:05.816823 11179 tablet_bootstrap.cc:492] T 497ca545c71446259b5dc17afceaaf59 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:05.816901 11177 raft_consensus.cc:740] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.817420 11179 ts_tablet_manager.cc:1403] T 497ca545c71446259b5dc17afceaaf59 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 12:23:05.817682 11177 consensus_queue.cc:260] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.838210 11177 ts_tablet_manager.cc:1434] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.096s	user 0.005s	sys 0.002s
I20260709 12:23:05.851850 11379 consensus_queue.cc:1048] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:05.827867 11179 raft_consensus.cc:359] T 497ca545c71446259b5dc17afceaaf59 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.854231 11179 raft_consensus.cc:385] T 497ca545c71446259b5dc17afceaaf59 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.854780 11179 raft_consensus.cc:740] T 497ca545c71446259b5dc17afceaaf59 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.855544 11179 consensus_queue.cc:260] T 497ca545c71446259b5dc17afceaaf59 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.839197 11177 tablet_bootstrap.cc:492] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:05.858210 11176 tablet_bootstrap.cc:492] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:05.858675 11176 ts_tablet_manager.cc:1403] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.155s	user 0.026s	sys 0.005s
I20260709 12:23:05.861502 11176 raft_consensus.cc:359] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.862505 11379 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.862589 11176 raft_consensus.cc:385] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.864198 11176 raft_consensus.cc:740] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.865201 11177 tablet_bootstrap.cc:654] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.865818 11179 ts_tablet_manager.cc:1434] T 497ca545c71446259b5dc17afceaaf59 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.048s	user 0.003s	sys 0.003s
I20260709 12:23:05.863374 10880 catalog_manager.cc:5697] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:05.867712 11208 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.868367 11179 tablet_bootstrap.cc:492] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:05.868160 11208 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.863050 11379 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.864907 11176 consensus_queue.cc:260] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.870596 11379 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:05.872658 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:23:05.874058 10949 leader_election.cc:343] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.875587 11343 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.877303 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:23:05.880111 11025 leader_election.cc:343] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.880977 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:05.882238 10983 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
I20260709 12:23:05.882655 11343 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:05.886373 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:05.887112 10983 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 0.
I20260709 12:23:05.888180 11097 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:05.887123 11023 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:05.889022 11333 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:05.890270 11333 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.890669 11333 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.890779 11325 consensus_queue.cc:1048] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:05.892515 11179 tablet_bootstrap.cc:654] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.889848 11343 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:05.894836 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:05.895010 11296 raft_consensus.cc:2804] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:05.903885 11296 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.904578 11296 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.875936 11208 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:05.922165 11176 ts_tablet_manager.cc:1434] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.001s
I20260709 12:23:05.923563 11176 tablet_bootstrap.cc:492] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:05.919044 11391 consensus_queue.cc:1048] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 12:23:05.931325 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:23:05.963428 11098 leader_election.cc:343] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.973102 11325 consensus_queue.cc:1048] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:05.968412 11333 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.020646 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:06.021310 10983 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.023522 11251 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.026851 11251 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.028947 11251 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:06.029763 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:23:06.031224 11023 leader_election.cc:343] T 497ca545c71446259b5dc17afceaaf59 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.031850 11179 tablet_bootstrap.cc:492] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:06.032351 11179 ts_tablet_manager.cc:1403] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.166s	user 0.034s	sys 0.070s
I20260709 12:23:06.014590 11296 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.039182 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:06.039623 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:06.037024 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:06.040007 11177 tablet_bootstrap.cc:492] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
W20260709 12:23:06.041904 11098 leader_election.cc:343] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.042279 11177 ts_tablet_manager.cc:1403] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.203s	user 0.039s	sys 0.038s
I20260709 12:23:06.042400 11176 tablet_bootstrap.cc:654] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.040232 10980 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.035960 11333 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:23:06.045529 10930 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:06.054369 11325 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.071957 11296 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:06.054983 11325 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.073980 10980 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:06.040809 11060 raft_consensus.cc:2393] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 1: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:06.091602 11023 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:06.092198 11179 raft_consensus.cc:359] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.092958 11179 raft_consensus.cc:385] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.093218 11179 raft_consensus.cc:740] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.095219 11296 raft_consensus.cc:2804] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:06.095746 11296 raft_consensus.cc:697] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:06.096602 11296 consensus_queue.cc:237] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:06.111523 11025 leader_election.cc:343] T 497ca545c71446259b5dc17afceaaf59 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.093905 11179 consensus_queue.cc:260] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.112742 11025 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:06.113600 11179 ts_tablet_manager.cc:1434] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.001s
I20260709 12:23:06.118048 11251 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:06.121755 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:06.123874 11179 tablet_bootstrap.cc:492] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:06.111286 10983 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:06.132644 10948 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:06.134871 11097 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:06.135972 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:06.136535 11326 raft_consensus.cc:2749] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:06.136893 11333 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:06.137372 11333 raft_consensus.cc:697] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:06.132216 11325 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:06.139212 11333 consensus_queue.cc:237] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.142262 11177 raft_consensus.cc:359] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.142944 11177 raft_consensus.cc:385] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.143224 11177 raft_consensus.cc:740] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.143814 11177 consensus_queue.cc:260] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.145911 11177 ts_tablet_manager.cc:1434] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.102s	user 0.002s	sys 0.001s
W20260709 12:23:06.139726 10949 leader_election.cc:343] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.156297 11176 tablet_bootstrap.cc:492] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:06.156847 11176 ts_tablet_manager.cc:1403] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.234s	user 0.021s	sys 0.007s
I20260709 12:23:06.157779 11177 tablet_bootstrap.cc:492] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:06.159938 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:06.160676 11056 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 0.
I20260709 12:23:06.161984 10880 catalog_manager.cc:5697] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.165297 11179 tablet_bootstrap.cc:654] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.166877 11176 raft_consensus.cc:359] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.167553 11176 raft_consensus.cc:385] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.167788 11176 raft_consensus.cc:740] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.169529 11176 consensus_queue.cc:260] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.171485 10948 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:06.172029 11176 ts_tablet_manager.cc:1434] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
W20260709 12:23:06.173089 11025 leader_election.cc:343] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.194903 11176 tablet_bootstrap.cc:492] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:06.188247 11177 tablet_bootstrap.cc:654] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.197997 11179 tablet_bootstrap.cc:492] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:06.198549 11179 ts_tablet_manager.cc:1403] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.075s	user 0.007s	sys 0.016s
I20260709 12:23:06.201275 11179 raft_consensus.cc:359] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.202040 11179 raft_consensus.cc:385] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.202349 11179 raft_consensus.cc:740] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.203035 11179 consensus_queue.cc:260] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.175629 11326 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:06.210058 11326 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.210568 11326 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.214926 11379 consensus_queue.cc:1048] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:06.207419 11179 ts_tablet_manager.cc:1434] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:23:06.206821 10880 catalog_manager.cc:5697] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:06.218421 11179 tablet_bootstrap.cc:492] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:06.209471 11176 tablet_bootstrap.cc:654] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.225302 11179 tablet_bootstrap.cc:654] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.231642 11333 consensus_queue.cc:1048] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:06.238873 11177 tablet_bootstrap.cc:492] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:06.239354 11177 ts_tablet_manager.cc:1403] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.090s	user 0.018s	sys 0.010s
I20260709 12:23:06.229132 11326 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.243340 11326 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:06.243633 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:06.244483 11056 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.247987 11177 raft_consensus.cc:359] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.248703 11177 raft_consensus.cc:385] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.249254 11296 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.252664 11056 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:06.252624 11177 raft_consensus.cc:740] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.252893 11296 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.254202 10948 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:06.255205 11326 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:06.256405 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:06.256480 11326 raft_consensus.cc:697] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:06.256773 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:06.253741 11177 consensus_queue.cc:260] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.257588 10983 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
I20260709 12:23:06.257522 11326 consensus_queue.cc:237] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.260102 11296 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:23:06.258455 11025 leader_election.cc:343] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.272725 11023 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:06.273806 11251 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:06.274242 11251 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.274600 11251 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.276084 11176 tablet_bootstrap.cc:492] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:06.276573 11176 ts_tablet_manager.cc:1403] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.082s	user 0.012s	sys 0.011s
I20260709 12:23:06.282924 11177 ts_tablet_manager.cc:1434] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.001s
I20260709 12:23:06.283942 11177 tablet_bootstrap.cc:492] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:06.284711 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:06.287645 11343 consensus_queue.cc:1048] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:06.290496 11177 tablet_bootstrap.cc:654] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.295966 11179 tablet_bootstrap.cc:492] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:06.296540 11179 ts_tablet_manager.cc:1403] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.078s	user 0.031s	sys 0.030s
I20260709 12:23:06.295998 11381 consensus_queue.cc:1048] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:23:06.291493 10949 leader_election.cc:343] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.306694 11179 raft_consensus.cc:359] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.307519 11179 raft_consensus.cc:385] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.307798 11179 raft_consensus.cc:740] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.308701 11179 consensus_queue.cc:260] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.311036 11179 ts_tablet_manager.cc:1434] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:06.312170 11179 tablet_bootstrap.cc:492] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:06.293197 11251 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.324406 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:06.325016 10983 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.321345 11179 tablet_bootstrap.cc:654] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.332378 11177 tablet_bootstrap.cc:492] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:06.332855 11177 ts_tablet_manager.cc:1403] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.002s
I20260709 12:23:06.335517 11177 raft_consensus.cc:359] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.336251 11177 raft_consensus.cc:385] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.336508 11177 raft_consensus.cc:740] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.337111 11177 consensus_queue.cc:260] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.338886 11177 ts_tablet_manager.cc:1434] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:23:06.339769 11177 tablet_bootstrap.cc:492] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:06.350203 10983 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:06.351151 11177 tablet_bootstrap.cc:654] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.351763 11023 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:06.352720 11208 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:06.353283 11208 raft_consensus.cc:697] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:06.354223 11208 consensus_queue.cc:237] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.364337 11176 raft_consensus.cc:359] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.366693 11177 tablet_bootstrap.cc:492] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:06.366716 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:06.370262 11176 raft_consensus.cc:385] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.370589 11176 raft_consensus.cc:740] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.371251 11176 consensus_queue.cc:260] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:06.371563 11025 leader_election.cc:343] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.373347 11176 ts_tablet_manager.cc:1434] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.096s	user 0.005s	sys 0.000s
I20260709 12:23:06.374353 11177 ts_tablet_manager.cc:1403] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.003s
I20260709 12:23:06.377075 11255 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.377576 11255 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.378747 11177 raft_consensus.cc:359] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.379426 11177 raft_consensus.cc:385] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.379676 11177 raft_consensus.cc:740] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.367210 11251 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:06.380324 11179 tablet_bootstrap.cc:492] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:06.380882 11179 ts_tablet_manager.cc:1403] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.069s	user 0.029s	sys 0.027s
I20260709 12:23:06.382973 11176 tablet_bootstrap.cc:492] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:06.383522 11179 raft_consensus.cc:359] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.384212 11179 raft_consensus.cc:385] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.384384 11255 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:06.384506 11179 raft_consensus.cc:740] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.385180 11179 consensus_queue.cc:260] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.386080 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:06.386723 11179 ts_tablet_manager.cc:1434] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:06.380303 11177 consensus_queue.cc:260] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.389079 11177 ts_tablet_manager.cc:1434] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:23:06.389430 10983 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
I20260709 12:23:06.390074 11177 tablet_bootstrap.cc:492] T a5d087871c7847629fca3c40460a08b1 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:06.389933 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:06.390727 11132 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
I20260709 12:23:06.392660 11025 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:06.390131 11176 tablet_bootstrap.cc:654] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.397370 11251 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:06.397956 11251 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.398335 11251 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.396247 11177 tablet_bootstrap.cc:654] T a5d087871c7847629fca3c40460a08b1 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.397310 11179 tablet_bootstrap.cc:492] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:06.389123 10880 catalog_manager.cc:5697] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 0 to 1, leader changed from <none> to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.413800 11251 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.415585 11343 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.416110 11343 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.416523 11251 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:06.420776 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:06.422134 11179 tablet_bootstrap.cc:654] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.424307 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:23:06.426441 11098 leader_election.cc:343] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.426721 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:06.427412 11132 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.422221 10980 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 0.
I20260709 12:23:06.443871 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:06.445394 11132 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:06.444051 11097 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:06.423167 11343 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:06.448168 11177 tablet_bootstrap.cc:492] T a5d087871c7847629fca3c40460a08b1 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:06.447510 10880 catalog_manager.cc:5697] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.448664 11177 ts_tablet_manager.cc:1403] T a5d087871c7847629fca3c40460a08b1 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.010s
I20260709 12:23:06.450255 11333 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:06.450733 11333 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.451071 11333 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.451354 11177 raft_consensus.cc:359] T a5d087871c7847629fca3c40460a08b1 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.452008 11177 raft_consensus.cc:385] T a5d087871c7847629fca3c40460a08b1 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.452265 11177 raft_consensus.cc:740] T a5d087871c7847629fca3c40460a08b1 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.453020 11177 consensus_queue.cc:260] T a5d087871c7847629fca3c40460a08b1 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.455415 11177 ts_tablet_manager.cc:1434] T a5d087871c7847629fca3c40460a08b1 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 12:23:06.455576 11025 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:06.456272 11177 tablet_bootstrap.cc:492] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:06.456686 11208 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:06.457636 11208 raft_consensus.cc:697] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:06.458900 11208 consensus_queue.cc:237] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.445732 10983 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.468468 11333 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.471261 11333 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:06.471721 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:06.472425 10980 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.473188 10983 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:06.474884 11333 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.475382 11333 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.476146 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:06.477504 11177 tablet_bootstrap.cc:654] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:06.477844 11098 leader_election.cc:343] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.478540 11333 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:06.479140 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:06.479809 10981 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 0.
I20260709 12:23:06.481521 11176 tablet_bootstrap.cc:492] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:06.481400 11097 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:06.483673 11343 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:06.484053 11343 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.484423 11343 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.482086 11176 ts_tablet_manager.cc:1403] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.099s	user 0.046s	sys 0.023s
I20260709 12:23:06.487512 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:06.488307 11060 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 0.
I20260709 12:23:06.491065 11176 raft_consensus.cc:359] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.491801 11176 raft_consensus.cc:385] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.492076 11176 raft_consensus.cc:740] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.492720 11176 consensus_queue.cc:260] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.499100 11176 ts_tablet_manager.cc:1434] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:23:06.499197 11343 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.500133 11176 tablet_bootstrap.cc:492] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:06.502205 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:06.502854 10981 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.503440 10878 catalog_manager.cc:5697] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.505014 10980 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:06.506371 11097 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:06.507525 11333 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:06.512132 10981 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:06.513563 11097 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:06.514681 11336 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:06.519444 11176 tablet_bootstrap.cc:654] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.520196 11336 raft_consensus.cc:697] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:06.525306 11179 tablet_bootstrap.cc:492] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:06.525833 11179 ts_tablet_manager.cc:1403] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.129s	user 0.008s	sys 0.005s
I20260709 12:23:06.526890 11177 tablet_bootstrap.cc:492] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:06.527369 11177 ts_tablet_manager.cc:1403] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.071s	user 0.025s	sys 0.016s
I20260709 12:23:06.519045 11333 raft_consensus.cc:697] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:06.528714 11179 raft_consensus.cc:359] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.542158 11179 raft_consensus.cc:385] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.543216 11343 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:06.542997 11177 raft_consensus.cc:359] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.546231 11177 raft_consensus.cc:385] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.546554 11177 raft_consensus.cc:740] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.547506 11176 tablet_bootstrap.cc:492] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:06.547216 11177 consensus_queue.cc:260] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.548094 11176 ts_tablet_manager.cc:1403] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.001s
I20260709 12:23:06.550552 11177 ts_tablet_manager.cc:1434] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.009s
I20260709 12:23:06.551517 11177 tablet_bootstrap.cc:492] T ec4be143c296464e86202c1a42e3d3ee P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:06.551174 11176 raft_consensus.cc:359] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.552428 11176 raft_consensus.cc:385] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.552726 11176 raft_consensus.cc:740] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.553462 11176 consensus_queue.cc:260] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.555730 11176 ts_tablet_manager.cc:1434] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:23:06.557902 11176 tablet_bootstrap.cc:492] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:06.558362 11177 tablet_bootstrap.cc:654] T ec4be143c296464e86202c1a42e3d3ee P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.543560 11333 consensus_queue.cc:237] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.531257 11336 consensus_queue.cc:237] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.545471 11179 raft_consensus.cc:740] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.564677 11179 consensus_queue.cc:260] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.566843 11179 ts_tablet_manager.cc:1434] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 12:23:06.571408 11179 tablet_bootstrap.cc:492] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:06.571990 11176 tablet_bootstrap.cc:654] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:06.576939 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 43988.5us
I20260709 12:23:06.579068 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:06.583014 11057 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.591233 11208 consensus_queue.cc:1048] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:06.592433 11177 tablet_bootstrap.cc:492] T ec4be143c296464e86202c1a42e3d3ee P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:06.592948 11177 ts_tablet_manager.cc:1403] T ec4be143c296464e86202c1a42e3d3ee P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.042s	user 0.004s	sys 0.007s
I20260709 12:23:06.595021 11179 tablet_bootstrap.cc:654] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.600533 11132 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.603489 11176 tablet_bootstrap.cc:492] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:06.604116 11176 ts_tablet_manager.cc:1403] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.046s	user 0.017s	sys 0.012s
I20260709 12:23:06.606318 10882 catalog_manager.cc:5697] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:06.608111 10882 catalog_manager.cc:5697] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:06.611027 11177 raft_consensus.cc:359] T ec4be143c296464e86202c1a42e3d3ee P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.611105 11208 consensus_queue.cc:1048] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:23:06.616084 11177 raft_consensus.cc:385] T ec4be143c296464e86202c1a42e3d3ee P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.616405 11177 raft_consensus.cc:740] T ec4be143c296464e86202c1a42e3d3ee P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.613876 11176 raft_consensus.cc:359] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.617792 11176 raft_consensus.cc:385] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.618163 11176 raft_consensus.cc:740] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.618956 11176 consensus_queue.cc:260] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.617031 11177 consensus_queue.cc:260] T ec4be143c296464e86202c1a42e3d3ee P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.622279 11177 ts_tablet_manager.cc:1434] T ec4be143c296464e86202c1a42e3d3ee P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:23:06.623934 11177 tablet_bootstrap.cc:492] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:06.625461 11176 ts_tablet_manager.cc:1434] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 12:23:06.626616 11176 tablet_bootstrap.cc:492] T a84c56f62e0a4a9990f4969bc324dd7e P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:06.619895 11057 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:06.645186 11179 tablet_bootstrap.cc:492] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:06.645795 11179 ts_tablet_manager.cc:1403] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.013s
I20260709 12:23:06.646552 11176 tablet_bootstrap.cc:654] T a84c56f62e0a4a9990f4969bc324dd7e P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.655571 11179 raft_consensus.cc:359] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.674157 11179 raft_consensus.cc:385] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.673230 11177 tablet_bootstrap.cc:654] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.674587 11179 raft_consensus.cc:740] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.675420 11179 consensus_queue.cc:260] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.677958 11296 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.678527 11296 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.681735 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:23:06.683537 11023 leader_election.cc:343] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.686022 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:06.685927 11442 consensus_queue.cc:1048] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:23:06.687772 11025 leader_election.cc:343] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.688400 11025 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:06.689316 11251 raft_consensus.cc:2749] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:06.689504 11296 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:23:06.692011 11098 consensus_peers.cc:597] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:06.694741 11179 ts_tablet_manager.cc:1434] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.049s	user 0.004s	sys 0.002s
I20260709 12:23:06.696574 11179 tablet_bootstrap.cc:492] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:06.708989 11179 tablet_bootstrap.cc:654] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.711349 11176 tablet_bootstrap.cc:492] T a84c56f62e0a4a9990f4969bc324dd7e P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:06.711971 11176 ts_tablet_manager.cc:1403] T a84c56f62e0a4a9990f4969bc324dd7e P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.086s	user 0.014s	sys 0.005s
I20260709 12:23:06.714905 11176 raft_consensus.cc:359] T a84c56f62e0a4a9990f4969bc324dd7e P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.715529 11176 raft_consensus.cc:385] T a84c56f62e0a4a9990f4969bc324dd7e P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.717528 11177 tablet_bootstrap.cc:492] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:06.717995 11177 ts_tablet_manager.cc:1403] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.094s	user 0.023s	sys 0.018s
I20260709 12:23:06.715827 11176 raft_consensus.cc:740] T a84c56f62e0a4a9990f4969bc324dd7e P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.719053 11176 consensus_queue.cc:260] T a84c56f62e0a4a9990f4969bc324dd7e P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.720743 11177 raft_consensus.cc:359] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.721493 11177 raft_consensus.cc:385] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.721769 11177 raft_consensus.cc:740] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.722425 11177 consensus_queue.cc:260] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.723244 11176 ts_tablet_manager.cc:1434] T a84c56f62e0a4a9990f4969bc324dd7e P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:23:06.724737 11177 ts_tablet_manager.cc:1434] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:06.725131 11176 tablet_bootstrap.cc:492] T 820ab313402049dfa58d12167763953e P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:06.725569 11177 tablet_bootstrap.cc:492] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:06.728754 11179 tablet_bootstrap.cc:492] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:06.729285 11179 ts_tablet_manager.cc:1403] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.004s
I20260709 12:23:06.731612 11177 tablet_bootstrap.cc:654] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.732384 11179 raft_consensus.cc:359] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.733099 11179 raft_consensus.cc:385] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.733387 11179 raft_consensus.cc:740] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.734181 11179 consensus_queue.cc:260] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.736348 11179 ts_tablet_manager.cc:1434] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:06.742554 11130 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.743407 11179 tablet_bootstrap.cc:492] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:06.745522 11176 tablet_bootstrap.cc:654] T 820ab313402049dfa58d12167763953e P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.750984 11179 tablet_bootstrap.cc:654] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.761781 11177 tablet_bootstrap.cc:492] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:06.761583 11381 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.762239 11381 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.764118 11179 tablet_bootstrap.cc:492] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:06.764395 11381 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:06.764663 11179 ts_tablet_manager.cc:1403] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.021s	user 0.019s	sys 0.000s
I20260709 12:23:06.765522 11177 ts_tablet_manager.cc:1403] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.011s
I20260709 12:23:06.767345 11179 raft_consensus.cc:359] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.767809 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:06.768129 11179 raft_consensus.cc:385] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.769021 11179 raft_consensus.cc:740] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.768146 11177 raft_consensus.cc:359] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.769511 11177 raft_consensus.cc:385] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.769798 11177 raft_consensus.cc:740] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
W20260709 12:23:06.770318 10948 leader_election.cc:343] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.769999 11179 consensus_queue.cc:260] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.770452 11177 consensus_queue.cc:260] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.772408 11179 ts_tablet_manager.cc:1434] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:06.773370 11179 tablet_bootstrap.cc:492] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:06.775233 11177 ts_tablet_manager.cc:1434] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:23:06.777666 11177 tablet_bootstrap.cc:492] T 0bb096cdb35c45e785fda6900a7999f7 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:06.779021 11179 tablet_bootstrap.cc:654] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.780845 11333 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.781384 11333 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.783351 11177 tablet_bootstrap.cc:654] T 0bb096cdb35c45e785fda6900a7999f7 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.783529 11333 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:06.785184 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:06.785890 10981 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 0.
I20260709 12:23:06.787348 11097 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:06.788352 11333 raft_consensus.cc:2804] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:06.788779 11333 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.789144 11333 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.798565 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:06.800706 11179 tablet_bootstrap.cc:492] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:06.800662 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:06.801390 11179 ts_tablet_manager.cc:1403] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.008s
I20260709 12:23:06.801573 11060 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 0.
I20260709 12:23:06.803995 11179 raft_consensus.cc:359] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.804620 11179 raft_consensus.cc:385] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:23:06.804540 10949 consensus_peers.cc:597] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb -> Peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Couldn't send request to peer 7518bdeb78f24e67a530754ae48547eb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:06.804998 11179 raft_consensus.cc:740] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.805866 11381 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.805691 11179 consensus_queue.cc:260] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.806418 11381 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.808645 11381 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:06.812018 11179 ts_tablet_manager.cc:1434] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:23:06.813063 11179 tablet_bootstrap.cc:492] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:06.815212 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:06.815958 11060 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 0.
I20260709 12:23:06.817489 11381 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:06.818922 11179 tablet_bootstrap.cc:654] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.818558 10948 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:23:06.820785 10949 leader_election.cc:343] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.821224 10949 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:06.821944 11381 raft_consensus.cc:2804] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:06.822402 11381 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.822743 11381 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.827500 11391 raft_consensus.cc:2749] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:06.833895 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:06.834594 11134 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 0.
I20260709 12:23:06.842084 11296 consensus_queue.cc:1048] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:06.844595 11326 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.845196 11296 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.845355 11326 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.845793 11296 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.848199 11326 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:06.849159 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:06.849946 10981 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
I20260709 12:23:06.851341 11296 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:06.851502 11023 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:06.853132 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:06.854822 11296 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:06.855283 11296 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.855626 11296 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.863952 11296 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.867187 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:06.867892 10981 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.872453 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:06.876459 11255 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.877074 11255 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.879396 11333 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.881829 11333 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:06.882627 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:06.886508 10983 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.887012 11176 tablet_bootstrap.cc:492] T 820ab313402049dfa58d12167763953e P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:06.887495 11176 ts_tablet_manager.cc:1403] T 820ab313402049dfa58d12167763953e P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.163s	user 0.040s	sys 0.030s
I20260709 12:23:06.879354 11255 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:06.888856 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:23:06.890398 11023 leader_election.cc:343] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.892066 11296 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:06.885979 10981 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:06.892596 11176 raft_consensus.cc:359] T 820ab313402049dfa58d12167763953e P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:06.867796 11025 leader_election.cc:343] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.893692 11023 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:06.893265 11176 raft_consensus.cc:385] T 820ab313402049dfa58d12167763953e P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.894526 10983 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:06.894701 11176 raft_consensus.cc:740] T 820ab313402049dfa58d12167763953e P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.895301 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:06.883749 11381 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.895735 11176 consensus_queue.cc:260] T 820ab313402049dfa58d12167763953e P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.896186 11097 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:06.896642 11134 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
I20260709 12:23:06.896201 11296 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:06.897531 11296 raft_consensus.cc:697] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:06.898818 11296 consensus_queue.cc:237] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:06.900377 10949 leader_election.cc:343] T a5d087871c7847629fca3c40460a08b1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.897980 11176 ts_tablet_manager.cc:1434] T 820ab313402049dfa58d12167763953e P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:23:06.901631 11176 tablet_bootstrap.cc:492] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:06.897162 11333 raft_consensus.cc:2804] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:06.905117 11333 raft_consensus.cc:697] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:06.907418 11176 tablet_bootstrap.cc:654] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.909107 11381 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:06.907053 11333 consensus_queue.cc:237] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.917904 11179 tablet_bootstrap.cc:492] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:06.919062 11179 ts_tablet_manager.cc:1403] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.106s	user 0.051s	sys 0.024s
I20260709 12:23:06.922010 11179 raft_consensus.cc:359] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.922734 11176 tablet_bootstrap.cc:492] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:06.922906 11179 raft_consensus.cc:385] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.923223 11176 ts_tablet_manager.cc:1403] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.004s
I20260709 12:23:06.922420 10882 catalog_manager.cc:5697] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.923326 11179 raft_consensus.cc:740] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.924437 11179 consensus_queue.cc:260] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.926956 11179 ts_tablet_manager.cc:1434] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:23:06.928018 11179 tablet_bootstrap.cc:492] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:06.935431 11179 tablet_bootstrap.cc:654] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.940117 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:06.942560 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:06.944289 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:06.944968 11060 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.946800 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:06.947129 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:06.947481 11059 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.947679 11133 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.954649 11059 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:06.954651 11133 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:06.962033 11296 consensus_queue.cc:1048] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:23:06.962556 10948 leader_election.cc:343] T a5d087871c7847629fca3c40460a08b1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.963042 10948 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:06.964053 11025 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:06.965466 11251 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:06.965880 11251 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.966240 11251 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.979306 11381 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:06.983506 11060 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:06.984706 11177 tablet_bootstrap.cc:492] T 0bb096cdb35c45e785fda6900a7999f7 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:06.985284 11177 ts_tablet_manager.cc:1403] T 0bb096cdb35c45e785fda6900a7999f7 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.208s	user 0.026s	sys 0.042s
I20260709 12:23:06.987972 11251 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.989913 11177 raft_consensus.cc:359] T 0bb096cdb35c45e785fda6900a7999f7 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:06.990697 11177 raft_consensus.cc:385] T 0bb096cdb35c45e785fda6900a7999f7 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.990990 11177 raft_consensus.cc:740] T 0bb096cdb35c45e785fda6900a7999f7 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.991665 11177 consensus_queue.cc:260] T 0bb096cdb35c45e785fda6900a7999f7 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.002960 11440 consensus_queue.cc:1048] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:07.003592 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:23:07.005429 11023 leader_election.cc:343] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.005479 11251 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:07.009838 11176 raft_consensus.cc:359] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.010545 11176 raft_consensus.cc:385] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.010821 11176 raft_consensus.cc:740] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
W20260709 12:23:07.007200 11025 leader_election.cc:343] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.016585 11177 ts_tablet_manager.cc:1434] T 0bb096cdb35c45e785fda6900a7999f7 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:23:07.016135 11176 consensus_queue.cc:260] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.019553 11177 tablet_bootstrap.cc:492] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:07.020092 11176 ts_tablet_manager.cc:1434] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.096s	user 0.007s	sys 0.000s
I20260709 12:23:07.026403 11251 consensus_queue.cc:1048] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:07.026038 10882 catalog_manager.cc:5697] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:07.026823 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 63970.5us
I20260709 12:23:07.027670 10949 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:07.029881 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:07.030556 11133 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.034258 11179 tablet_bootstrap.cc:492] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:07.034817 11179 ts_tablet_manager.cc:1403] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.107s	user 0.016s	sys 0.018s
I20260709 12:23:07.037261 11133 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:07.028613 11468 raft_consensus.cc:2804] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:07.037424 11179 raft_consensus.cc:359] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:07.039000 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 76481.3us
I20260709 12:23:07.039942 11179 raft_consensus.cc:385] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.040927 11179 raft_consensus.cc:740] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.041675 11179 consensus_queue.cc:260] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.043504 11179 ts_tablet_manager.cc:1434] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:23:07.037995 11468 raft_consensus.cc:697] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:07.047849 11060 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.058977 11296 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.059549 11296 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.061671 11296 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:07.062340 11179 tablet_bootstrap.cc:492] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:07.063364 11025 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:07.063441 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:07.021082 11176 tablet_bootstrap.cc:492] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:07.068305 11333 consensus_queue.cc:1048] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:23:07.080595 11251 consensus_queue.cc:1048] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:07.080809 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:07.071843 11296 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:07.082856 11296 raft_consensus.cc:697] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:07.090553 11296 consensus_queue.cc:237] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.074411 11468 consensus_queue.cc:237] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.094993 11251 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.095578 11251 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.098829 11025 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:07.102831 11255 raft_consensus.cc:2749] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:07.120432 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:07.121204 10981 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
I20260709 12:23:07.127063 11023 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:07.129523 11208 raft_consensus.cc:2804] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:07.130017 11208 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.130421 11208 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.137162 11251 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:07.139214 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:23:07.140787 11025 leader_election.cc:343] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.145355 11177 tablet_bootstrap.cc:654] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.147653 11060 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.149454 11208 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.154554 11176 tablet_bootstrap.cc:654] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.169497 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:07.159576 11440 consensus_queue.cc:1048] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:07.162411 11179 tablet_bootstrap.cc:654] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.170163 10983 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.165642 11177 tablet_bootstrap.cc:492] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:07.172726 11177 ts_tablet_manager.cc:1403] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.153s	user 0.007s	sys 0.005s
I20260709 12:23:07.180001 11208 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:07.180987 11176 tablet_bootstrap.cc:492] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:07.181528 11176 ts_tablet_manager.cc:1403] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.161s	user 0.011s	sys 0.000s
I20260709 12:23:07.182026 11177 raft_consensus.cc:359] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.182761 11177 raft_consensus.cc:385] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.183044 11177 raft_consensus.cc:740] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.187070 11176 raft_consensus.cc:359] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.187852 11176 raft_consensus.cc:385] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.188117 11176 raft_consensus.cc:740] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.188772 11176 consensus_queue.cc:260] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.190631 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:07.191471 11177 consensus_queue.cc:260] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.193953 11176 ts_tablet_manager.cc:1434] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:23:07.195098 11176 tablet_bootstrap.cc:492] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:07.197032 11177 ts_tablet_manager.cc:1434] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 12:23:07.198040 11177 tablet_bootstrap.cc:492] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
W20260709 12:23:07.199244 11025 leader_election.cc:343] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.206615 11468 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.206856 11333 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.207279 11468 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.207362 11333 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.205137 10882 catalog_manager.cc:5697] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 0 to 1, leader changed from <none> to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:07.211383 10983 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:07.234400 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:07.241142 11023 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:07.242019 11251 raft_consensus.cc:2804] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:07.242654 11251 raft_consensus.cc:697] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:07.246066 11468 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:07.245975 11251 consensus_queue.cc:237] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.246608 11333 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:07.245962 11130 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.250512 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:07.256817 11255 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.263728 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:07.264079 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:07.264923 10980 raft_consensus.cc:2393] T ec4be143c296464e86202c1a42e3d3ee P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 1: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:07.267052 11134 raft_consensus.cc:2393] T 820ab313402049dfa58d12167763953e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 1: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:07.277293 10949 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:07.279759 11255 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.280481 11468 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.279686 11443 consensus_queue.cc:1048] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:23:07.277997 11179 tablet_bootstrap.cc:492] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:07.278376 11176 tablet_bootstrap.cc:654] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.279826 11177 tablet_bootstrap.cc:654] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.284380 11179 ts_tablet_manager.cc:1403] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.240s	user 0.019s	sys 0.027s
I20260709 12:23:07.287492 11098 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:07.284327 11255 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:07.292063 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:07.289103 11336 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:07.297398 11023 leader_election.cc:343] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.301543 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:23:07.305789 11025 leader_election.cc:343] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.306357 11025 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:07.307776 11251 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:07.307705 10878 catalog_manager.cc:5697] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:07.311255 10930 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:07.321455 11179 raft_consensus.cc:359] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.322743 11179 raft_consensus.cc:385] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.323062 11179 raft_consensus.cc:740] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.325870 11179 consensus_queue.cc:260] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.329865 11179 ts_tablet_manager.cc:1434] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 12:23:07.330004 11468 raft_consensus.cc:2749] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:07.330878 11333 consensus_queue.cc:1048] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:07.332063 11179 tablet_bootstrap.cc:492] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:07.334399 11177 tablet_bootstrap.cc:492] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:07.334895 11177 ts_tablet_manager.cc:1403] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.137s	user 0.014s	sys 0.000s
I20260709 12:23:07.337646 11177 raft_consensus.cc:359] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.338387 11177 raft_consensus.cc:385] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.338581 11179 tablet_bootstrap.cc:654] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.338652 11177 raft_consensus.cc:740] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.339262 11336 raft_consensus.cc:2749] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:07.339520 11177 consensus_queue.cc:260] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.358161 11177 ts_tablet_manager.cc:1434] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:23:07.359156 11177 tablet_bootstrap.cc:492] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:07.364207 11333 consensus_queue.cc:1048] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:07.371407 11177 tablet_bootstrap.cc:654] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.374338 11176 tablet_bootstrap.cc:492] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:07.374861 11176 ts_tablet_manager.cc:1403] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.180s	user 0.010s	sys 0.010s
I20260709 12:23:07.377271 11176 raft_consensus.cc:359] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.377758 11176 raft_consensus.cc:385] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.377918 11176 raft_consensus.cc:740] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.378599 11176 consensus_queue.cc:260] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.382817 11177 tablet_bootstrap.cc:492] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:07.383340 11177 ts_tablet_manager.cc:1403] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.005s
I20260709 12:23:07.386852 11177 raft_consensus.cc:359] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.387573 11177 raft_consensus.cc:385] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.387844 11177 raft_consensus.cc:740] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.388612 11177 consensus_queue.cc:260] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.390985 11177 ts_tablet_manager.cc:1434] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:23:07.391891 11177 tablet_bootstrap.cc:492] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:07.394748 11176 ts_tablet_manager.cc:1434] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:23:07.395812 11176 tablet_bootstrap.cc:492] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:07.402501 11177 tablet_bootstrap.cc:654] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.412107 10879 catalog_manager.cc:5697] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:07.415251 11391 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.415833 11391 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.418345 11391 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:07.420662 11177 tablet_bootstrap.cc:492] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:07.420516 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:07.426472 11057 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 0.
I20260709 12:23:07.421270 11177 ts_tablet_manager.cc:1403] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.008s
I20260709 12:23:07.422840 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:23:07.428448 10949 leader_election.cc:343] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.432124 11443 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.432298 10948 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:07.432672 11443 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.433568 11468 raft_consensus.cc:2804] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:07.433964 11468 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.434365 11468 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.434829 11443 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:07.425041 11176 tablet_bootstrap.cc:654] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.430249 11177 raft_consensus.cc:359] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.438628 11177 raft_consensus.cc:385] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.438941 11177 raft_consensus.cc:740] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.439491 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:07.439751 11177 consensus_queue.cc:260] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.440254 10981 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 0.
I20260709 12:23:07.441795 11097 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:07.442206 11177 ts_tablet_manager.cc:1434] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 12:23:07.442836 11442 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:07.443252 11442 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.443681 11442 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.453426 11179 tablet_bootstrap.cc:492] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:07.453979 11179 ts_tablet_manager.cc:1403] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.122s	user 0.057s	sys 0.027s
I20260709 12:23:07.454130 11442 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.457190 11179 raft_consensus.cc:359] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.457485 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:07.457937 11179 raft_consensus.cc:385] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.458263 10981 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.458402 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:07.459429 11060 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 0.
I20260709 12:23:07.458279 11179 raft_consensus.cc:740] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.463109 11179 consensus_queue.cc:260] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.443252 11177 tablet_bootstrap.cc:492] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:07.465224 11179 ts_tablet_manager.cc:1434] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:23:07.466244 11179 tablet_bootstrap.cc:492] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:07.472218 10981 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:07.473666 11097 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:07.475358 11442 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:07.476892 11179 tablet_bootstrap.cc:654] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.478354 11177 tablet_bootstrap.cc:654] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.479562 11333 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:07.491910 11251 consensus_queue.cc:1048] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:07.492394 11333 raft_consensus.cc:697] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:07.493366 11255 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:07.493485 11333 consensus_queue.cc:237] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.498330 11177 tablet_bootstrap.cc:492] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:07.498956 11177 ts_tablet_manager.cc:1403] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.056s	user 0.009s	sys 0.011s
I20260709 12:23:07.502429 11177 raft_consensus.cc:359] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.503240 11177 raft_consensus.cc:385] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.503511 11177 raft_consensus.cc:740] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.504207 11177 consensus_queue.cc:260] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.511855 11177 ts_tablet_manager.cc:1434] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:23:07.524684 11470 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.525197 11470 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.528513 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:07.533505 11208 consensus_queue.cc:1048] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:23:07.534807 10949 leader_election.cc:343] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.535837 11208 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:07.536867 11177 tablet_bootstrap.cc:492] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:07.536832 10879 catalog_manager.cc:5697] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:07.540668 11468 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.543411 11177 tablet_bootstrap.cc:654] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.537030 11470 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:07.553047 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:07.585238 11060 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.587033 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:07.587649 11059 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.554229 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:07.590413 11057 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 0.
I20260709 12:23:07.593189 11060 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:07.600514 11177 tablet_bootstrap.cc:492] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:07.601037 11177 ts_tablet_manager.cc:1403] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.002s
I20260709 12:23:07.599802 10948 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:07.602195 11391 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:07.602547 11391 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.602872 11391 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.603825 11177 raft_consensus.cc:359] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.604504 11177 raft_consensus.cc:385] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.604773 11177 raft_consensus.cc:740] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.605440 11177 consensus_queue.cc:260] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.607368 11325 consensus_queue.cc:1048] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:07.608292 11177 ts_tablet_manager.cc:1434] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:07.609419 11177 tablet_bootstrap.cc:492] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:07.618027 11177 tablet_bootstrap.cc:654] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.624110 11059 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:07.628391 11468 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:07.629084 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:23:07.630708 10949 leader_election.cc:343] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.631938 10948 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:07.633605 11468 raft_consensus.cc:2804] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:07.634284 11468 raft_consensus.cc:697] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:07.635140 11468 consensus_queue.cc:237] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.641469 11176 tablet_bootstrap.cc:492] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:07.642021 11176 ts_tablet_manager.cc:1403] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.246s	user 0.066s	sys 0.071s
I20260709 12:23:07.642040 11391 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.648087 11176 raft_consensus.cc:359] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.648841 11176 raft_consensus.cc:385] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.649142 11176 raft_consensus.cc:740] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.649771 11391 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:07.650597 11176 consensus_queue.cc:260] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.652841 11176 ts_tablet_manager.cc:1434] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.001s
I20260709 12:23:07.653685 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:07.655318 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:07.655994 11059 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:07.655941 10949 leader_election.cc:343] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.657425 11391 consensus_queue.cc:1048] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:07.664525 11176 tablet_bootstrap.cc:492] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:07.673943 11179 tablet_bootstrap.cc:492] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:07.674489 11179 ts_tablet_manager.cc:1403] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.208s	user 0.046s	sys 0.069s
I20260709 12:23:07.675550 11176 tablet_bootstrap.cc:654] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.677912 11179 raft_consensus.cc:359] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.678824 11179 raft_consensus.cc:385] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.679257 11179 raft_consensus.cc:740] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.682089 11177 tablet_bootstrap.cc:492] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:07.682770 11177 ts_tablet_manager.cc:1403] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.074s	user 0.014s	sys 0.019s
I20260709 12:23:07.679968 11179 consensus_queue.cc:260] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.686172 11177 raft_consensus.cc:359] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.687006 11177 raft_consensus.cc:385] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.687281 11177 raft_consensus.cc:740] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.687989 11177 consensus_queue.cc:260] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.689504 11059 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:07.691128 11179 ts_tablet_manager.cc:1434] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:23:07.692334 11179 tablet_bootstrap.cc:492] T c2dcd574d9d144ce853b29000889507e P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:07.694833 11177 ts_tablet_manager.cc:1434] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:23:07.695928 10948 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:07.697607 11391 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:07.698123 11391 raft_consensus.cc:697] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:07.698936 11391 consensus_queue.cc:237] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.721895 11177 tablet_bootstrap.cc:492] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:07.748888 10879 catalog_manager.cc:5697] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 0 to 1, leader changed from <none> to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:07.755069 11179 tablet_bootstrap.cc:654] T c2dcd574d9d144ce853b29000889507e P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.762880 11177 tablet_bootstrap.cc:654] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.763084 11176 tablet_bootstrap.cc:492] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:07.763588 11176 ts_tablet_manager.cc:1403] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.099s	user 0.033s	sys 0.030s
I20260709 12:23:07.766263 11176 raft_consensus.cc:359] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.766913 11176 raft_consensus.cc:385] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.767179 11176 raft_consensus.cc:740] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.767812 11176 consensus_queue.cc:260] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.769857 11176 ts_tablet_manager.cc:1434] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:23:07.770774 11176 tablet_bootstrap.cc:492] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:07.776571 11176 tablet_bootstrap.cc:654] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.778818 11179 tablet_bootstrap.cc:492] T c2dcd574d9d144ce853b29000889507e P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:07.779636 11179 ts_tablet_manager.cc:1403] T c2dcd574d9d144ce853b29000889507e P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.088s	user 0.010s	sys 0.004s
I20260709 12:23:07.782670 11179 raft_consensus.cc:359] T c2dcd574d9d144ce853b29000889507e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.783432 11179 raft_consensus.cc:385] T c2dcd574d9d144ce853b29000889507e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.783706 11179 raft_consensus.cc:740] T c2dcd574d9d144ce853b29000889507e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.789686 11179 consensus_queue.cc:260] T c2dcd574d9d144ce853b29000889507e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.790808 11177 tablet_bootstrap.cc:492] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:07.791311 11177 ts_tablet_manager.cc:1403] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.095s	user 0.019s	sys 0.012s
I20260709 12:23:07.795405 11336 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.796008 11336 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.798406 11336 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:07.798817 11179 ts_tablet_manager.cc:1434] T c2dcd574d9d144ce853b29000889507e P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:23:07.799837 11179 tablet_bootstrap.cc:492] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:07.800062 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:07.800684 10980 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 0.
I20260709 12:23:07.800637 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:07.801914 11059 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 0.
I20260709 12:23:07.805085 11097 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:07.805807 11179 tablet_bootstrap.cc:654] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.806475 11495 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:07.807418 11495 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.807777 11495 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.812840 11391 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.813445 11391 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.815606 11391 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:07.794000 11177 raft_consensus.cc:359] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.818583 11177 raft_consensus.cc:385] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.818902 11177 raft_consensus.cc:740] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.819559 11177 consensus_queue.cc:260] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.819927 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:07.821805 11177 ts_tablet_manager.cc:1434] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:23:07.822750 11177 tablet_bootstrap.cc:492] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:07.819594 10880 catalog_manager.cc:5697] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 0 to 1, leader changed from <none> to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:07.823529 10948 leader_election.cc:343] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.825973 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:07.826448 11255 consensus_queue.cc:1048] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:07.815291 11495 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:07.831403 10949 leader_election.cc:343] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.831845 10949 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:07.832126 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:07.832718 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:07.832921 11058 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.833356 10980 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.839886 11470 raft_consensus.cc:2749] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:07.851014 11058 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:07.851854 11495 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:07.852325 11381 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.832126 11177 tablet_bootstrap.cc:654] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.852885 11381 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.855123 11381 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:07.856261 11176 tablet_bootstrap.cc:492] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:07.856789 11176 ts_tablet_manager.cc:1403] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.086s	user 0.029s	sys 0.019s
I20260709 12:23:07.856746 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:23:07.859266 10948 leader_election.cc:343] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.859905 11176 raft_consensus.cc:359] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.860625 11176 raft_consensus.cc:385] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.860571 11098 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:07.860859 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:07.861126 11176 raft_consensus.cc:740] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.861922 11495 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:07.861799 11176 consensus_queue.cc:260] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.862447 11495 raft_consensus.cc:697] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:07.863291 11495 consensus_queue.cc:237] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.863935 11176 ts_tablet_manager.cc:1434] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:07.864218 11179 tablet_bootstrap.cc:492] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:07.864705 11179 ts_tablet_manager.cc:1403] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.017s
I20260709 12:23:07.864893 11176 tablet_bootstrap.cc:492] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:07.867820 11179 raft_consensus.cc:359] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.868527 11179 raft_consensus.cc:385] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.868775 11179 raft_consensus.cc:740] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.869511 11179 consensus_queue.cc:260] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:07.870812 10949 leader_election.cc:343] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.871250 10949 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:07.871790 11179 ts_tablet_manager.cc:1434] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.007s
W20260709 12:23:07.873191 11025 consensus_peers.cc:597] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Couldn't send request to peer 7518bdeb78f24e67a530754ae48547eb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:07.873386 11179 tablet_bootstrap.cc:492] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:07.875721 11381 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:07.877260 11176 tablet_bootstrap.cc:654] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.883206 10980 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:07.884158 11177 tablet_bootstrap.cc:492] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:07.884696 11177 ts_tablet_manager.cc:1403] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.062s	user 0.005s	sys 0.007s
I20260709 12:23:07.905416 11179 tablet_bootstrap.cc:654] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.904268 11177 raft_consensus.cc:359] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.906224 11177 raft_consensus.cc:385] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.906466 11177 raft_consensus.cc:740] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.907034 11177 consensus_queue.cc:260] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.911586 11177 ts_tablet_manager.cc:1434] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 12:23:07.912912 11177 tablet_bootstrap.cc:492] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:07.918604 11176 tablet_bootstrap.cc:492] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:07.919598 11177 tablet_bootstrap.cc:654] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.919498 10878 catalog_manager.cc:5697] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:07.927757 11176 ts_tablet_manager.cc:1403] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.010s
I20260709 12:23:07.931270 11176 raft_consensus.cc:359] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.932018 11176 raft_consensus.cc:385] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.932300 11176 raft_consensus.cc:740] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.932886 11176 consensus_queue.cc:260] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.933911 11177 tablet_bootstrap.cc:492] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:07.934986 11176 ts_tablet_manager.cc:1434] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:07.935469 11177 ts_tablet_manager.cc:1403] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 12:23:07.936017 11176 tablet_bootstrap.cc:492] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:07.941803 11177 raft_consensus.cc:359] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.942559 11176 tablet_bootstrap.cc:654] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.942657 11177 raft_consensus.cc:385] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.943148 11177 raft_consensus.cc:740] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.943881 11177 consensus_queue.cc:260] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.945770 11177 ts_tablet_manager.cc:1434] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:23:07.946835 11177 tablet_bootstrap.cc:492] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:07.951930 11381 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.952216 11179 tablet_bootstrap.cc:492] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:07.952667 11179 ts_tablet_manager.cc:1403] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.079s	user 0.009s	sys 0.010s
I20260709 12:23:07.952509 11381 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.959436 11208 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.960002 11208 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.961961 11208 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:07.966864 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:07.967665 11134 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
I20260709 12:23:07.969774 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:07.970173 11025 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:23:07.971411 10948 leader_election.cc:343] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.971513 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:07.972472 11177 tablet_bootstrap.cc:654] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.973158 11495 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:07.973438 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:07.974157 10981 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
I20260709 12:23:07.965716 11381 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:07.976107 11208 raft_consensus.cc:2804] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:23:07.976215 10949 leader_election.cc:343] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.976593 11208 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.976683 10949 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:07.976934 11208 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.978286 11179 raft_consensus.cc:359] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.980266 11179 raft_consensus.cc:385] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.980604 11179 raft_consensus.cc:740] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.981091 11176 tablet_bootstrap.cc:492] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:07.981566 11176 ts_tablet_manager.cc:1403] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.046s	user 0.020s	sys 0.006s
I20260709 12:23:07.982398 11179 consensus_queue.cc:260] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.983609 11495 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.984126 11495 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.984347 11176 raft_consensus.cc:359] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.985033 11176 raft_consensus.cc:385] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.985307 11176 raft_consensus.cc:740] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.985960 11176 consensus_queue.cc:260] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:07.986878 11179 ts_tablet_manager.cc:1434] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 12:23:07.987972 11179 tablet_bootstrap.cc:492] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:07.988039 11176 ts_tablet_manager.cc:1434] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:23:07.990604 11495 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:07.993040 11176 tablet_bootstrap.cc:492] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:07.994475 11179 tablet_bootstrap.cc:654] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.979070 11381 raft_consensus.cc:2749] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:07.998811 11176 tablet_bootstrap.cc:654] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.002436 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:08.003432 11058 raft_consensus.cc:2393] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 1: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:08.002436 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:08.010835 11098 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:08.012972 11333 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.026306 11443 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:08.027864 11177 tablet_bootstrap.cc:492] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:08.028355 11177 ts_tablet_manager.cc:1403] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.082s	user 0.005s	sys 0.007s
I20260709 12:23:08.029752 11208 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.039129 11381 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.043648 11381 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.045921 11381 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:08.047801 11176 tablet_bootstrap.cc:492] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:08.048055 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:08.038416 11177 raft_consensus.cc:359] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.048789 11177 raft_consensus.cc:385] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.049093 11177 raft_consensus.cc:740] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.049799 11177 consensus_queue.cc:260] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.050546 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:23:08.050755 10948 leader_election.cc:343] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.051162 10982 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.052018 11177 ts_tablet_manager.cc:1434] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.002s
I20260709 12:23:08.052940 11177 tablet_bootstrap.cc:492] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:08.048311 11176 ts_tablet_manager.cc:1403] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.056s	user 0.036s	sys 0.011s
I20260709 12:23:08.054682 11179 tablet_bootstrap.cc:492] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:08.055171 11179 ts_tablet_manager.cc:1403] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.013s
I20260709 12:23:08.056951 11176 raft_consensus.cc:359] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.057683 11176 raft_consensus.cc:385] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.057811 11179 raft_consensus.cc:359] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.059094 11179 raft_consensus.cc:385] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.059374 11179 raft_consensus.cc:740] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.060019 11179 consensus_queue.cc:260] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.061887 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:08.062559 11130 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.062721 11179 ts_tablet_manager.cc:1434] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:23:08.063681 11179 tablet_bootstrap.cc:492] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:08.070031 11179 tablet_bootstrap.cc:654] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.057960 11176 raft_consensus.cc:740] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.072093 11208 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:08.073975 11177 tablet_bootstrap.cc:654] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.040580 11333 raft_consensus.cc:2749] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:08.076181 11176 consensus_queue.cc:260] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.078092 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:08.114791 11176 ts_tablet_manager.cc:1434] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.060s	user 0.010s	sys 0.009s
I20260709 12:23:08.115355 11134 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 0.
I20260709 12:23:08.115868 11176 tablet_bootstrap.cc:492] T e8083bc5cbd34d98a24be9a390262c19 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:08.116328 10949 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:08.079115 10982 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:08.128062 11381 raft_consensus.cc:2804] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:08.145881 11381 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.146277 11381 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.145020 11130 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:08.154393 11470 consensus_queue.cc:1048] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:08.159541 11391 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.168118 11391 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.188350 11391 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:08.166764 11469 consensus_queue.cc:1048] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:23:08.216936 11176 tablet_bootstrap.cc:654] T e8083bc5cbd34d98a24be9a390262c19 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.229066 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:08.229872 11060 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 0.
I20260709 12:23:08.242359 10948 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:08.259760 11325 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:08.260233 11325 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.260581 11325 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.258598 11469 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.290956 11025 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:08.293013 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:08.302760 11208 raft_consensus.cc:2804] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:08.303354 11208 raft_consensus.cc:697] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:08.304127 11208 consensus_queue.cc:237] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.270774 11381 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.302259 11336 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.303292 11255 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.339469 11177 tablet_bootstrap.cc:492] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:08.340061 11177 ts_tablet_manager.cc:1403] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.287s	user 0.023s	sys 0.007s
I20260709 12:23:08.343991 11336 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.302878 11469 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:08.373980 10949 leader_election.cc:343] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.376736 11177 raft_consensus.cc:359] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.377671 11177 raft_consensus.cc:385] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.378224 11177 raft_consensus.cc:740] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.336894 11255 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.379375 11177 consensus_queue.cc:260] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.399961 11179 tablet_bootstrap.cc:492] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:08.399792 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:08.400545 11179 ts_tablet_manager.cc:1403] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.337s	user 0.016s	sys 0.014s
W20260709 12:23:08.403644 10930 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:08.403575 11325 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.406946 11469 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:08.371459 11251 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.408157 11251 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.410176 11251 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:08.407650 11381 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:08.405884 11325 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:08.407749 11336 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:08.426048 11255 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:08.435942 11177 ts_tablet_manager.cc:1434] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.096s	user 0.004s	sys 0.005s
I20260709 12:23:08.447083 11177 tablet_bootstrap.cc:492] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
W20260709 12:23:08.447944 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 72854.8us
W20260709 12:23:08.452386 10948 leader_election.cc:343] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.457993 11179 raft_consensus.cc:359] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.460395 11179 raft_consensus.cc:385] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.460759 11179 raft_consensus.cc:740] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.440626 11538 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.447829 11336 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.482797 11538 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.485854 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:08.486590 11059 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 0.
I20260709 12:23:08.489138 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:08.492491 11058 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 0.
I20260709 12:23:08.492607 11538 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:08.496366 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:08.498900 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:08.499550 11325 consensus_queue.cc:1048] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:08.498132 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:08.507066 11056 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.488677 11336 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.510344 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:08.519469 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:08.520221 10978 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
I20260709 12:23:08.520900 11336 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:08.534523 11179 consensus_queue.cc:260] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.536749 10948 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:08.533386 10879 catalog_manager.cc:5697] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:08.540766 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:08.547605 10980 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
W20260709 12:23:08.549485 10948 leader_election.cc:343] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.552513 11179 ts_tablet_manager.cc:1434] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.152s	user 0.008s	sys 0.002s
I20260709 12:23:08.563098 11098 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:08.544023 11535 raft_consensus.cc:2804] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:08.572593 11179 tablet_bootstrap.cc:492] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:08.575799 11333 raft_consensus.cc:2804] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:08.576287 11333 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.576639 11333 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.582819 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:08.574625 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:08.572376 11535 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.577715 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:08.589596 10984 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 0.
I20260709 12:23:08.589604 11535 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.596698 11132 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.609975 11176 tablet_bootstrap.cc:492] T e8083bc5cbd34d98a24be9a390262c19 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:08.610553 11176 ts_tablet_manager.cc:1403] T e8083bc5cbd34d98a24be9a390262c19 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.495s	user 0.052s	sys 0.057s
I20260709 12:23:08.614193 11177 tablet_bootstrap.cc:654] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.629175 11056 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:08.635275 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:23:08.643008 10949 consensus_peers.cc:597] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb -> Peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Couldn't send request to peer 7518bdeb78f24e67a530754ae48547eb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:08.643477 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 69762us
W20260709 12:23:08.646066 10949 leader_election.cc:343] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.646574 11179 tablet_bootstrap.cc:654] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:08.647162 10949 leader_election.cc:343] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.655817 11132 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:08.662942 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:08.672607 10949 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:08.676995 11176 raft_consensus.cc:359] T e8083bc5cbd34d98a24be9a390262c19 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.677749 11176 raft_consensus.cc:385] T e8083bc5cbd34d98a24be9a390262c19 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.678316 11536 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:23:08.660879 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:08.678032 11176 raft_consensus.cc:740] T e8083bc5cbd34d98a24be9a390262c19 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.686937 11176 consensus_queue.cc:260] T e8083bc5cbd34d98a24be9a390262c19 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.688565 10948 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:08.701009 11176 ts_tablet_manager.cc:1434] T e8083bc5cbd34d98a24be9a390262c19 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.090s	user 0.007s	sys 0.000s
W20260709 12:23:08.703663 10949 leader_election.cc:343] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.704710 11540 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.704793 10949 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:08.705286 11540 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.705595 11538 raft_consensus.cc:2749] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:23:08.702759 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 59039us
I20260709 12:23:08.707382 11023 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:08.708073 11540 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:08.708774 11023 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:08.708760 11296 raft_consensus.cc:2804] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:08.711896 11296 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.712265 11296 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.712942 11208 raft_consensus.cc:2804] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:08.713382 11208 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.713692 11208 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.716883 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:08.720163 11208 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:08.720081 10949 leader_election.cc:343] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.722317 11208 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:08.728880 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:08.729578 10979 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.731178 11296 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.733304 11296 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:08.746529 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:23:08.747849 10948 leader_election.cc:343] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.748342 10948 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:08.698318 11381 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:08.762312 11545 raft_consensus.cc:2804] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:08.762876 11545 raft_consensus.cc:697] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:08.767063 11177 tablet_bootstrap.cc:492] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:08.767567 11177 ts_tablet_manager.cc:1403] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.328s	user 0.017s	sys 0.010s
I20260709 12:23:08.765228 11545 consensus_queue.cc:237] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.751578 11538 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:08.702059 11333 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.690418 11535 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.760293 11381 raft_consensus.cc:697] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:08.776965 11134 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.778780 11381 consensus_queue.cc:237] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.777549 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:08.779863 10978 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.760856 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:08.786707 11097 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:08.788223 11130 raft_consensus.cc:2393] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 1: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:08.786736 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:08.781153 11495 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:23:08.793634 11177 raft_consensus.cc:359] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.794250 11177 raft_consensus.cc:385] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.794485 11177 raft_consensus.cc:740] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.780474 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:08.789881 11535 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:08.803078 11177 consensus_queue.cc:260] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.808238 11177 ts_tablet_manager.cc:1434] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 12:23:08.809378 11177 tablet_bootstrap.cc:492] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:08.810331 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:08.841221 11333 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:08.843333 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:23:08.843400 10949 leader_election.cc:343] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.844520 11176 tablet_bootstrap.cc:492] T 6c233c491e1b4126b9d776bfd98023b6 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:08.827961 11536 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:08.848340 11055 raft_consensus.cc:2393] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 1: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:08.848507 11535 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.849090 11535 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.837134 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:08.855927 11535 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:08.866115 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:23:08.867749 10949 leader_election.cc:343] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.872236 11179 tablet_bootstrap.cc:492] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:08.872707 11179 ts_tablet_manager.cc:1403] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.300s	user 0.006s	sys 0.011s
I20260709 12:23:08.876111 11177 tablet_bootstrap.cc:654] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.878616 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:08.879283 11056 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.865386 11097 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:08.885949 11537 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:08.885924 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:08.890332 11179 raft_consensus.cc:359] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.891110 11179 raft_consensus.cc:385] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.891400 11179 raft_consensus.cc:740] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.892019 11179 consensus_queue.cc:260] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:08.895762 11025 leader_election.cc:343] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:08.896734 11025 leader_election.cc:343] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.902223 11179 ts_tablet_manager.cc:1434] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 12:23:08.903308 11179 tablet_bootstrap.cc:492] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:08.904176 10979 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
W20260709 12:23:08.904994 10948 leader_election.cc:343] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.905418 10948 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:08.915357 11534 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.915934 11534 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.923084 11023 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:08.923859 10978 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:08.923969 11251 raft_consensus.cc:2804] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:08.912290 11540 raft_consensus.cc:2749] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:08.924613 11251 raft_consensus.cc:697] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:08.931841 11023 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:08.925599 11251 consensus_queue.cc:237] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.936453 11550 raft_consensus.cc:2804] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:08.937003 11550 raft_consensus.cc:697] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:08.943867 11255 consensus_queue.cc:1048] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:08.937814 11550 consensus_queue.cc:237] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:08.950793 11176 tablet_bootstrap.cc:654] T 6c233c491e1b4126b9d776bfd98023b6 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.952243 11534 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:08.958753 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:08.966862 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:08.962649 11255 consensus_queue.cc:1048] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:23:08.960541 10880 catalog_manager.cc:5697] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 0 to 1, leader changed from <none> to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:08.969497 10880 catalog_manager.cc:5697] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 0 to 1, leader changed from <none> to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:08.977821 11556 log.cc:927] Time spent T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:23:08.980767 11056 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:08.983168 11097 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:08.984074 11333 raft_consensus.cc:2749] T e8083bc5cbd34d98a24be9a390262c19 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:08.984530 10948 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
W20260709 12:23:08.989631 11559 log.cc:927] Time spent T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:23:08.991776 11177 tablet_bootstrap.cc:492] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:08.992287 11177 ts_tablet_manager.cc:1403] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.183s	user 0.012s	sys 0.007s
I20260709 12:23:08.987164 11545 raft_consensus.cc:2804] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.003528 11131 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.014324 11177 raft_consensus.cc:359] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.015074 11177 raft_consensus.cc:385] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.015375 11177 raft_consensus.cc:740] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.006796 11545 raft_consensus.cc:697] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:09.016635 11177 consensus_queue.cc:260] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.018589 11545 consensus_queue.cc:237] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.025014 11177 ts_tablet_manager.cc:1434] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:23:09.026041 11177 tablet_bootstrap.cc:492] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:09.036634 11179 tablet_bootstrap.cc:654] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.048449 10880 catalog_manager.cc:5697] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 0 to 1, leader changed from <none> to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:09.051491 10878 catalog_manager.cc:5697] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:09.055241 10878 catalog_manager.cc:5697] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:09.056833 11176 tablet_bootstrap.cc:492] T 6c233c491e1b4126b9d776bfd98023b6 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:09.057557 11176 ts_tablet_manager.cc:1403] T 6c233c491e1b4126b9d776bfd98023b6 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.213s	user 0.013s	sys 0.003s
I20260709 12:23:09.060487 11176 raft_consensus.cc:359] T 6c233c491e1b4126b9d776bfd98023b6 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.061966 11176 raft_consensus.cc:385] T 6c233c491e1b4126b9d776bfd98023b6 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.062359 11176 raft_consensus.cc:740] T 6c233c491e1b4126b9d776bfd98023b6 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.063061 11176 consensus_queue.cc:260] T 6c233c491e1b4126b9d776bfd98023b6 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.070364 11176 ts_tablet_manager.cc:1434] T 6c233c491e1b4126b9d776bfd98023b6 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 12:23:09.071461 11176 tablet_bootstrap.cc:492] T d2205be6a7c94913a366d683de188a31 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:09.073407 11177 tablet_bootstrap.cc:654] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.074368 11179 tablet_bootstrap.cc:492] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:09.074826 11179 ts_tablet_manager.cc:1403] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.172s	user 0.004s	sys 0.012s
I20260709 12:23:09.077339 11179 raft_consensus.cc:359] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.083002 11176 tablet_bootstrap.cc:654] T d2205be6a7c94913a366d683de188a31 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.077986 11179 raft_consensus.cc:385] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.092098 11177 tablet_bootstrap.cc:492] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:09.092461 11179 raft_consensus.cc:740] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.095597 11179 consensus_queue.cc:260] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.092592 11177 ts_tablet_manager.cc:1403] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.067s	user 0.005s	sys 0.017s
I20260709 12:23:09.098063 11179 ts_tablet_manager.cc:1434] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.023s	user 0.001s	sys 0.004s
I20260709 12:23:09.101960 11208 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.107160 11179 tablet_bootstrap.cc:492] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:09.106839 11208 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.109184 11208 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:09.100907 11177 raft_consensus.cc:359] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.110811 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:23:09.112350 11025 leader_election.cc:343] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.113974 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:09.110872 11177 raft_consensus.cc:385] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.114997 11179 tablet_bootstrap.cc:654] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.115065 11177 raft_consensus.cc:740] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.115931 11177 consensus_queue.cc:260] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.114652 10979 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
I20260709 12:23:09.118127 11177 ts_tablet_manager.cc:1434] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.000s
I20260709 12:23:09.118733 11023 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:09.119235 11176 tablet_bootstrap.cc:492] T d2205be6a7c94913a366d683de188a31 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:09.119429 11177 tablet_bootstrap.cc:492] T 2cdd07e6995141b68c257e6c93f15f2e P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:09.119699 11176 ts_tablet_manager.cc:1403] T d2205be6a7c94913a366d683de188a31 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.048s	user 0.023s	sys 0.012s
I20260709 12:23:09.119993 11208 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.120342 11208 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.120637 11208 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.126021 11177 tablet_bootstrap.cc:654] T 2cdd07e6995141b68c257e6c93f15f2e P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.129125 11208 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.132637 11176 raft_consensus.cc:359] T d2205be6a7c94913a366d683de188a31 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.133369 11176 raft_consensus.cc:385] T d2205be6a7c94913a366d683de188a31 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.136168 11176 raft_consensus.cc:740] T d2205be6a7c94913a366d683de188a31 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.136638 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:09.138231 10979 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.139777 11177 tablet_bootstrap.cc:492] T 2cdd07e6995141b68c257e6c93f15f2e P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:09.141983 11177 ts_tablet_manager.cc:1403] T 2cdd07e6995141b68c257e6c93f15f2e P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.008s
I20260709 12:23:09.145814 11179 tablet_bootstrap.cc:492] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:09.145470 11176 consensus_queue.cc:260] T d2205be6a7c94913a366d683de188a31 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.146327 11179 ts_tablet_manager.cc:1403] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.006s
I20260709 12:23:09.147619 11176 ts_tablet_manager.cc:1434] T d2205be6a7c94913a366d683de188a31 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:23:09.150339 10979 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:09.148180 11177 raft_consensus.cc:359] T 2cdd07e6995141b68c257e6c93f15f2e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.148898 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:09.151654 11177 raft_consensus.cc:385] T 2cdd07e6995141b68c257e6c93f15f2e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.151827 11131 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.151974 11177 raft_consensus.cc:740] T 2cdd07e6995141b68c257e6c93f15f2e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.151324 11208 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:09.152621 11179 raft_consensus.cc:359] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.153350 11179 raft_consensus.cc:385] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.153652 11179 raft_consensus.cc:740] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.153955 11550 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.152659 11177 consensus_queue.cc:260] T 2cdd07e6995141b68c257e6c93f15f2e P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.154446 11550 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.156390 11177 ts_tablet_manager.cc:1434] T 2cdd07e6995141b68c257e6c93f15f2e P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 12:23:09.156914 11179 consensus_queue.cc:260] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.157871 11023 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:09.159265 11179 ts_tablet_manager.cc:1434] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:23:09.158816 11131 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:09.158985 11531 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.165901 11531 raft_consensus.cc:697] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:09.166918 11531 consensus_queue.cc:237] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.160022 11177 tablet_bootstrap.cc:492] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:09.169744 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:09.170460 10980 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
I20260709 12:23:09.172395 11023 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:09.174554 11255 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.174954 11255 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.175279 11255 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.176473 11177 tablet_bootstrap.cc:654] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.178650 11381 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.179131 11381 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.156420 11550 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:09.184056 11179 tablet_bootstrap.cc:492] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:09.162801 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:09.188920 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:09.190765 11179 tablet_bootstrap.cc:654] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:09.190840 11025 leader_election.cc:343] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:09.191524 10948 leader_election.cc:343] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.196509 11177 tablet_bootstrap.cc:492] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:09.196986 11177 ts_tablet_manager.cc:1403] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.005s
I20260709 12:23:09.198971 11550 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.199512 11550 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.199673 11177 raft_consensus.cc:359] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.200374 11177 raft_consensus.cc:385] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.200644 11177 raft_consensus.cc:740] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.202250 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:09.202884 10980 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
I20260709 12:23:09.201279 11177 consensus_queue.cc:260] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.203956 11023 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:09.204694 11251 raft_consensus.cc:2804] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.205049 11251 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.205392 11251 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.206140 11177 ts_tablet_manager.cc:1434] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:23:09.207136 11177 tablet_bootstrap.cc:492] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb: Bootstrap starting.
I20260709 12:23:09.209432 11545 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.209956 11545 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.206303 11255 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.215093 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:09.211781 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:09.213443 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:09.212780 11545 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:09.207136 11176 tablet_bootstrap.cc:492] T 0a21734672b8441faae7b5d5d050d2b2 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:09.211135 11381 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:23:09.216723 10949 leader_election.cc:343] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:09.221791 10949 leader_election.cc:343] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.224660 10949 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:23:09.224901 10948 leader_election.cc:343] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.225298 10948 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:09.226938 11545 raft_consensus.cc:2749] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:09.223973 11177 tablet_bootstrap.cc:654] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.232841 11251 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.253404 11255 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:09.252915 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:09.271242 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:09.271454 10979 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.254769 11542 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:09.280779 11251 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:09.281243 10979 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:09.283387 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:09.267628 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:09.269950 11550 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:09.289685 11542 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.290638 11542 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.289772 10980 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.297015 11534 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.297729 11534 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.305063 11023 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:09.306054 11577 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.306851 11577 raft_consensus.cc:697] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:09.307690 11577 consensus_queue.cc:237] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.309427 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:09.314275 11177 tablet_bootstrap.cc:492] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb: No bootstrap required, opened a new log
I20260709 12:23:09.314793 11177 ts_tablet_manager.cc:1403] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb: Time spent bootstrapping tablet: real 0.108s	user 0.012s	sys 0.009s
I20260709 12:23:09.316697 11542 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:09.317870 11177 raft_consensus.cc:359] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.318619 11177 raft_consensus.cc:385] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.318883 11177 raft_consensus.cc:740] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.319619 11177 consensus_queue.cc:260] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.321787 11177 ts_tablet_manager.cc:1434] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:09.322288 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:23:09.323464 10949 leader_election.cc:343] T 2cdd07e6995141b68c257e6c93f15f2e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.324712 11534 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:09.325771 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:09.325979 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:23:09.328044 11025 leader_election.cc:343] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:09.329933 11025 leader_election.cc:343] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:09.331856 11025 leader_election.cc:343] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:09.332902 10948 leader_election.cc:343] T 2cdd07e6995141b68c257e6c93f15f2e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.333377 10948 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:09.334297 11391 raft_consensus.cc:2749] T 2cdd07e6995141b68c257e6c93f15f2e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:09.336005 10980 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:09.337126 11023 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:09.338191 11576 raft_consensus.cc:2804] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.338799 11576 raft_consensus.cc:697] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:09.340777 11176 tablet_bootstrap.cc:654] T 0a21734672b8441faae7b5d5d050d2b2 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.339772 11576 consensus_queue.cc:237] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.349150 11577 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.351979 11550 consensus_queue.cc:1048] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:09.351854 11577 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.356527 11577 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:09.357911 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:09.358528 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:09.359179 11130 raft_consensus.cc:2393] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 1: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:09.359223 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:09.360039 11055 raft_consensus.cc:2393] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 1: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:09.363946 11098 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:09.364675 11025 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:09.366367 10882 catalog_manager.cc:5697] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:09.367401 11531 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.370544 11577 consensus_queue.cc:1048] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:09.372974 11534 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.378748 11176 tablet_bootstrap.cc:492] T 0a21734672b8441faae7b5d5d050d2b2 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:09.379285 11176 ts_tablet_manager.cc:1403] T 0a21734672b8441faae7b5d5d050d2b2 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.172s	user 0.005s	sys 0.015s
I20260709 12:23:09.384238 11534 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:09.386747 11179 tablet_bootstrap.cc:492] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:09.387324 11179 ts_tablet_manager.cc:1403] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.203s	user 0.040s	sys 0.078s
I20260709 12:23:09.390506 11179 raft_consensus.cc:359] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.391245 11179 raft_consensus.cc:385] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.391644 11179 raft_consensus.cc:740] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.392282 11179 consensus_queue.cc:260] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.394089 11179 ts_tablet_manager.cc:1434] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 12:23:09.395067 11179 tablet_bootstrap.cc:492] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:09.397485 11531 raft_consensus.cc:2749] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:09.398820 11176 raft_consensus.cc:359] T 0a21734672b8441faae7b5d5d050d2b2 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.399550 11176 raft_consensus.cc:385] T 0a21734672b8441faae7b5d5d050d2b2 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.399832 11176 raft_consensus.cc:740] T 0a21734672b8441faae7b5d5d050d2b2 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.400519 11176 consensus_queue.cc:260] T 0a21734672b8441faae7b5d5d050d2b2 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.403141 11176 ts_tablet_manager.cc:1434] T 0a21734672b8441faae7b5d5d050d2b2 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 12:23:09.404196 11176 tablet_bootstrap.cc:492] T ad5b1fe8f9f246d791d03da03e5c44ee P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:09.406435 11179 tablet_bootstrap.cc:654] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.410037 11176 tablet_bootstrap.cc:654] T ad5b1fe8f9f246d791d03da03e5c44ee P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.414961 10882 catalog_manager.cc:5697] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:09.416958 11542 consensus_queue.cc:1048] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:09.416771 10882 catalog_manager.cc:5697] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:09.419343 11179 tablet_bootstrap.cc:492] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:09.419147 11325 consensus_queue.cc:1048] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:09.419829 11179 ts_tablet_manager.cc:1403] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.004s
I20260709 12:23:09.426491 11176 tablet_bootstrap.cc:492] T ad5b1fe8f9f246d791d03da03e5c44ee P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:09.427712 11176 ts_tablet_manager.cc:1403] T ad5b1fe8f9f246d791d03da03e5c44ee P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.004s
I20260709 12:23:09.430667 11179 raft_consensus.cc:359] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.432866 11179 raft_consensus.cc:385] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.433133 11179 raft_consensus.cc:740] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.433784 11179 consensus_queue.cc:260] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.436787 11179 ts_tablet_manager.cc:1434] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:23:09.437845 11179 tablet_bootstrap.cc:492] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:09.461014 11179 tablet_bootstrap.cc:654] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.460649 11550 consensus_queue.cc:1048] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:09.475236 11325 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.475770 11325 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.477733 11325 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:23:09.489836 10930 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:09.453521 11176 raft_consensus.cc:359] T ad5b1fe8f9f246d791d03da03e5c44ee P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:09.496315 10949 consensus_peers.cc:597] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb -> Peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Couldn't send request to peer 7518bdeb78f24e67a530754ae48547eb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:09.501295 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:09.495769 11125 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.512001 11179 tablet_bootstrap.cc:492] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:09.524286 11179 ts_tablet_manager.cc:1403] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.087s	user 0.017s	sys 0.029s
I20260709 12:23:09.523093 11176 raft_consensus.cc:385] T ad5b1fe8f9f246d791d03da03e5c44ee P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.496712 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:09.526865 11538 consensus_queue.cc:1048] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:09.511725 11542 consensus_queue.cc:1048] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:23:09.528327 11176 raft_consensus.cc:740] T ad5b1fe8f9f246d791d03da03e5c44ee P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.528918 11176 consensus_queue.cc:260] T ad5b1fe8f9f246d791d03da03e5c44ee P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:09.526957 10948 leader_election.cc:343] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.530848 11176 ts_tablet_manager.cc:1434] T ad5b1fe8f9f246d791d03da03e5c44ee P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.103s	user 0.004s	sys 0.010s
I20260709 12:23:09.531800 11176 tablet_bootstrap.cc:492] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:09.526970 11179 raft_consensus.cc:359] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.532955 11179 raft_consensus.cc:385] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.533262 11179 raft_consensus.cc:740] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.535934 11179 consensus_queue.cc:260] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:09.537148 10949 leader_election.cc:343] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.537611 10949 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:09.540498 11179 ts_tablet_manager.cc:1434] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:23:09.542157 11542 raft_consensus.cc:2749] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:09.542655 11179 tablet_bootstrap.cc:492] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:09.544282 11176 tablet_bootstrap.cc:654] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.533046 11251 consensus_queue.cc:1048] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:23:09.553155 11179 tablet_bootstrap.cc:654] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.570254 11542 consensus_queue.cc:1048] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:09.592005 11251 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.592615 11251 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.597013 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:09.597790 10983 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
I20260709 12:23:09.599306 11023 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:09.600411 11550 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.600813 11550 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.601137 11550 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.606988 11251 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:09.614576 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:23:09.621141 11025 leader_election.cc:343] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.649864 11255 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.650476 11255 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.651953 11179 tablet_bootstrap.cc:492] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:09.652468 11179 ts_tablet_manager.cc:1403] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.110s	user 0.029s	sys 0.026s
I20260709 12:23:09.653332 11255 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:09.656970 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:09.664551 11179 raft_consensus.cc:359] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.666790 11179 raft_consensus.cc:385] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.667086 11179 raft_consensus.cc:740] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.665349 10983 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
I20260709 12:23:09.669344 11251 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:09.670408 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:09.672775 11023 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:09.674237 11179 consensus_queue.cc:260] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.674419 11251 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.675727 11251 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.676134 11251 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:09.679677 11025 leader_election.cc:343] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.639566 11550 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.693044 11545 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.693488 11179 ts_tablet_manager.cc:1434] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 12:23:09.690166 11251 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.692020 11176 tablet_bootstrap.cc:492] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:09.693585 11545 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.694278 11176 ts_tablet_manager.cc:1403] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.163s	user 0.063s	sys 0.032s
I20260709 12:23:09.695955 11443 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.696286 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:09.697074 10983 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.696748 11443 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.711858 11255 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:09.712630 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:09.694254 11550 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:09.697995 11176 raft_consensus.cc:359] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.713593 11176 raft_consensus.cc:385] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.712177 11443 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:09.713934 11176 raft_consensus.cc:740] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.714612 11176 consensus_queue.cc:260] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.699316 11179 tablet_bootstrap.cc:492] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:09.716653 11176 ts_tablet_manager.cc:1434] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.000s
I20260709 12:23:09.717628 11176 tablet_bootstrap.cc:492] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:09.718835 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:09.721669 11098 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:09.722538 11443 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:09.723845 11176 tablet_bootstrap.cc:654] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.701049 11251 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:09.701792 11545 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:09.703047 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:09.704993 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:09.725929 11131 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.705427 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:09.708081 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:09.729444 10978 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.751550 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:09.752453 11055 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 0.
I20260709 12:23:09.756608 10983 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
W20260709 12:23:09.796401 11025 leader_election.cc:343] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.774613 10978 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:09.762759 11131 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:09.805073 10948 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:09.806453 11179 tablet_bootstrap.cc:654] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.808897 11023 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:09.810755 11531 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.811267 11531 raft_consensus.cc:697] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:09.817304 11023 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
W20260709 12:23:09.816547 10949 leader_election.cc:343] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.818172 11255 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.818719 11255 raft_consensus.cc:697] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:09.820210 11255 consensus_queue.cc:237] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.819473 11531 consensus_queue.cc:237] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.815649 11542 raft_consensus.cc:2804] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.827309 11542 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:09.853588 11025 consensus_peers.cc:597] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Couldn't send request to peer 7518bdeb78f24e67a530754ae48547eb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:09.833314 11542 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.933562 11176 tablet_bootstrap.cc:492] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:09.934183 11176 ts_tablet_manager.cc:1403] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.217s	user 0.025s	sys 0.013s
I20260709 12:23:09.936872 11176 raft_consensus.cc:359] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.937376 11179 tablet_bootstrap.cc:492] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:09.940233 11125 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.940510 11179 ts_tablet_manager.cc:1403] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.241s	user 0.011s	sys 0.006s
I20260709 12:23:09.940654 11255 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.941191 11255 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.943028 11255 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:09.943769 11179 raft_consensus.cc:359] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.944640 11179 raft_consensus.cc:385] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.944975 11179 raft_consensus.cc:740] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.944994 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:09.945778 11179 consensus_queue.cc:260] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.937539 11176 raft_consensus.cc:385] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.948168 11176 raft_consensus.cc:740] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.948963 11176 consensus_queue.cc:260] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.947456 11179 ts_tablet_manager.cc:1434] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:23:09.952095 11176 ts_tablet_manager.cc:1434] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.002s
I20260709 12:23:09.952229 11542 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:09.953167 11176 tablet_bootstrap.cc:492] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:09.953439 11251 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:23:09.956682 11025 leader_election.cc:343] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.957446 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:09.959863 11179 tablet_bootstrap.cc:492] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Bootstrap starting.
I20260709 12:23:09.961333 11542 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:09.964491 11125 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.966089 11179 tablet_bootstrap.cc:654] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.970395 11176 tablet_bootstrap.cc:654] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:10.009618 10949 leader_election.cc:343] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.013716 10879 catalog_manager.cc:5697] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.016536 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:10.017974 10978 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
I20260709 12:23:10.042399 11179 tablet_bootstrap.cc:492] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7: No bootstrap required, opened a new log
I20260709 12:23:10.017356 10879 catalog_manager.cc:5697] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.064324 11179 ts_tablet_manager.cc:1403] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent bootstrapping tablet: real 0.105s	user 0.015s	sys 0.002s
I20260709 12:23:10.070444 11179 raft_consensus.cc:359] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:10.071471 11179 raft_consensus.cc:385] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.071882 11179 raft_consensus.cc:740] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.072753 11179 consensus_queue.cc:260] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:10.076967 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:10.078073 11056 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.096710 11023 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:10.098512 11576 consensus_queue.cc:1048] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:10.101761 11576 raft_consensus.cc:2804] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.102411 11576 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.102780 11576 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.107903 11056 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:10.121724 11179 ts_tablet_manager.cc:1434] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.003s
I20260709 12:23:10.130180 11576 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:10.131953 10948 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:10.133215 11545 raft_consensus.cc:2804] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.133971 11545 raft_consensus.cc:697] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:10.135182 11545 consensus_queue.cc:237] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:10.138450 11176 tablet_bootstrap.cc:492] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:10.139200 11176 ts_tablet_manager.cc:1403] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.186s	user 0.008s	sys 0.007s
I20260709 12:23:10.142515 11176 raft_consensus.cc:359] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:10.143473 11176 raft_consensus.cc:385] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.143869 11176 raft_consensus.cc:740] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.144668 11176 consensus_queue.cc:260] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:10.148155 11176 ts_tablet_manager.cc:1434] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:23:10.149540 11176 tablet_bootstrap.cc:492] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:10.156533 11576 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:10.172699 11550 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:10.175890 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:10.176570 10980 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.186179 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:10.192495 11176 tablet_bootstrap.cc:654] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.192137 10878 catalog_manager.cc:5697] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 0 to 1, leader changed from <none> to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.196889 10980 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:10.198284 11495 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.198864 11495 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:10.204762 11495 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:10.218935 11023 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:10.219864 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:10.219959 11576 raft_consensus.cc:2804] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.222141 11576 raft_consensus.cc:697] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:10.223254 11576 consensus_queue.cc:237] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:10.226660 10980 raft_consensus.cc:2393] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 1: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:10.227559 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:10.233139 11098 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:10.241088 11443 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.256281 11443 raft_consensus.cc:2749] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:23:10.264673 11025 leader_election.cc:343] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.265698 11176 tablet_bootstrap.cc:492] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:10.266256 11176 ts_tablet_manager.cc:1403] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.117s	user 0.024s	sys 0.028s
I20260709 12:23:10.269424 11176 raft_consensus.cc:359] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:10.270294 11176 raft_consensus.cc:385] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.270654 11176 raft_consensus.cc:740] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.271396 11176 consensus_queue.cc:260] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:10.273142 11176 ts_tablet_manager.cc:1434] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:10.274257 11176 tablet_bootstrap.cc:492] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:10.281322 11176 tablet_bootstrap.cc:654] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.338881 10878 catalog_manager.cc:5697] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.346987 11550 consensus_queue.cc:1048] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:10.349377 11550 consensus_queue.cc:1048] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:10.352528 11176 tablet_bootstrap.cc:492] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:10.353048 11176 ts_tablet_manager.cc:1403] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.079s	user 0.024s	sys 0.045s
I20260709 12:23:10.357003 11176 raft_consensus.cc:359] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:10.357721 11176 raft_consensus.cc:385] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.358002 11176 raft_consensus.cc:740] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.358698 11176 consensus_queue.cc:260] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:10.360952 11176 ts_tablet_manager.cc:1434] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:23:10.363090 11176 tablet_bootstrap.cc:492] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:10.369761 11176 tablet_bootstrap.cc:654] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.376752 11176 tablet_bootstrap.cc:492] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:10.377115 11176 ts_tablet_manager.cc:1403] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.001s
I20260709 12:23:10.379421 11176 raft_consensus.cc:359] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:10.380156 11176 raft_consensus.cc:385] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.380477 11176 raft_consensus.cc:740] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.381237 11176 consensus_queue.cc:260] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:10.383435 11176 ts_tablet_manager.cc:1434] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:23:10.384990 11176 tablet_bootstrap.cc:492] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:10.390599 11176 tablet_bootstrap.cc:654] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.391356 11550 consensus_queue.cc:1048] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:10.402204 11176 tablet_bootstrap.cc:492] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:10.402716 11176 ts_tablet_manager.cc:1403] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.002s
I20260709 12:23:10.405634 11176 raft_consensus.cc:359] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:10.406352 11176 raft_consensus.cc:385] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.406647 11176 raft_consensus.cc:740] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.407349 11176 consensus_queue.cc:260] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:10.408778 11550 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.409308 11550 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:10.409873 11176 ts_tablet_manager.cc:1434] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:10.411046 11176 tablet_bootstrap.cc:492] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb: Bootstrap starting.
I20260709 12:23:10.411603 11550 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:10.417393 11176 tablet_bootstrap.cc:654] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.414001 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:10.419044 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:10.419519 11127 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
I20260709 12:23:10.419832 10982 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
I20260709 12:23:10.421068 11023 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:10.421847 11576 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.422273 11576 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.422595 11576 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.422796 11176 tablet_bootstrap.cc:492] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb: No bootstrap required, opened a new log
I20260709 12:23:10.423259 11176 ts_tablet_manager.cc:1403] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb: Time spent bootstrapping tablet: real 0.012s	user 0.005s	sys 0.006s
I20260709 12:23:10.426014 11176 raft_consensus.cc:359] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:10.426784 11176 raft_consensus.cc:385] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.427074 11176 raft_consensus.cc:740] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.427695 11176 consensus_queue.cc:260] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:10.429698 11176 ts_tablet_manager.cc:1434] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:10.435220 11550 consensus_queue.cc:1048] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:10.438169 11576 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:10.442200 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:10.442827 10979 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.454062 10979 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:10.454612 11576 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:10.455240 11023 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:10.455770 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:10.456386 11550 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.457007 11550 raft_consensus.cc:697] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:10.456447 11127 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.457935 11550 consensus_queue.cc:237] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:10.465961 11127 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:10.471240 10879 catalog_manager.cc:5697] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.506583 11443 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.507205 11443 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:10.510919 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:10.511811 10980 raft_consensus.cc:2393] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 1: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:10.514256 11443 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:10.515760 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:10.517177 11098 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:10.517989 11443 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.528478 11443 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:10.532860 11127 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:10.538442 10930 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:10.541309 11535 consensus_queue.cc:1048] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:10.541610 11443 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.542080 11443 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:10.544159 11443 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:10.545492 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:10.547266 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:10.553853 11098 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:10.554651 11495 raft_consensus.cc:2749] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:10.559650 11325 consensus_queue.cc:1048] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:10.576772 11550 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.577303 11550 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:10.579336 11550 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:10.580765 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:10.581513 10980 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
I20260709 12:23:10.580821 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:10.582598 11023 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:10.582789 11127 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 0.
I20260709 12:23:10.583283 11550 raft_consensus.cc:2804] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.584038 11550 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.584412 11550 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.595052 11550 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:10.598551 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:10.599239 10980 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.606695 11550 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:10.607892 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:10.608536 11127 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.615662 10980 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:10.616721 11023 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:10.617376 11550 raft_consensus.cc:2804] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.617812 11550 raft_consensus.cc:697] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:10.618829 11127 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:10.618876 11550 consensus_queue.cc:237] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:10.629702 10879 catalog_manager.cc:5697] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.675513 11550 consensus_queue.cc:1048] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:10.685357 11576 consensus_queue.cc:1048] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:10.725157 11127 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.977128 11576 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:10.990180 11255 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:11.115352  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:11.124223 11633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:11.148663 11636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:11.149593 11634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:11.151883  9799 server_base.cc:1061] running on GCE node
I20260709 12:23:11.153209  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:11.153432  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:11.153620  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783599791153603 us; error 0 us; skew 500 ppm
I20260709 12:23:11.154496  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:11.158339  9799 webserver.cc:533] Webserver started at http://127.9.145.196:36665/ using document root <none> and password file <none>
I20260709 12:23:11.159087  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:11.159386  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:11.159796  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:11.161469  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-3-root/instance:
uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
format_stamp: "Formatted at 2026-07-09 12:23:11 on dist-test-slave-1sdq"
I20260709 12:23:11.168522 11255 consensus_queue.cc:1048] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.170013  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:23:11.176335 11642 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:11.178799  9799 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.000s
I20260709 12:23:11.179140  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-3-root
uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
format_stamp: "Formatted at 2026-07-09 12:23:11 on dist-test-slave-1sdq"
I20260709 12:23:11.179457  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:11.190158 11577 consensus_queue.cc:1048] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:11.211660  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:11.213600  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:11.215454  9799 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:11.218441  9799 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:11.218698  9799 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:11.218972  9799 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:11.219149  9799 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:11.292094  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.196:42197
I20260709 12:23:11.292249 11705 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.196:42197 every 8 connection(s)
I20260709 12:23:11.301558  9799 auto_leader_rebalancer-test.cc:439] add a tserver: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:11.322474 11706 heartbeater.cc:344] Connected to a master server at 127.9.145.254:35687
I20260709 12:23:11.323009 11706 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:11.323992 11706 heartbeater.cc:507] Master 127.9.145.254:35687 requested a full tablet report, sending...
I20260709 12:23:11.326942 10879 ts_manager.cc:194] Registered new tserver with Master: 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:11.328738 10879 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39956
I20260709 12:23:11.613762 11055 consensus_queue.cc:237] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:11.620738 10980 raft_consensus.cc:1275] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:11.621385 11127 raft_consensus.cc:1275] T a84c56f62e0a4a9990f4969bc324dd7e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:11.622964 11550 consensus_queue.cc:1048] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:11.628448 11576 consensus_queue.cc:1048] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:11.642504 11550 raft_consensus.cc:2955] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
W20260709 12:23:11.646291 11024 consensus_peers.cc:597] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a84c56f62e0a4a9990f4969bc324dd7e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:11.647132 11125 raft_consensus.cc:2955] T a84c56f62e0a4a9990f4969bc324dd7e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:11.648059 10980 raft_consensus.cc:2955] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:11.668743 10879 catalog_manager.cc:5697] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:11.687474 11125 consensus_queue.cc:237] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:11.718591 11059 raft_consensus.cc:1275] T d10de3c352ba4d7c805da1ea559bfcb5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:11.721673 11625 consensus_queue.cc:1048] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:11.730252 10980 raft_consensus.cc:1275] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:11.732021 11625 consensus_queue.cc:1048] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:11.735474 11098 consensus_peers.cc:597] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d10de3c352ba4d7c805da1ea559bfcb5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:11.740509 11625 raft_consensus.cc:2955] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:11.741807 10980 raft_consensus.cc:2955] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:11.785735 11059 raft_consensus.cc:2955] T d10de3c352ba4d7c805da1ea559bfcb5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:11.789273 11125 consensus_queue.cc:237] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:11.794799 10879 catalog_manager.cc:5697] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:11.811506 10979 raft_consensus.cc:1275] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:11.813274 11059 raft_consensus.cc:1275] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:11.815104 11625 consensus_queue.cc:1048] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:11.815943 11495 consensus_queue.cc:1048] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:11.818897 11098 consensus_peers.cc:597] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8390bc6d251348e398da3cb9bee4bd2c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:11.831350 11495 raft_consensus.cc:2955] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:11.834180 11059 raft_consensus.cc:2955] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:11.836462 10979 raft_consensus.cc:2955] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:11.849099 10879 catalog_manager.cc:5697] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:11.863529 10980 consensus_queue.cc:237] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:11.873741 11127 raft_consensus.cc:1275] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:11.875106 11055 raft_consensus.cc:1275] T 49ef051819cd4f229ac2b37858ee3db5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:11.875483 11710 consensus_queue.cc:1048] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:11.877418 11710 consensus_queue.cc:1048] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:11.885511 10948 consensus_peers.cc:597] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 49ef051819cd4f229ac2b37858ee3db5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:11.886471 11542 raft_consensus.cc:2955] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:11.888170 11127 raft_consensus.cc:2955] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:11.890341 11055 raft_consensus.cc:2955] T 49ef051819cd4f229ac2b37858ee3db5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:11.906984 10878 catalog_manager.cc:5697] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.144254 11739 ts_tablet_manager.cc:933] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:12.148852 11739 tablet_copy_client.cc:323] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.194:44483
I20260709 12:23:12.162967 11070 tablet_copy_service.cc:140] P c979ef00e0ad4157b49ebbdc13ce7cd7: Received BeginTabletCopySession request for tablet a84c56f62e0a4a9990f4969bc324dd7e from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:52804)
I20260709 12:23:12.163606 11070 tablet_copy_service.cc:161] P c979ef00e0ad4157b49ebbdc13ce7cd7: Beginning new tablet copy session on tablet a84c56f62e0a4a9990f4969bc324dd7e from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:52804: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-a84c56f62e0a4a9990f4969bc324dd7e
I20260709 12:23:12.172602 11070 tablet_copy_source_session.cc:215] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:12.176666 11739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a84c56f62e0a4a9990f4969bc324dd7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.193742 11739 tablet_copy_client.cc:806] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:12.194512 11739 tablet_copy_client.cc:670] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:12.198799 11739 tablet_copy_client.cc:538] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:12.209057 11739 tablet_bootstrap.cc:492] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:12.238018 11739 tablet_bootstrap.cc:492] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:12.239050 11739 tablet_bootstrap.cc:492] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:12.239742 11739 ts_tablet_manager.cc:1403] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.031s	user 0.027s	sys 0.004s
I20260709 12:23:12.242601 11739 raft_consensus.cc:359] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:12.243463 11739 raft_consensus.cc:740] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:12.244560 11739 consensus_queue.cc:260] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:12.255441 11706 heartbeater.cc:499] Master 127.9.145.254:35687 was elected leader, sending a full tablet report...
I20260709 12:23:12.256172 11739 ts_tablet_manager.cc:1434] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.008s
I20260709 12:23:12.259064 11745 ts_tablet_manager.cc:933] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:12.261821 11070 tablet_copy_service.cc:342] P c979ef00e0ad4157b49ebbdc13ce7cd7: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-a84c56f62e0a4a9990f4969bc324dd7e received from {username='slave'} at 127.0.0.1:52804
I20260709 12:23:12.262436 11070 tablet_copy_service.cc:434] P c979ef00e0ad4157b49ebbdc13ce7cd7: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-a84c56f62e0a4a9990f4969bc324dd7e on tablet a84c56f62e0a4a9990f4969bc324dd7e with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:12.274305 11745 tablet_copy_client.cc:323] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.195:42537
I20260709 12:23:12.281453 11739 ts_tablet_manager.cc:933] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
I20260709 12:23:12.283176 11739 tablet_copy_client.cc:323] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.193:46777
I20260709 12:23:12.288213 11144 tablet_copy_service.cc:140] P 7518bdeb78f24e67a530754ae48547eb: Received BeginTabletCopySession request for tablet d10de3c352ba4d7c805da1ea559bfcb5 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:58414)
I20260709 12:23:12.288843 11144 tablet_copy_service.cc:161] P 7518bdeb78f24e67a530754ae48547eb: Beginning new tablet copy session on tablet d10de3c352ba4d7c805da1ea559bfcb5 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:58414: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-d10de3c352ba4d7c805da1ea559bfcb5
I20260709 12:23:12.297127 11144 tablet_copy_source_session.cc:215] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:12.300374 11750 ts_tablet_manager.cc:933] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:12.301411 11745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d10de3c352ba4d7c805da1ea559bfcb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.309082 11750 tablet_copy_client.cc:323] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.195:42537
I20260709 12:23:12.310967 11144 tablet_copy_service.cc:140] P 7518bdeb78f24e67a530754ae48547eb: Received BeginTabletCopySession request for tablet 8390bc6d251348e398da3cb9bee4bd2c from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:58414)
I20260709 12:23:12.311564 11144 tablet_copy_service.cc:161] P 7518bdeb78f24e67a530754ae48547eb: Beginning new tablet copy session on tablet 8390bc6d251348e398da3cb9bee4bd2c from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:58414: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-8390bc6d251348e398da3cb9bee4bd2c
I20260709 12:23:12.319238 11144 tablet_copy_source_session.cc:215] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:12.322911 11750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8390bc6d251348e398da3cb9bee4bd2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.340351 11750 tablet_copy_client.cc:806] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:12.340948 11750 tablet_copy_client.cc:670] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:12.345162 11750 tablet_copy_client.cc:538] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:12.353283 11745 tablet_copy_client.cc:806] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:12.353914 11745 tablet_copy_client.cc:670] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:12.354179 11750 tablet_bootstrap.cc:492] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:12.359401 11745 tablet_copy_client.cc:538] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:12.363039 10994 tablet_copy_service.cc:140] P bc01179655564f29b83babe396377cbb: Received BeginTabletCopySession request for tablet 49ef051819cd4f229ac2b37858ee3db5 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:60928)
I20260709 12:23:12.363667 10994 tablet_copy_service.cc:161] P bc01179655564f29b83babe396377cbb: Beginning new tablet copy session on tablet 49ef051819cd4f229ac2b37858ee3db5 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:60928: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-49ef051819cd4f229ac2b37858ee3db5
I20260709 12:23:12.371130 11745 tablet_bootstrap.cc:492] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:12.383847 11750 tablet_bootstrap.cc:492] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:12.384758 11750 tablet_bootstrap.cc:492] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:12.385468 11750 ts_tablet_manager.cc:1403] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.032s	user 0.026s	sys 0.003s
I20260709 12:23:12.388496 11750 raft_consensus.cc:359] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:12.389334 11750 raft_consensus.cc:740] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:12.389969 11750 consensus_queue.cc:260] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:12.395141 11750 ts_tablet_manager.cc:1434] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:23:12.397409 11144 tablet_copy_service.cc:342] P 7518bdeb78f24e67a530754ae48547eb: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-8390bc6d251348e398da3cb9bee4bd2c received from {username='slave'} at 127.0.0.1:58414
I20260709 12:23:12.397884 11144 tablet_copy_service.cc:434] P 7518bdeb78f24e67a530754ae48547eb: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-8390bc6d251348e398da3cb9bee4bd2c on tablet 8390bc6d251348e398da3cb9bee4bd2c with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:12.408836 11745 tablet_bootstrap.cc:492] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:12.409811 11745 tablet_bootstrap.cc:492] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:12.411621 11745 ts_tablet_manager.cc:1403] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.041s	user 0.021s	sys 0.008s
I20260709 12:23:12.415169 11745 raft_consensus.cc:359] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:12.415917 11745 raft_consensus.cc:740] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:12.416532 11745 consensus_queue.cc:260] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:12.419044 11745 ts_tablet_manager.cc:1434] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:23:12.420433 10994 tablet_copy_source_session.cc:215] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:12.420972 11144 tablet_copy_service.cc:342] P 7518bdeb78f24e67a530754ae48547eb: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-d10de3c352ba4d7c805da1ea559bfcb5 received from {username='slave'} at 127.0.0.1:58414
I20260709 12:23:12.421485 11144 tablet_copy_service.cc:434] P 7518bdeb78f24e67a530754ae48547eb: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-d10de3c352ba4d7c805da1ea559bfcb5 on tablet d10de3c352ba4d7c805da1ea559bfcb5 with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:12.424531 11739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49ef051819cd4f229ac2b37858ee3db5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.448973 11739 tablet_copy_client.cc:806] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:12.449630 11739 tablet_copy_client.cc:670] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:12.453589 11739 tablet_copy_client.cc:538] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:12.463302 11739 tablet_bootstrap.cc:492] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:12.484025 11739 tablet_bootstrap.cc:492] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:12.485004 11739 tablet_bootstrap.cc:492] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:12.485743 11739 ts_tablet_manager.cc:1403] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.023s	user 0.020s	sys 0.001s
I20260709 12:23:12.489009 11739 raft_consensus.cc:359] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:12.489933 11739 raft_consensus.cc:740] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:12.490712 11739 consensus_queue.cc:260] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:12.493571 11739 ts_tablet_manager.cc:1434] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:23:12.495798 10994 tablet_copy_service.cc:342] P bc01179655564f29b83babe396377cbb: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-49ef051819cd4f229ac2b37858ee3db5 received from {username='slave'} at 127.0.0.1:60928
I20260709 12:23:12.496299 10994 tablet_copy_service.cc:434] P bc01179655564f29b83babe396377cbb: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-49ef051819cd4f229ac2b37858ee3db5 on tablet 49ef051819cd4f229ac2b37858ee3db5 with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:12.696530 11681 raft_consensus.cc:1217] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:12.772315 11681 raft_consensus.cc:1217] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:12.814345 11681 raft_consensus.cc:1217] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:12.856554 11681 raft_consensus.cc:1217] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:13.177788 11757 raft_consensus.cc:1064] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:23:13.180730 11757 consensus_queue.cc:237] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:13.194854 11055 raft_consensus.cc:1275] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:13.196767 11757 consensus_queue.cc:1048] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:13.197054 10979 raft_consensus.cc:1275] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:13.197413 11681 raft_consensus.cc:1275] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:13.198864 11757 consensus_queue.cc:1048] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:13.199954 11756 consensus_queue.cc:1048] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:13.209779 11535 raft_consensus.cc:1064] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:23:13.213845 11535 consensus_queue.cc:237] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:13.232399 11680 raft_consensus.cc:1275] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:13.232576 11059 raft_consensus.cc:1275] T 49ef051819cd4f229ac2b37858ee3db5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:13.234285 11710 consensus_queue.cc:1048] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:13.236053 11125 raft_consensus.cc:1275] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:13.236781 11738 consensus_queue.cc:1048] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:13.240871 11535 consensus_queue.cc:1048] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:13.247421 11495 raft_consensus.cc:2955] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.251735 10979 raft_consensus.cc:2955] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.276969 11681 raft_consensus.cc:2955] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.285832 10878 catalog_manager.cc:5697] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.286362 11710 raft_consensus.cc:2955] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.290545 11056 raft_consensus.cc:2955] T 49ef051819cd4f229ac2b37858ee3db5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.310138 11550 raft_consensus.cc:1064] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:23:13.309790 11125 raft_consensus.cc:2955] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.305373 11681 raft_consensus.cc:2955] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.314572 10880 catalog_manager.cc:5697] T 49ef051819cd4f229ac2b37858ee3db5 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.319375 11550 consensus_queue.cc:237] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:13.335130 11055 raft_consensus.cc:2955] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.358232 11755 raft_consensus.cc:1064] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:23:13.361137 11755 consensus_queue.cc:237] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:13.373345 11681 raft_consensus.cc:1275] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:13.374881 11576 consensus_queue.cc:1048] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:13.384018 10979 raft_consensus.cc:1275] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:13.385875 11576 consensus_queue.cc:1048] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:13.393821 10982 raft_consensus.cc:1275] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:13.408036 11756 consensus_queue.cc:1048] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:13.408852 11125 consensus_queue.cc:237] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:13.413246 11059 raft_consensus.cc:1275] T d10de3c352ba4d7c805da1ea559bfcb5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:13.422906 11127 raft_consensus.cc:1275] T a84c56f62e0a4a9990f4969bc324dd7e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:13.424106 11756 consensus_queue.cc:1048] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:13.426009 10979 consensus_queue.cc:237] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:13.427578 11681 raft_consensus.cc:1275] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:13.431843 11056 raft_consensus.cc:1275] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:13.438457 11679 raft_consensus.cc:1275] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:13.440173 11763 consensus_queue.cc:1048] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:13.432680 11757 consensus_queue.cc:1048] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:23:13.449644 11738 raft_consensus.cc:2955] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.451159 11681 raft_consensus.cc:1275] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:13.455410 11127 raft_consensus.cc:1275] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:13.456245 11576 consensus_queue.cc:1048] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:13.461992 11710 consensus_queue.cc:1048] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:13.461460 11576 raft_consensus.cc:2955] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.454876 11680 raft_consensus.cc:2955] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.471999 11679 raft_consensus.cc:2955] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.460999 11755 consensus_queue.cc:1048] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
W20260709 12:23:13.505517 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 46617.6us
I20260709 12:23:13.522377 11757 consensus_queue.cc:1048] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:23:13.550340 10880 catalog_manager.cc:5697] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:13.570899 11495 raft_consensus.cc:2955] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.599025 11125 raft_consensus.cc:2955] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.608047 10866 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 49ef051819cd4f229ac2b37858ee3db5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:13.612226 10882 catalog_manager.cc:5697] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb reported cstate change: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:13.611126 11054 raft_consensus.cc:2955] T d10de3c352ba4d7c805da1ea559bfcb5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.531023 10982 raft_consensus.cc:2955] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.651289 11127 raft_consensus.cc:2955] T a84c56f62e0a4a9990f4969bc324dd7e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.655797 11047 tablet_service.cc:1558] Processing DeleteTablet for tablet 49ef051819cd4f229ac2b37858ee3db5 with delete_type TABLET_DATA_TOMBSTONED (TS c979ef00e0ad4157b49ebbdc13ce7cd7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41292
W20260709 12:23:13.683087 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 78678.7us
I20260709 12:23:13.685655 11059 consensus_queue.cc:237] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:13.688818 11789 tablet_replica.cc:333] T 49ef051819cd4f229ac2b37858ee3db5 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
W20260709 12:23:13.692159 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 97170.4us
I20260709 12:23:13.695788 11681 raft_consensus.cc:1275] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:13.706049 10979 raft_consensus.cc:1275] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:13.709062 11576 consensus_queue.cc:1048] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:13.709947 10980 raft_consensus.cc:2955] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.717738 11576 consensus_queue.cc:1048] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:13.723515 11780 raft_consensus.cc:2955] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.732124 10878 catalog_manager.cc:5697] T d10de3c352ba4d7c805da1ea559bfcb5 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.734294 11681 raft_consensus.cc:2955] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.735773 11789 raft_consensus.cc:2243] T 49ef051819cd4f229ac2b37858ee3db5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:13.738991 11789 raft_consensus.cc:2272] T 49ef051819cd4f229ac2b37858ee3db5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:13.741133 10980 raft_consensus.cc:2955] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.745502 10867 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a84c56f62e0a4a9990f4969bc324dd7e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:13.779095 11756 raft_consensus.cc:2955] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.785161 10879 catalog_manager.cc:5697] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:13.798882 11059 raft_consensus.cc:2955] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.799109 11680 raft_consensus.cc:2955] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.804095 11121 tablet_service.cc:1558] Processing DeleteTablet for tablet a84c56f62e0a4a9990f4969bc324dd7e with delete_type TABLET_DATA_TOMBSTONED (TS 7518bdeb78f24e67a530754ae48547eb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36562
I20260709 12:23:13.814898 11681 raft_consensus.cc:2955] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.816624 11789 ts_tablet_manager.cc:1916] T 49ef051819cd4f229ac2b37858ee3db5 P c979ef00e0ad4157b49ebbdc13ce7cd7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:13.831626 10868 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8390bc6d251348e398da3cb9bee4bd2c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:13.840274 11790 tablet_replica.cc:333] T a84c56f62e0a4a9990f4969bc324dd7e P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:23:13.846123 11790 raft_consensus.cc:2243] T a84c56f62e0a4a9990f4969bc324dd7e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:13.846992 11790 raft_consensus.cc:2272] T a84c56f62e0a4a9990f4969bc324dd7e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:13.854566 11789 ts_tablet_manager.cc:1929] T 49ef051819cd4f229ac2b37858ee3db5 P c979ef00e0ad4157b49ebbdc13ce7cd7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:13.857115 11790 ts_tablet_manager.cc:1916] T a84c56f62e0a4a9990f4969bc324dd7e P 7518bdeb78f24e67a530754ae48547eb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:13.849542 11132 consensus_queue.cc:237] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:13.857616 11789 log.cc:1199] T 49ef051819cd4f229ac2b37858ee3db5 P c979ef00e0ad4157b49ebbdc13ce7cd7: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-1-root/wals/49ef051819cd4f229ac2b37858ee3db5
I20260709 12:23:13.843494 10882 catalog_manager.cc:5697] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.862491 10867 catalog_manager.cc:5028] TS c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): tablet 49ef051819cd4f229ac2b37858ee3db5 (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:23:13.869191 10982 raft_consensus.cc:1275] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:13.869462 11681 raft_consensus.cc:1275] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:13.872007 11788 consensus_queue.cc:1048] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:13.874352 11755 consensus_queue.cc:1048] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:13.875177 10969 tablet_service.cc:1558] Processing DeleteTablet for tablet 8390bc6d251348e398da3cb9bee4bd2c with delete_type TABLET_DATA_TOMBSTONED (TS bc01179655564f29b83babe396377cbb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52810
I20260709 12:23:13.875792 11790 ts_tablet_manager.cc:1929] T a84c56f62e0a4a9990f4969bc324dd7e P 7518bdeb78f24e67a530754ae48547eb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:13.876267 11790 log.cc:1199] T a84c56f62e0a4a9990f4969bc324dd7e P 7518bdeb78f24e67a530754ae48547eb: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-2-root/wals/a84c56f62e0a4a9990f4969bc324dd7e
I20260709 12:23:13.878302 10868 catalog_manager.cc:5028] TS 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): tablet a84c56f62e0a4a9990f4969bc324dd7e (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:23:13.881723 11787 raft_consensus.cc:2955] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.884101 11681 raft_consensus.cc:2955] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.890795 10980 raft_consensus.cc:2955] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:13.895292 10868 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d10de3c352ba4d7c805da1ea559bfcb5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:13.916189 11791 tablet_replica.cc:333] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:23:13.916013 10880 catalog_manager.cc:5697] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:13.917541 11791 raft_consensus.cc:2243] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:13.918422 11791 raft_consensus.cc:2272] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:13.921525 11791 ts_tablet_manager.cc:1916] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:13.927721 11047 tablet_service.cc:1558] Processing DeleteTablet for tablet d10de3c352ba4d7c805da1ea559bfcb5 with delete_type TABLET_DATA_TOMBSTONED (TS c979ef00e0ad4157b49ebbdc13ce7cd7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41292
I20260709 12:23:13.928949 11789 tablet_replica.cc:333] T d10de3c352ba4d7c805da1ea559bfcb5 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:23:13.929783 11789 raft_consensus.cc:2243] T d10de3c352ba4d7c805da1ea559bfcb5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:13.930524 11789 raft_consensus.cc:2272] T d10de3c352ba4d7c805da1ea559bfcb5 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:13.934532 11789 ts_tablet_manager.cc:1916] T d10de3c352ba4d7c805da1ea559bfcb5 P c979ef00e0ad4157b49ebbdc13ce7cd7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:13.938241 11791 ts_tablet_manager.cc:1929] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:13.938650 11791 log.cc:1199] T 8390bc6d251348e398da3cb9bee4bd2c P bc01179655564f29b83babe396377cbb: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-0-root/wals/8390bc6d251348e398da3cb9bee4bd2c
I20260709 12:23:13.940037 10866 catalog_manager.cc:5028] TS bc01179655564f29b83babe396377cbb (127.9.145.193:46777): tablet 8390bc6d251348e398da3cb9bee4bd2c (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:23:13.946254 11789 ts_tablet_manager.cc:1929] T d10de3c352ba4d7c805da1ea559bfcb5 P c979ef00e0ad4157b49ebbdc13ce7cd7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:13.946743 11789 log.cc:1199] T d10de3c352ba4d7c805da1ea559bfcb5 P c979ef00e0ad4157b49ebbdc13ce7cd7: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-1-root/wals/d10de3c352ba4d7c805da1ea559bfcb5
I20260709 12:23:13.948175 10867 catalog_manager.cc:5028] TS c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): tablet d10de3c352ba4d7c805da1ea559bfcb5 (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:23:14.999979 10982 consensus_queue.cc:237] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:15.007026 11129 raft_consensus.cc:1275] T e8083bc5cbd34d98a24be9a390262c19 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:15.008057 10948 consensus_peers.cc:597] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e8083bc5cbd34d98a24be9a390262c19. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:15.008234 11059 raft_consensus.cc:1275] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:15.009159 11779 consensus_queue.cc:1048] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:15.010130 11792 consensus_queue.cc:1048] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:15.020264 11778 raft_consensus.cc:2955] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:15.022629 11129 raft_consensus.cc:2955] T e8083bc5cbd34d98a24be9a390262c19 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:15.029461 11059 raft_consensus.cc:2955] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:15.045593 11054 consensus_queue.cc:237] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:15.055811 11129 raft_consensus.cc:1275] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:15.056123 11024 consensus_peers.cc:597] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0bb096cdb35c45e785fda6900a7999f7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:15.057348 10982 raft_consensus.cc:1275] T 0bb096cdb35c45e785fda6900a7999f7 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:15.058202 11255 consensus_queue.cc:1048] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:15.053406 10882 catalog_manager.cc:5697] T e8083bc5cbd34d98a24be9a390262c19 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:15.060994 11255 consensus_queue.cc:1048] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:15.071137 11798 raft_consensus.cc:2955] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:15.074864 11129 raft_consensus.cc:2955] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:15.086128 10982 raft_consensus.cc:2955] T 0bb096cdb35c45e785fda6900a7999f7 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:15.091219 10983 consensus_queue.cc:237] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:15.126076 11129 raft_consensus.cc:1275] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:15.126281 11053 raft_consensus.cc:1275] T 1e22af520a9e4eb795f4a0e920b05a3b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:15.126425 10948 consensus_peers.cc:597] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1e22af520a9e4eb795f4a0e920b05a3b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:15.127748 11778 consensus_queue.cc:1048] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:15.129314 11792 consensus_queue.cc:1048] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:15.145447 11779 raft_consensus.cc:2955] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:15.147137 11129 raft_consensus.cc:2955] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:15.138751 10880 catalog_manager.cc:5697] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:15.164114 11053 raft_consensus.cc:2955] T 1e22af520a9e4eb795f4a0e920b05a3b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:15.168851 11132 consensus_queue.cc:237] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:15.180991 11054 raft_consensus.cc:1275] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:15.187516 10983 raft_consensus.cc:1275] T 1d0463b3e1c746218d71d6d8eb843dc8 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:15.187649 11728 consensus_queue.cc:1048] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:23:15.191649 11756 consensus_queue.cc:1048] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:23:15.192767 11098 consensus_peers.cc:597] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d0463b3e1c746218d71d6d8eb843dc8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:15.188907 10882 catalog_manager.cc:5697] T 1e22af520a9e4eb795f4a0e920b05a3b P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:15.214819 11796 raft_consensus.cc:2955] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:15.217160 11054 raft_consensus.cc:2955] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:15.238786 10882 catalog_manager.cc:5697] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:15.260334 10983 raft_consensus.cc:2955] T 1d0463b3e1c746218d71d6d8eb843dc8 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:15.609230 11816 ts_tablet_manager.cc:933] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
I20260709 12:23:15.611105 11816 tablet_copy_client.cc:323] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.193:46777
I20260709 12:23:15.612664 10994 tablet_copy_service.cc:140] P bc01179655564f29b83babe396377cbb: Received BeginTabletCopySession request for tablet e8083bc5cbd34d98a24be9a390262c19 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:60928)
I20260709 12:23:15.613124 10994 tablet_copy_service.cc:161] P bc01179655564f29b83babe396377cbb: Beginning new tablet copy session on tablet e8083bc5cbd34d98a24be9a390262c19 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:60928: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-e8083bc5cbd34d98a24be9a390262c19
I20260709 12:23:15.620062 10994 tablet_copy_source_session.cc:215] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:15.623777 11816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8083bc5cbd34d98a24be9a390262c19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:15.625000 11818 ts_tablet_manager.cc:933] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:15.634131 11818 tablet_copy_client.cc:323] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.194:44483
I20260709 12:23:15.635933 11070 tablet_copy_service.cc:140] P c979ef00e0ad4157b49ebbdc13ce7cd7: Received BeginTabletCopySession request for tablet 0bb096cdb35c45e785fda6900a7999f7 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:52804)
I20260709 12:23:15.636508 11070 tablet_copy_service.cc:161] P c979ef00e0ad4157b49ebbdc13ce7cd7: Beginning new tablet copy session on tablet 0bb096cdb35c45e785fda6900a7999f7 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:52804: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-0bb096cdb35c45e785fda6900a7999f7
I20260709 12:23:15.644008 11070 tablet_copy_source_session.cc:215] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:15.647975 11818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bb096cdb35c45e785fda6900a7999f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:15.671795 11816 tablet_copy_client.cc:806] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:15.678313 11816 tablet_copy_client.cc:670] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:15.683367 11816 tablet_copy_client.cc:538] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:15.690527 11818 tablet_copy_client.cc:806] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:15.694888 11820 ts_tablet_manager.cc:933] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:15.695705 11816 tablet_bootstrap.cc:492] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:15.691162 11818 tablet_copy_client.cc:670] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:15.703526 11820 tablet_copy_client.cc:323] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.195:42537
I20260709 12:23:15.706049 11144 tablet_copy_service.cc:140] P 7518bdeb78f24e67a530754ae48547eb: Received BeginTabletCopySession request for tablet 1d0463b3e1c746218d71d6d8eb843dc8 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:58414)
I20260709 12:23:15.706653 11144 tablet_copy_service.cc:161] P 7518bdeb78f24e67a530754ae48547eb: Beginning new tablet copy session on tablet 1d0463b3e1c746218d71d6d8eb843dc8 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:58414: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-1d0463b3e1c746218d71d6d8eb843dc8
I20260709 12:23:15.706802 11818 tablet_copy_client.cc:538] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:15.719139 11818 tablet_bootstrap.cc:492] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:15.719875 11144 tablet_copy_source_session.cc:215] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:15.729660 11820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d0463b3e1c746218d71d6d8eb843dc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:15.735690 11822 ts_tablet_manager.cc:933] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
I20260709 12:23:15.750000 11820 tablet_copy_client.cc:806] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:15.750706 11820 tablet_copy_client.cc:670] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:15.753684 11822 tablet_copy_client.cc:323] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.193:46777
I20260709 12:23:15.755395 11820 tablet_copy_client.cc:538] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:15.755698 10994 tablet_copy_service.cc:140] P bc01179655564f29b83babe396377cbb: Received BeginTabletCopySession request for tablet 1e22af520a9e4eb795f4a0e920b05a3b from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:60928)
I20260709 12:23:15.756244 10994 tablet_copy_service.cc:161] P bc01179655564f29b83babe396377cbb: Beginning new tablet copy session on tablet 1e22af520a9e4eb795f4a0e920b05a3b from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:60928: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-1e22af520a9e4eb795f4a0e920b05a3b
I20260709 12:23:15.765693 11820 tablet_bootstrap.cc:492] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:15.767383 11816 tablet_bootstrap.cc:492] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:15.775586 10994 tablet_copy_source_session.cc:215] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:15.783845 11816 tablet_bootstrap.cc:492] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:15.784739 11816 ts_tablet_manager.cc:1403] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.089s	user 0.013s	sys 0.015s
I20260709 12:23:15.788223 11816 raft_consensus.cc:359] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:15.791085 11822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e22af520a9e4eb795f4a0e920b05a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:15.854209 11816 raft_consensus.cc:740] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:15.860481 11816 consensus_queue.cc:260] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:15.865509 11818 tablet_bootstrap.cc:492] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:15.865693 11820 tablet_bootstrap.cc:492] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:15.888748 11820 tablet_bootstrap.cc:492] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:15.889542 11820 ts_tablet_manager.cc:1403] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.124s	user 0.030s	sys 0.020s
I20260709 12:23:15.892769 11820 raft_consensus.cc:359] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:15.893759 11820 raft_consensus.cc:740] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:15.894484 11820 consensus_queue.cc:260] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:15.895713 11816 ts_tablet_manager.cc:1434] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.111s	user 0.002s	sys 0.008s
I20260709 12:23:15.896956 11820 ts_tablet_manager.cc:1434] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:23:15.898780 11144 tablet_copy_service.cc:342] P 7518bdeb78f24e67a530754ae48547eb: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-1d0463b3e1c746218d71d6d8eb843dc8 received from {username='slave'} at 127.0.0.1:58414
I20260709 12:23:15.899243 11144 tablet_copy_service.cc:434] P 7518bdeb78f24e67a530754ae48547eb: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-1d0463b3e1c746218d71d6d8eb843dc8 on tablet 1d0463b3e1c746218d71d6d8eb843dc8 with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:15.900696 11818 tablet_bootstrap.cc:492] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:15.901504 11818 ts_tablet_manager.cc:1403] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.183s	user 0.021s	sys 0.013s
I20260709 12:23:15.903684 10994 tablet_copy_service.cc:342] P bc01179655564f29b83babe396377cbb: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-e8083bc5cbd34d98a24be9a390262c19 received from {username='slave'} at 127.0.0.1:60928
I20260709 12:23:15.904161 10994 tablet_copy_service.cc:434] P bc01179655564f29b83babe396377cbb: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-e8083bc5cbd34d98a24be9a390262c19 on tablet e8083bc5cbd34d98a24be9a390262c19 with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:15.916244 11818 raft_consensus.cc:359] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:15.922286 11818 raft_consensus.cc:740] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:15.923312 11822 tablet_copy_client.cc:806] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:15.923096 11818 consensus_queue.cc:260] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:15.923971 11822 tablet_copy_client.cc:670] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:15.931847 11818 ts_tablet_manager.cc:1434] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.002s
I20260709 12:23:15.944940 11070 tablet_copy_service.cc:342] P c979ef00e0ad4157b49ebbdc13ce7cd7: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-0bb096cdb35c45e785fda6900a7999f7 received from {username='slave'} at 127.0.0.1:52804
I20260709 12:23:15.945431 11070 tablet_copy_service.cc:434] P c979ef00e0ad4157b49ebbdc13ce7cd7: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-0bb096cdb35c45e785fda6900a7999f7 on tablet 0bb096cdb35c45e785fda6900a7999f7 with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:15.932114 11822 tablet_copy_client.cc:538] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:15.966583 11822 tablet_bootstrap.cc:492] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:15.989804 11822 tablet_bootstrap.cc:492] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:15.990819 11822 tablet_bootstrap.cc:492] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:15.991532 11822 ts_tablet_manager.cc:1403] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.008s
I20260709 12:23:15.994633 11822 raft_consensus.cc:359] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:15.995522 11822 raft_consensus.cc:740] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:15.996217 11822 consensus_queue.cc:260] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:15.998764 11822 ts_tablet_manager.cc:1434] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:23:16.000415 10994 tablet_copy_service.cc:342] P bc01179655564f29b83babe396377cbb: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-1e22af520a9e4eb795f4a0e920b05a3b received from {username='slave'} at 127.0.0.1:60928
I20260709 12:23:16.000859 10994 tablet_copy_service.cc:434] P bc01179655564f29b83babe396377cbb: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-1e22af520a9e4eb795f4a0e920b05a3b on tablet 1e22af520a9e4eb795f4a0e920b05a3b with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:16.024317 11681 raft_consensus.cc:1217] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:16.106037 11681 raft_consensus.cc:1217] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:16.115789 11681 raft_consensus.cc:1217] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:16.146196 11681 raft_consensus.cc:1217] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:16.538758 11828 raft_consensus.cc:1064] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:23:16.543015 11828 consensus_queue.cc:237] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:16.544234 11779 raft_consensus.cc:1064] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:23:16.546634 11779 consensus_queue.cc:237] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:16.550423 11681 raft_consensus.cc:1275] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:16.551496 10980 raft_consensus.cc:1275] T 0bb096cdb35c45e785fda6900a7999f7 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:16.552161 11132 raft_consensus.cc:1275] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:16.553632 11828 consensus_queue.cc:1048] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:16.555223 11830 consensus_queue.cc:1048] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:16.556411 11829 consensus_queue.cc:1048] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:16.579960 11053 raft_consensus.cc:1275] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:16.581393 11681 raft_consensus.cc:1275] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:16.583770 11127 raft_consensus.cc:1275] T e8083bc5cbd34d98a24be9a390262c19 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:16.584096 11832 consensus_queue.cc:1048] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:16.582852 11829 raft_consensus.cc:2955] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:16.584954 11132 raft_consensus.cc:2955] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:16.586179 11779 consensus_queue.cc:1048] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:16.588053 11832 consensus_queue.cc:1048] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:16.604048 11680 raft_consensus.cc:2955] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:16.613588 11779 raft_consensus.cc:2955] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:16.617203 10980 raft_consensus.cc:2955] T 0bb096cdb35c45e785fda6900a7999f7 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:16.625341 10879 catalog_manager.cc:5697] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:16.629324 11836 raft_consensus.cc:1064] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:23:16.631896 11836 consensus_queue.cc:237] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:16.635773 11132 raft_consensus.cc:2955] T e8083bc5cbd34d98a24be9a390262c19 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:16.642700 11680 raft_consensus.cc:2955] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:16.645215 11053 raft_consensus.cc:2955] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:16.667785 11059 raft_consensus.cc:1275] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:16.669116 10980 raft_consensus.cc:1275] T 1d0463b3e1c746218d71d6d8eb843dc8 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:16.672319 11836 consensus_queue.cc:1048] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:16.672415 10878 catalog_manager.cc:5697] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb reported cstate change: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:16.678154 11681 raft_consensus.cc:1275] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:16.678613 11815 consensus_queue.cc:1048] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:16.680080 11814 consensus_queue.cc:1048] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:16.694052 11832 raft_consensus.cc:1064] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:23:16.699441 11832 consensus_queue.cc:237] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:16.702006 11815 raft_consensus.cc:2955] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:16.703954 10980 raft_consensus.cc:2955] T 1d0463b3e1c746218d71d6d8eb843dc8 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:16.725446 11053 raft_consensus.cc:2955] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:16.729547 11132 raft_consensus.cc:1275] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:16.730144 11680 raft_consensus.cc:1275] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:16.731314 11059 raft_consensus.cc:1275] T 1e22af520a9e4eb795f4a0e920b05a3b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:16.732573 11833 consensus_queue.cc:1048] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:16.734688 11833 consensus_queue.cc:1048] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:16.771822 10982 consensus_queue.cc:237] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:16.739547 11832 consensus_queue.cc:1048] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:23:16.779222 11681 raft_consensus.cc:1275] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:16.779997 11053 raft_consensus.cc:1275] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:16.780930 11834 consensus_queue.cc:1048] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:16.790944 11779 consensus_queue.cc:1048] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:16.790320 11679 raft_consensus.cc:2955] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:16.797935 11779 raft_consensus.cc:2955] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:16.799063 11833 raft_consensus.cc:2955] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:16.807024 11680 raft_consensus.cc:2955] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:16.812578 11053 raft_consensus.cc:2955] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:16.816367 11132 raft_consensus.cc:2955] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:16.808341 11681 raft_consensus.cc:2955] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:16.822578 10866 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e8083bc5cbd34d98a24be9a390262c19 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:16.838658 11059 consensus_queue.cc:237] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:16.838953 10880 catalog_manager.cc:5697] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:16.852504 11678 raft_consensus.cc:1275] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:16.854257 11829 consensus_queue.cc:1048] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:16.858151 11053 raft_consensus.cc:2955] T 1e22af520a9e4eb795f4a0e920b05a3b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:16.870141 10879 catalog_manager.cc:5697] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:16.882416 11828 raft_consensus.cc:2955] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:16.884583 11127 raft_consensus.cc:1275] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:16.885478 11132 consensus_queue.cc:237] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:16.886615 11829 consensus_queue.cc:1048] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:16.890961 11121 tablet_service.cc:1558] Processing DeleteTablet for tablet e8083bc5cbd34d98a24be9a390262c19 with delete_type TABLET_DATA_TOMBSTONED (TS 7518bdeb78f24e67a530754ae48547eb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36562
I20260709 12:23:16.892643 11681 raft_consensus.cc:2955] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:16.895673 11127 raft_consensus.cc:2955] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:16.904721 11680 raft_consensus.cc:1275] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:16.907321 11815 consensus_queue.cc:1048] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:16.910064 10867 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0bb096cdb35c45e785fda6900a7999f7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:16.899083 10879 catalog_manager.cc:5697] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:16.912684 11054 raft_consensus.cc:1275] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:16.916661 11863 tablet_replica.cc:333] T e8083bc5cbd34d98a24be9a390262c19 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:23:16.918185 11863 raft_consensus.cc:2243] T e8083bc5cbd34d98a24be9a390262c19 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:16.919005 11863 raft_consensus.cc:2272] T e8083bc5cbd34d98a24be9a390262c19 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:16.920581 11815 consensus_queue.cc:1048] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:16.926388 11836 raft_consensus.cc:2955] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:16.927944 11054 raft_consensus.cc:2955] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:16.927418 11863 ts_tablet_manager.cc:1916] T e8083bc5cbd34d98a24be9a390262c19 P 7518bdeb78f24e67a530754ae48547eb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:16.941839 10868 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1d0463b3e1c746218d71d6d8eb843dc8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:16.938019 11681 raft_consensus.cc:2955] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:16.961531 11863 ts_tablet_manager.cc:1929] T e8083bc5cbd34d98a24be9a390262c19 P 7518bdeb78f24e67a530754ae48547eb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:16.962033 11863 log.cc:1199] T e8083bc5cbd34d98a24be9a390262c19 P 7518bdeb78f24e67a530754ae48547eb: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-2-root/wals/e8083bc5cbd34d98a24be9a390262c19
I20260709 12:23:16.962320 10880 catalog_manager.cc:5697] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:16.964543 10868 catalog_manager.cc:5028] TS 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): tablet e8083bc5cbd34d98a24be9a390262c19 (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:23:16.972146 10982 consensus_queue.cc:237] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:16.978972 10969 tablet_service.cc:1558] Processing DeleteTablet for tablet 0bb096cdb35c45e785fda6900a7999f7 with delete_type TABLET_DATA_TOMBSTONED (TS bc01179655564f29b83babe396377cbb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52810
I20260709 12:23:16.981323 11681 raft_consensus.cc:1275] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:16.983184 11127 raft_consensus.cc:1275] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:16.986683 11834 consensus_queue.cc:1048] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:16.987545 11860 consensus_queue.cc:1048] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:16.996215 10879 catalog_manager.cc:5697] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:17.007449 11832 raft_consensus.cc:2955] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:17.013119 11681 raft_consensus.cc:2955] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:17.023412 11127 raft_consensus.cc:2955] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:17.035877 10866 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1e22af520a9e4eb795f4a0e920b05a3b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:17.041337 10969 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d0463b3e1c746218d71d6d8eb843dc8 with delete_type TABLET_DATA_TOMBSTONED (TS bc01179655564f29b83babe396377cbb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52810
I20260709 12:23:17.046554 10880 catalog_manager.cc:5697] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:17.046581 11864 tablet_replica.cc:333] T 0bb096cdb35c45e785fda6900a7999f7 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:23:17.053994 11864 raft_consensus.cc:2243] T 0bb096cdb35c45e785fda6900a7999f7 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:17.054875 11864 raft_consensus.cc:2272] T 0bb096cdb35c45e785fda6900a7999f7 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:17.059127 11864 ts_tablet_manager.cc:1916] T 0bb096cdb35c45e785fda6900a7999f7 P bc01179655564f29b83babe396377cbb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:17.068954 11047 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e22af520a9e4eb795f4a0e920b05a3b with delete_type TABLET_DATA_TOMBSTONED (TS c979ef00e0ad4157b49ebbdc13ce7cd7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41292
I20260709 12:23:17.072489 11865 tablet_replica.cc:333] T 1e22af520a9e4eb795f4a0e920b05a3b P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:23:17.073341 11865 raft_consensus.cc:2243] T 1e22af520a9e4eb795f4a0e920b05a3b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:17.074334 11865 raft_consensus.cc:2272] T 1e22af520a9e4eb795f4a0e920b05a3b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:17.078612 11865 ts_tablet_manager.cc:1916] T 1e22af520a9e4eb795f4a0e920b05a3b P c979ef00e0ad4157b49ebbdc13ce7cd7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:17.080875 11864 ts_tablet_manager.cc:1929] T 0bb096cdb35c45e785fda6900a7999f7 P bc01179655564f29b83babe396377cbb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:17.081435 11864 log.cc:1199] T 0bb096cdb35c45e785fda6900a7999f7 P bc01179655564f29b83babe396377cbb: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-0-root/wals/0bb096cdb35c45e785fda6900a7999f7
I20260709 12:23:17.083057 10866 catalog_manager.cc:5028] TS bc01179655564f29b83babe396377cbb (127.9.145.193:46777): tablet 0bb096cdb35c45e785fda6900a7999f7 (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:23:17.083312 11864 tablet_replica.cc:333] T 1d0463b3e1c746218d71d6d8eb843dc8 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:23:17.084583 11864 raft_consensus.cc:2243] T 1d0463b3e1c746218d71d6d8eb843dc8 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:17.085376 11864 raft_consensus.cc:2272] T 1d0463b3e1c746218d71d6d8eb843dc8 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:17.090662 11864 ts_tablet_manager.cc:1916] T 1d0463b3e1c746218d71d6d8eb843dc8 P bc01179655564f29b83babe396377cbb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:17.096099 11865 ts_tablet_manager.cc:1929] T 1e22af520a9e4eb795f4a0e920b05a3b P c979ef00e0ad4157b49ebbdc13ce7cd7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:17.096603 11865 log.cc:1199] T 1e22af520a9e4eb795f4a0e920b05a3b P c979ef00e0ad4157b49ebbdc13ce7cd7: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-1-root/wals/1e22af520a9e4eb795f4a0e920b05a3b
I20260709 12:23:17.098359 10867 catalog_manager.cc:5028] TS c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): tablet 1e22af520a9e4eb795f4a0e920b05a3b (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:23:17.104326 11864 ts_tablet_manager.cc:1929] T 1d0463b3e1c746218d71d6d8eb843dc8 P bc01179655564f29b83babe396377cbb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:17.104720 11864 log.cc:1199] T 1d0463b3e1c746218d71d6d8eb843dc8 P bc01179655564f29b83babe396377cbb: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-0-root/wals/1d0463b3e1c746218d71d6d8eb843dc8
I20260709 12:23:17.106070 10866 catalog_manager.cc:5028] TS bc01179655564f29b83babe396377cbb (127.9.145.193:46777): tablet 1d0463b3e1c746218d71d6d8eb843dc8 (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:23:18.148047 11054 consensus_queue.cc:237] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:18.155779 11127 raft_consensus.cc:1275] T 0a21734672b8441faae7b5d5d050d2b2 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:18.155783 10982 raft_consensus.cc:1275] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:18.156178 11024 consensus_peers.cc:597] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0a21734672b8441faae7b5d5d050d2b2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:18.157583 11828 consensus_queue.cc:1048] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.158540 11868 consensus_queue.cc:1048] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.167377 11868 raft_consensus.cc:2955] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:18.169430 11127 raft_consensus.cc:2955] T 0a21734672b8441faae7b5d5d050d2b2 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:18.170925 10983 raft_consensus.cc:2955] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:18.186973 10880 catalog_manager.cc:5697] T 0a21734672b8441faae7b5d5d050d2b2 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:18.198766 10983 consensus_queue.cc:237] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
W20260709 12:23:18.217469 10948 consensus_peers.cc:597] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 497ca545c71446259b5dc17afceaaf59. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:18.218305 11127 raft_consensus.cc:1275] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:18.219832 11834 consensus_queue.cc:1048] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.220253 11054 raft_consensus.cc:1275] T 497ca545c71446259b5dc17afceaaf59 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:18.222637 11834 consensus_queue.cc:1048] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.230432 11871 raft_consensus.cc:2955] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:18.232161 11127 raft_consensus.cc:2955] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:18.235960 11054 raft_consensus.cc:2955] T 497ca545c71446259b5dc17afceaaf59 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:18.246594 10983 consensus_queue.cc:237] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:18.249197 10878 catalog_manager.cc:5697] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:18.259856 10948 consensus_peers.cc:597] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ad5b1fe8f9f246d791d03da03e5c44ee. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:18.262586 11127 raft_consensus.cc:1275] T ad5b1fe8f9f246d791d03da03e5c44ee P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:18.263252 11054 raft_consensus.cc:1275] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:18.265048 11832 consensus_queue.cc:1048] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:18.269867 11832 consensus_queue.cc:1048] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.278839 11832 raft_consensus.cc:2955] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:18.285248 11127 raft_consensus.cc:2955] T ad5b1fe8f9f246d791d03da03e5c44ee P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:18.292893 11059 consensus_queue.cc:237] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:18.288448 11054 raft_consensus.cc:2955] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:18.302867 10880 catalog_manager.cc:5697] T ad5b1fe8f9f246d791d03da03e5c44ee P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:18.304045 11127 raft_consensus.cc:1275] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:18.311925 11024 consensus_peers.cc:597] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2721401e0fa944aea90572c7ec29c134. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:18.312057 10983 raft_consensus.cc:1275] T 2721401e0fa944aea90572c7ec29c134 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:18.314049 11830 consensus_queue.cc:1048] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.315593 11828 consensus_queue.cc:1048] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.328445 11828 raft_consensus.cc:2955] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:18.330890 11132 raft_consensus.cc:2955] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:18.329691 10983 raft_consensus.cc:2955] T 2721401e0fa944aea90572c7ec29c134 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:18.373114 10878 catalog_manager.cc:5697] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:18.618939 11888 ts_tablet_manager.cc:933] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
I20260709 12:23:18.640023 11888 tablet_copy_client.cc:323] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.193:46777
I20260709 12:23:18.642150 10994 tablet_copy_service.cc:140] P bc01179655564f29b83babe396377cbb: Received BeginTabletCopySession request for tablet 497ca545c71446259b5dc17afceaaf59 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:60928)
I20260709 12:23:18.642740 10994 tablet_copy_service.cc:161] P bc01179655564f29b83babe396377cbb: Beginning new tablet copy session on tablet 497ca545c71446259b5dc17afceaaf59 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:60928: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-497ca545c71446259b5dc17afceaaf59
I20260709 12:23:18.648200 10994 tablet_copy_source_session.cc:215] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:18.651860 11888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 497ca545c71446259b5dc17afceaaf59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:18.666260 11888 tablet_copy_client.cc:806] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:18.666801 11888 tablet_copy_client.cc:670] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:18.670461 11888 tablet_copy_client.cc:538] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:18.680200 11888 tablet_bootstrap.cc:492] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:18.700160 11888 tablet_bootstrap.cc:492] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:18.700942 11888 tablet_bootstrap.cc:492] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:18.701494 11888 ts_tablet_manager.cc:1403] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 12:23:18.703681 11888 raft_consensus.cc:359] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:18.704433 11888 raft_consensus.cc:740] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:18.705144 11888 consensus_queue.cc:260] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:18.708477 11888 ts_tablet_manager.cc:1434] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.001s
I20260709 12:23:18.710201 10994 tablet_copy_service.cc:342] P bc01179655564f29b83babe396377cbb: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-497ca545c71446259b5dc17afceaaf59 received from {username='slave'} at 127.0.0.1:60928
I20260709 12:23:18.710637 10994 tablet_copy_service.cc:434] P bc01179655564f29b83babe396377cbb: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-497ca545c71446259b5dc17afceaaf59 on tablet 497ca545c71446259b5dc17afceaaf59 with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:18.732218 11888 ts_tablet_manager.cc:933] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:18.735227 11888 tablet_copy_client.cc:323] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.194:44483
I20260709 12:23:18.737259 11070 tablet_copy_service.cc:140] P c979ef00e0ad4157b49ebbdc13ce7cd7: Received BeginTabletCopySession request for tablet 2721401e0fa944aea90572c7ec29c134 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:52804)
I20260709 12:23:18.737844 11070 tablet_copy_service.cc:161] P c979ef00e0ad4157b49ebbdc13ce7cd7: Beginning new tablet copy session on tablet 2721401e0fa944aea90572c7ec29c134 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:52804: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-2721401e0fa944aea90572c7ec29c134
I20260709 12:23:18.754472 11070 tablet_copy_source_session.cc:215] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:18.757287 11888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2721401e0fa944aea90572c7ec29c134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:18.760270 11893 ts_tablet_manager.cc:933] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:18.774879 11893 tablet_copy_client.cc:323] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.194:44483
I20260709 12:23:18.776494 11070 tablet_copy_service.cc:140] P c979ef00e0ad4157b49ebbdc13ce7cd7: Received BeginTabletCopySession request for tablet 0a21734672b8441faae7b5d5d050d2b2 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:52804)
I20260709 12:23:18.777063 11070 tablet_copy_service.cc:161] P c979ef00e0ad4157b49ebbdc13ce7cd7: Beginning new tablet copy session on tablet 0a21734672b8441faae7b5d5d050d2b2 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:52804: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-0a21734672b8441faae7b5d5d050d2b2
I20260709 12:23:18.779017 11888 tablet_copy_client.cc:806] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:18.779580 11888 tablet_copy_client.cc:670] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:18.784694 11888 tablet_copy_client.cc:538] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:18.785933 11070 tablet_copy_source_session.cc:215] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:18.789238 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a21734672b8441faae7b5d5d050d2b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:18.793066 11888 tablet_bootstrap.cc:492] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:18.810691 11893 tablet_copy_client.cc:806] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:18.811291 11893 tablet_copy_client.cc:670] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:18.813452 11888 tablet_bootstrap.cc:492] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:18.814393 11888 tablet_bootstrap.cc:492] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:18.814972 11893 tablet_copy_client.cc:538] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:18.815016 11888 ts_tablet_manager.cc:1403] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.009s
I20260709 12:23:18.817895 11888 raft_consensus.cc:359] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:18.818889 11888 raft_consensus.cc:740] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:18.819569 11888 consensus_queue.cc:260] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:18.823947 11888 ts_tablet_manager.cc:1434] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:23:18.827472 11070 tablet_copy_service.cc:342] P c979ef00e0ad4157b49ebbdc13ce7cd7: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-2721401e0fa944aea90572c7ec29c134 received from {username='slave'} at 127.0.0.1:52804
I20260709 12:23:18.827921 11070 tablet_copy_service.cc:434] P c979ef00e0ad4157b49ebbdc13ce7cd7: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-2721401e0fa944aea90572c7ec29c134 on tablet 2721401e0fa944aea90572c7ec29c134 with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:18.832736 11893 tablet_bootstrap.cc:492] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:18.852697 11888 ts_tablet_manager.cc:933] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
I20260709 12:23:18.855201 11888 tablet_copy_client.cc:323] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.193:46777
I20260709 12:23:18.856959 10994 tablet_copy_service.cc:140] P bc01179655564f29b83babe396377cbb: Received BeginTabletCopySession request for tablet ad5b1fe8f9f246d791d03da03e5c44ee from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:60928)
I20260709 12:23:18.857518 10994 tablet_copy_service.cc:161] P bc01179655564f29b83babe396377cbb: Beginning new tablet copy session on tablet ad5b1fe8f9f246d791d03da03e5c44ee from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:60928: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-ad5b1fe8f9f246d791d03da03e5c44ee
I20260709 12:23:18.861769 11893 tablet_bootstrap.cc:492] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:18.862643 11893 tablet_bootstrap.cc:492] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:18.863329 11893 ts_tablet_manager.cc:1403] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.010s
I20260709 12:23:18.867202 11893 raft_consensus.cc:359] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:18.868255 11893 raft_consensus.cc:740] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:18.868884 11893 consensus_queue.cc:260] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:18.871294 11893 ts_tablet_manager.cc:1434] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:18.875131 11070 tablet_copy_service.cc:342] P c979ef00e0ad4157b49ebbdc13ce7cd7: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-0a21734672b8441faae7b5d5d050d2b2 received from {username='slave'} at 127.0.0.1:52804
I20260709 12:23:18.875497 11070 tablet_copy_service.cc:434] P c979ef00e0ad4157b49ebbdc13ce7cd7: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-0a21734672b8441faae7b5d5d050d2b2 on tablet 0a21734672b8441faae7b5d5d050d2b2 with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:18.884843 10994 tablet_copy_source_session.cc:215] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:18.889930 11888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad5b1fe8f9f246d791d03da03e5c44ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:18.927148 11888 tablet_copy_client.cc:806] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:18.927686 11888 tablet_copy_client.cc:670] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:18.934361 11888 tablet_copy_client.cc:538] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:18.942931 11888 tablet_bootstrap.cc:492] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:18.968010 11888 tablet_bootstrap.cc:492] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:18.968753 11888 tablet_bootstrap.cc:492] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:18.969303 11888 ts_tablet_manager.cc:1403] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.009s
I20260709 12:23:18.971427 11888 raft_consensus.cc:359] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:18.972170 11888 raft_consensus.cc:740] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:18.972769 11888 consensus_queue.cc:260] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:18.974869 11888 ts_tablet_manager.cc:1434] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:23:18.978350 10994 tablet_copy_service.cc:342] P bc01179655564f29b83babe396377cbb: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-ad5b1fe8f9f246d791d03da03e5c44ee received from {username='slave'} at 127.0.0.1:60928
I20260709 12:23:18.978806 10994 tablet_copy_service.cc:434] P bc01179655564f29b83babe396377cbb: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-ad5b1fe8f9f246d791d03da03e5c44ee on tablet ad5b1fe8f9f246d791d03da03e5c44ee with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:19.087672 11680 raft_consensus.cc:1217] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:19.108402 11680 raft_consensus.cc:1217] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:19.343094 11680 raft_consensus.cc:1217] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:19.354076 11680 raft_consensus.cc:1217] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:19.651069 11830 raft_consensus.cc:1064] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:23:19.653223 11830 consensus_queue.cc:237] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:19.659278 11132 raft_consensus.cc:1275] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:19.661146 11680 raft_consensus.cc:1275] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:19.661927 11828 consensus_queue.cc:1048] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:19.669776 11828 consensus_queue.cc:1048] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:19.673550 10982 raft_consensus.cc:1275] T 2721401e0fa944aea90572c7ec29c134 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:19.680363 11886 consensus_queue.cc:1048] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:19.696592 11901 raft_consensus.cc:2955] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:19.698601 11125 raft_consensus.cc:2955] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:19.701310 11832 raft_consensus.cc:1064] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:23:19.703951 11832 consensus_queue.cc:237] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:19.719947 10880 catalog_manager.cc:5697] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:19.726418 11680 raft_consensus.cc:2955] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:19.744706 11059 raft_consensus.cc:1275] T 497ca545c71446259b5dc17afceaaf59 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:19.750309 11871 consensus_queue.cc:1048] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:19.750840 11680 raft_consensus.cc:1275] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:19.756354 11896 consensus_queue.cc:1048] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:19.761358 11125 raft_consensus.cc:1275] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:19.770470 11871 consensus_queue.cc:1048] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:19.774116 10982 raft_consensus.cc:2955] T 2721401e0fa944aea90572c7ec29c134 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:19.853781 11896 raft_consensus.cc:2955] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:19.861431 11125 raft_consensus.cc:2955] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:19.865547 11886 raft_consensus.cc:1064] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:23:19.867996 11059 raft_consensus.cc:2955] T 497ca545c71446259b5dc17afceaaf59 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:19.868978 11886 consensus_queue.cc:237] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:19.885635 11680 raft_consensus.cc:2955] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:19.893607 11681 raft_consensus.cc:1275] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:19.894809 11127 raft_consensus.cc:1275] T 0a21734672b8441faae7b5d5d050d2b2 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:19.895412 11886 consensus_queue.cc:1048] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:19.896549 11902 consensus_queue.cc:1048] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:19.906453 10983 raft_consensus.cc:1275] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:19.915668 10878 catalog_manager.cc:5697] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:19.917433 11901 consensus_queue.cc:1048] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:19.918378 11053 consensus_queue.cc:237] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:19.936342 11830 raft_consensus.cc:2955] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:19.937678 11125 raft_consensus.cc:2955] T 0a21734672b8441faae7b5d5d050d2b2 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:19.945909 11129 raft_consensus.cc:1275] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:19.949306 11828 consensus_queue.cc:1048] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:19.963022 11901 raft_consensus.cc:2955] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:19.965381 11681 raft_consensus.cc:1275] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:19.965605 11909 raft_consensus.cc:1064] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:23:19.972091 11909 consensus_queue.cc:237] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:19.973714 11828 consensus_queue.cc:1048] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:23:19.986127 10983 raft_consensus.cc:2955] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:19.991209 11681 raft_consensus.cc:2955] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:20.003355 10982 consensus_queue.cc:237] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:20.008637 11125 raft_consensus.cc:2955] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:20.013212 10878 catalog_manager.cc:5697] T 0a21734672b8441faae7b5d5d050d2b2 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:20.018218 10879 catalog_manager.cc:5697] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:19.983583 11680 raft_consensus.cc:2955] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:20.022416 11679 raft_consensus.cc:1275] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:20.020750 10867 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2721401e0fa944aea90572c7ec29c134 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:20.024928 11129 raft_consensus.cc:1275] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:20.026219 11832 consensus_queue.cc:1048] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:20.031911 11896 consensus_queue.cc:1048] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:20.032600 10969 tablet_service.cc:1558] Processing DeleteTablet for tablet 2721401e0fa944aea90572c7ec29c134 with delete_type TABLET_DATA_TOMBSTONED (TS bc01179655564f29b83babe396377cbb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52810
I20260709 12:23:20.048761 11925 tablet_replica.cc:333] T 2721401e0fa944aea90572c7ec29c134 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:23:20.054210 11132 raft_consensus.cc:1275] T ad5b1fe8f9f246d791d03da03e5c44ee P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:20.047821 11896 raft_consensus.cc:2955] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:20.051266 11681 raft_consensus.cc:1275] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:20.051599 11679 raft_consensus.cc:2955] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:20.059834 11871 consensus_queue.cc:1048] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:20.054885 11925 raft_consensus.cc:2243] T 2721401e0fa944aea90572c7ec29c134 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.052690 11059 raft_consensus.cc:1275] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:20.061635 11925 raft_consensus.cc:2272] T 2721401e0fa944aea90572c7ec29c134 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.064116 11871 consensus_queue.cc:1048] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:20.065630 11925 ts_tablet_manager.cc:1916] T 2721401e0fa944aea90572c7ec29c134 P bc01179655564f29b83babe396377cbb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:20.067138 11832 consensus_queue.cc:1048] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:20.074635 10866 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 497ca545c71446259b5dc17afceaaf59 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:20.056895 11132 raft_consensus.cc:2955] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:20.090137 11059 consensus_queue.cc:237] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:20.113485 11680 raft_consensus.cc:1275] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:20.120976 10882 catalog_manager.cc:5697] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:20.123479 10982 raft_consensus.cc:1275] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:20.126026 11830 consensus_queue.cc:1048] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:20.128528 11871 raft_consensus.cc:2955] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:20.133890 11922 raft_consensus.cc:2955] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:20.141083 11901 consensus_queue.cc:1048] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:20.145618 11047 tablet_service.cc:1558] Processing DeleteTablet for tablet 497ca545c71446259b5dc17afceaaf59 with delete_type TABLET_DATA_TOMBSTONED (TS c979ef00e0ad4157b49ebbdc13ce7cd7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41292
I20260709 12:23:20.151856 11681 raft_consensus.cc:2955] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:20.157378 10980 raft_consensus.cc:2955] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:20.162434 10867 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0a21734672b8441faae7b5d5d050d2b2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:20.163681 10878 catalog_manager.cc:5697] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb reported cstate change: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:20.175279 10879 catalog_manager.cc:5697] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:20.206919 11931 tablet_replica.cc:333] T 497ca545c71446259b5dc17afceaaf59 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:23:20.190900 11125 raft_consensus.cc:2955] T ad5b1fe8f9f246d791d03da03e5c44ee P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:20.197705 11681 raft_consensus.cc:2955] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:20.200332 11054 raft_consensus.cc:2955] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:20.221622 11931 raft_consensus.cc:2243] T 497ca545c71446259b5dc17afceaaf59 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.223265 11931 raft_consensus.cc:2272] T 497ca545c71446259b5dc17afceaaf59 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.228886 11925 ts_tablet_manager.cc:1929] T 2721401e0fa944aea90572c7ec29c134 P bc01179655564f29b83babe396377cbb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:20.229380 11925 log.cc:1199] T 2721401e0fa944aea90572c7ec29c134 P bc01179655564f29b83babe396377cbb: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-0-root/wals/2721401e0fa944aea90572c7ec29c134
I20260709 12:23:20.232796 11931 ts_tablet_manager.cc:1916] T 497ca545c71446259b5dc17afceaaf59 P c979ef00e0ad4157b49ebbdc13ce7cd7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:20.263520 10866 catalog_manager.cc:5028] TS bc01179655564f29b83babe396377cbb (127.9.145.193:46777): tablet 2721401e0fa944aea90572c7ec29c134 (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:23:20.291723 11121 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a21734672b8441faae7b5d5d050d2b2 with delete_type TABLET_DATA_TOMBSTONED (TS 7518bdeb78f24e67a530754ae48547eb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36562
I20260709 12:23:20.301488 11934 tablet_replica.cc:333] T 0a21734672b8441faae7b5d5d050d2b2 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:23:20.330000 11934 raft_consensus.cc:2243] T 0a21734672b8441faae7b5d5d050d2b2 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.332698 11934 raft_consensus.cc:2272] T 0a21734672b8441faae7b5d5d050d2b2 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.339867 11931 ts_tablet_manager.cc:1929] T 497ca545c71446259b5dc17afceaaf59 P c979ef00e0ad4157b49ebbdc13ce7cd7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:20.340646 11931 log.cc:1199] T 497ca545c71446259b5dc17afceaaf59 P c979ef00e0ad4157b49ebbdc13ce7cd7: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-1-root/wals/497ca545c71446259b5dc17afceaaf59
I20260709 12:23:20.344194 10867 catalog_manager.cc:5028] TS c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): tablet 497ca545c71446259b5dc17afceaaf59 (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:23:20.344256 11934 ts_tablet_manager.cc:1916] T 0a21734672b8441faae7b5d5d050d2b2 P 7518bdeb78f24e67a530754ae48547eb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:20.351601 10980 consensus_queue.cc:237] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:20.386840 11681 raft_consensus.cc:1275] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:20.388141 11934 ts_tablet_manager.cc:1929] T 0a21734672b8441faae7b5d5d050d2b2 P 7518bdeb78f24e67a530754ae48547eb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:20.388727 11934 log.cc:1199] T 0a21734672b8441faae7b5d5d050d2b2 P 7518bdeb78f24e67a530754ae48547eb: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-2-root/wals/0a21734672b8441faae7b5d5d050d2b2
I20260709 12:23:20.390354 11054 raft_consensus.cc:1275] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:20.391768 10868 catalog_manager.cc:5028] TS 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): tablet 0a21734672b8441faae7b5d5d050d2b2 (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:23:20.395591 11832 consensus_queue.cc:1048] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:20.398049 11935 consensus_queue.cc:1048] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:20.406869 11832 raft_consensus.cc:2955] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:20.409688 11059 raft_consensus.cc:2955] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:20.414122 11681 raft_consensus.cc:2955] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:20.429034 10866 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ad5b1fe8f9f246d791d03da03e5c44ee with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:20.431784 10882 catalog_manager.cc:5697] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:20.465155 11121 tablet_service.cc:1558] Processing DeleteTablet for tablet ad5b1fe8f9f246d791d03da03e5c44ee with delete_type TABLET_DATA_TOMBSTONED (TS 7518bdeb78f24e67a530754ae48547eb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36562
I20260709 12:23:20.467190 11934 tablet_replica.cc:333] T ad5b1fe8f9f246d791d03da03e5c44ee P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:23:20.469345 11934 raft_consensus.cc:2243] T ad5b1fe8f9f246d791d03da03e5c44ee P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.470536 11934 raft_consensus.cc:2272] T ad5b1fe8f9f246d791d03da03e5c44ee P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.486078 11934 ts_tablet_manager.cc:1916] T ad5b1fe8f9f246d791d03da03e5c44ee P 7518bdeb78f24e67a530754ae48547eb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:20.539875 11934 ts_tablet_manager.cc:1929] T ad5b1fe8f9f246d791d03da03e5c44ee P 7518bdeb78f24e67a530754ae48547eb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:20.540299 11934 log.cc:1199] T ad5b1fe8f9f246d791d03da03e5c44ee P 7518bdeb78f24e67a530754ae48547eb: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-2-root/wals/ad5b1fe8f9f246d791d03da03e5c44ee
I20260709 12:23:20.542358 10868 catalog_manager.cc:5028] TS 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): tablet ad5b1fe8f9f246d791d03da03e5c44ee (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:23:21.535699 11132 consensus_queue.cc:237] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
W20260709 12:23:21.544731 11098 consensus_peers.cc:597] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a5d087871c7847629fca3c40460a08b1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:21.547904 11054 raft_consensus.cc:1275] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:21.547991 10983 raft_consensus.cc:1275] T a5d087871c7847629fca3c40460a08b1 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:21.549505 11836 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:21.550700 11913 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:21.568432 11913 raft_consensus.cc:2955] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:21.575887 11053 raft_consensus.cc:2955] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:21.581947 10983 raft_consensus.cc:2955] T a5d087871c7847629fca3c40460a08b1 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:21.597143 11127 consensus_queue.cc:237] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:21.636076 11053 raft_consensus.cc:1275] T dabbb0c174364b1ea4126a4f3d5bb4c2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:21.639627 11939 consensus_queue.cc:1048] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:21.642172 10882 catalog_manager.cc:5697] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:21.647089 10983 raft_consensus.cc:1275] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:21.647326 11098 consensus_peers.cc:597] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dabbb0c174364b1ea4126a4f3d5bb4c2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:21.655113 11944 consensus_queue.cc:1048] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:21.656749 11941 raft_consensus.cc:2955] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:21.659173 11059 raft_consensus.cc:2955] T dabbb0c174364b1ea4126a4f3d5bb4c2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:21.677110 10983 raft_consensus.cc:2955] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:21.692711 10983 consensus_queue.cc:237] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
W20260709 12:23:21.705185 10948 consensus_peers.cc:597] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6875ad729dd0416d88035fd642f6b3bd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:21.708276 11059 raft_consensus.cc:1275] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:21.708762 11127 raft_consensus.cc:1275] T 6875ad729dd0416d88035fd642f6b3bd P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:21.709728 11871 consensus_queue.cc:1048] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:21.710788 11936 consensus_queue.cc:1048] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:21.721238 10879 catalog_manager.cc:5697] T dabbb0c174364b1ea4126a4f3d5bb4c2 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:21.727372 11871 raft_consensus.cc:2955] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:21.729032 11127 raft_consensus.cc:2955] T 6875ad729dd0416d88035fd642f6b3bd P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:21.743238 11053 raft_consensus.cc:2955] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:21.748922 11059 consensus_queue.cc:237] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
W20260709 12:23:21.769490 11024 consensus_peers.cc:597] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2cdd07e6995141b68c257e6c93f15f2e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:21.769999 10983 raft_consensus.cc:1275] T 2cdd07e6995141b68c257e6c93f15f2e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:21.770936 11125 raft_consensus.cc:1275] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:21.772241 11828 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:21.773658 11901 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:21.774747 10879 catalog_manager.cc:5697] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:21.786875 11901 raft_consensus.cc:2955] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:21.793745 10982 raft_consensus.cc:2955] T 2cdd07e6995141b68c257e6c93f15f2e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:21.812711 10882 catalog_manager.cc:5697] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:21.836313 11125 raft_consensus.cc:2955] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:21.992475 11960 ts_tablet_manager.cc:933] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:21.994979 11960 tablet_copy_client.cc:323] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.195:42537
I20260709 12:23:21.996968 11144 tablet_copy_service.cc:140] P 7518bdeb78f24e67a530754ae48547eb: Received BeginTabletCopySession request for tablet a5d087871c7847629fca3c40460a08b1 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:58414)
I20260709 12:23:21.997490 11144 tablet_copy_service.cc:161] P 7518bdeb78f24e67a530754ae48547eb: Beginning new tablet copy session on tablet a5d087871c7847629fca3c40460a08b1 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:58414: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-a5d087871c7847629fca3c40460a08b1
I20260709 12:23:22.004184 11144 tablet_copy_source_session.cc:215] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:22.007508 11960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5d087871c7847629fca3c40460a08b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.025913 11960 tablet_copy_client.cc:806] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:22.026604 11960 tablet_copy_client.cc:670] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:22.031073 11960 tablet_copy_client.cc:538] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:22.040742 11960 tablet_bootstrap.cc:492] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:22.064462 11960 tablet_bootstrap.cc:492] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:22.065462 11960 tablet_bootstrap.cc:492] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:22.066267 11960 ts_tablet_manager.cc:1403] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.008s
I20260709 12:23:22.069779 11960 raft_consensus.cc:359] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:22.070751 11960 raft_consensus.cc:740] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:22.071465 11960 consensus_queue.cc:260] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:22.077502 11960 ts_tablet_manager.cc:1434] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 12:23:22.079475 11144 tablet_copy_service.cc:342] P 7518bdeb78f24e67a530754ae48547eb: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-a5d087871c7847629fca3c40460a08b1 received from {username='slave'} at 127.0.0.1:58414
I20260709 12:23:22.079977 11144 tablet_copy_service.cc:434] P 7518bdeb78f24e67a530754ae48547eb: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-a5d087871c7847629fca3c40460a08b1 on tablet a5d087871c7847629fca3c40460a08b1 with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:22.096400 11960 ts_tablet_manager.cc:933] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
I20260709 12:23:22.103061 11960 tablet_copy_client.cc:323] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.193:46777
I20260709 12:23:22.105553 10994 tablet_copy_service.cc:140] P bc01179655564f29b83babe396377cbb: Received BeginTabletCopySession request for tablet 6875ad729dd0416d88035fd642f6b3bd from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:60928)
I20260709 12:23:22.106014 10994 tablet_copy_service.cc:161] P bc01179655564f29b83babe396377cbb: Beginning new tablet copy session on tablet 6875ad729dd0416d88035fd642f6b3bd from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:60928: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-6875ad729dd0416d88035fd642f6b3bd
I20260709 12:23:22.112167 10994 tablet_copy_source_session.cc:215] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:22.114923 11960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6875ad729dd0416d88035fd642f6b3bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.129971 11960 tablet_copy_client.cc:806] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:22.130569 11960 tablet_copy_client.cc:670] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:22.133844 11960 tablet_copy_client.cc:538] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:22.142683 11960 tablet_bootstrap.cc:492] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:22.155874 11965 ts_tablet_manager.cc:933] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:22.169924 11960 tablet_bootstrap.cc:492] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:22.170949 11960 tablet_bootstrap.cc:492] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:22.171625 11960 ts_tablet_manager.cc:1403] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.010s
I20260709 12:23:22.174645 11960 raft_consensus.cc:359] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:22.175482 11960 raft_consensus.cc:740] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:22.176128 11960 consensus_queue.cc:260] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:22.180466 11965 tablet_copy_client.cc:323] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.195:42537
I20260709 12:23:22.182235 11144 tablet_copy_service.cc:140] P 7518bdeb78f24e67a530754ae48547eb: Received BeginTabletCopySession request for tablet dabbb0c174364b1ea4126a4f3d5bb4c2 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:58414)
I20260709 12:23:22.182806 11144 tablet_copy_service.cc:161] P 7518bdeb78f24e67a530754ae48547eb: Beginning new tablet copy session on tablet dabbb0c174364b1ea4126a4f3d5bb4c2 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:58414: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-dabbb0c174364b1ea4126a4f3d5bb4c2
I20260709 12:23:22.183015 11960 ts_tablet_manager.cc:1434] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:23:22.187397 10994 tablet_copy_service.cc:342] P bc01179655564f29b83babe396377cbb: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-6875ad729dd0416d88035fd642f6b3bd received from {username='slave'} at 127.0.0.1:60928
I20260709 12:23:22.187886 10994 tablet_copy_service.cc:434] P bc01179655564f29b83babe396377cbb: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-6875ad729dd0416d88035fd642f6b3bd on tablet 6875ad729dd0416d88035fd642f6b3bd with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:22.190863 11144 tablet_copy_source_session.cc:215] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:22.194175 11965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dabbb0c174364b1ea4126a4f3d5bb4c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.211794 11965 tablet_copy_client.cc:806] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:22.212384 11965 tablet_copy_client.cc:670] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:22.215827 11965 tablet_copy_client.cc:538] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:22.223723 11965 tablet_bootstrap.cc:492] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:22.242424 11965 tablet_bootstrap.cc:492] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:22.243136 11965 tablet_bootstrap.cc:492] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:22.243691 11965 ts_tablet_manager.cc:1403] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 12:23:22.246022 11965 raft_consensus.cc:359] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:22.246686 11965 raft_consensus.cc:740] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:22.247344 11965 consensus_queue.cc:260] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:22.249959 11965 ts_tablet_manager.cc:1434] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 12:23:22.252691 11144 tablet_copy_service.cc:342] P 7518bdeb78f24e67a530754ae48547eb: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-dabbb0c174364b1ea4126a4f3d5bb4c2 received from {username='slave'} at 127.0.0.1:58414
I20260709 12:23:22.253067 11144 tablet_copy_service.cc:434] P 7518bdeb78f24e67a530754ae48547eb: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-dabbb0c174364b1ea4126a4f3d5bb4c2 on tablet dabbb0c174364b1ea4126a4f3d5bb4c2 with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:22.328969 11965 ts_tablet_manager.cc:933] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:22.331038 11965 tablet_copy_client.cc:323] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.194:44483
I20260709 12:23:22.332877 11070 tablet_copy_service.cc:140] P c979ef00e0ad4157b49ebbdc13ce7cd7: Received BeginTabletCopySession request for tablet 2cdd07e6995141b68c257e6c93f15f2e from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:52804)
I20260709 12:23:22.333467 11070 tablet_copy_service.cc:161] P c979ef00e0ad4157b49ebbdc13ce7cd7: Beginning new tablet copy session on tablet 2cdd07e6995141b68c257e6c93f15f2e from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:52804: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-2cdd07e6995141b68c257e6c93f15f2e
I20260709 12:23:22.344138 11070 tablet_copy_source_session.cc:215] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:22.347592 11965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cdd07e6995141b68c257e6c93f15f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.362907 11965 tablet_copy_client.cc:806] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:22.363554 11965 tablet_copy_client.cc:670] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:22.369181 11965 tablet_copy_client.cc:538] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:22.379446 11965 tablet_bootstrap.cc:492] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:22.396723 11965 tablet_bootstrap.cc:492] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:22.397441 11965 tablet_bootstrap.cc:492] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:22.397984 11965 ts_tablet_manager.cc:1403] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 12:23:22.400501 11965 raft_consensus.cc:359] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:22.401291 11965 raft_consensus.cc:740] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:22.401909 11965 consensus_queue.cc:260] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:22.405944 11965 ts_tablet_manager.cc:1434] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:23:22.407812 11070 tablet_copy_service.cc:342] P c979ef00e0ad4157b49ebbdc13ce7cd7: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-2cdd07e6995141b68c257e6c93f15f2e received from {username='slave'} at 127.0.0.1:52804
I20260709 12:23:22.408272 11070 tablet_copy_service.cc:434] P c979ef00e0ad4157b49ebbdc13ce7cd7: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-2cdd07e6995141b68c257e6c93f15f2e on tablet 2cdd07e6995141b68c257e6c93f15f2e with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:22.490950 11681 raft_consensus.cc:1217] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:22.635573 11681 raft_consensus.cc:1217] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:22.668748 11681 raft_consensus.cc:1217] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:22.778502 11681 raft_consensus.cc:1217] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:22.953894 11969 raft_consensus.cc:1064] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:23:22.956638 11969 consensus_queue.cc:237] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:22.972517 11053 raft_consensus.cc:1275] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:22.973847 10982 raft_consensus.cc:1275] T a5d087871c7847629fca3c40460a08b1 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:22.974648 11681 raft_consensus.cc:1275] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:22.976166 11941 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:22.978216 11941 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:22.987923 11944 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:23.030543 11941 raft_consensus.cc:2955] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.039105 10983 raft_consensus.cc:2955] T a5d087871c7847629fca3c40460a08b1 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.043459 11681 raft_consensus.cc:2955] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.046622 11053 raft_consensus.cc:2955] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.056001 10878 catalog_manager.cc:5697] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:23.081315 11935 raft_consensus.cc:1064] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:23:23.084594 11935 consensus_queue.cc:237] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:23.086048 11976 raft_consensus.cc:1064] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:23:23.089178 11976 consensus_queue.cc:237] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:23.117869 11053 raft_consensus.cc:1275] T dabbb0c174364b1ea4126a4f3d5bb4c2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:23.120324 11681 raft_consensus.cc:1275] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:23.121833 10982 raft_consensus.cc:1275] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:23.124337 11681 raft_consensus.cc:1275] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:23.126389 11981 consensus_queue.cc:1048] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:23.127498 11053 raft_consensus.cc:1275] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:23.126701 11127 raft_consensus.cc:1275] T 6875ad729dd0416d88035fd642f6b3bd P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:23.131160 11979 consensus_queue.cc:1048] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:23.122675 11976 consensus_queue.cc:1048] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:23:23.132892 11935 consensus_queue.cc:1048] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:23.140364 11944 consensus_queue.cc:1048] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:23.142827 11941 consensus_queue.cc:1048] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:23.162604 11681 raft_consensus.cc:2955] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.168056 11981 raft_consensus.cc:2955] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.174360 11944 raft_consensus.cc:2955] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.181876 11054 raft_consensus.cc:2955] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.196007 11973 raft_consensus.cc:1064] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:23:23.195226 11127 raft_consensus.cc:2955] T 6875ad729dd0416d88035fd642f6b3bd P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.197551 10983 raft_consensus.cc:2955] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.198913 11973 consensus_queue.cc:237] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:23.219839 11681 raft_consensus.cc:1275] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:23.214571 11059 raft_consensus.cc:2955] T dabbb0c174364b1ea4126a4f3d5bb4c2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.217608 11125 raft_consensus.cc:1275] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:23.222745 11973 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:23.263490 10982 raft_consensus.cc:1275] T 2cdd07e6995141b68c257e6c93f15f2e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:23:23.267019 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 43820.5us
I20260709 12:23:23.267740 11901 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:23.291646 11132 consensus_queue.cc:237] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:23.300820 11680 raft_consensus.cc:1275] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:23.302322 11828 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:23.299062 11681 raft_consensus.cc:2955] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.309055 11969 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:23.313117 11059 raft_consensus.cc:1275] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:23.316097 10879 catalog_manager.cc:5697] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.320497 11680 raft_consensus.cc:2955] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.319646 11944 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:23:23.325232 11969 raft_consensus.cc:2955] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.333360 11973 raft_consensus.cc:2955] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.338811 11127 raft_consensus.cc:2955] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.344321 10880 catalog_manager.cc:5697] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb reported cstate change: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.350544 10868 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a5d087871c7847629fca3c40460a08b1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:23.353715 11059 raft_consensus.cc:2955] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.374248 10979 consensus_queue.cc:237] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:23.383906 11053 raft_consensus.cc:1275] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:23.383970 11680 raft_consensus.cc:1275] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:23.386528 11979 consensus_queue.cc:1048] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:23.387543 11981 consensus_queue.cc:1048] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:23.389109 11680 raft_consensus.cc:2955] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.390556 10880 catalog_manager.cc:5697] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.403893 11935 raft_consensus.cc:2955] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.409387 10969 tablet_service.cc:1558] Processing DeleteTablet for tablet a5d087871c7847629fca3c40460a08b1 with delete_type TABLET_DATA_TOMBSTONED (TS bc01179655564f29b83babe396377cbb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52810
I20260709 12:23:23.413970 11127 consensus_queue.cc:237] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:23.417625 10878 catalog_manager.cc:5697] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:23.430306 11680 raft_consensus.cc:1275] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:23.430023 11054 raft_consensus.cc:2955] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.433421 11680 raft_consensus.cc:2955] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.434962 11941 consensus_queue.cc:1048] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:23.436242 10983 raft_consensus.cc:1275] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:23.437788 11941 consensus_queue.cc:1048] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:23.440279 10866 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6875ad729dd0416d88035fd642f6b3bd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:23.449803 11998 tablet_replica.cc:333] T a5d087871c7847629fca3c40460a08b1 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:23:23.452332 11998 raft_consensus.cc:2243] T a5d087871c7847629fca3c40460a08b1 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:23.450877 11941 raft_consensus.cc:2955] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.453265 11998 raft_consensus.cc:2272] T a5d087871c7847629fca3c40460a08b1 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:23.457202 11681 raft_consensus.cc:2955] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.458228 11998 ts_tablet_manager.cc:1916] T a5d087871c7847629fca3c40460a08b1 P bc01179655564f29b83babe396377cbb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:23.455160 10983 raft_consensus.cc:2955] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.476156 10880 catalog_manager.cc:5697] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb reported cstate change: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:23.480789 10980 raft_consensus.cc:2955] T 2cdd07e6995141b68c257e6c93f15f2e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.507067 10868 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dabbb0c174364b1ea4126a4f3d5bb4c2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:23.500092 11053 consensus_queue.cc:237] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:23.517860 11132 raft_consensus.cc:1275] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:23.519357 11973 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:23.527304 11681 raft_consensus.cc:1275] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:23.530017 11973 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:23.531611 10879 catalog_manager.cc:5697] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:23.533982 11998 ts_tablet_manager.cc:1929] T a5d087871c7847629fca3c40460a08b1 P bc01179655564f29b83babe396377cbb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:23.545400 11998 log.cc:1199] T a5d087871c7847629fca3c40460a08b1 P bc01179655564f29b83babe396377cbb: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-0-root/wals/a5d087871c7847629fca3c40460a08b1
I20260709 12:23:23.541402 11828 raft_consensus.cc:2955] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.542676 11121 tablet_service.cc:1558] Processing DeleteTablet for tablet 6875ad729dd0416d88035fd642f6b3bd with delete_type TABLET_DATA_TOMBSTONED (TS 7518bdeb78f24e67a530754ae48547eb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36562
I20260709 12:23:23.554005 11999 tablet_replica.cc:333] T 6875ad729dd0416d88035fd642f6b3bd P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:23:23.561725 11681 raft_consensus.cc:2955] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.552500 10866 catalog_manager.cc:5028] TS bc01179655564f29b83babe396377cbb (127.9.145.193:46777): tablet a5d087871c7847629fca3c40460a08b1 (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:23:23.581348 11999 raft_consensus.cc:2243] T 6875ad729dd0416d88035fd642f6b3bd P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:23.583129 11999 raft_consensus.cc:2272] T 6875ad729dd0416d88035fd642f6b3bd P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:23.586531 10867 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2cdd07e6995141b68c257e6c93f15f2e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:23.589709 11047 tablet_service.cc:1558] Processing DeleteTablet for tablet dabbb0c174364b1ea4126a4f3d5bb4c2 with delete_type TABLET_DATA_TOMBSTONED (TS c979ef00e0ad4157b49ebbdc13ce7cd7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41292
I20260709 12:23:23.589670 11999 ts_tablet_manager.cc:1916] T 6875ad729dd0416d88035fd642f6b3bd P 7518bdeb78f24e67a530754ae48547eb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:23.600852 10880 catalog_manager.cc:5697] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.598927 11127 raft_consensus.cc:2955] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:23.611250 12000 tablet_replica.cc:333] T dabbb0c174364b1ea4126a4f3d5bb4c2 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:23:23.616871 12000 raft_consensus.cc:2243] T dabbb0c174364b1ea4126a4f3d5bb4c2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:23.617722 12000 raft_consensus.cc:2272] T dabbb0c174364b1ea4126a4f3d5bb4c2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:23.622040 10969 tablet_service.cc:1558] Processing DeleteTablet for tablet 2cdd07e6995141b68c257e6c93f15f2e with delete_type TABLET_DATA_TOMBSTONED (TS bc01179655564f29b83babe396377cbb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52810
I20260709 12:23:23.623313 11998 tablet_replica.cc:333] T 2cdd07e6995141b68c257e6c93f15f2e P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:23:23.622253 12000 ts_tablet_manager.cc:1916] T dabbb0c174364b1ea4126a4f3d5bb4c2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:23.624418 11998 raft_consensus.cc:2243] T 2cdd07e6995141b68c257e6c93f15f2e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:23.625111 11999 ts_tablet_manager.cc:1929] T 6875ad729dd0416d88035fd642f6b3bd P 7518bdeb78f24e67a530754ae48547eb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:23.625170 11998 raft_consensus.cc:2272] T 2cdd07e6995141b68c257e6c93f15f2e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:23.625530 11999 log.cc:1199] T 6875ad729dd0416d88035fd642f6b3bd P 7518bdeb78f24e67a530754ae48547eb: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-2-root/wals/6875ad729dd0416d88035fd642f6b3bd
I20260709 12:23:23.627202 10868 catalog_manager.cc:5028] TS 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): tablet 6875ad729dd0416d88035fd642f6b3bd (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:23:23.628469 11998 ts_tablet_manager.cc:1916] T 2cdd07e6995141b68c257e6c93f15f2e P bc01179655564f29b83babe396377cbb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:23.641700 12000 ts_tablet_manager.cc:1929] T dabbb0c174364b1ea4126a4f3d5bb4c2 P c979ef00e0ad4157b49ebbdc13ce7cd7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:23.642308 12000 log.cc:1199] T dabbb0c174364b1ea4126a4f3d5bb4c2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-1-root/wals/dabbb0c174364b1ea4126a4f3d5bb4c2
I20260709 12:23:23.645272 11998 ts_tablet_manager.cc:1929] T 2cdd07e6995141b68c257e6c93f15f2e P bc01179655564f29b83babe396377cbb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:23.645742 11998 log.cc:1199] T 2cdd07e6995141b68c257e6c93f15f2e P bc01179655564f29b83babe396377cbb: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-0-root/wals/2cdd07e6995141b68c257e6c93f15f2e
I20260709 12:23:23.646200 10867 catalog_manager.cc:5028] TS c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): tablet dabbb0c174364b1ea4126a4f3d5bb4c2 (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:23:23.647562 10866 catalog_manager.cc:5028] TS bc01179655564f29b83babe396377cbb (127.9.145.193:46777): tablet 2cdd07e6995141b68c257e6c93f15f2e (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:23:24.689038 10980 consensus_queue.cc:237] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:24.695315 11125 raft_consensus.cc:1275] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:24.695430 11057 raft_consensus.cc:1275] T 634832ddce4348f1bb6c7bbf1b9045f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:24.695884 10948 consensus_peers.cc:597] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 634832ddce4348f1bb6c7bbf1b9045f0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:24.696789 11972 consensus_queue.cc:1048] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:24.697608 12005 consensus_queue.cc:1048] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:24.707492 11972 raft_consensus.cc:2955] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:24.709426 11057 raft_consensus.cc:2955] T 634832ddce4348f1bb6c7bbf1b9045f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:24.711685 11125 raft_consensus.cc:2955] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:24.733083 10879 catalog_manager.cc:5697] T 634832ddce4348f1bb6c7bbf1b9045f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:24.735760 11057 consensus_queue.cc:237] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:24.745154 11125 raft_consensus.cc:1275] T 820ab313402049dfa58d12167763953e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:24.746912 12002 consensus_queue.cc:1048] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:24.750844 10980 raft_consensus.cc:1275] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:24.751948 11024 consensus_peers.cc:597] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 820ab313402049dfa58d12167763953e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:24.753492 11828 consensus_queue.cc:1048] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:24.766966 12003 raft_consensus.cc:2955] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:24.768921 11125 raft_consensus.cc:2955] T 820ab313402049dfa58d12167763953e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:24.773520 10980 raft_consensus.cc:2955] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:24.787209 10979 consensus_queue.cc:237] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:24.790176 10880 catalog_manager.cc:5697] T 820ab313402049dfa58d12167763953e P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
W20260709 12:23:24.798554 10948 consensus_peers.cc:597] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6c233c491e1b4126b9d776bfd98023b6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:24.802573 11057 raft_consensus.cc:1275] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:24.804189 11125 raft_consensus.cc:1275] T 6c233c491e1b4126b9d776bfd98023b6 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:24.804415 11972 consensus_queue.cc:1048] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:24.805613 12004 consensus_queue.cc:1048] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:24.814862 12006 raft_consensus.cc:2955] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:24.816390 11127 raft_consensus.cc:2955] T 6c233c491e1b4126b9d776bfd98023b6 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:24.817008 11057 raft_consensus.cc:2955] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:24.833374 11057 consensus_queue.cc:237] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:24.838029 10880 catalog_manager.cc:5697] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
W20260709 12:23:24.851661 11024 consensus_peers.cc:597] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ec4be143c296464e86202c1a42e3d3ee. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:24.856473 10979 raft_consensus.cc:1275] T ec4be143c296464e86202c1a42e3d3ee P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:24.857900 11828 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:24.858178 11127 raft_consensus.cc:1275] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:24.859683 12003 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:24.865845 11828 raft_consensus.cc:2955] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:24.867532 10979 raft_consensus.cc:2955] T ec4be143c296464e86202c1a42e3d3ee P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:24.869107 11127 raft_consensus.cc:2955] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:24.898851 10880 catalog_manager.cc:5697] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:25.126253 12024 ts_tablet_manager.cc:933] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
I20260709 12:23:25.129333 12024 tablet_copy_client.cc:323] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.193:46777
I20260709 12:23:25.131227 10994 tablet_copy_service.cc:140] P bc01179655564f29b83babe396377cbb: Received BeginTabletCopySession request for tablet 634832ddce4348f1bb6c7bbf1b9045f0 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:60928)
I20260709 12:23:25.131722 10994 tablet_copy_service.cc:161] P bc01179655564f29b83babe396377cbb: Beginning new tablet copy session on tablet 634832ddce4348f1bb6c7bbf1b9045f0 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:60928: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-634832ddce4348f1bb6c7bbf1b9045f0
I20260709 12:23:25.137926 10994 tablet_copy_source_session.cc:215] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:25.140542 12024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 634832ddce4348f1bb6c7bbf1b9045f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:25.157146 12024 tablet_copy_client.cc:806] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:25.157841 12024 tablet_copy_client.cc:670] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:25.162897 12024 tablet_copy_client.cc:538] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:25.171200 12024 tablet_bootstrap.cc:492] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:25.197598 12027 ts_tablet_manager.cc:933] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:25.210220 12027 tablet_copy_client.cc:323] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.194:44483
I20260709 12:23:25.212088 11070 tablet_copy_service.cc:140] P c979ef00e0ad4157b49ebbdc13ce7cd7: Received BeginTabletCopySession request for tablet 820ab313402049dfa58d12167763953e from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:52804)
I20260709 12:23:25.212689 11070 tablet_copy_service.cc:161] P c979ef00e0ad4157b49ebbdc13ce7cd7: Beginning new tablet copy session on tablet 820ab313402049dfa58d12167763953e from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:52804: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-820ab313402049dfa58d12167763953e
I20260709 12:23:25.214170 12024 tablet_bootstrap.cc:492] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:25.215145 12024 tablet_bootstrap.cc:492] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:25.215904 12024 ts_tablet_manager.cc:1403] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.045s	user 0.020s	sys 0.005s
I20260709 12:23:25.219094 12024 raft_consensus.cc:359] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:25.219992 12024 raft_consensus.cc:740] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:25.221194 11070 tablet_copy_source_session.cc:215] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:25.220711 12024 consensus_queue.cc:260] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:25.226078 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 820ab313402049dfa58d12167763953e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:25.226523 12024 ts_tablet_manager.cc:1434] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:23:25.228318 10994 tablet_copy_service.cc:342] P bc01179655564f29b83babe396377cbb: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-634832ddce4348f1bb6c7bbf1b9045f0 received from {username='slave'} at 127.0.0.1:60928
I20260709 12:23:25.228742 10994 tablet_copy_service.cc:434] P bc01179655564f29b83babe396377cbb: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-634832ddce4348f1bb6c7bbf1b9045f0 on tablet 634832ddce4348f1bb6c7bbf1b9045f0 with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:25.244956 12027 tablet_copy_client.cc:806] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:25.245530 12027 tablet_copy_client.cc:670] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:25.248916 12027 tablet_copy_client.cc:538] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:25.257551 12027 tablet_bootstrap.cc:492] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:25.278160 12027 tablet_bootstrap.cc:492] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:25.278903 12027 tablet_bootstrap.cc:492] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:25.279464 12027 ts_tablet_manager.cc:1403] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.004s
I20260709 12:23:25.281816 12027 raft_consensus.cc:359] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:25.282482 12027 raft_consensus.cc:740] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:25.283109 12027 consensus_queue.cc:260] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:25.285588 12027 ts_tablet_manager.cc:1434] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:25.289644 11070 tablet_copy_service.cc:342] P c979ef00e0ad4157b49ebbdc13ce7cd7: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-820ab313402049dfa58d12167763953e received from {username='slave'} at 127.0.0.1:52804
I20260709 12:23:25.290125 11070 tablet_copy_service.cc:434] P c979ef00e0ad4157b49ebbdc13ce7cd7: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-820ab313402049dfa58d12167763953e on tablet 820ab313402049dfa58d12167763953e with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:25.293098 12027 ts_tablet_manager.cc:933] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:25.294456 12024 ts_tablet_manager.cc:933] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
I20260709 12:23:25.299067 12027 tablet_copy_client.cc:323] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.194:44483
I20260709 12:23:25.300352 12024 tablet_copy_client.cc:323] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.193:46777
I20260709 12:23:25.302291 10994 tablet_copy_service.cc:140] P bc01179655564f29b83babe396377cbb: Received BeginTabletCopySession request for tablet 6c233c491e1b4126b9d776bfd98023b6 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:60928)
I20260709 12:23:25.302858 10994 tablet_copy_service.cc:161] P bc01179655564f29b83babe396377cbb: Beginning new tablet copy session on tablet 6c233c491e1b4126b9d776bfd98023b6 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:60928: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-6c233c491e1b4126b9d776bfd98023b6
I20260709 12:23:25.307016 11070 tablet_copy_service.cc:140] P c979ef00e0ad4157b49ebbdc13ce7cd7: Received BeginTabletCopySession request for tablet ec4be143c296464e86202c1a42e3d3ee from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:52804)
I20260709 12:23:25.307675 11070 tablet_copy_service.cc:161] P c979ef00e0ad4157b49ebbdc13ce7cd7: Beginning new tablet copy session on tablet ec4be143c296464e86202c1a42e3d3ee from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:52804: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-ec4be143c296464e86202c1a42e3d3ee
I20260709 12:23:25.311363 10994 tablet_copy_source_session.cc:215] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:25.316085 12024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c233c491e1b4126b9d776bfd98023b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:25.316958 11070 tablet_copy_source_session.cc:215] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:25.320226 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec4be143c296464e86202c1a42e3d3ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:25.334313 12024 tablet_copy_client.cc:806] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:25.335005 12024 tablet_copy_client.cc:670] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:25.339524 12027 tablet_copy_client.cc:806] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:25.340586 12027 tablet_copy_client.cc:670] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:25.345592 12027 tablet_copy_client.cc:538] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:25.345592 12024 tablet_copy_client.cc:538] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:25.356437 12024 tablet_bootstrap.cc:492] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:25.356552 12027 tablet_bootstrap.cc:492] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:25.393524 12027 tablet_bootstrap.cc:492] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:25.394495 12027 tablet_bootstrap.cc:492] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:25.395213 12027 ts_tablet_manager.cc:1403] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.039s	user 0.025s	sys 0.013s
I20260709 12:23:25.398275 12027 raft_consensus.cc:359] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:25.399140 12027 raft_consensus.cc:740] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:25.399812 12024 tablet_bootstrap.cc:492] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:25.399811 12027 consensus_queue.cc:260] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:25.400887 12024 tablet_bootstrap.cc:492] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:25.401971 12024 ts_tablet_manager.cc:1403] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.046s	user 0.023s	sys 0.008s
I20260709 12:23:25.402526 12027 ts_tablet_manager.cc:1434] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:25.407148 11070 tablet_copy_service.cc:342] P c979ef00e0ad4157b49ebbdc13ce7cd7: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-ec4be143c296464e86202c1a42e3d3ee received from {username='slave'} at 127.0.0.1:52804
I20260709 12:23:25.407689 11070 tablet_copy_service.cc:434] P c979ef00e0ad4157b49ebbdc13ce7cd7: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-ec4be143c296464e86202c1a42e3d3ee on tablet ec4be143c296464e86202c1a42e3d3ee with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:25.408051 12024 raft_consensus.cc:359] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:25.409091 12024 raft_consensus.cc:740] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:25.409842 12024 consensus_queue.cc:260] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:25.413301 12024 ts_tablet_manager.cc:1434] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 12:23:25.415817 10994 tablet_copy_service.cc:342] P bc01179655564f29b83babe396377cbb: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-6c233c491e1b4126b9d776bfd98023b6 received from {username='slave'} at 127.0.0.1:60928
I20260709 12:23:25.416266 10994 tablet_copy_service.cc:434] P bc01179655564f29b83babe396377cbb: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-6c233c491e1b4126b9d776bfd98023b6 on tablet 6c233c491e1b4126b9d776bfd98023b6 with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
W20260709 12:23:25.557897 11081 debug-util.cc:398] Leaking SignalData structure 0x7b080016d760 after lost signal to thread 9802
W20260709 12:23:25.558908 11081 debug-util.cc:398] Leaking SignalData structure 0x7b0800165e40 after lost signal to thread 10916
W20260709 12:23:25.560034 11081 debug-util.cc:398] Leaking SignalData structure 0x7b0800141da0 after lost signal to thread 11009
W20260709 12:23:25.561070 11081 debug-util.cc:398] Leaking SignalData structure 0x7b080027a360 after lost signal to thread 11084
W20260709 12:23:25.562083 11081 debug-util.cc:398] Leaking SignalData structure 0x7b08002c1ee0 after lost signal to thread 11159
W20260709 12:23:25.563102 11081 debug-util.cc:398] Leaking SignalData structure 0x7b08002c9280 after lost signal to thread 11705
I20260709 12:23:25.660261 11679 raft_consensus.cc:1217] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:25.690680 11679 raft_consensus.cc:1217] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:25.782866 11679 raft_consensus.cc:1217] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:25.872905 11679 raft_consensus.cc:1217] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:26.222227 12037 raft_consensus.cc:1064] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:23:26.225314 12037 consensus_queue.cc:237] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:26.239027 11679 raft_consensus.cc:1275] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:26.242749 11127 raft_consensus.cc:1275] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:26.243498 11972 consensus_queue.cc:1048] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:26.249125 12039 consensus_queue.cc:1048] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:26.312179 11972 raft_consensus.cc:2955] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:26.315266 11828 raft_consensus.cc:1064] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:23:26.317710 11828 consensus_queue.cc:237] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:26.343513 11054 raft_consensus.cc:1275] T 634832ddce4348f1bb6c7bbf1b9045f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:26.344977 11679 raft_consensus.cc:2955] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:26.348425 12040 consensus_queue.cc:1048] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:23:26.363831 10879 catalog_manager.cc:5697] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb reported cstate change: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:26.367256 11996 raft_consensus.cc:1064] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:23:26.372622 11996 consensus_queue.cc:237] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:26.383396 12039 raft_consensus.cc:1064] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:23:26.386322 12039 consensus_queue.cc:237] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:26.405534 11054 raft_consensus.cc:2955] T 634832ddce4348f1bb6c7bbf1b9045f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:26.411891 11127 raft_consensus.cc:2955] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:26.412955 11125 raft_consensus.cc:1275] T 820ab313402049dfa58d12167763953e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:26.421667 11680 raft_consensus.cc:1275] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:26.424175 11828 consensus_queue.cc:1048] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:26.426788 12049 consensus_queue.cc:1048] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:23:26.474900 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 53150.8us
I20260709 12:23:26.476945 10979 raft_consensus.cc:1275] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:26.483325 11679 raft_consensus.cc:1275] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:26.485159 12040 consensus_queue.cc:1048] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:26.496322 12003 consensus_queue.cc:1048] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:26.502226 10979 raft_consensus.cc:1275] T ec4be143c296464e86202c1a42e3d3ee P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:26.505267 12003 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:26.506850 11680 raft_consensus.cc:1275] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:26.500680 11125 raft_consensus.cc:1275] T 6c233c491e1b4126b9d776bfd98023b6 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:26.510246 12003 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:26.512591 10978 consensus_queue.cc:237] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:26.523051 12041 consensus_queue.cc:1048] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:26.531595 11680 raft_consensus.cc:1275] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:26.536584 12040 consensus_queue.cc:1048] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:26.556448 12040 raft_consensus.cc:2955] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:26.571035 12003 raft_consensus.cc:2955] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:26.574316 11129 raft_consensus.cc:1275] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:26.576176 12041 consensus_queue.cc:1048] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:26.577980 11129 raft_consensus.cc:1275] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:26.578751 10980 raft_consensus.cc:2955] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:26.581990 11132 raft_consensus.cc:2955] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:26.586225 12044 raft_consensus.cc:2955] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:26.588186 12051 raft_consensus.cc:2955] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:26.591451 10979 raft_consensus.cc:2955] T ec4be143c296464e86202c1a42e3d3ee P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:26.599093 11681 raft_consensus.cc:2955] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:26.606384 11058 raft_consensus.cc:1275] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:26.608137 11125 raft_consensus.cc:2955] T 820ab313402049dfa58d12167763953e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:26.620962 12053 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:26.625229 10879 catalog_manager.cc:5697] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:26.640197 11679 raft_consensus.cc:2955] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:26.652490 10866 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 634832ddce4348f1bb6c7bbf1b9045f0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:26.654076 11972 consensus_queue.cc:1048] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:26.672720 11680 raft_consensus.cc:2955] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:26.676298 11125 raft_consensus.cc:2955] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:26.687857 11681 raft_consensus.cc:2955] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:26.719630 11047 tablet_service.cc:1558] Processing DeleteTablet for tablet 634832ddce4348f1bb6c7bbf1b9045f0 with delete_type TABLET_DATA_TOMBSTONED (TS c979ef00e0ad4157b49ebbdc13ce7cd7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41292
I20260709 12:23:26.744076 10880 catalog_manager.cc:5697] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
W20260709 12:23:26.749133 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 74275.4us
I20260709 12:23:26.752015 11125 raft_consensus.cc:2955] T 6c233c491e1b4126b9d776bfd98023b6 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:26.749544 10880 catalog_manager.cc:5697] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:26.769176 11058 raft_consensus.cc:2955] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:26.778877 10882 catalog_manager.cc:5697] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:26.807548 11054 consensus_queue.cc:237] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:26.817690 11679 raft_consensus.cc:1275] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:26.818077 10978 raft_consensus.cc:1275] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:26.819554 12065 consensus_queue.cc:1048] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:26.809742 12068 tablet_replica.cc:333] T 634832ddce4348f1bb6c7bbf1b9045f0 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:23:26.820744 12060 consensus_queue.cc:1048] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:26.823110 12068 raft_consensus.cc:2243] T 634832ddce4348f1bb6c7bbf1b9045f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:26.823900 12068 raft_consensus.cc:2272] T 634832ddce4348f1bb6c7bbf1b9045f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:26.841295 10979 raft_consensus.cc:2955] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:26.837118 12068 ts_tablet_manager.cc:1916] T 634832ddce4348f1bb6c7bbf1b9045f0 P c979ef00e0ad4157b49ebbdc13ce7cd7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:26.838491 12049 raft_consensus.cc:2955] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:26.861550 11679 raft_consensus.cc:2955] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:26.874955 12068 ts_tablet_manager.cc:1929] T 634832ddce4348f1bb6c7bbf1b9045f0 P c979ef00e0ad4157b49ebbdc13ce7cd7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:26.882861 12068 log.cc:1199] T 634832ddce4348f1bb6c7bbf1b9045f0 P c979ef00e0ad4157b49ebbdc13ce7cd7: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-1-root/wals/634832ddce4348f1bb6c7bbf1b9045f0
I20260709 12:23:26.877530 10867 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 820ab313402049dfa58d12167763953e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:26.885485 10867 catalog_manager.cc:5028] TS c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): tablet 634832ddce4348f1bb6c7bbf1b9045f0 (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:23:26.886176 10882 catalog_manager.cc:5697] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:26.900274 11121 tablet_service.cc:1558] Processing DeleteTablet for tablet 820ab313402049dfa58d12167763953e with delete_type TABLET_DATA_TOMBSTONED (TS 7518bdeb78f24e67a530754ae48547eb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36562
I20260709 12:23:26.917354 12070 tablet_replica.cc:333] T 820ab313402049dfa58d12167763953e P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:23:26.918521 12070 raft_consensus.cc:2243] T 820ab313402049dfa58d12167763953e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:26.920918 12070 raft_consensus.cc:2272] T 820ab313402049dfa58d12167763953e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:26.926469 12070 ts_tablet_manager.cc:1916] T 820ab313402049dfa58d12167763953e P 7518bdeb78f24e67a530754ae48547eb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:26.947767 12070 ts_tablet_manager.cc:1929] T 820ab313402049dfa58d12167763953e P 7518bdeb78f24e67a530754ae48547eb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:26.948283 12070 log.cc:1199] T 820ab313402049dfa58d12167763953e P 7518bdeb78f24e67a530754ae48547eb: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-2-root/wals/820ab313402049dfa58d12167763953e
I20260709 12:23:26.950773 10868 catalog_manager.cc:5028] TS 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): tablet 820ab313402049dfa58d12167763953e (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:23:27.193308 11054 consensus_queue.cc:237] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:27.201290 11679 raft_consensus.cc:1275] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:27.205367 12049 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:27.205367 11130 raft_consensus.cc:1275] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:27.210078 12060 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:23:27.217612 11681 raft_consensus.cc:2955] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:27.215627 12060 raft_consensus.cc:2955] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:27.230892 11130 raft_consensus.cc:2955] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:27.247556 10882 catalog_manager.cc:5697] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:27.261804 10867 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ec4be143c296464e86202c1a42e3d3ee with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:27.271793 10969 tablet_service.cc:1558] Processing DeleteTablet for tablet ec4be143c296464e86202c1a42e3d3ee with delete_type TABLET_DATA_TOMBSTONED (TS bc01179655564f29b83babe396377cbb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52810
I20260709 12:23:27.271906 10978 consensus_queue.cc:237] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:27.294901 11679 raft_consensus.cc:1275] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:27.296383 12066 consensus_queue.cc:1048] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:27.302934 12040 raft_consensus.cc:2955] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:27.314783 11681 raft_consensus.cc:2955] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:27.323913 11054 raft_consensus.cc:1275] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:27.324499 10866 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6c233c491e1b4126b9d776bfd98023b6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:27.332105 12040 consensus_queue.cc:1048] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:27.345021 12071 tablet_replica.cc:333] T ec4be143c296464e86202c1a42e3d3ee P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:23:27.347510 12071 raft_consensus.cc:2243] T ec4be143c296464e86202c1a42e3d3ee P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.348627 12071 raft_consensus.cc:2272] T ec4be143c296464e86202c1a42e3d3ee P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.348177 10880 catalog_manager.cc:5697] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb reported cstate change: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:27.353760 11054 raft_consensus.cc:2955] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:27.361017 12071 ts_tablet_manager.cc:1916] T ec4be143c296464e86202c1a42e3d3ee P bc01179655564f29b83babe396377cbb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:27.390618 12071 ts_tablet_manager.cc:1929] T ec4be143c296464e86202c1a42e3d3ee P bc01179655564f29b83babe396377cbb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:27.391038 12071 log.cc:1199] T ec4be143c296464e86202c1a42e3d3ee P bc01179655564f29b83babe396377cbb: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-0-root/wals/ec4be143c296464e86202c1a42e3d3ee
I20260709 12:23:27.393941 10866 catalog_manager.cc:5028] TS bc01179655564f29b83babe396377cbb (127.9.145.193:46777): tablet ec4be143c296464e86202c1a42e3d3ee (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:23:27.394382 11121 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c233c491e1b4126b9d776bfd98023b6 with delete_type TABLET_DATA_TOMBSTONED (TS 7518bdeb78f24e67a530754ae48547eb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36562
I20260709 12:23:27.395363 12070 tablet_replica.cc:333] T 6c233c491e1b4126b9d776bfd98023b6 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:23:27.396327 12070 raft_consensus.cc:2243] T 6c233c491e1b4126b9d776bfd98023b6 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.397106 12070 raft_consensus.cc:2272] T 6c233c491e1b4126b9d776bfd98023b6 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.406155 12070 ts_tablet_manager.cc:1916] T 6c233c491e1b4126b9d776bfd98023b6 P 7518bdeb78f24e67a530754ae48547eb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:27.421908 12070 ts_tablet_manager.cc:1929] T 6c233c491e1b4126b9d776bfd98023b6 P 7518bdeb78f24e67a530754ae48547eb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:27.422441 12070 log.cc:1199] T 6c233c491e1b4126b9d776bfd98023b6 P 7518bdeb78f24e67a530754ae48547eb: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-2-root/wals/6c233c491e1b4126b9d776bfd98023b6
I20260709 12:23:27.423926 10868 catalog_manager.cc:5028] TS 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): tablet 6c233c491e1b4126b9d776bfd98023b6 (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:23:28.471979 11125 consensus_queue.cc:237] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:28.481564 10978 raft_consensus.cc:1275] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:28.482216 11098 consensus_peers.cc:597] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c2dcd574d9d144ce853b29000889507e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:28.484417 11054 raft_consensus.cc:1275] T c2dcd574d9d144ce853b29000889507e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:28.484727 12046 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:28.487618 12076 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:28.498425 12046 raft_consensus.cc:2955] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:28.504323 11054 raft_consensus.cc:2955] T c2dcd574d9d144ce853b29000889507e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:28.506269 10979 raft_consensus.cc:2955] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:28.515187 11057 consensus_queue.cc:237] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:28.520234 10878 catalog_manager.cc:5697] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:28.527872 11125 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:28.529007 11024 consensus_peers.cc:597] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d2205be6a7c94913a366d683de188a31. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:28.532809 10978 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:28.537894 12074 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:28.540302 11996 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:28.572993 10978 raft_consensus.cc:2955] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:28.576227 11996 raft_consensus.cc:2955] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:28.583194 11130 raft_consensus.cc:2955] T d2205be6a7c94913a366d683de188a31 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:28.618852 10882 catalog_manager.cc:5697] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:28.618839 10979 consensus_queue.cc:237] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:28.654479 11130 raft_consensus.cc:1275] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:28.655123 11057 raft_consensus.cc:1275] T 6dff0ae92c5347b59bfed7b76061d189 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:28.655268 10948 consensus_peers.cc:597] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6dff0ae92c5347b59bfed7b76061d189. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:28.656819 12072 consensus_queue.cc:1048] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:28.658213 12040 consensus_queue.cc:1048] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:28.669767 12040 raft_consensus.cc:2955] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:28.685715 11057 raft_consensus.cc:2955] T 6dff0ae92c5347b59bfed7b76061d189 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:28.724720 11058 consensus_queue.cc:237] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:28.733323 10882 catalog_manager.cc:5697] T 6dff0ae92c5347b59bfed7b76061d189 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:28.747325 11130 raft_consensus.cc:2955] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:28.749147 11125 raft_consensus.cc:1275] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:28.750195 11024 consensus_peers.cc:597] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: af28bcf443bc457bacfe081d037b6d9c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:28.751451 11996 consensus_queue.cc:1048] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:28.754567 10978 raft_consensus.cc:1275] T af28bcf443bc457bacfe081d037b6d9c P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:28.755966 12074 consensus_queue.cc:1048] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:28.777560 12073 raft_consensus.cc:2955] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:28.779426 11127 raft_consensus.cc:2955] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:28.809672 10979 raft_consensus.cc:2955] T af28bcf443bc457bacfe081d037b6d9c P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:28.804134 10882 catalog_manager.cc:5697] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:28.867727 12095 ts_tablet_manager.cc:933] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:28.870234 12095 tablet_copy_client.cc:323] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.195:42537
I20260709 12:23:28.872478 11144 tablet_copy_service.cc:140] P 7518bdeb78f24e67a530754ae48547eb: Received BeginTabletCopySession request for tablet c2dcd574d9d144ce853b29000889507e from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:58414)
I20260709 12:23:28.873119 11144 tablet_copy_service.cc:161] P 7518bdeb78f24e67a530754ae48547eb: Beginning new tablet copy session on tablet c2dcd574d9d144ce853b29000889507e from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:58414: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-c2dcd574d9d144ce853b29000889507e
I20260709 12:23:28.882925 11144 tablet_copy_source_session.cc:215] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:28.886493 12095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2dcd574d9d144ce853b29000889507e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.904238 12095 tablet_copy_client.cc:806] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:28.904930 12095 tablet_copy_client.cc:670] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:28.913722 12095 tablet_copy_client.cc:538] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:28.959331 12095 tablet_bootstrap.cc:492] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:28.987566 12095 tablet_bootstrap.cc:492] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:28.988606 12095 tablet_bootstrap.cc:492] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:28.989377 12095 ts_tablet_manager.cc:1403] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.030s	user 0.025s	sys 0.000s
I20260709 12:23:28.993737 12095 raft_consensus.cc:359] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:28.994711 12095 raft_consensus.cc:740] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:28.995829 12095 consensus_queue.cc:260] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:29.053292 12098 ts_tablet_manager.cc:933] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:29.058326 12095 ts_tablet_manager.cc:1434] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.069s	user 0.028s	sys 0.031s
I20260709 12:23:29.060215 12098 tablet_copy_client.cc:323] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.194:44483
I20260709 12:23:29.060870 11144 tablet_copy_service.cc:342] P 7518bdeb78f24e67a530754ae48547eb: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-c2dcd574d9d144ce853b29000889507e received from {username='slave'} at 127.0.0.1:58414
I20260709 12:23:29.061374 11144 tablet_copy_service.cc:434] P 7518bdeb78f24e67a530754ae48547eb: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-c2dcd574d9d144ce853b29000889507e on tablet c2dcd574d9d144ce853b29000889507e with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:29.062245 11070 tablet_copy_service.cc:140] P c979ef00e0ad4157b49ebbdc13ce7cd7: Received BeginTabletCopySession request for tablet d2205be6a7c94913a366d683de188a31 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:52804)
I20260709 12:23:29.062829 11070 tablet_copy_service.cc:161] P c979ef00e0ad4157b49ebbdc13ce7cd7: Beginning new tablet copy session on tablet d2205be6a7c94913a366d683de188a31 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:52804: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-d2205be6a7c94913a366d683de188a31
I20260709 12:23:29.071015 11070 tablet_copy_source_session.cc:215] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:29.074582 12098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2205be6a7c94913a366d683de188a31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.097288 12098 tablet_copy_client.cc:806] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:29.098209 12098 tablet_copy_client.cc:670] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:29.104920 12098 tablet_copy_client.cc:538] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:29.131214 12095 ts_tablet_manager.cc:933] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
I20260709 12:23:29.149214 12095 tablet_copy_client.cc:323] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.193:46777
I20260709 12:23:29.151473 10994 tablet_copy_service.cc:140] P bc01179655564f29b83babe396377cbb: Received BeginTabletCopySession request for tablet 6dff0ae92c5347b59bfed7b76061d189 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:60928)
I20260709 12:23:29.152046 10994 tablet_copy_service.cc:161] P bc01179655564f29b83babe396377cbb: Beginning new tablet copy session on tablet 6dff0ae92c5347b59bfed7b76061d189 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:60928: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-6dff0ae92c5347b59bfed7b76061d189
I20260709 12:23:29.158208 12098 tablet_bootstrap.cc:492] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:29.168588 10994 tablet_copy_source_session.cc:215] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:29.172638 12095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dff0ae92c5347b59bfed7b76061d189. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:29.178709 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 60715.4us
I20260709 12:23:29.192589 12095 tablet_copy_client.cc:806] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:29.193300 12095 tablet_copy_client.cc:670] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:29.197660 12095 tablet_copy_client.cc:538] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:29.220995 12095 tablet_bootstrap.cc:492] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:29.299575 12098 tablet_bootstrap.cc:492] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:29.300675 12098 tablet_bootstrap.cc:492] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:29.301487 12098 ts_tablet_manager.cc:1403] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.144s	user 0.024s	sys 0.003s
I20260709 12:23:29.323238 12098 raft_consensus.cc:359] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:29.344808 12098 raft_consensus.cc:740] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:29.347779 12098 consensus_queue.cc:260] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:29.359510 12106 ts_tablet_manager.cc:933] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:29.360610 12098 ts_tablet_manager.cc:1434] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.000s
I20260709 12:23:29.363209 11070 tablet_copy_service.cc:342] P c979ef00e0ad4157b49ebbdc13ce7cd7: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-d2205be6a7c94913a366d683de188a31 received from {username='slave'} at 127.0.0.1:52804
I20260709 12:23:29.363557 12106 tablet_copy_client.cc:323] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.194:44483
I20260709 12:23:29.363644 11070 tablet_copy_service.cc:434] P c979ef00e0ad4157b49ebbdc13ce7cd7: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-d2205be6a7c94913a366d683de188a31 on tablet d2205be6a7c94913a366d683de188a31 with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:29.365322 11070 tablet_copy_service.cc:140] P c979ef00e0ad4157b49ebbdc13ce7cd7: Received BeginTabletCopySession request for tablet af28bcf443bc457bacfe081d037b6d9c from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:52804)
I20260709 12:23:29.365839 11070 tablet_copy_service.cc:161] P c979ef00e0ad4157b49ebbdc13ce7cd7: Beginning new tablet copy session on tablet af28bcf443bc457bacfe081d037b6d9c from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:52804: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-af28bcf443bc457bacfe081d037b6d9c
I20260709 12:23:29.367969 12095 tablet_bootstrap.cc:492] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:29.369166 12095 tablet_bootstrap.cc:492] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:29.369905 12095 ts_tablet_manager.cc:1403] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.149s	user 0.052s	sys 0.051s
I20260709 12:23:29.373301 12095 raft_consensus.cc:359] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:29.374539 11070 tablet_copy_source_session.cc:215] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:29.378449 12095 raft_consensus.cc:740] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:29.379289 12095 consensus_queue.cc:260] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:29.383319 12106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af28bcf443bc457bacfe081d037b6d9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.384939 12095 ts_tablet_manager.cc:1434] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:23:29.387614 10994 tablet_copy_service.cc:342] P bc01179655564f29b83babe396377cbb: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-6dff0ae92c5347b59bfed7b76061d189 received from {username='slave'} at 127.0.0.1:60928
I20260709 12:23:29.388080 10994 tablet_copy_service.cc:434] P bc01179655564f29b83babe396377cbb: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-6dff0ae92c5347b59bfed7b76061d189 on tablet 6dff0ae92c5347b59bfed7b76061d189 with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:29.413725 11681 raft_consensus.cc:1217] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:29.430477 12106 tablet_copy_client.cc:806] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:29.432307 12106 tablet_copy_client.cc:670] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:29.443840 12106 tablet_copy_client.cc:538] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:29.456784 12106 tablet_bootstrap.cc:492] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:29.461555 11681 raft_consensus.cc:1217] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:29.512264 12106 tablet_bootstrap.cc:492] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:29.513396 12106 tablet_bootstrap.cc:492] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:29.518682 12106 ts_tablet_manager.cc:1403] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.062s	user 0.027s	sys 0.004s
I20260709 12:23:29.521912 12106 raft_consensus.cc:359] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:29.522915 12106 raft_consensus.cc:740] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:29.523694 12106 consensus_queue.cc:260] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:29.526000 12106 ts_tablet_manager.cc:1434] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:29.535384 11070 tablet_copy_service.cc:342] P c979ef00e0ad4157b49ebbdc13ce7cd7: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-af28bcf443bc457bacfe081d037b6d9c received from {username='slave'} at 127.0.0.1:52804
I20260709 12:23:29.535869 11070 tablet_copy_service.cc:434] P c979ef00e0ad4157b49ebbdc13ce7cd7: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-af28bcf443bc457bacfe081d037b6d9c on tablet af28bcf443bc457bacfe081d037b6d9c with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:29.636199 11679 raft_consensus.cc:1217] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:29.866308 12060 raft_consensus.cc:1064] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:23:29.869222 12060 consensus_queue.cc:237] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:29.877128 10983 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:29.878811 11679 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:29.879957 12074 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:29.881820 11996 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:29.893246 11681 raft_consensus.cc:1217] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:29.905905 11130 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:29.912011 12060 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:29.920343 12073 raft_consensus.cc:2955] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:29.922227 11681 raft_consensus.cc:2955] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:29.935339 10983 raft_consensus.cc:2955] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:29.938678 10878 catalog_manager.cc:5697] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:29.939613 11130 raft_consensus.cc:2955] T d2205be6a7c94913a366d683de188a31 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:29.985597 11058 consensus_queue.cc:237] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:29.997529 11681 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:29.999226 12074 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:30.000301 10983 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:30.002677 12074 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:30.014055 12046 raft_consensus.cc:1064] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:23:30.016767 12046 consensus_queue.cc:237] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:30.017822 11996 raft_consensus.cc:2955] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:30.021334 10978 raft_consensus.cc:2955] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:30.028986 11058 raft_consensus.cc:1275] T c2dcd574d9d144ce853b29000889507e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:30.030998 12076 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:30.032140 11679 raft_consensus.cc:1275] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:30.035068 10980 raft_consensus.cc:1275] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:30.034956 12076 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:30.027892 11681 raft_consensus.cc:2955] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:30.040241 12102 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:30.064546 10867 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d2205be6a7c94913a366d683de188a31 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:30.075989 10882 catalog_manager.cc:5697] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index 3 to 4, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:30.080322 12076 raft_consensus.cc:2955] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:30.088586 11681 raft_consensus.cc:2955] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:30.090965 11058 raft_consensus.cc:2955] T c2dcd574d9d144ce853b29000889507e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:30.105453 11121 tablet_service.cc:1558] Processing DeleteTablet for tablet d2205be6a7c94913a366d683de188a31 with delete_type TABLET_DATA_TOMBSTONED (TS 7518bdeb78f24e67a530754ae48547eb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36562
I20260709 12:23:30.116251 10980 raft_consensus.cc:2955] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:30.128095 12121 tablet_replica.cc:333] T d2205be6a7c94913a366d683de188a31 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:23:30.130893 12121 raft_consensus.cc:2243] T d2205be6a7c94913a366d683de188a31 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.142753 10880 catalog_manager.cc:5697] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:30.133158 12121 raft_consensus.cc:2272] T d2205be6a7c94913a366d683de188a31 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.157042 12121 ts_tablet_manager.cc:1916] T d2205be6a7c94913a366d683de188a31 P 7518bdeb78f24e67a530754ae48547eb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:30.175714 12121 ts_tablet_manager.cc:1929] T d2205be6a7c94913a366d683de188a31 P 7518bdeb78f24e67a530754ae48547eb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:30.176250 12121 log.cc:1199] T d2205be6a7c94913a366d683de188a31 P 7518bdeb78f24e67a530754ae48547eb: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-2-root/wals/d2205be6a7c94913a366d683de188a31
I20260709 12:23:30.178153 10868 catalog_manager.cc:5028] TS 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): tablet d2205be6a7c94913a366d683de188a31 (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:23:30.189425 11125 consensus_queue.cc:237] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:30.195737 10978 raft_consensus.cc:1275] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:30.197155 11681 raft_consensus.cc:1275] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:30.197088 12123 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:30.198453 12122 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:30.204974 12122 raft_consensus.cc:2955] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:30.206053 10980 raft_consensus.cc:2955] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:30.211485 11681 raft_consensus.cc:2955] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:30.229861 10868 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c2dcd574d9d144ce853b29000889507e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:30.231458 12090 raft_consensus.cc:1064] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:23:30.233493 12090 consensus_queue.cc:237] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:30.226701 10880 catalog_manager.cc:5697] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb reported cstate change: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:30.254483 11047 tablet_service.cc:1558] Processing DeleteTablet for tablet c2dcd574d9d144ce853b29000889507e with delete_type TABLET_DATA_TOMBSTONED (TS c979ef00e0ad4157b49ebbdc13ce7cd7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41292
I20260709 12:23:30.259716 12125 tablet_replica.cc:333] T c2dcd574d9d144ce853b29000889507e P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:23:30.262727 12125 raft_consensus.cc:2243] T c2dcd574d9d144ce853b29000889507e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.268098 12125 raft_consensus.cc:2272] T c2dcd574d9d144ce853b29000889507e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.272835 12125 ts_tablet_manager.cc:1916] T c2dcd574d9d144ce853b29000889507e P c979ef00e0ad4157b49ebbdc13ce7cd7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:30.285486 11681 raft_consensus.cc:1275] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:30.286793 11125 raft_consensus.cc:1275] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:30.288465 12090 consensus_queue.cc:1048] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:30.289181 11058 raft_consensus.cc:1275] T 6dff0ae92c5347b59bfed7b76061d189 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:30.293324 12127 consensus_queue.cc:1048] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:30.295840 12004 consensus_queue.cc:1048] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:30.315482 12126 raft_consensus.cc:2955] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:30.317754 11058 raft_consensus.cc:2955] T 6dff0ae92c5347b59bfed7b76061d189 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:30.337157 10878 catalog_manager.cc:5697] T 6dff0ae92c5347b59bfed7b76061d189 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:30.347266 11125 raft_consensus.cc:2955] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:30.350765 12125 ts_tablet_manager.cc:1929] T c2dcd574d9d144ce853b29000889507e P c979ef00e0ad4157b49ebbdc13ce7cd7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:30.362795 12074 raft_consensus.cc:1064] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:23:30.376132 11680 raft_consensus.cc:2955] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:30.384928 12074 consensus_queue.cc:237] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:30.389442 12125 log.cc:1199] T c2dcd574d9d144ce853b29000889507e P c979ef00e0ad4157b49ebbdc13ce7cd7: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-1-root/wals/c2dcd574d9d144ce853b29000889507e
I20260709 12:23:30.428574 10867 catalog_manager.cc:5028] TS c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): tablet c2dcd574d9d144ce853b29000889507e (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:23:30.437259 10980 raft_consensus.cc:1275] T af28bcf443bc457bacfe081d037b6d9c P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:30.447937 11125 raft_consensus.cc:1275] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:30.460263 12060 consensus_queue.cc:1048] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:30.486367 11679 raft_consensus.cc:1275] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:30.496014 11996 consensus_queue.cc:1048] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:30.523607 10978 consensus_queue.cc:237] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:30.534497 11680 raft_consensus.cc:1275] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:30.541723 12060 consensus_queue.cc:1048] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:30.550627 11132 raft_consensus.cc:1275] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:30.569185 12090 consensus_queue.cc:1048] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:23:30.592911 12127 consensus_queue.cc:1048] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:30.619818 12133 raft_consensus.cc:2955] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:30.627651 11681 raft_consensus.cc:2955] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:30.628335 11125 raft_consensus.cc:2955] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:30.623152 12134 raft_consensus.cc:2955] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
W20260709 12:23:30.634153 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 43863.2us
I20260709 12:23:30.675650 11679 raft_consensus.cc:2955] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:30.675773 10979 raft_consensus.cc:2955] T af28bcf443bc457bacfe081d037b6d9c P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:30.682319 10866 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6dff0ae92c5347b59bfed7b76061d189 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:30.699864 10880 catalog_manager.cc:5697] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:30.706926 11132 raft_consensus.cc:2955] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:30.723448 10882 catalog_manager.cc:5697] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:30.747958 11047 tablet_service.cc:1558] Processing DeleteTablet for tablet 6dff0ae92c5347b59bfed7b76061d189 with delete_type TABLET_DATA_TOMBSTONED (TS c979ef00e0ad4157b49ebbdc13ce7cd7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41292
I20260709 12:23:30.753860 12125 tablet_replica.cc:333] T 6dff0ae92c5347b59bfed7b76061d189 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:23:30.755205 12125 raft_consensus.cc:2243] T 6dff0ae92c5347b59bfed7b76061d189 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.756363 12125 raft_consensus.cc:2272] T 6dff0ae92c5347b59bfed7b76061d189 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.760934 11056 consensus_queue.cc:237] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:30.763386 12125 ts_tablet_manager.cc:1916] T 6dff0ae92c5347b59bfed7b76061d189 P c979ef00e0ad4157b49ebbdc13ce7cd7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:30.780190 11681 raft_consensus.cc:1275] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:30.782015 11125 raft_consensus.cc:1275] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:30.781839 12133 consensus_queue.cc:1048] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:30.784511 12140 consensus_queue.cc:1048] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:30.789242 12125 ts_tablet_manager.cc:1929] T 6dff0ae92c5347b59bfed7b76061d189 P c979ef00e0ad4157b49ebbdc13ce7cd7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:30.789939 12125 log.cc:1199] T 6dff0ae92c5347b59bfed7b76061d189 P c979ef00e0ad4157b49ebbdc13ce7cd7: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-1-root/wals/6dff0ae92c5347b59bfed7b76061d189
I20260709 12:23:30.792495 10867 catalog_manager.cc:5028] TS c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): tablet 6dff0ae92c5347b59bfed7b76061d189 (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:23:30.793143 12060 raft_consensus.cc:2955] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:30.798642 11681 raft_consensus.cc:2955] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:30.799324 11132 raft_consensus.cc:2955] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:30.806139 10867 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet af28bcf443bc457bacfe081d037b6d9c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:30.816110 10878 catalog_manager.cc:5697] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index 3 to 4, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:30.834554 10969 tablet_service.cc:1558] Processing DeleteTablet for tablet af28bcf443bc457bacfe081d037b6d9c with delete_type TABLET_DATA_TOMBSTONED (TS bc01179655564f29b83babe396377cbb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52810
I20260709 12:23:30.840787 12141 tablet_replica.cc:333] T af28bcf443bc457bacfe081d037b6d9c P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:23:30.842201 12141 raft_consensus.cc:2243] T af28bcf443bc457bacfe081d037b6d9c P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.843206 12141 raft_consensus.cc:2272] T af28bcf443bc457bacfe081d037b6d9c P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.847880 12141 ts_tablet_manager.cc:1916] T af28bcf443bc457bacfe081d037b6d9c P bc01179655564f29b83babe396377cbb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:30.864329 12141 ts_tablet_manager.cc:1929] T af28bcf443bc457bacfe081d037b6d9c P bc01179655564f29b83babe396377cbb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:30.864668 12141 log.cc:1199] T af28bcf443bc457bacfe081d037b6d9c P bc01179655564f29b83babe396377cbb: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-0-root/wals/af28bcf443bc457bacfe081d037b6d9c
I20260709 12:23:30.866285 10866 catalog_manager.cc:5028] TS bc01179655564f29b83babe396377cbb (127.9.145.193:46777): tablet af28bcf443bc457bacfe081d037b6d9c (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:23:31.418080  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:31.472988 10983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b"
dest_uuid: "bc01179655564f29b83babe396377cbb"
mode: GRACEFUL
new_leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
 from {username='slave'} at 127.0.0.1:41958
I20260709 12:23:31.473538 10983 raft_consensus.cc:606] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Received request to transfer leadership to TS 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:31.475808 10983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04"
dest_uuid: "bc01179655564f29b83babe396377cbb"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:41958
I20260709 12:23:31.476344 10983 raft_consensus.cc:606] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:31.478698 10983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59"
dest_uuid: "bc01179655564f29b83babe396377cbb"
mode: GRACEFUL
new_leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
 from {username='slave'} at 127.0.0.1:41958
I20260709 12:23:31.479148 10983 raft_consensus.cc:606] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Received request to transfer leadership to TS 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:31.491662 11056 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "820ab313402049dfa58d12167763953e"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:23:31.492261 11056 raft_consensus.cc:606] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Received request to transfer leadership to TS 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:31.494702 10983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee"
dest_uuid: "bc01179655564f29b83babe396377cbb"
mode: GRACEFUL
new_leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
 from {username='slave'} at 127.0.0.1:41958
I20260709 12:23:31.495163 10983 raft_consensus.cc:606] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Received request to transfer leadership to TS 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:31.497212 10983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9"
dest_uuid: "bc01179655564f29b83babe396377cbb"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:41958
I20260709 12:23:31.497648 10983 raft_consensus.cc:606] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:31.498741  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:23:31.500041  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:31.500945  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:31.545473 12127 raft_consensus.cc:993] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb: : Instructing follower 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:23:31.546736 12126 raft_consensus.cc:1081] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Signalling peer 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:23:31.550498 11125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:36576
I20260709 12:23:31.551149 11125 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:31.551525 11125 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.557682 11125 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:31.560398 11125 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:31.562016 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:31.562440 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:31.562880 11056 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.563042 10983 raft_consensus.cc:3055] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:31.563370 10983 raft_consensus.cc:740] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:31.564075 10983 consensus_queue.cc:260] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:31.565217 10983 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.568382 11056 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:31.569929 11098 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:31.571388 10983 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:31.570888 12076 raft_consensus.cc:2804] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:31.572083 12076 raft_consensus.cc:697] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:31.572871 12076 consensus_queue.cc:237] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:31.591648 10879 catalog_manager.cc:5697] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 1 to 2, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 2 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:31.633037 12134 raft_consensus.cc:993] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb: : Instructing follower 0f3b1ccd8aa5412393aa7eb90f2bef95 to start an election
I20260709 12:23:31.633442 12126 raft_consensus.cc:1081] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Signalling peer 0f3b1ccd8aa5412393aa7eb90f2bef95 to start an election
I20260709 12:23:31.634828 11679 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee"
dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
 from {username='slave'} at 127.0.0.1:41784
I20260709 12:23:31.635289 11679 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:31.635555 11679 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.640985 12134 raft_consensus.cc:993] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb: : Instructing follower 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:23:31.641556 12126 raft_consensus.cc:1081] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Signalling peer 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:23:31.642390 11679 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:31.643187 11132 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:36576
I20260709 12:23:31.643731 11132 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:31.644064 11132 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.644788 11679 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:31.645455 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:31.645707 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:31.646188 10983 raft_consensus.cc:3055] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:31.646256 11056 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.646595 10983 raft_consensus.cc:740] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:31.647392 10983 consensus_queue.cc:260] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:31.649011 10983 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.650663 11132 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:31.653038 11132 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:31.653728 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:31.654335 10979 raft_consensus.cc:3055] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:31.654734 10979 raft_consensus.cc:740] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:31.654486 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:31.655481 11058 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.655964 10983 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:31.655542 10979 consensus_queue.cc:260] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:31.657014 10979 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.657145 11643 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:31.661882 11058 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:31.665206 11098 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:31.666033 12076 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:31.654315 11056 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:31.665988 10979 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:31.672678 12151 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:31.677779 12076 raft_consensus.cc:697] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:31.678963 12076 consensus_queue.cc:237] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:31.683091 12151 raft_consensus.cc:697] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:31.684309 12151 consensus_queue.cc:237] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:31.697929 10879 catalog_manager.cc:5697] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 1 to 2, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 2 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:31.706763 10881 catalog_manager.cc:5697] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 1 to 2, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 2 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:31.720381 12126 raft_consensus.cc:993] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb: : Instructing follower 0f3b1ccd8aa5412393aa7eb90f2bef95 to start an election
I20260709 12:23:31.720860 12146 raft_consensus.cc:1081] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Signalling peer 0f3b1ccd8aa5412393aa7eb90f2bef95 to start an election
I20260709 12:23:31.722235 11681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59"
dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
 from {username='slave'} at 127.0.0.1:41784
I20260709 12:23:31.722664 11681 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:31.722892 11681 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.727491 11681 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:31.729174 11681 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:31.730046 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:31.730415 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:31.730636 10979 raft_consensus.cc:3055] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:31.730924 11125 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.730924 10979 raft_consensus.cc:740] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:31.731812 10979 consensus_queue.cc:260] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:31.732987 10979 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.737425 11125 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:31.738782 11645 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:23:31.738950 10979 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:31.739519 12151 raft_consensus.cc:2804] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:31.739991 12151 raft_consensus.cc:697] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:31.740818 12151 consensus_queue.cc:237] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:31.749050 10881 catalog_manager.cc:5697] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 1 to 2, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 2 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:23:31.909444 10930 auto_rebalancer.cc:629] Failed to schedule move for tablet f28a3d1504ca450d9efd93115b1164f9: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:23:31.913691 10983 consensus_queue.cc:237] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
W20260709 12:23:31.920878 10948 consensus_peers.cc:597] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7865a5cff5849a2bd74dddc1bcdd8f3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:31.920955 11132 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:31.922269 11056 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:31.923252 12126 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:31.924182 12146 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:31.937253 12146 raft_consensus.cc:2955] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:31.944420 11056 raft_consensus.cc:2955] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:31.945662 12127 raft_consensus.cc:993] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb: : Instructing follower 0f3b1ccd8aa5412393aa7eb90f2bef95 to start an election
I20260709 12:23:31.947444 12127 raft_consensus.cc:1081] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Signalling peer 0f3b1ccd8aa5412393aa7eb90f2bef95 to start an election
I20260709 12:23:31.946801 11132 raft_consensus.cc:2955] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:31.949694 11681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b"
dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
 from {username='slave'} at 127.0.0.1:41784
I20260709 12:23:31.950265 11681 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:31.950661 11681 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.959081 11125 consensus_queue.cc:237] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:31.966218 10881 catalog_manager.cc:5697] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.973735 12145 raft_consensus.cc:993] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7: : Instructing follower 0f3b1ccd8aa5412393aa7eb90f2bef95 to start an election
I20260709 12:23:31.974464 12145 raft_consensus.cc:1081] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Signalling peer 0f3b1ccd8aa5412393aa7eb90f2bef95 to start an election
I20260709 12:23:31.975211 11681 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:31.976450 11679 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "820ab313402049dfa58d12167763953e"
dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
 from {username='slave'} at 127.0.0.1:41762
I20260709 12:23:31.977005 11679 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:31.977226 11681 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:31.977339 11679 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.978400 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:31.979009 11127 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.979329 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:31.979883 10983 raft_consensus.cc:3055] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:31.980152 10983 raft_consensus.cc:740] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:31.980899 10983 consensus_queue.cc:260] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:31.981909 10983 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.987438 11127 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:31.989269 11645 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:23:31.990331 12151 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:31.990880 12151 raft_consensus.cc:697] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:31.990964 11679 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:31.998766 11679 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:32.002043 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:32.002710 10979 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.003067 10978 raft_consensus.cc:1275] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:31.994376 11057 raft_consensus.cc:1275] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:32.007022 10983 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:32.007609 12076 consensus_queue.cc:1048] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:31.991839 12151 consensus_queue.cc:237] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:32.017104 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:32.020992 11057 raft_consensus.cc:3055] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:32.021484 11057 raft_consensus.cc:740] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:32.022419 12123 consensus_queue.cc:1048] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:32.026893 11098 consensus_peers.cc:597] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cfc5f0c97d6e4662b2fe7ef12f7e7284. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:32.011332 10979 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:32.032203 11056 raft_consensus.cc:1275] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:32.032258 11643 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:32.033098 12151 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:32.033887 12151 raft_consensus.cc:697] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:32.034032 12123 consensus_queue.cc:1048] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:23:32.038185 10881 catalog_manager.cc:5697] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 1 to 2, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 2 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:32.033552 11057 consensus_queue.cc:260] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:32.040550 11057 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.043987 12076 raft_consensus.cc:2955] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:32.035058 12151 consensus_queue.cc:237] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:32.064945 10979 consensus_queue.cc:237] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:32.073665 10984 raft_consensus.cc:1275] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:32.074421 11057 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:32.080749 11125 raft_consensus.cc:1275] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:32.081112 11057 raft_consensus.cc:1275] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:32.081048 10948 consensus_peers.cc:597] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6aa9f4fbf45b4a0a88651d571f7b49e4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:32.079944 10881 catalog_manager.cc:5697] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 1 to 2, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 2 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:32.081825 12123 consensus_queue.cc:1048] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:32.082818 12134 consensus_queue.cc:1048] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:32.084882 12134 consensus_queue.cc:1048] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:32.086746 10983 raft_consensus.cc:2955] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:32.095438 11056 raft_consensus.cc:2955] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:32.127127 10879 catalog_manager.cc:5697] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:32.136065 11125 raft_consensus.cc:2955] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:32.132208 12127 raft_consensus.cc:2955] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:32.157821 10983 raft_consensus.cc:1275] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:32.160708 12169 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:32.157799 11058 raft_consensus.cc:2955] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:32.184316 11057 raft_consensus.cc:1275] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:32.186869 12162 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:32.199683 10878 catalog_manager.cc:5697] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:32.204994 11125 raft_consensus.cc:1275] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:32.206914 12151 consensus_queue.cc:1048] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:32.264776 10979 raft_consensus.cc:1275] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:32.268460 10983 raft_consensus.cc:1275] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:32.271673 12151 consensus_queue.cc:1048] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:32.278252 12153 consensus_queue.cc:1048] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:32.314079 11058 raft_consensus.cc:1275] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:32.315881 12153 consensus_queue.cc:1048] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:32.343654 12186 ts_tablet_manager.cc:933] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
I20260709 12:23:32.365700 12186 tablet_copy_client.cc:323] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.193:46777
I20260709 12:23:32.367959 10994 tablet_copy_service.cc:140] P bc01179655564f29b83babe396377cbb: Received BeginTabletCopySession request for tablet c7865a5cff5849a2bd74dddc1bcdd8f3 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:60928)
I20260709 12:23:32.368577 10994 tablet_copy_service.cc:161] P bc01179655564f29b83babe396377cbb: Beginning new tablet copy session on tablet c7865a5cff5849a2bd74dddc1bcdd8f3 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:60928: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-c7865a5cff5849a2bd74dddc1bcdd8f3
I20260709 12:23:32.381538 10994 tablet_copy_source_session.cc:215] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:32.385015 12186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7865a5cff5849a2bd74dddc1bcdd8f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:32.407986 12186 tablet_copy_client.cc:806] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:32.408718 12186 tablet_copy_client.cc:670] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:32.415014 12186 tablet_copy_client.cc:538] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:32.422865 12186 tablet_bootstrap.cc:492] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:32.446478 12186 tablet_bootstrap.cc:492] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:32.447444 12186 tablet_bootstrap.cc:492] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:32.448015 12186 ts_tablet_manager.cc:1403] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.005s
I20260709 12:23:32.450502 12186 raft_consensus.cc:359] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:32.451118 12186 raft_consensus.cc:740] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:32.451694 12186 consensus_queue.cc:260] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:32.453971 12186 ts_tablet_manager.cc:1434] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:23:32.455742 10994 tablet_copy_service.cc:342] P bc01179655564f29b83babe396377cbb: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-c7865a5cff5849a2bd74dddc1bcdd8f3 received from {username='slave'} at 127.0.0.1:60928
I20260709 12:23:32.456224 10994 tablet_copy_service.cc:434] P bc01179655564f29b83babe396377cbb: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-c7865a5cff5849a2bd74dddc1bcdd8f3 on tablet c7865a5cff5849a2bd74dddc1bcdd8f3 with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:32.458531 10983 raft_consensus.cc:1275] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:32.460819 12151 consensus_queue.cc:1048] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:32.472101 11058 raft_consensus.cc:1275] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:32.479493 12181 consensus_queue.cc:1048] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:32.507133 12186 ts_tablet_manager.cc:933] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:32.510447 12186 tablet_copy_client.cc:323] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.195:42537
I20260709 12:23:32.512451 11144 tablet_copy_service.cc:140] P 7518bdeb78f24e67a530754ae48547eb: Received BeginTabletCopySession request for tablet cfc5f0c97d6e4662b2fe7ef12f7e7284 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:58414)
I20260709 12:23:32.513031 11144 tablet_copy_service.cc:161] P 7518bdeb78f24e67a530754ae48547eb: Beginning new tablet copy session on tablet cfc5f0c97d6e4662b2fe7ef12f7e7284 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:58414: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-cfc5f0c97d6e4662b2fe7ef12f7e7284
I20260709 12:23:32.519585 11144 tablet_copy_source_session.cc:215] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:32.525210 12186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfc5f0c97d6e4662b2fe7ef12f7e7284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:32.538283  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:32.555670 12186 tablet_copy_client.cc:806] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:32.556389 12186 tablet_copy_client.cc:670] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:32.561174 12186 tablet_copy_client.cc:538] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:32.568763 12186 tablet_bootstrap.cc:492] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:32.573007 11127 raft_consensus.cc:1275] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:32.574978 12181 consensus_queue.cc:1048] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:32.602596 10984 raft_consensus.cc:1275] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:32.609076 12153 consensus_queue.cc:1048] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:32.610044 12186 tablet_bootstrap.cc:492] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:32.611639 12186 tablet_bootstrap.cc:492] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:32.613030 12186 ts_tablet_manager.cc:1403] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.044s	user 0.027s	sys 0.000s
I20260709 12:23:32.616979 12186 raft_consensus.cc:359] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:32.618151 12186 raft_consensus.cc:740] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:32.619592 12186 consensus_queue.cc:260] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:32.622654 12186 ts_tablet_manager.cc:1434] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:23:32.629328 11144 tablet_copy_service.cc:342] P 7518bdeb78f24e67a530754ae48547eb: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-cfc5f0c97d6e4662b2fe7ef12f7e7284 received from {username='slave'} at 127.0.0.1:58414
I20260709 12:23:32.629814 11144 tablet_copy_service.cc:434] P 7518bdeb78f24e67a530754ae48547eb: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-cfc5f0c97d6e4662b2fe7ef12f7e7284 on tablet cfc5f0c97d6e4662b2fe7ef12f7e7284 with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:32.654497 12186 ts_tablet_manager.cc:933] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
I20260709 12:23:32.675588 12186 tablet_copy_client.cc:323] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.193:46777
I20260709 12:23:32.677268 10994 tablet_copy_service.cc:140] P bc01179655564f29b83babe396377cbb: Received BeginTabletCopySession request for tablet 6aa9f4fbf45b4a0a88651d571f7b49e4 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:60928)
I20260709 12:23:32.677836 10994 tablet_copy_service.cc:161] P bc01179655564f29b83babe396377cbb: Beginning new tablet copy session on tablet 6aa9f4fbf45b4a0a88651d571f7b49e4 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:60928: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-6aa9f4fbf45b4a0a88651d571f7b49e4
I20260709 12:23:32.682142 11057 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:23:32.682780 11057 raft_consensus.cc:606] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:32.686007 10994 tablet_copy_source_session.cc:215] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:32.689574 12186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aa9f4fbf45b4a0a88651d571f7b49e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:32.695015 11680 raft_consensus.cc:1217] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:32.711594 11127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
mode: GRACEFUL
new_leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
 from {username='slave'} at 127.0.0.1:54492
I20260709 12:23:32.712218 11127 raft_consensus.cc:606] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Received request to transfer leadership to TS 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:32.715407 11057 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:23:32.716018 11057 raft_consensus.cc:606] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:23:32.718976 11057 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:23:32.719579 11057 raft_consensus.cc:606] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Received request to transfer leadership to TS 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:32.722656 10984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3"
dest_uuid: "bc01179655564f29b83babe396377cbb"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:41958
I20260709 12:23:32.723249 10984 raft_consensus.cc:606] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:32.723507 12186 tablet_copy_client.cc:806] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:32.724076 12186 tablet_copy_client.cc:670] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:32.724596  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:32.726975  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:32.727777  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:32.729930 12186 tablet_copy_client.cc:538] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:32.738869 12186 tablet_bootstrap.cc:492] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:32.767484 12186 tablet_bootstrap.cc:492] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:32.768389 12186 tablet_bootstrap.cc:492] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:32.769040 12186 ts_tablet_manager.cc:1403] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.016s
I20260709 12:23:32.771759 12186 raft_consensus.cc:359] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:32.772554 12186 raft_consensus.cc:740] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:32.773490 12186 consensus_queue.cc:260] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:32.776234 12186 ts_tablet_manager.cc:1434] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:23:32.785738 10994 tablet_copy_service.cc:342] P bc01179655564f29b83babe396377cbb: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-6aa9f4fbf45b4a0a88651d571f7b49e4 received from {username='slave'} at 127.0.0.1:60928
I20260709 12:23:32.786240 10994 tablet_copy_service.cc:434] P bc01179655564f29b83babe396377cbb: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-6aa9f4fbf45b4a0a88651d571f7b49e4 on tablet 6aa9f4fbf45b4a0a88651d571f7b49e4 with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:32.803864 12202 raft_consensus.cc:993] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7: : Instructing follower bc01179655564f29b83babe396377cbb to start an election
I20260709 12:23:32.804344 12202 raft_consensus.cc:1081] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Signalling peer bc01179655564f29b83babe396377cbb to start an election
I20260709 12:23:32.814384 10984 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d"
dest_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:52828
I20260709 12:23:32.823140 10984 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:32.824009 10984 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.846169 12145 raft_consensus.cc:993] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7: : Instructing follower 0f3b1ccd8aa5412393aa7eb90f2bef95 to start an election
I20260709 12:23:32.850569 12145 raft_consensus.cc:1081] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Signalling peer 0f3b1ccd8aa5412393aa7eb90f2bef95 to start an election
I20260709 12:23:32.852169 11680 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c"
dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
 from {username='slave'} at 127.0.0.1:41762
I20260709 12:23:32.852905 11680 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:32.853253 11680 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.854447 10984 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:32.856734 10984 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:32.857326 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:32.857905 11057 raft_consensus.cc:3055] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:32.858234 11057 raft_consensus.cc:740] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:32.858979 11057 consensus_queue.cc:260] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:32.859989 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:32.860158 11057 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.860560 11127 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.861505 11680 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:32.863687 11680 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:32.864415 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:32.865036 11058 raft_consensus.cc:3055] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:32.865336 11058 raft_consensus.cc:740] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:32.866071 11058 consensus_queue.cc:260] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:32.867826 11058 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.868899 11057 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:32.870141 10948 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:32.870498 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:32.871068 11125 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.871493 12134 raft_consensus.cc:2804] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:32.873896 12134 raft_consensus.cc:697] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 2 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:32.874781 12134 consensus_queue.cc:237] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:32.876821 11125 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:32.878048 11645 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:23:32.879127 11127 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:32.879757 12153 raft_consensus.cc:2804] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:32.880497 12153 raft_consensus.cc:697] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:32.884080 12153 consensus_queue.cc:237] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:32.907905 11058 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:32.910722 10879 catalog_manager.cc:5697] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 1 to 2, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 2 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:32.915285 10878 catalog_manager.cc:5697] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 1 to 2, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 2 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:32.938910 12126 raft_consensus.cc:993] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb: : Instructing follower 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:23:32.939512 12134 raft_consensus.cc:1081] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Signalling peer 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:23:32.951967 11127 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:36576
I20260709 12:23:32.952562 11127 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:32.952919 11127 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.963157 11127 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:32.966203 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:32.966465 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:32.966815 10979 raft_consensus.cc:3055] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:32.966989 11057 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.967146 10979 raft_consensus.cc:740] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:32.967960 10979 consensus_queue.cc:260] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:32.969307 10979 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.976073 10979 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:32.974298 11057 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:32.977417 11127 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:32.977921 11097 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:32.979661 12076 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:32.980150 12076 raft_consensus.cc:697] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:32.980981 12076 consensus_queue.cc:237] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:32.992132 10878 catalog_manager.cc:5697] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 1 to 2, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 2 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:32.996305 12123 raft_consensus.cc:993] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb: : Instructing follower 0f3b1ccd8aa5412393aa7eb90f2bef95 to start an election
I20260709 12:23:32.996820 12076 raft_consensus.cc:1081] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Signalling peer 0f3b1ccd8aa5412393aa7eb90f2bef95 to start an election
I20260709 12:23:32.998257 11679 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8"
dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
 from {username='slave'} at 127.0.0.1:41774
I20260709 12:23:32.998791 11679 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:32.999147 11679 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:33.003419 11125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36562
I20260709 12:23:33.004051 11125 raft_consensus.cc:606] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Received request to transfer leadership
I20260709 12:23:33.007377 11679 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:33.008970 11125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36562
I20260709 12:23:33.009589 11125 raft_consensus.cc:606] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Received request to transfer leadership
I20260709 12:23:33.010000 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:33.010336 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:33.010658 11057 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:33.011019 11127 raft_consensus.cc:3055] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:23:33.010967 10868 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for c7865a5cff5849a2bd74dddc1bcdd8f3 already in progress [suppressed 4 similar messages]
I20260709 12:23:33.011473 11127 raft_consensus.cc:740] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:33.010159 11679 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:33.012300 11127 consensus_queue.cc:260] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:33.014155 11127 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:33.014361 11125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36562
I20260709 12:23:33.014917 11125 raft_consensus.cc:606] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Received request to transfer leadership
I20260709 12:23:33.017982 11057 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:33.019294 11644 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:33.020033 12153 raft_consensus.cc:2804] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:33.020515 12153 raft_consensus.cc:697] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:33.021405 12153 consensus_queue.cc:237] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:33.022235 10930 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:23:33.022825 10930 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for c7865a5cff5849a2bd74dddc1bcdd8f3 already in progress
W20260709 12:23:33.023228 10930 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for c7865a5cff5849a2bd74dddc1bcdd8f3 already in progress
I20260709 12:23:33.024610 11127 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:33.032848 10878 catalog_manager.cc:5697] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 1 to 2, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 2 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:33.074393 12168 raft_consensus.cc:993] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7: : Instructing follower 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:23:33.074926 12145 raft_consensus.cc:1081] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Signalling peer 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:23:33.076344 11127 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:36582
I20260709 12:23:33.076917 11127 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:33.077950 11127 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:33.085316 11127 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:33.087359 11127 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:33.088361 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:33.088953 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:33.089141 11057 raft_consensus.cc:3055] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:33.089620 11057 raft_consensus.cc:740] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:33.089668 10984 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:33.090548 11057 consensus_queue.cc:260] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:33.091925 11057 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:33.098832 11057 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:33.100366 11098 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:33.101286 12076 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:33.101853 12076 raft_consensus.cc:697] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:33.102695 12076 consensus_queue.cc:237] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:33.107702 10984 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:33.123517 11680 raft_consensus.cc:1217] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:33.131529 10878 catalog_manager.cc:5697] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 1 to 2, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 2 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:33.199530 11680 raft_consensus.cc:1217] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:33.333900 11057 raft_consensus.cc:1275] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:33.335146 12151 consensus_queue.cc:1048] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:33.351308 11127 raft_consensus.cc:1275] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:33.353174 12183 consensus_queue.cc:1048] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:33.376174 11058 raft_consensus.cc:1275] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:33.388837 12127 consensus_queue.cc:1048] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:33.406613 11125 raft_consensus.cc:1275] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:33.410686 12127 consensus_queue.cc:1048] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:33.468668 11057 raft_consensus.cc:1275] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:33.470340 12183 consensus_queue.cc:1048] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:33.485641 11058 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:33.487370 11680 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Advancing to term 2
I20260709 12:23:33.493552 12076 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:33.511026 11127 raft_consensus.cc:1275] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:33.511610 12162 raft_consensus.cc:993] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb: : Instructing follower c979ef00e0ad4157b49ebbdc13ce7cd7 to start an election
I20260709 12:23:33.512132 12162 raft_consensus.cc:1081] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Signalling peer c979ef00e0ad4157b49ebbdc13ce7cd7 to start an election
I20260709 12:23:33.512470 12151 consensus_queue.cc:1048] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:33.513820 11056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
 from {username='slave'} at 127.0.0.1:41294
I20260709 12:23:33.514461 11056 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:33.514811 11056 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:33.519690 10979 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:33.521981 11056 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:33.523845 12123 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:33.524595 11057 raft_consensus.cc:1240] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:33.528712 11680 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEARNER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:33.530826 12123 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:33.532326 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:33.533169 11056 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:33.536303 12162 consensus_queue.cc:1059] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:33.537211 12123 raft_consensus.cc:3055] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:33.539191 12123 raft_consensus.cc:740] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:33.540105 12123 consensus_queue.cc:260] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:33.541469 12123 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:33.542459 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:33.582343 12162 raft_consensus.cc:1064] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:23:33.590487 12162 consensus_queue.cc:237] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:33.604022 11058 raft_consensus.cc:1275] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:33.610684 12076 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:33.629873 11125 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:33.638690 11025 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:33.640506 12201 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:33.641060 12201 raft_consensus.cc:697] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:33.642185 12201 consensus_queue.cc:237] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:33.659673 10984 raft_consensus.cc:1275] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:33.661331 12226 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:33.676395 11056 raft_consensus.cc:1275] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:33.676728 11679 raft_consensus.cc:1275] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:33.677111 10984 raft_consensus.cc:1275] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:33.677963 12162 consensus_queue.cc:1048] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:33.686244 12123 consensus_queue.cc:1048] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:33.687379 12226 consensus_queue.cc:1048] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:33.729625 12134 raft_consensus.cc:1064] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:23:33.732674 12134 consensus_queue.cc:237] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:33.750448 12162 raft_consensus.cc:2955] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:33.750299 10881 catalog_manager.cc:5697] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 2 to 3, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 3 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:33.763029 10984 raft_consensus.cc:2955] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:33.765849 11680 raft_consensus.cc:2955] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:33.782051 11125 raft_consensus.cc:1275] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:33.782528 11679 raft_consensus.cc:1275] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:33.784915 12209 consensus_queue.cc:1048] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:33.786887 11056 raft_consensus.cc:1275] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:33.788640 12209 consensus_queue.cc:1048] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:33.788897  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:33.792063 10879 catalog_manager.cc:5697] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:33.797079 12209 consensus_queue.cc:1048] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:33.797201 11058 raft_consensus.cc:2955] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:33.848836 12126 raft_consensus.cc:2955] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:33.853570 11056 raft_consensus.cc:2955] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:33.858846 11125 raft_consensus.cc:2955] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:33.861444 11679 raft_consensus.cc:2955] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:33.890492 11125 consensus_queue.cc:237] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:33.897743 11679 raft_consensus.cc:1275] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:33.899449 12076 consensus_queue.cc:1048] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:33.897106 10881 catalog_manager.cc:5697] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb reported cstate change: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:33.911847 12076 raft_consensus.cc:2955] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:33.914543 11679 raft_consensus.cc:2955] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:33.925894 10868 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cfc5f0c97d6e4662b2fe7ef12f7e7284 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:33.935227 11132 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
mode: GRACEFUL
new_leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
 from {username='slave'} at 127.0.0.1:54492
I20260709 12:23:33.935849 11132 raft_consensus.cc:606] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Received request to transfer leadership to TS 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:33.941468 11058 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:23:33.942051 11058 raft_consensus.cc:606] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:23:33.941979 10984 raft_consensus.cc:1275] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:33.944742 12162 consensus_queue.cc:1048] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:33.946950 10881 catalog_manager.cc:5697] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:33.948585 11125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:54492
I20260709 12:23:33.949179 11125 raft_consensus.cc:606] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:23:33.949610 11125 raft_consensus.cc:614] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:33.949993 10979 raft_consensus.cc:2955] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:33.954550 10980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19"
dest_uuid: "bc01179655564f29b83babe396377cbb"
mode: GRACEFUL
new_leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
 from {username='slave'} at 127.0.0.1:41958
I20260709 12:23:33.955197 10980 raft_consensus.cc:606] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Received request to transfer leadership to TS 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:33.964181 10984 consensus_queue.cc:237] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:33.965721 11058 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:23:33.966360 11058 raft_consensus.cc:606] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:33.968539  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:33.970253  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:33.974422  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:33.976570 11680 raft_consensus.cc:1275] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:33.980513 12127 consensus_queue.cc:1048] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:33.995461 12126 raft_consensus.cc:2955] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:34.000931 11047 tablet_service.cc:1558] Processing DeleteTablet for tablet cfc5f0c97d6e4662b2fe7ef12f7e7284 with delete_type TABLET_DATA_TOMBSTONED (TS c979ef00e0ad4157b49ebbdc13ce7cd7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41292
I20260709 12:23:34.002844 11680 raft_consensus.cc:2955] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:34.011956 12240 tablet_replica.cc:333] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:23:34.018291 12240 raft_consensus.cc:2243] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:34.019387 12226 raft_consensus.cc:993] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb: : Instructing follower 0f3b1ccd8aa5412393aa7eb90f2bef95 to start an election
I20260709 12:23:34.019485 12240 raft_consensus.cc:2272] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:34.020052 12226 raft_consensus.cc:1081] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Signalling peer 0f3b1ccd8aa5412393aa7eb90f2bef95 to start an election
I20260709 12:23:34.022126 11681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1"
dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
 from {username='slave'} at 127.0.0.1:41774
I20260709 12:23:34.022723 11681 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:34.023092 11681 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:34.024237 12240 ts_tablet_manager.cc:1916] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P c979ef00e0ad4157b49ebbdc13ce7cd7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:34.056152 11125 raft_consensus.cc:1275] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:34.061167 12240 ts_tablet_manager.cc:1929] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P c979ef00e0ad4157b49ebbdc13ce7cd7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:34.061748 12240 log.cc:1199] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P c979ef00e0ad4157b49ebbdc13ce7cd7: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-1-root/wals/cfc5f0c97d6e4662b2fe7ef12f7e7284
I20260709 12:23:34.063511 10867 catalog_manager.cc:5028] TS c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): tablet cfc5f0c97d6e4662b2fe7ef12f7e7284 (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:23:34.068477 12209 consensus_queue.cc:1048] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:34.072008 11679 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEARNER]: Advancing to term 3
I20260709 12:23:34.079624 11681 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:34.082058 11681 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:34.082859 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:34.083103 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:34.083559 11058 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:34.088478 11125 raft_consensus.cc:3055] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:34.088907 11125 raft_consensus.cc:740] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:34.091964 11058 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:34.089675 11125 consensus_queue.cc:260] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:34.093323 11644 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:34.094319 12183 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:34.094841 12183 raft_consensus.cc:697] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:34.094092 11132 raft_consensus.cc:2955] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:34.095671 12183 consensus_queue.cc:237] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:34.096275 11679 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEARNER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:34.093531 11125 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:34.099929 11056 raft_consensus.cc:1240] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:34.104632 12201 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:34.105965 11130 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:34.107824 12201 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:34.112414 12200 raft_consensus.cc:1064] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
W20260709 12:23:34.112887 12200 raft_consensus.cc:1068] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7: Unable to promote non-voter 0f3b1ccd8aa5412393aa7eb90f2bef95: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:23:34.118897 10866 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6aa9f4fbf45b4a0a88651d571f7b49e4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:34.120705 10882 catalog_manager.cc:5697] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 3 to 4, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New cstate: current_term: 1 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:34.131279 10984 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:34.143374 10984 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:34.146756 11125 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:34.163249 12200 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:34.166375 12200 raft_consensus.cc:1064] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:23:34.169057 12200 consensus_queue.cc:237] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:34.183677 12126 raft_consensus.cc:993] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb: : Instructing follower 0f3b1ccd8aa5412393aa7eb90f2bef95 to start an election
I20260709 12:23:34.184228 12126 raft_consensus.cc:1081] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Signalling peer 0f3b1ccd8aa5412393aa7eb90f2bef95 to start an election
I20260709 12:23:34.185828 11125 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:34.185883 11680 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19"
dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
 from {username='slave'} at 127.0.0.1:41784
I20260709 12:23:34.186668 11680 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:34.187044 11680 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:34.186970 11681 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEARNER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:34.187584 12242 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:34.190176 12201 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:34.190902 10984 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:34.192729 12201 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:34.198508 11680 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:34.199895 12201 raft_consensus.cc:2955] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:34.201573 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:34.202215 11058 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:34.203248 10879 catalog_manager.cc:5697] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 1 to 2, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 2 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:34.202234 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:34.207067 10980 raft_consensus.cc:3055] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:34.207352 10980 raft_consensus.cc:740] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:34.208102 10980 consensus_queue.cc:260] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:34.209162 10980 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:34.209451 10984 raft_consensus.cc:2955] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:34.214752 12243 raft_consensus.cc:993] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7: : Instructing follower bc01179655564f29b83babe396377cbb to start an election
I20260709 12:23:34.215269 12243 raft_consensus.cc:1081] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Signalling peer bc01179655564f29b83babe396377cbb to start an election
I20260709 12:23:34.217211 10979 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e"
dest_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:52828
I20260709 12:23:34.217756 10979 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:34.218132 10979 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:34.219238 11058 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:34.224741 11644 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:34.228561 11680 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:34.226308 10979 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:34.230247 12183 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:34.232409 12183 raft_consensus.cc:697] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:34.235261 10980 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:34.233491 12183 consensus_queue.cc:237] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:34.237054 11125 raft_consensus.cc:2955] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:34.237421 10979 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:34.242934 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:34.244685 11058 raft_consensus.cc:3055] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:34.245000 11058 raft_consensus.cc:740] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:34.245795 11058 consensus_queue.cc:260] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:34.247649 11058 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:34.247776 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:34.248405 11680 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:34.256085 11047 tablet_service.cc:1558] Processing DeleteTablet for tablet 6aa9f4fbf45b4a0a88651d571f7b49e4 with delete_type TABLET_DATA_TOMBSTONED (TS c979ef00e0ad4157b49ebbdc13ce7cd7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41292
I20260709 12:23:34.258010 12240 tablet_replica.cc:333] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:23:34.229547 11681 raft_consensus.cc:2955] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:34.259057 12240 raft_consensus.cc:2243] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:34.260322 12240 raft_consensus.cc:2272] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:34.271411 11058 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:34.279831 10948 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:34.280833 12126 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:34.281412 12126 raft_consensus.cc:697] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 2 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:34.266369 10879 catalog_manager.cc:5697] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index 2 to 5, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:34.273715 11680 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:34.282375 12126 consensus_queue.cc:237] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:34.277776 10882 catalog_manager.cc:5697] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 1 to 2, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 2 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:34.289162 12240 ts_tablet_manager.cc:1916] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:34.313012 12240 ts_tablet_manager.cc:1929] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P c979ef00e0ad4157b49ebbdc13ce7cd7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:34.313560 12240 log.cc:1199] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-1-root/wals/6aa9f4fbf45b4a0a88651d571f7b49e4
I20260709 12:23:34.316787 10867 catalog_manager.cc:5028] TS c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): tablet 6aa9f4fbf45b4a0a88651d571f7b49e4 (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:23:34.334793 11058 consensus_queue.cc:237] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:34.337589 10879 catalog_manager.cc:5697] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 1 to 2, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 2 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:34.340792 10984 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:34.342564 12201 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:34.343538 11679 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:34.347857 12201 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:34.351208 12168 raft_consensus.cc:2955] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:34.352857 10980 raft_consensus.cc:2955] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:34.359825 11679 raft_consensus.cc:2955] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:34.363404 10867 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c7865a5cff5849a2bd74dddc1bcdd8f3 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:34.368386 10882 catalog_manager.cc:5697] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb reported cstate change: config changed from index 5 to 6, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New cstate: current_term: 3 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:34.381156 11121 tablet_service.cc:1558] Processing DeleteTablet for tablet c7865a5cff5849a2bd74dddc1bcdd8f3 with delete_type TABLET_DATA_TOMBSTONED (TS 7518bdeb78f24e67a530754ae48547eb not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:36562
I20260709 12:23:34.382725 12248 tablet_replica.cc:333] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:23:34.383810 12248 raft_consensus.cc:2243] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:34.384719 12248 raft_consensus.cc:2272] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:34.388056 12248 ts_tablet_manager.cc:1916] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:34.403800 12248 ts_tablet_manager.cc:1929] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:23:34.404212 12248 log.cc:1199] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 7518bdeb78f24e67a530754ae48547eb: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-2-root/wals/c7865a5cff5849a2bd74dddc1bcdd8f3
I20260709 12:23:34.405912 10868 catalog_manager.cc:5028] TS 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): tablet c7865a5cff5849a2bd74dddc1bcdd8f3 (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:23:34.422075 12168 raft_consensus.cc:993] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7: : Instructing follower 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:23:34.422681 12201 raft_consensus.cc:1081] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Signalling peer 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:23:34.424067 11132 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:36582
I20260709 12:23:34.424542 11132 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:34.424924 11132 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:34.430533 11132 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:34.432180 11132 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:34.433229 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:34.433454 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:34.434063 11058 raft_consensus.cc:3055] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:34.434360 11058 raft_consensus.cc:740] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:34.433936 11679 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:34.435138 11058 consensus_queue.cc:260] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:34.437495 11058 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:34.441840 11679 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:34.443002 11098 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:23:34.443418 11058 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:34.443706 12162 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:34.444278 12162 raft_consensus.cc:697] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:34.445092 12162 consensus_queue.cc:237] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:34.454743 10879 catalog_manager.cc:5697] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 1 to 2, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 2 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:34.662436 11056 raft_consensus.cc:1275] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:34.664980 12183 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:34.676261 11125 raft_consensus.cc:1275] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:34.677899 12183 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:34.739207 11680 raft_consensus.cc:1275] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:34.740314 12126 consensus_queue.cc:1048] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:34.755571 11056 raft_consensus.cc:1275] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:34.756816 12126 consensus_queue.cc:1048] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:34.824782 11056 raft_consensus.cc:1275] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:34.826293 12076 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:34.832182 10980 raft_consensus.cc:1275] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:34.833833 12183 consensus_queue.cc:1048] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:34.840796 11680 raft_consensus.cc:1275] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:34.843793 12076 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:34.853513 11058 raft_consensus.cc:1275] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:34.856874 12153 consensus_queue.cc:1048] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:35.121153  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:35.176056 11056 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:23:35.176590 11056 raft_consensus.cc:606] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:23:35.179330 11056 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6506ec2922c24d099538b52b0df81502"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:23:35.179863 11056 raft_consensus.cc:606] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:35.182161 11130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:54492
I20260709 12:23:35.182802 11130 raft_consensus.cc:606] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:23:35.185640 10980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4"
dest_uuid: "bc01179655564f29b83babe396377cbb"
mode: GRACEFUL
new_leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
 from {username='slave'} at 127.0.0.1:41958
I20260709 12:23:35.186252 10980 raft_consensus.cc:606] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Received request to transfer leadership to TS 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:35.188825 11056 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "709d2903489748c8a8490194704bc3ca"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:23:35.189316 11056 raft_consensus.cc:606] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:35.191517  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:35.193259  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:35.194032  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:35.231565 12076 raft_consensus.cc:993] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb: : Instructing follower bc01179655564f29b83babe396377cbb to start an election
I20260709 12:23:35.232074 12076 raft_consensus.cc:1081] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Signalling peer bc01179655564f29b83babe396377cbb to start an election
I20260709 12:23:35.232252 11056 consensus_queue.cc:237] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:35.233845 10984 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8"
dest_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:52820
I20260709 12:23:35.234460 10984 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:35.234813 10984 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:35.239354 11130 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:35.241571 10980 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:35.242231 11024 consensus_peers.cc:597] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 46989f4f6130442698a2028fb5bcbf0e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:35.243104 12201 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:35.244004 12168 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:35.246317 10984 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:35.250838 10984 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:35.250993 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:35.251590 11057 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:35.258847 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:35.259582 11130 raft_consensus.cc:3055] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:35.259889 11130 raft_consensus.cc:740] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:35.262966 11130 consensus_queue.cc:260] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:35.264267 11130 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:35.265614 11057 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:35.320423 10948 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:35.270665 12168 raft_consensus.cc:2955] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:35.325434 11130 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:35.327246 12275 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:35.327924 12275 raft_consensus.cc:697] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 2 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:35.328979 12275 consensus_queue.cc:237] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:35.333346 11125 raft_consensus.cc:2955] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:35.358757 10881 catalog_manager.cc:5697] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:35.364235 10879 catalog_manager.cc:5697] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 1 to 2, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 2 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:35.367842 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 101131us
I20260709 12:23:35.372103 10980 raft_consensus.cc:2955] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:35.387274 11057 consensus_queue.cc:237] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:35.389894 12269 raft_consensus.cc:993] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7: : Instructing follower bc01179655564f29b83babe396377cbb to start an election
I20260709 12:23:35.397728 11125 raft_consensus.cc:1275] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:35.409303 12268 raft_consensus.cc:1081] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Signalling peer bc01179655564f29b83babe396377cbb to start an election
I20260709 12:23:35.412463 12168 consensus_queue.cc:1048] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:35.413618 10980 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75"
dest_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:52828
I20260709 12:23:35.414309 10980 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:35.414736 10980 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:35.415613 11024 consensus_peers.cc:597] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2d9fad3893d845fa9208a48c76eb609f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:35.419600 10978 raft_consensus.cc:1275] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:35.425349 12201 consensus_queue.cc:1048] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:35.429229 12274 raft_consensus.cc:993] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb: : Instructing follower 0f3b1ccd8aa5412393aa7eb90f2bef95 to start an election
I20260709 12:23:35.429773 12274 raft_consensus.cc:1081] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Signalling peer 0f3b1ccd8aa5412393aa7eb90f2bef95 to start an election
I20260709 12:23:35.432111 11679 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4"
dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
 from {username='slave'} at 127.0.0.1:41784
I20260709 12:23:35.432718 11679 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:35.433142 11679 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:35.434963 10980 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:35.435616 12168 raft_consensus.cc:2955] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:35.442210 11125 raft_consensus.cc:2955] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:35.459776 10980 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:35.466209 12273 raft_consensus.cc:993] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7: : Instructing follower 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:23:35.466774 12273 raft_consensus.cc:1081] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Signalling peer 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:23:35.469656 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:35.470278 11132 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "709d2903489748c8a8490194704bc3ca"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:36582
I20260709 12:23:35.470454 11057 raft_consensus.cc:3055] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:35.470896 11057 raft_consensus.cc:740] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:35.470973 11132 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:35.471469 11132 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:35.471776 11057 consensus_queue.cc:260] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:35.473078 11057 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:35.472970 11058 consensus_queue.cc:237] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:35.476943 11679 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:35.479784 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:35.480373 11057 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:35.480922 11679 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:35.481228 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:35.481573 10948 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:35.480423 10978 raft_consensus.cc:3055] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:35.482396 10978 raft_consensus.cc:740] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:35.481877 11125 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:35.482831 12275 raft_consensus.cc:2804] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:35.483372 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:35.483394 12275 raft_consensus.cc:697] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 2 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:35.484015 11130 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:35.483464 10978 consensus_queue.cc:260] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:35.478622 10881 catalog_manager.cc:5697] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:35.485409 12275 consensus_queue.cc:237] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:35.489830 10978 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:35.495440 10980 raft_consensus.cc:2955] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:35.501504 11132 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:35.504415 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:35.504650 11132 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:35.505079 10984 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:35.508147 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:35.508742 11057 raft_consensus.cc:3055] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:35.509045 11057 raft_consensus.cc:740] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:35.509197 11130 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:35.498286 10978 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:35.510890 11645 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:23:35.514379 12153 raft_consensus.cc:2804] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:35.514789 11125 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:35.514945 12153 raft_consensus.cc:697] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:35.516223 10979 raft_consensus.cc:1275] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:35.515862 12153 consensus_queue.cc:237] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:35.517556 11024 consensus_peers.cc:597] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d3ee878370114c8d8434e02b9c0aa6be. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:35.518204 12168 consensus_queue.cc:1048] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:35.509862 11057 consensus_queue.cc:260] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:35.521198 11057 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:35.524441 11132 raft_consensus.cc:1275] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:35.526656 12168 consensus_queue.cc:1048] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:35.528631 10984 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:35.529803 11097 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:35.530426 11057 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:35.531471 12076 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:35.539440 12076 raft_consensus.cc:697] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:35.540323 12076 consensus_queue.cc:237] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:35.543933 10880 catalog_manager.cc:5697] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 1 to 2, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 2 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:35.547509 10881 catalog_manager.cc:5697] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 1 to 2, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 2 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:35.555234 12168 raft_consensus.cc:2955] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:35.557298 10879 catalog_manager.cc:5697] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 1 to 2, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 2 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:35.557211 11130 raft_consensus.cc:2955] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:35.570842 10979 raft_consensus.cc:2955] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:35.573755 10881 catalog_manager.cc:5697] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:35.575069 11132 consensus_queue.cc:237] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:35.597416 12201 raft_consensus.cc:993] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7: : Instructing follower 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:23:35.597924 12201 raft_consensus.cc:1081] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Signalling peer 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:23:35.600082 11125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6506ec2922c24d099538b52b0df81502"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:36582
I20260709 12:23:35.600656 11125 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:35.601015 11125 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:35.608412 11125 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:35.609987 11057 raft_consensus.cc:1275] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:35.610594 11125 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:35.614373 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:35.614992 10979 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:35.615227 11098 consensus_peers.cc:597] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 03bda770d3504576acc9bfb2923fb9ff. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:35.615733 12162 consensus_queue.cc:1048] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:35.617228 10984 raft_consensus.cc:1275] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:35.619095 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:35.619649 12076 consensus_queue.cc:1048] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:35.619697 11057 raft_consensus.cc:3055] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:35.621526 11057 raft_consensus.cc:740] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:35.622721 10979 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:35.622527 11057 consensus_queue.cc:260] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:35.624226 11057 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:35.624511 11097 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:35.625363 12162 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:35.625995 12162 raft_consensus.cc:697] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:35.626945 12162 consensus_queue.cc:237] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:35.631181 11057 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:35.633126 12076 raft_consensus.cc:2955] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:35.634487 11057 raft_consensus.cc:2955] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:35.649276 10984 raft_consensus.cc:2955] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:35.652171 10880 catalog_manager.cc:5697] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index -1 to 2, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 1 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:23:35.663856 10881 catalog_manager.cc:5697] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 1 to 2, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 2 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:35.725450 11057 raft_consensus.cc:1275] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:35.726760 12275 consensus_queue.cc:1048] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:35.745672 11125 raft_consensus.cc:1275] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:35.747442 12275 consensus_queue.cc:1048] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:35.816535 12300 ts_tablet_manager.cc:933] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:35.818428 12300 tablet_copy_client.cc:323] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.194:44483
I20260709 12:23:35.820269 11070 tablet_copy_service.cc:140] P c979ef00e0ad4157b49ebbdc13ce7cd7: Received BeginTabletCopySession request for tablet 2d9fad3893d845fa9208a48c76eb609f from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:52804)
I20260709 12:23:35.820819 11070 tablet_copy_service.cc:161] P c979ef00e0ad4157b49ebbdc13ce7cd7: Beginning new tablet copy session on tablet 2d9fad3893d845fa9208a48c76eb609f from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:52804: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-2d9fad3893d845fa9208a48c76eb609f
I20260709 12:23:35.827116 11070 tablet_copy_source_session.cc:215] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:35.830761 12300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9fad3893d845fa9208a48c76eb609f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:35.839828 12302 ts_tablet_manager.cc:933] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:35.852224 12302 tablet_copy_client.cc:323] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.194:44483
I20260709 12:23:35.853979 11070 tablet_copy_service.cc:140] P c979ef00e0ad4157b49ebbdc13ce7cd7: Received BeginTabletCopySession request for tablet 46989f4f6130442698a2028fb5bcbf0e from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:52804)
I20260709 12:23:35.854513 11070 tablet_copy_service.cc:161] P c979ef00e0ad4157b49ebbdc13ce7cd7: Beginning new tablet copy session on tablet 46989f4f6130442698a2028fb5bcbf0e from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:52804: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-46989f4f6130442698a2028fb5bcbf0e
I20260709 12:23:35.856436 12300 tablet_copy_client.cc:806] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:35.857072 12300 tablet_copy_client.cc:670] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:35.862929 12300 tablet_copy_client.cc:538] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:35.863756 11070 tablet_copy_source_session.cc:215] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:35.869488 12302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46989f4f6130442698a2028fb5bcbf0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:35.876238 12300 tablet_bootstrap.cc:492] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:35.884883 12302 tablet_copy_client.cc:806] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:35.885914 12302 tablet_copy_client.cc:670] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:35.892100 12302 tablet_copy_client.cc:538] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:35.904088 12300 tablet_bootstrap.cc:492] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:35.905150 12300 tablet_bootstrap.cc:492] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:35.905311 12302 tablet_bootstrap.cc:492] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:35.910051 12300 ts_tablet_manager.cc:1403] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.034s	user 0.020s	sys 0.008s
I20260709 12:23:35.913632 12300 raft_consensus.cc:359] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:35.914659 12300 raft_consensus.cc:740] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:35.915318 12300 consensus_queue.cc:260] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:35.917340 12300 ts_tablet_manager.cc:1434] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:23:35.920853 11070 tablet_copy_service.cc:342] P c979ef00e0ad4157b49ebbdc13ce7cd7: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-2d9fad3893d845fa9208a48c76eb609f received from {username='slave'} at 127.0.0.1:52804
I20260709 12:23:35.921361 11070 tablet_copy_service.cc:434] P c979ef00e0ad4157b49ebbdc13ce7cd7: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-2d9fad3893d845fa9208a48c76eb609f on tablet 2d9fad3893d845fa9208a48c76eb609f with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:35.939381 12302 tablet_bootstrap.cc:492] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:35.940400 12302 tablet_bootstrap.cc:492] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:35.941201 12302 ts_tablet_manager.cc:1403] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.036s	user 0.020s	sys 0.008s
I20260709 12:23:35.948069 11132 raft_consensus.cc:1275] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:35.950146 12275 consensus_queue.cc:1048] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:35.955834 12302 raft_consensus.cc:359] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:35.956737 12302 raft_consensus.cc:740] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:35.957718 12302 consensus_queue.cc:260] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:35.960376 12302 ts_tablet_manager.cc:1434] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 12:23:35.999207 10980 raft_consensus.cc:1275] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:35.999812 11070 tablet_copy_service.cc:342] P c979ef00e0ad4157b49ebbdc13ce7cd7: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-46989f4f6130442698a2028fb5bcbf0e received from {username='slave'} at 127.0.0.1:52804
I20260709 12:23:36.000284 11070 tablet_copy_service.cc:434] P c979ef00e0ad4157b49ebbdc13ce7cd7: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-46989f4f6130442698a2028fb5bcbf0e on tablet 46989f4f6130442698a2028fb5bcbf0e with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:36.003739 12153 consensus_queue.cc:1048] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:23:36.008698 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 46386.7us
I20260709 12:23:36.023195 12302 ts_tablet_manager.cc:933] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:36.031181 10979 raft_consensus.cc:1275] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:36.033087 12302 tablet_copy_client.cc:323] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.194:44483
I20260709 12:23:36.035097 11070 tablet_copy_service.cc:140] P c979ef00e0ad4157b49ebbdc13ce7cd7: Received BeginTabletCopySession request for tablet d3ee878370114c8d8434e02b9c0aa6be from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:52804)
I20260709 12:23:36.035729 11070 tablet_copy_service.cc:161] P c979ef00e0ad4157b49ebbdc13ce7cd7: Beginning new tablet copy session on tablet d3ee878370114c8d8434e02b9c0aa6be from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:52804: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-d3ee878370114c8d8434e02b9c0aa6be
I20260709 12:23:36.041697 11125 raft_consensus.cc:1275] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:36.045234 11070 tablet_copy_source_session.cc:215] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:36.046360 12162 consensus_queue.cc:1048] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:36.046294 12153 consensus_queue.cc:1048] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:23:36.052306 12302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3ee878370114c8d8434e02b9c0aa6be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:36.078289 12302 tablet_copy_client.cc:806] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:36.078836 11058 raft_consensus.cc:1275] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:36.080583 12274 consensus_queue.cc:1048] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:36.078927 12302 tablet_copy_client.cc:670] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:36.088348 12302 tablet_copy_client.cc:538] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:36.131984 11058 raft_consensus.cc:1275] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:36.139470 12076 consensus_queue.cc:1048] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:36.157471 12302 tablet_bootstrap.cc:492] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:36.204027 12300 ts_tablet_manager.cc:933] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:36.230157 12300 tablet_copy_client.cc:323] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.195:42537
I20260709 12:23:36.232388 11144 tablet_copy_service.cc:140] P 7518bdeb78f24e67a530754ae48547eb: Received BeginTabletCopySession request for tablet 03bda770d3504576acc9bfb2923fb9ff from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:58414)
I20260709 12:23:36.233008 11144 tablet_copy_service.cc:161] P 7518bdeb78f24e67a530754ae48547eb: Beginning new tablet copy session on tablet 03bda770d3504576acc9bfb2923fb9ff from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:58414: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-03bda770d3504576acc9bfb2923fb9ff
I20260709 12:23:36.243708  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:36.278134 11144 tablet_copy_source_session.cc:215] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:36.287405 12300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03bda770d3504576acc9bfb2923fb9ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:36.292416 11056 raft_consensus.cc:1275] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:36.294544 12317 consensus_queue.cc:1048] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:36.323915 10978 raft_consensus.cc:1275] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:36.327636 11679 raft_consensus.cc:1217] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:36.344677 12300 tablet_copy_client.cc:806] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:36.345304 12300 tablet_copy_client.cc:670] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:36.347452 12076 consensus_queue.cc:1048] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:36.363075 12300 tablet_copy_client.cc:538] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:36.389604 12300 tablet_bootstrap.cc:492] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:23:36.422394 11679 raft_consensus.cc:1217] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:36.436301 12302 tablet_bootstrap.cc:492] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:36.443002 12302 tablet_bootstrap.cc:492] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:36.443528 12300 tablet_bootstrap.cc:492] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:36.443769 12302 ts_tablet_manager.cc:1403] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.287s	user 0.022s	sys 0.006s
I20260709 12:23:36.444494 12300 tablet_bootstrap.cc:492] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:23:36.445223 12300 ts_tablet_manager.cc:1403] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.072s	user 0.023s	sys 0.006s
I20260709 12:23:36.447335 12302 raft_consensus.cc:359] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:36.448225 12302 raft_consensus.cc:740] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:36.448879 12302 consensus_queue.cc:260] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:36.451519 12302 ts_tablet_manager.cc:1434] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:23:36.454352 11070 tablet_copy_service.cc:342] P c979ef00e0ad4157b49ebbdc13ce7cd7: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-d3ee878370114c8d8434e02b9c0aa6be received from {username='slave'} at 127.0.0.1:52804
I20260709 12:23:36.454813 11070 tablet_copy_service.cc:434] P c979ef00e0ad4157b49ebbdc13ce7cd7: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-d3ee878370114c8d8434e02b9c0aa6be on tablet d3ee878370114c8d8434e02b9c0aa6be with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:36.454927 12300 raft_consensus.cc:359] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:36.455798 12300 raft_consensus.cc:740] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:23:36.456449 12300 consensus_queue.cc:260] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:36.459348 12300 ts_tablet_manager.cc:1434] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.001s
I20260709 12:23:36.461871 11144 tablet_copy_service.cc:342] P 7518bdeb78f24e67a530754ae48547eb: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-03bda770d3504576acc9bfb2923fb9ff received from {username='slave'} at 127.0.0.1:58414
I20260709 12:23:36.462364 11144 tablet_copy_service.cc:434] P 7518bdeb78f24e67a530754ae48547eb: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-03bda770d3504576acc9bfb2923fb9ff on tablet 03bda770d3504576acc9bfb2923fb9ff with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:36.464435 10980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b"
dest_uuid: "bc01179655564f29b83babe396377cbb"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:41958
I20260709 12:23:36.465044 10980 raft_consensus.cc:606] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:36.468286 11056 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:23:36.468888 11056 raft_consensus.cc:606] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:23:36.474915 11132 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
mode: GRACEFUL
new_leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
 from {username='slave'} at 127.0.0.1:54492
I20260709 12:23:36.475435 11132 raft_consensus.cc:606] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Received request to transfer leadership to TS c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:36.478161  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:23:36.479895  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:36.480667  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:36.605536 11679 raft_consensus.cc:1217] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:37.589823  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:37.650161 12260 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:37.650915 12260 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:37.654172 12260 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:37.659452 12260 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:37.660192 12260 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:37.663120 12260 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:37.737556 12260 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:37.738305 12260 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:37.741586 12260 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:37.873641 12260 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:37.874476 12260 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:37.881177 12325 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:37.881984 12325 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:37.946743 12327 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:37.947470 12327 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:37.965106 12328 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:37.965729 12328 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:37.969550 12335 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:37.970268 12335 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:37.971661 12325 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:37.973673 12325 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:37.974308 12325 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:37.974818 12335 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
I20260709 12:23:37.977363 12326 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:37.979326 12333 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:37.986387 12335 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:37.988063 12335 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:37.991894 12333 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:37.996124 12333 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:37.997865 12335 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:37.986580 12328 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:38.000411 12325 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:37.987095 12326 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.023561 12326 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:38.013114 12327 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:38.035401 12330 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:38.036159 12330 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:38.039086 12341 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:38.039726 12341 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:38.042151 12345 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:38.049592 12345 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.102679 12345 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:38.042743 12330 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:38.143522 12338 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:38.174449 12338 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.176755 12338 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:38.146893 12334 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:38.178634 12334 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.159873 12330 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:38.147733 12336 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:38.181439 12330 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.181680 12336 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:38.183620 12330 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:38.183880 12336 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:38.184552 12327 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:38.160171 12326 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:38.185216 12327 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:38.185290 12326 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:38.187608 12327 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:38.042021 12341 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:38.188261 12327 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:38.188786 12327 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:38.189780 12260 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:38.190272 12325 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:38.187719 12344 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:38.190923 12325 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:38.191072 12344 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:38.193414 12344 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:38.195741 12325 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:38.180845 12334 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:38.150877 12339 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:38.197569 12339 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:38.202409 12340 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:38.203028 12340 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.204069 12339 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:38.187638 12326 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:38.205719 12345 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:38.206559 12346 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:38.206300 12345 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:38.207062 12341 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:38.207604 12341 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.209654 12341 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:38.210896 12327 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:38.205248 12340 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:38.213629 12341 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:38.214278 12341 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.216542 12341 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:38.216709 12347 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:38.217423 12347 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.218286 12343 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:38.218822 12343 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.219802 12340 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:38.222044 12334 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:38.222621 12334 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.224478 12342 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:38.224792 12344 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:38.225059 12342 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:38.225337 12344 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:38.227428 12338 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:38.228055 12326 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:38.227979 12338 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:38.228708 12326 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:38.227451 12342 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:38.230394 12342 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:38.230808 12342 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:38.231220 12347 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:38.231302 12345 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:38.231802 12327 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:38.232306 12327 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:38.233436 12334 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:38.234776 12336 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:38.257467 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:38.235203 12338 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:38.258837 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:38.259572 10980 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 3.
I20260709 12:23:38.261650 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:38.262069 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:38.262135 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:38.261925 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:38.262903 10980 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 1.
I20260709 12:23:38.263514 10979 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 1.
I20260709 12:23:38.266435 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:38.266623 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:38.267319 10980 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 1.
I20260709 12:23:38.255317 12346 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.238899 12333 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:38.238667 12327 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:38.235399 12336 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.220359 12340 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:38.269727 11057 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:23:38.367036 11057 raft_consensus.cc:606] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Received request to transfer leadership to TS 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:38.255450 12330 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:38.372753 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:38.387935 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:38.263442 12334 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:38.268078 12347 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:38.392804 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:38.355041 12329 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:38.356009 12326 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:38.322191 12353 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:38.304545 12338 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:38.356559 12345 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:38.398015 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:38.393527 11132 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:38.373418 12341 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:38.388955 12334 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:38.371579 12333 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.405155 12339 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:38.419298 12326 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:38.444636 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:38.445237 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:38.445889 11132 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:38.446044 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:38.446698 11125 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:38.448195 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:38.448472 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:38.420884 12342 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:38.395900 12330 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.397215 12347 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.424382 12352 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:38.420876 12345 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:38.424937 12353 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.469434 11643 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:38.422176 12341 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.467020 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:38.471824 12354 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:38.460165 12326 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.420601 12338 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:38.490008 11643 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:38.495298 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:38.500885 12331 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:38.501503 12331 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:38.501919 12331 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:38.496013 11643 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:38.502993 12327 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:38.503425 12327 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:38.503793 12327 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:38.496023 11057 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:38.421068 12329 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.454809 12339 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.481204 12343 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:38.498963 12260 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:23:38.516717 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 51213.2us
I20260709 12:23:38.522331 12328 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:38.523329 12357 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:38.510782 11643 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:38.514786 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:38.537724 12331 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:38.511382 12360 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:38.507747 12352 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.543664 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:38.550417 12364 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:38.534706 12325 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:38.535065 12260 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:38.562775 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:38.563366 11057 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 1.
I20260709 12:23:38.552594 12340 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:38.556984 12260 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:38.540899 12328 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:38.564687 10949 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:38.551061 12364 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.557125 12325 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:38.545687 12348 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:38.510221 12354 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:38.573985 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:38.574708 11057 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 1.
I20260709 12:23:38.574743 12325 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:38.566932 12356 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:38.580947 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:38.576939 12353 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:38.548383 12357 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.570667 12334 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:38.572558 12326 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:38.570916 12346 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:38.572683 12333 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:38.566044 12372 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:38.588461 12349 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:38.588652 12345 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:38.576979 12361 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:38.568362 12359 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:38.568370 12332 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:38.594884 12330 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:38.602736 12362 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:38.593694 12347 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:38.553628 12360 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:38.613418 12349 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:38.617324 12361 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:38.615684 12338 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:38.634759 12366 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:38.617374 12326 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:38.620483 12341 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:38.638706 12366 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:38.619943 12332 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:38.676019 12368 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:38.627213 12339 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:38.636965 12352 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:38.681468 12369 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:38.682065 12365 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:38.602499 12372 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.677909 12326 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.593760 12356 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:38.638051 12328 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:38.637421 12331 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:38.634979 12349 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:38.675086 12338 raft_consensus.cc:993] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7: : Instructing follower 0f3b1ccd8aa5412393aa7eb90f2bef95 to start an election
I20260709 12:23:38.698239 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:38.683766 12332 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:38.636180 12378 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:38.706115 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:38.637426 12337 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:38.628556 12362 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.676517 12330 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:38.636986 12351 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:38.617573 12359 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.700120 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:38.699041 11058 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:38.636252 12371 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:38.704695 12364 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:38.690852 12352 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:38.691469 12354 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:38.710455 12376 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:38.694507 12334 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:38.714032 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:38.712752 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:38.588603 12348 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.697126 12329 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:38.716221 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:38.721398 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:38.709985 12338 raft_consensus.cc:1081] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Signalling peer 0f3b1ccd8aa5412393aa7eb90f2bef95 to start an election
I20260709 12:23:38.728694 12357 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:38.709254 12378 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.730973 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:38.735410 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:38.711099 12330 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.754570 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:38.755358 11058 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:38.691185 12369 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.719173 12334 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.719700 12352 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.718047 12376 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.742781 12326 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:38.742604 12340 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:38.742192 12353 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:38.695145 12368 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.726003 12337 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.730625 12351 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.730907 12371 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.699564 12365 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:38.792018 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:38.850847 12340 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:38.838045 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:38.824703 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:23:38.818084 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 249453us
I20260709 12:23:38.856834 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:38.868465 11127 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:38.869076 12360 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:38.867398 11059 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:38.869835 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:38.870198 12373 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:38.870908 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:38.868057 11644 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:38.872685 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:38.857700 10949 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:38.787024 12372 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:38.881386 12348 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:38.823585 12366 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:38.879676 10949 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:38.885905 12385 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:38.886587 12385 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:38.886999 12385 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:38.900735 12385 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
W20260709 12:23:38.901881 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 308696us
I20260709 12:23:38.905354 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:38.906049 11125 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 1.
I20260709 12:23:38.906543 11644 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:38.854024 12353 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:38.907485 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:38.870489 12362 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:38.920081 10978 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad"
dest_uuid: "bc01179655564f29b83babe396377cbb"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:41958
W20260709 12:23:38.989231 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 103770us
I20260709 12:23:38.990696 10978 raft_consensus.cc:606] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:38.878886 12357 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:38.993963 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:38.859304 12349 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:39.002059 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 99147.3us
I20260709 12:23:38.919066 12329 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:38.878989 12359 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:38.904989 12372 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:23:38.979557 11156 debug-util.cc:398] Leaking SignalData structure 0x7b08001c6180 after lost signal to thread 9802
I20260709 12:23:38.921468 12326 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:39.012121 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.033370 10980 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:38.996608 11644 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:38.988687 12354 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:38.907450 12356 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:38.920516 12331 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:38.992751 12328 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:38.988619 12370 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:39.036285 10980 raft_consensus.cc:1240] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:38.906909 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.001626 12364 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:38.920224 12373 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:39.047103 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:23:39.047657 11156 debug-util.cc:398] Leaking SignalData structure 0x7b080015ae40 after lost signal to thread 10916
I20260709 12:23:39.048182 12365 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:39.002195 12357 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:39.048641 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.047719 11681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e"
dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
 from {username='slave'} at 127.0.0.1:41762
W20260709 12:23:39.053603 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 130860us
I20260709 12:23:39.075759 11681 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:39.076171 11681 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:39.032141 12327 consensus_meta.cc:287] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.528s	user 0.002s	sys 0.009s
I20260709 12:23:39.078517 12327 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:39.080824 12327 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:39.057991 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.063419 11679 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:39.063738 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.033147 12372 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:39.068183 12376 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:39.050252 12328 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:39.054155 12331 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:39.070780 12368 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:39.072007 12351 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:39.052762 12340 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:39.074752 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.063777 12335 raft_consensus.cc:2804] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:39.086860 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.037180 12329 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:39.092077 12372 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.109019 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.109834 10979 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:39.110474 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.044760 12354 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:39.096431 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.091320 12328 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.044479 12326 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:39.087608 11133 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:39.090813 12334 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:39.108603 12373 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:39.108736 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.066010 12364 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:39.132802 10978 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:39.103389 12335 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:39.134006 12364 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:39.134416 12335 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.134006 12354 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:39.135763 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.113982 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.116195 12349 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:39.096952 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:39.116454 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.094087 12331 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.087801 12370 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:39.118417 12326 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:39.118276 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.122499 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.126246 12389 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:39.088660 12369 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:39.097016 12357 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:39.131551 12337 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:39.048203 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.095829 12330 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:39.149711 11133 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 1.
W20260709 12:23:39.154266 12260 consensus_meta.cc:287] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.582s	user 0.028s	sys 0.012s
I20260709 12:23:39.155292 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.118045 12329 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:23:39.165834 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 89132us
I20260709 12:23:39.165930 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.112620 12352 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:39.172537 11059 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:39.170488 11681 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:39.168428 11156 debug-util.cc:398] Leaking SignalData structure 0x7b080030f9a0 after lost signal to thread 11009
I20260709 12:23:39.182229 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.179277 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.186586 11681 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:39.187319 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.188189 11133 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
mode: GRACEFUL
new_leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
 from {username='slave'} at 127.0.0.1:54492
I20260709 12:23:39.190225 10980 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:39.167536 12389 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:39.198594 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.181071 12386 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:39.176103 12260 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:39.199239 11059 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:39.202857 12370 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:39.196890 11133 raft_consensus.cc:606] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Received request to transfer leadership to TS c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:39.207867 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.217816 12386 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:39.220435 12328 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:39.224035 12344 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:39.222397 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:23:39.199416 11156 debug-util.cc:398] Leaking SignalData structure 0x7b0800289a40 after lost signal to thread 11084
I20260709 12:23:39.218178 12331 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:39.227941 12328 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:39.206420 12353 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:39.197877 12372 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:39.239313 12372 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:39.240288 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.240422 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.242378 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.243031 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:23:39.243703 11647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.267s	user 0.002s	sys 0.013s
W20260709 12:23:39.244031 11647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.276s	user 0.002s	sys 0.013s
I20260709 12:23:39.244977 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.243090 10980 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
W20260709 12:23:39.237066 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 174447us
I20260709 12:23:39.247308 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.248286 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.248869 11055 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:39.251856 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.252014 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.253542 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.251730 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.253643 10983 raft_consensus.cc:1240] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:39.254220 10979 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:39.254439 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.255693 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.256789 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:39.245785 12378 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:39.259511 11678 raft_consensus.cc:2393] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 3: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:23:39.259706 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.260073 12331 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:39.260586 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.261277 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.261950 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.219010 12332 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:39.257947 11156 debug-util.cc:398] Leaking SignalData structure 0x7b0800360a00 after lost signal to thread 11159
I20260709 12:23:39.264551 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.268118 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.268808 11058 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
W20260709 12:23:39.266435 11156 debug-util.cc:398] Leaking SignalData structure 0x7b080033e880 after lost signal to thread 11160
I20260709 12:23:39.286010 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:39.286686 11053 raft_consensus.cc:3055] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:39.287020 11053 raft_consensus.cc:740] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:39.290704 12395 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:39.282567 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.289680 11053 consensus_queue.cc:260] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:39.296065 11053 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.298588 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.299125 12374 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:39.291378 12395 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:39.299055 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:39.287845 12389 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:39.303234 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:39.302006 11055 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.303587 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.305285 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.282804 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.306540 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.308115 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.308997 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.310750 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.312772 11644 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:39.314298 11676 raft_consensus.cc:1240] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:39.313989 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.315454 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.316630 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:39.317255 11681 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:39.311429 11057 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:39.319185 11023 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:39.328663 12393 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:39.314545 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.339259 12336 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:39.332168 12260 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:39.333575 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.341456 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.347563 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.348248 11056 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:39.338477 11677 raft_consensus.cc:1240] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4. Ops: []
W20260709 12:23:39.327178 11156 debug-util.cc:398] Leaking SignalData structure 0x7b08000f4b20 after lost signal to thread 11705
I20260709 12:23:39.333097 11024 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:39.347465 11023 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:23:39.300604 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.353294 12394 raft_consensus.cc:1064] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:23:39.356340 11055 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 3.
I20260709 12:23:39.358126 11023 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:39.333495 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.360286 11023 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:39.353566 12385 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:39.361446 11023 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:23:39.361964 12389 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:39.362142 12388 raft_consensus.cc:2749] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:39.362452 12389 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:39.362749 12396 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:39.362880 12389 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.363240 12396 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:39.363672 12396 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.365197 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:39.366379 11023 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:39.367671 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.370823 11023 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:39.371542 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.371706 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.354694 12335 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:39.374761 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.376926 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.378716 11053 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:39.300669 12374 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:39.389467 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:39.388975 11024 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:39.367607 12390 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:39.365860 12352 raft_consensus.cc:2804] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:39.389648 11023 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:39.350075 12397 consensus_queue.cc:1059] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:23:39.396274 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.399780 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.370534 12357 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:39.395802 12373 raft_consensus.cc:2804] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:39.414354  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:23:39.385017 12383 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:39.410338 10948 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:39.416687 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.414183 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.417119 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.419541 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.408990 12356 raft_consensus.cc:1064] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:23:39.424181 12336 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:39.424400 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.393416 12361 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:39.424873 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.426522 12336 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:39.426952 12336 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.424847 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.428272 11053 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:39.408782 12329 raft_consensus.cc:2804] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:39.397537 12352 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:39.408699 12390 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:39.411366 12364 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:39.434963 10948 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:39.414783 12373 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
W20260709 12:23:39.408448 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 141601us
I20260709 12:23:39.417865 12383 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
W20260709 12:23:39.438411 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 113222us
I20260709 12:23:39.439844 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:39.443138 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.444186 10948 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:39.449973 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.451931 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.452333 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:39.453377 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:39.454154 11674 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:39.454591 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:39.417171 12338 consensus_queue.cc:1059] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:23:39.430583 12329 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:39.434039 12352 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.458120 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.439172 12364 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:39.458869 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.460325 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.461113 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:39.443169 12373 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.432426 12332 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:39.437563 12390 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.463079 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:39.411578 12388 consensus_queue.cc:1059] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:23:39.464788 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:39.459705 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.441789 12370 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:39.461943 12330 raft_consensus.cc:2804] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:39.525699 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:39.460254 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:39.578088 11674 raft_consensus.cc:1240] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:39.449631 12383 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.580179 12386 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:39.530123 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.532022 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.522441 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.530179 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.472365 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.535748 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.465942 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.534157 12395 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:39.592535 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:39.593375 11680 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:39.519093 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:23:39.541596 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 93929.9us
I20260709 12:23:39.470472 10948 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:39.599221 11644 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:23:39.599422 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 129065us
I20260709 12:23:39.600064 11644 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:39.601393 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.519444 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.519793 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.589710 10881 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41120 (request call id 262) took 1565 ms. Trace:
I20260709 12:23:39.605933 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:39.518474 10981 raft_consensus.cc:1240] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:39.571877 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:39.606307 10881 rpcz_store.cc:276] 0709 12:23:38.019845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:38.034281 (+ 14436us) service_pool.cc:224] Handling call
0709 12:23:39.585255 (+1550974us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":295910,"reported_tablets":6}
I20260709 12:23:39.467069 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.517270 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.467253 12329 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.527519 12364 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.584247  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:39.587215 12374 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:39.463917 12371 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:39.597049 10949 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:39.603127 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:39.576835 12370 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:39.604180 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.603793 12363 raft_consensus.cc:1064] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:23:39.604693 11055 raft_consensus.cc:2393] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 2: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:23:39.631539 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.632133 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.633896 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.634339 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.574702 12336 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:39.600394 10948 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:39.609766 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.612748 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.586229 12330 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:39.615615 12401 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:39.616485 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.635373 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.647080 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.623208 12370 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.609030 12395 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:39.608629 12342 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:39.644366 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.634717 12371 raft_consensus.cc:2804] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:23:39.653133 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 52823us
I20260709 12:23:39.651755 11025 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:39.676425 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.588963 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.652177 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.677101 11025 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:39.660647 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:39.648845 12330 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.683396 11025 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:39.689569 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.670774 12385 raft_consensus.cc:2749] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:23:39.700227 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 105332us
I20260709 12:23:39.684757 12405 raft_consensus.cc:2749] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:39.673281 12342 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:39.673848 12371 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:39.711213 10948 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
W20260709 12:23:39.673043 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 46022.9us
I20260709 12:23:39.685714 12388 raft_consensus.cc:2749] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:39.679901 12395 raft_consensus.cc:697] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:39.734283 11058 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:39.699414 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:39.712699 12342 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.727701 12397 raft_consensus.cc:2749] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:23:39.755595 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 52691us
I20260709 12:23:39.757740 11025 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:39.759462 11680 raft_consensus.cc:1240] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:39.758038 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:23:39.765018 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 349397us
I20260709 12:23:39.749114 11677 raft_consensus.cc:1240] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:39.767022 11023 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:39.687235 12401 raft_consensus.cc:697] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:23:39.777782 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 66668us
I20260709 12:23:39.778731 10948 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:39.773309 12371 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.787424 11025 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
W20260709 12:23:39.770272 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 134251us
I20260709 12:23:39.764153 12385 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:39.782436 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.789500 11643 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:39.791725 11643 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:39.791949 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:39.793128 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:39.780221 12337 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:39.800910 11643 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:39.801081 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:39.784442 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:39.791023 12392 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:39.763809 11645 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:39.795282 12260 raft_consensus.cc:2749] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:39.799229 12338 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:39.793764 12384 raft_consensus.cc:2749] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:39.807386 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:39.814253 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:39.815120 10949 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:39.817157 12325 consensus_queue.cc:1059] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:39.802977 12328 raft_consensus.cc:2749] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:39.796067 12385 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:39.818485 11678 raft_consensus.cc:1240] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:39.765777 12356 consensus_queue.cc:237] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:39.819216 12338 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:39.820365 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:39.821365 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:39.822235 11025 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:39.823807 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.800750 12337 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:39.827431 12402 raft_consensus.cc:2749] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:39.799724 12395 consensus_queue.cc:237] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:39.833102 12388 raft_consensus.cc:2749] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:39.833478 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:23:39.835057 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 56420.5us
I20260709 12:23:39.793292 12404 consensus_queue.cc:1059] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.182s
I20260709 12:23:39.840574 11098 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:39.843333 10948 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:39.834197 12338 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.846534 10948 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:39.848443 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:39.845319 12365 raft_consensus.cc:2749] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:39.852140 12355 raft_consensus.cc:2804] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:39.852578 12355 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:39.835956 12260 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:39.852960 12355 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.831279 12392 raft_consensus.cc:2749] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:39.855400 10948 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:39.837793 12337 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.898347 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:39.835960 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:23:39.900475 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 55401us
I20260709 12:23:39.908154 11098 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:39.914139 12407 raft_consensus.cc:2749] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:23:39.837072 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 86721.2us
I20260709 12:23:39.918818 11098 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:39.926973 12351 raft_consensus.cc:2749] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:39.833124 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:39.938716 11098 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:39.945729 12338 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:39.946650 12335 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:39.852298 11673 raft_consensus.cc:1217] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:39.970141 11098 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:39.923121 11675 raft_consensus.cc:1240] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:39.915788 12336 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:39.997107 11098 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:40.003047 12391 raft_consensus.cc:2749] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:39.928714 12392 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:40.012765 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:40.013731 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:39.612520  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:40.014902 10879 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41106 (request call id 278) took 1710 ms. Trace:
I20260709 12:23:40.016870 11098 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:40.018193 10879 rpcz_store.cc:276] 0709 12:23:38.304334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:38.322658 (+ 18324us) service_pool.cc:224] Handling call
0709 12:23:40.014836 (+1692178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":926604,"reported_tablets":1}
W20260709 12:23:40.022168 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 200049us
I20260709 12:23:39.952577 12346 raft_consensus.cc:2804] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:39.952344 12367 raft_consensus.cc:2749] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:39.836987 12401 consensus_queue.cc:237] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:40.045833 10984 raft_consensus.cc:1240] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 1. Current term is 2. Ops: []
W20260709 12:23:40.054301 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 232389us
I20260709 12:23:40.016950 12359 raft_consensus.cc:2749] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:40.016073 12392 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:40.031508 12340 raft_consensus.cc:2749] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:40.030505 12345 raft_consensus.cc:2749] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:40.039203 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:40.041193 12346 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:40.007282 11645 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:40.071589 12346 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:40.084270 12369 raft_consensus.cc:993] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb: : Instructing follower c979ef00e0ad4157b49ebbdc13ce7cd7 to start an election
I20260709 12:23:40.084846 12369 raft_consensus.cc:1081] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Signalling peer c979ef00e0ad4157b49ebbdc13ce7cd7 to start an election
W20260709 12:23:40.085215 12383 consensus_meta.cc:287] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.505s	user 0.006s	sys 0.002s
I20260709 12:23:40.062422 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:40.086268 12338 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:40.064257 12392 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:40.044957 12364 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:40.085630 12383 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:40.113305 12389 consensus_meta.cc:287] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.750s	user 0.005s	sys 0.004s
I20260709 12:23:40.114229 11057 raft_consensus.cc:1240] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 1. Current term is 2. Ops: []
W20260709 12:23:40.115322 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 259958us
I20260709 12:23:40.116925 10948 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:40.120743 12391 raft_consensus.cc:2804] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:40.121230 12391 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:40.122179 10948 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:40.125764 10948 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:40.121590 12391 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:40.103099 12335 raft_consensus.cc:2749] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:40.122408 12389 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:40.140249 11054 raft_consensus.cc:1240] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:40.144507 10948 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:40.127120 12336 raft_consensus.cc:2804] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:23:40.119688 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 160629us
I20260709 12:23:40.101939 12330 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:40.153340 12347 raft_consensus.cc:3055] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:40.185657 12392 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:40.188270 12392 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:40.175676 12347 raft_consensus.cc:740] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:40.160272 12336 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:40.168845 12364 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:23:40.211527 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 155743us
I20260709 12:23:40.225333 10949 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:23:40.235060 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 211861us
I20260709 12:23:40.212218 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:40.215723 12336 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:40.210820 12392 raft_consensus.cc:2749] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:40.199703 12418 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:23:40.232075 12396 consensus_meta.cc:287] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.868s	user 0.010s	sys 0.003s
I20260709 12:23:40.236212 11098 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:40.245198 12389 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:23:40.245604 12390 consensus_meta.cc:287] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.664s	user 0.007s	sys 0.003s
W20260709 12:23:40.259738 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 229075us
W20260709 12:23:40.292825 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 235648us
W20260709 12:23:40.331143 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 94992.4us
I20260709 12:23:40.369414 11098 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:40.371281 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:40.372471 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:23:40.317052 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 91788us
I20260709 12:23:40.374171 10949 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:40.230700 11645 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:23:40.388191 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 322688us
I20260709 12:23:40.391402 11025 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:40.397095 11098 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:40.346791 12367 raft_consensus.cc:2749] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:40.243856 12347 consensus_queue.cc:260] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:40.389865 12390 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:40.398756 12347 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:40.400672 12390 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:40.406786 10980 raft_consensus.cc:1275] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:40.408516 12368 raft_consensus.cc:2749] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:40.410737 12421 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:40.411172 12389 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:40.411334 12421 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:40.411741 12389 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:40.413679 12421 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:40.415289 11098 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:40.423425 12424 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:40.414471 12361 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:40.425072 12404 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:40.424870 12361 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:40.258894 12385 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:40.415026 11025 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:40.425123 12364 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:40.428409 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:40.428582 12381 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:40.389346 12374 raft_consensus.cc:3055] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:40.478646 12364 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:40.430321 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:40.410287 12368 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:40.413817 12389 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:23:40.470430 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 46307.6us
W20260709 12:23:40.424754 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 211457us
I20260709 12:23:40.478053 12361 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:40.415570 12407 raft_consensus.cc:2749] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:40.247049 12396 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:40.501814 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 86868.5us
I20260709 12:23:40.502754 11025 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:40.477491 12392 raft_consensus.cc:2749] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:40.425742 12404 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:40.390025 12344 raft_consensus.cc:3055] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:40.414281 12406 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:40.424258 12424 raft_consensus.cc:2749] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:40.414800 12356 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:40.494813 11098 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:40.516909 11098 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:40.415982 12383 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:40.258044 12371 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:40.509418 12370 consensus_meta.cc:287] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.832s	user 0.007s	sys 0.004s
W20260709 12:23:40.506733 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:40.496609 12373 consensus_meta.cc:287] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.920s	user 0.020s	sys 0.005s
I20260709 12:23:40.481750 12374 raft_consensus.cc:740] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:40.527549 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:40.511898 12410 raft_consensus.cc:2749] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:40.512482 11055 raft_consensus.cc:1240] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:40.512863 12430 raft_consensus.cc:2749] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:40.504370 11025 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:40.511746 11678 raft_consensus.cc:1275] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:40.510618 12389 raft_consensus.cc:2749] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:40.509789 12344 raft_consensus.cc:740] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:40.513545 12396 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:40.574227 12344 consensus_queue.cc:260] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:40.574882 12340 consensus_queue.cc:1059] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:23:40.541416 12394 consensus_queue.cc:237] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:40.563544 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 59269.5us
I20260709 12:23:40.521687 12343 consensus_queue.cc:1059] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:23:40.578861 12343 raft_consensus.cc:3055] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:40.579231 12343 raft_consensus.cc:740] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
W20260709 12:23:40.579916 12342 consensus_meta.cc:287] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.815s	user 0.011s	sys 0.000s
I20260709 12:23:40.580091 12343 consensus_queue.cc:260] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:40.580338 12342 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:40.580967 12367 raft_consensus.cc:3055] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:40.581389 12367 raft_consensus.cc:740] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:40.523138 12330 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:40.499807 12381 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:40.535094 12373 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:40.525326 12421 raft_consensus.cc:2749] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:40.522307 12359 raft_consensus.cc:2749] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:40.577318 12344 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:40.497488 12368 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:40.570459 12425 raft_consensus.cc:2749] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:40.611240 12371 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:40.612063 12404 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:40.534500 12406 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
W20260709 12:23:40.583207 12337 consensus_meta.cc:287] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.662s	user 0.004s	sys 0.007s
I20260709 12:23:40.621719 12381 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:40.627415 12405 raft_consensus.cc:3055] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:40.627962 12405 raft_consensus.cc:740] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:40.628827 12405 consensus_queue.cc:260] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:40.630549 12374 consensus_queue.cc:260] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:40.631886 12374 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:40.633342 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.816547 11645 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
W20260709 12:23:40.843506 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 220624us
I20260709 12:23:40.843933 12332 raft_consensus.cc:2749] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:40.844765 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:40.821255 11054 raft_consensus.cc:1240] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 1. Current term is 2. Ops: []
W20260709 12:23:40.822935 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.534861 11051 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
 from {username='slave'} at 127.0.0.1:41294
I20260709 12:23:40.851255 11051 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:40.831207 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:23:40.833549 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 457389us
I20260709 12:23:40.836788 10975 raft_consensus.cc:1240] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:40.876919 11672 raft_consensus.cc:2393] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 2: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:23:40.838569 11675 raft_consensus.cc:1240] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 1. Current term is 2. Ops: []
W20260709 12:23:40.839699 10948 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.004s	sys 0.003s
W20260709 12:23:40.617475 12329 consensus_meta.cc:287] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 1.000s	user 0.009s	sys 0.003s
I20260709 12:23:40.636360 12342 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:40.633322 12337 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:40.531396 12345 consensus_queue.cc:1059] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 12:23:40.582217 12367 consensus_queue.cc:260] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:40.893260 12329 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:40.532874 12370 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:40.647423 12391 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:40.901070 11057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 960) took 1203 ms. Trace:
I20260709 12:23:40.901286 12364 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:40.902832 12391 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:40.596138 12396 consensus_queue.cc:1048] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 12:23:40.640017 12405 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:40.844901 11645 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:40.819577 11025 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
W20260709 12:23:40.845175 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 281750us
W20260709 12:23:40.848059 10950 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.042s	sys 0.030s
I20260709 12:23:40.563963 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:23:40.852471 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.879331 10949 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:40.882690 12372 raft_consensus.cc:993] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb: : Instructing follower 7518bdeb78f24e67a530754ae48547eb to start an election
W20260709 12:23:40.906986 10950 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.043s	sys 0.031s
I20260709 12:23:40.907349 12332 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:40.908028 12332 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:40.908664 12332 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:40.909719 11098 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:23:40.910266 12345 consensus_queue.cc:1059] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:23:40.911427 12336 consensus_meta.cc:287] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.666s	user 0.002s	sys 0.017s
I20260709 12:23:40.912184 12345 raft_consensus.cc:2749] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:40.912602 12361 raft_consensus.cc:3055] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:40.913051 12361 raft_consensus.cc:740] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
W20260709 12:23:40.884436 10948 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.004s	sys 0.003s
I20260709 12:23:40.528143 12356 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:40.914780 12361 consensus_queue.cc:260] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:40.903139 12352 consensus_meta.cc:287] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 1.337s	user 0.015s	sys 0.003s
I20260709 12:23:40.906632 12370 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:40.901779 11057 rpcz_store.cc:276] 0709 12:23:39.697931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.698088 (+   157us) service_pool.cc:224] Handling call
0709 12:23:39.698540 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:40.119085 (+420545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:40.900290 (+781205us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b5400348854. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:40.900815 (+   525us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":955511040}
I20260709 12:23:40.918632 12433 raft_consensus.cc:2749] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:40.907855 12372 raft_consensus.cc:1081] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Signalling peer 7518bdeb78f24e67a530754ae48547eb to start an election
W20260709 12:23:40.920027 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 101173us
I20260709 12:23:40.912045 12336 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:40.911926 10949 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:40.921248 11025 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:40.924106 12418 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:40.924365 12336 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:40.884552 11051 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:40.906728 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 62112.4us
I20260709 12:23:40.915747 12419 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:40.927251 12417 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:40.930374 12419 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:40.932883 12368 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:40.928933 11055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 945) took 1298 ms. Trace:
I20260709 12:23:40.929001 11645 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:40.938040 12328 raft_consensus.cc:2749] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:40.940577 11645 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:40.941821 12328 raft_consensus.cc:2749] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:40.942718 12328 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:40.944295 12328 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:40.948805 12372 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
W20260709 12:23:40.950060 12395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.054s	sys 0.118s
I20260709 12:23:40.921598 12383 raft_consensus.cc:2749] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:40.951435 12352 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:40.936179 11055 rpcz_store.cc:276] 0709 12:23:39.630489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.635841 (+  5352us) service_pool.cc:224] Handling call
0709 12:23:39.636093 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:40.533362 (+897269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:40.928381 (+395019us) spinlock_profiling.cc:243] Waited 876 ms on lock 0x7b5400276fd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:40.928737 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2015080192}
W20260709 12:23:40.954200 12355 consensus_meta.cc:287] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 1.095s	user 0.016s	sys 0.000s
I20260709 12:23:40.954370 12352 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:40.956248 12361 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:40.956920 12345 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:40.957141 11053 raft_consensus.cc:1240] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:40.951455 11676 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:40.974428 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:40.950341 12372 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:40.958215 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:40.975567 11055 raft_consensus.cc:2393] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 2: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:40.975978 10977 raft_consensus.cc:2393] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 2: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:40.960022 12355 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:40.977357 12372 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:40.965493 12329 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:40.959554 12356 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:40.966506 11098 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:40.963428 11643 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:40.974526 12345 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:40.959234 12373 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:40.986522 12345 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:40.991616 12398 raft_consensus.cc:2764] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:23:40.993842 12395 raft_consensus.cc:2749] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:41.000145 12343 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.008040 11098 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:23:41.010480 12367 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:41.005337 12406 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:40.984793 12419 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:41.022591 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:41.022306 12340 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:41.013906 12345 raft_consensus.cc:2749] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:41.032301 11055 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
W20260709 12:23:41.038373 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.042001 12328 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:41.044070 11644 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:41.044988 12328 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:41.046960 12421 raft_consensus.cc:3055] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:41.047487 12421 raft_consensus.cc:740] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:41.048913 12421 consensus_queue.cc:260] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:41.050429 12381 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:41.051014 11676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41774 (request call id 277) took 1245 ms. Trace:
I20260709 12:23:41.051254 12381 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:41.051468 11676 rpcz_store.cc:276] 0709 12:23:39.805898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.814146 (+  8248us) service_pool.cc:224] Handling call
0709 12:23:39.895155 (+ 81009us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:40.974928 (+1079773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:41.050630 (+ 75702us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54006801d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:41.050935 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2428140800}
I20260709 12:23:41.054868 12332 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:41.059670 12381 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:41.063623 11098 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:23:41.069854 12337 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:41.072266 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:41.072181 11051 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:41.073231 11676 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.074594 12363 consensus_queue.cc:237] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:41.079016 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.080341 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:41.081202 11051 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:23:41.084453 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:41.084982 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.040145 12355 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:41.089537 11053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 942) took 1650 ms. Trace:
I20260709 12:23:41.090135 10984 raft_consensus.cc:1240] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:41.090119 12365 raft_consensus.cc:2749] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:41.091485 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:41.101022 12389 consensus_queue.cc:1048] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:41.101279 11023 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:23:41.101788 10975 raft_consensus.cc:2393] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 3: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:41.092410 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:41.092730 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:41.093724 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:41.094501 12422 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:41.094874 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:41.105151 10976 raft_consensus.cc:2393] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 2: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:41.104893 12422 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:41.098430 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:41.107192 10981 raft_consensus.cc:2393] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 3: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:41.099252 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:41.099920 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:41.108987 10982 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:41.096083 11053 rpcz_store.cc:276] 0709 12:23:39.438946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.439069 (+   123us) service_pool.cc:224] Handling call
0709 12:23:39.439357 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:40.977275 (+1537918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:41.088447 (+111172us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b5400188dd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:41.089475 (+  1028us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3489709824}
I20260709 12:23:41.100329 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:23:41.110669 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 77419.6us
I20260709 12:23:41.111511 11098 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:23:41.112121 12422 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:23:41.114835 12437 log.cc:927] Time spent T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:23:41.112265 12332 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:23:41.119033 12346 consensus_meta.cc:287] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 1.014s	user 0.008s	sys 0.011s
I20260709 12:23:41.119661 12346 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:41.122394 12421 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.122526 12365 raft_consensus.cc:2749] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:23:41.052874 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 112517us
I20260709 12:23:41.131052 11053 raft_consensus.cc:1240] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:41.137284 12337 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:41.138362 12381 raft_consensus.cc:2749] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:41.138875 12365 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:41.139547 12346 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:41.138537 12345 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:41.148316 11098 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:41.129040 12389 consensus_queue.cc:1059] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:23:41.140834 12365 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:41.147758 12406 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:41.162381 12340 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.165339 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:41.167001 12345 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:41.169628 12345 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:41.170215 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:41.170959 11125 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:41.171041 12406 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:41.173398 12406 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:41.139524 12337 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:41.176542 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:41.177403 11054 raft_consensus.cc:2393] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 2: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:41.178411 12365 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:41.179034 12365 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:41.179929 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:41.181159 12381 raft_consensus.cc:3055] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:41.181610 12381 raft_consensus.cc:740] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:41.182659 12381 consensus_queue.cc:260] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:41.184006 12260 consensus_queue.cc:1059] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:41.179805 12365 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:41.185148 12260 raft_consensus.cc:3055] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:41.185554 12260 raft_consensus.cc:740] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:41.186890 12365 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:41.187342 11672 raft_consensus.cc:1240] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:41.186811 12260 consensus_queue.cc:260] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:41.188544 12260 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:41.192843 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:41.193984 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:41.194437 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:41.156895 10948 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:41.195680 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:23:41.196419 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 53666.3us
I20260709 12:23:41.176496 12337 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:41.199123 12337 raft_consensus.cc:2749] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:41.183960 12381 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.202337 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:41.203938 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:41.205417 11672 raft_consensus.cc:2393] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 2: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:23:41.210091 10948 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:41.214061 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:41.221573 12337 raft_consensus.cc:2804] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:41.222124 12337 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:41.222553 12337 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.223974 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:23:41.228034 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 66085.3us
W20260709 12:23:41.230273 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 95841.4us
I20260709 12:23:41.231915 12422 consensus_queue.cc:1059] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:41.229697 11645 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:41.234763 12340 raft_consensus.cc:2749] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:41.155889 12424 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:41.245285 12338 raft_consensus.cc:1027] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: attempt to promote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 12:23:41.247869 12332 raft_consensus.cc:2749] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:41.253320 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:41.253902 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:41.254992 11132 raft_consensus.cc:1275] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:41.255478 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:41.256202 11130 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:41.247756 12422 raft_consensus.cc:3055] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:41.257036 12422 raft_consensus.cc:740] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:41.258138 12422 consensus_queue.cc:260] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:41.259505 12422 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.260159 12337 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:41.261049 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:41.266026 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:41.266785 11130 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:41.255599 12424 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:41.274565 11125 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
W20260709 12:23:41.277756 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 67785.9us
I20260709 12:23:41.282629 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:41.284960 12424 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:41.289083 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:41.289896 11130 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:41.290182 12405 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:41.290860 12405 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:41.319419 11133 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:41.320418 12419 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:23:41.319468 12438 log.cc:927] Time spent T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:23:41.322263 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.322819 11098 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:23:41.324283 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 52334.4us
W20260709 12:23:41.324476 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.327090 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:41.338245 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:41.336935 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:41.341764 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:41.321200 12419 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:41.325317 12405 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:41.342473 11130 raft_consensus.cc:3055] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:41.344621 11130 raft_consensus.cc:740] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:41.343650 12424 raft_consensus.cc:2749] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:41.345371 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:41.345976 12334 raft_consensus.cc:3055] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:41.346467 12334 raft_consensus.cc:740] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:41.346654 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:41.347543 12419 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:41.348217 11132 raft_consensus.cc:1275] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:41.348630 11645 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:41.345964 11130 consensus_queue.cc:260] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:41.349974 11645 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:41.350664 12260 raft_consensus.cc:2749] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:41.351426 12260 raft_consensus.cc:2749] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:41.349995 11128 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
W20260709 12:23:41.352537 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 88272.3us
I20260709 12:23:41.353603 12334 consensus_queue.cc:260] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:41.350169 11130 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:41.340202 12367 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:41.357826 10948 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:23:41.358340 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.359051 12419 raft_consensus.cc:2749] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:41.359167 12367 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:41.360760 11672 raft_consensus.cc:1275] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:41.362913 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:41.365042 11129 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 3.
W20260709 12:23:41.366392 12374 consensus_meta.cc:287] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.734s	user 0.011s	sys 0.002s
I20260709 12:23:41.372784 12334 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.376667 12367 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:41.380254 11126 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:41.385164 11025 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:41.356431 12337 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:41.386773 11023 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:23:41.387562 12405 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.388970 11023 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:41.389737 12381 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:41.390111 12381 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:41.390533 12381 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:41.382886 11676 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:41.391462 11098 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:41.390235 12394 consensus_queue.cc:1048] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:23:41.393180 11098 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:41.393929 11024 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:41.398175 12421 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:41.401635 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:41.402364 10977 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:41.384302 11131 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:41.412757 12421 raft_consensus.cc:2749] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:41.410702 10981 raft_consensus.cc:1275] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:41.387347 12422 raft_consensus.cc:2749] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:41.421440 10979 raft_consensus.cc:1240] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:41.417465 12394 raft_consensus.cc:2804] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:41.432189 12391 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:41.432830 12391 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:41.432238 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:41.437005 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:41.439330 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.441737 11130 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:41.435210 11025 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:41.442656 10948 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:41.443023 11134 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:41.430734 12394 raft_consensus.cc:697] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:41.447990 12422 consensus_queue.cc:1048] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
W20260709 12:23:41.452138 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.430033 12355 consensus_queue.cc:1059] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:23:41.454398 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:41.438870 12421 consensus_queue.cc:1059] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:23:41.455591 12363 raft_consensus.cc:2749] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:41.464862 12336 raft_consensus.cc:2804] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:41.484162 11025 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:41.468047 11129 raft_consensus.cc:1275] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:41.483197 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:41.493760 10948 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:41.496855 11133 raft_consensus.cc:1275] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:41.481449 12336 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:41.509243 11057 raft_consensus.cc:1240] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:41.489154 10981 raft_consensus.cc:1240] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:41.481463 10977 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:41.486897 12363 consensus_queue.cc:1048] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:23:41.511238 12336 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.510731 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:41.514989 12398 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:41.529520 12398 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:41.531932 12398 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:41.525581 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:41.533057 10976 raft_consensus.cc:1240] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:41.533399 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:41.534024 11055 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:41.524094 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:41.534926 11672 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:41.537513 10977 raft_consensus.cc:1240] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:41.538237 10979 raft_consensus.cc:1240] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:41.538534 12372 raft_consensus.cc:3055] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:41.523945 12401 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:23:41.525434 11025 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:41.540056 12381 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:41.541185 11025 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:41.542853 11025 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:41.543272 10977 raft_consensus.cc:1240] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:41.543443 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:41.543624 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:41.543866 12338 raft_consensus.cc:2749] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:41.544225 10978 raft_consensus.cc:2393] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 2: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:41.544442 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:41.545092 12338 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:41.545228 10978 raft_consensus.cc:1240] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:41.514640 12408 raft_consensus.cc:2804] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:41.527511 11023 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:41.545866 12408 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:41.546314 12408 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:41.528801 11674 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:41.538879 12372 raft_consensus.cc:740] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:41.541380 10982 raft_consensus.cc:1240] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:41.547103 12389 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:41.545472 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:41.547765 10980 raft_consensus.cc:1240] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:41.548139 12343 raft_consensus.cc:3055] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:41.545107 10975 raft_consensus.cc:1240] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:41.516067 12394 consensus_queue.cc:237] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:41.545739 12373 raft_consensus.cc:2749] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:23:41.548134 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 60430.8us
I20260709 12:23:41.525669 12355 raft_consensus.cc:2749] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:41.551317 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:41.546653 10983 raft_consensus.cc:1240] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:41.558318 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:41.545763 10977 raft_consensus.cc:1240] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:41.555222 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:41.556707 12343 raft_consensus.cc:740] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:41.562129 11134 raft_consensus.cc:2393] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 2: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:41.555751 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:41.555217 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:41.555248 12389 raft_consensus.cc:697] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:41.557168 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:41.559455 10978 raft_consensus.cc:1240] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:41.545526 12338 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:41.561945 10948 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:41.542876 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:41.562520 12398 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:41.548929 10879 catalog_manager.cc:5697] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 2 to 3, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 3 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:41.570261 10981 raft_consensus.cc:2393] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 2: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:41.571216 12355 raft_consensus.cc:2749] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:41.570791 12343 consensus_queue.cc:260] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:41.572286 12343 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.574397 11055 raft_consensus.cc:2393] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 3: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:41.566659 12338 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.578471 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:41.579090 12389 consensus_queue.cc:237] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:41.580078 11054 raft_consensus.cc:1275] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:41.560074 12391 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:41.561231 11051 raft_consensus.cc:1240] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:41.574935 12372 consensus_queue.cc:260] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:41.586232 12398 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:23:41.587208 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:41.584722 12372 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.590902 12405 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:41.593631 10879 catalog_manager.cc:5697] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 1 to 2, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 2 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:41.602051 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:41.603026 11677 raft_consensus.cc:2393] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 2: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:23:41.604192 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:41.603987 10975 raft_consensus.cc:2955] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:41.605583 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:41.604019 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:41.606947 11672 raft_consensus.cc:2393] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 2: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:23:41.599025 11645 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:41.598326 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:41.608498 12398 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:41.603261 12408 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:41.611593 12361 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:41.608408 11645 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:41.608811 11024 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:23:41.613757 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:41.614519 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:41.631314 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:41.632263 12374 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:41.632781 12374 raft_consensus.cc:697] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:41.615123 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:41.615330 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:41.639043 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:41.636422 12363 raft_consensus.cc:2749] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:41.640959 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:41.642163 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:41.643194 11132 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:36576
I20260709 12:23:41.643491 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:41.643913 11132 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:41.644309 11132 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.617726 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:41.622887 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:41.624830 11672 raft_consensus.cc:1240] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:41.626205 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:41.609041 12398 raft_consensus.cc:697] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:41.628767 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:41.628687 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:41.629987 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:41.567948 12381 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:41.634994 12374 consensus_queue.cc:237] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:41.635855 11058 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:41.636394 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:41.609673 12422 raft_consensus.cc:2955] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
W20260709 12:23:41.665845 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 123075us
I20260709 12:23:41.683406 11025 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:41.681267 10948 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:41.686748 12408 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:41.682049 11674 raft_consensus.cc:2393] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 2: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:23:41.678030 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:41.687412 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:41.665577 12367 consensus_queue.cc:1059] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:23:41.691891 12355 raft_consensus.cc:2749] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:41.700042 12338 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:41.702167 11675 raft_consensus.cc:1240] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:41.678013 12424 consensus_queue.cc:1059] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:23:41.703398 12424 raft_consensus.cc:3055] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:41.703763 12424 raft_consensus.cc:740] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:41.704700 12424 consensus_queue.cc:260] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:41.676893 12421 consensus_queue.cc:1059] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:23:41.705744 12340 raft_consensus.cc:3055] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:41.712193 11053 raft_consensus.cc:2410] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:23:41.711359 11025 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:41.711954 11643 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:41.721197 11132 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:41.734212 12340 raft_consensus.cc:740] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:41.705964 12424 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.735620 12340 consensus_queue.cc:260] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:41.736873 12340 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.737727 12338 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:23:41.741593 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 65363.2us
I20260709 12:23:41.695936 12405 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:41.748798 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:41.706382 12346 raft_consensus.cc:3055] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:23:41.759768 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 48500.4us
I20260709 12:23:41.760473 11025 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:41.748634 12328 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:41.762292 12405 raft_consensus.cc:697] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:41.763331 12405 consensus_queue.cc:237] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:41.749257 12367 consensus_queue.cc:1059] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:23:41.758818 12408 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:41.766829 12408 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:41.767213 12408 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:41.685153 12336 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:41.653198 12361 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:41.770694 11132 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:41.713706 12343 consensus_queue.cc:1059] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:23:41.774505 12372 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:41.776474 12372 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:41.756268 12421 consensus_queue.cc:1059] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:23:41.713835 12398 consensus_queue.cc:237] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:41.782219 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.783109 10976 raft_consensus.cc:1240] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:41.780155 11025 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:41.756642 12346 raft_consensus.cc:740] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:41.768755 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:41.781558 12446 raft_consensus.cc:2749] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:41.793812 12389 raft_consensus.cc:2749] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:41.773969 10982 raft_consensus.cc:2955] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:41.796727 12346 consensus_queue.cc:260] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:41.798050 12346 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:41.774849 12338 raft_consensus.cc:2955] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:41.810330 11025 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:41.812862 11643 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:23:41.813472 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 80035us
I20260709 12:23:41.826087 11098 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:41.827337 10948 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:41.820762 12401 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:41.816576 12373 consensus_queue.cc:1048] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:23:41.843180 11025 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:41.854135 12455 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:41.854673 12455 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:41.855054 12455 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.857462 12340 consensus_queue.cc:1059] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:41.858631 11025 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:41.859975 11025 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:41.841926 12413 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:41.848572 12456 raft_consensus.cc:3055] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:41.874836 12456 raft_consensus.cc:740] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:41.875945 12456 consensus_queue.cc:260] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:41.877588 12456 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.849398 12381 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.882808 12361 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:41.885183 12408 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:41.910884 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 69997.8us
I20260709 12:23:41.868703 12413 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:23:41.900816 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 160282us
I20260709 12:23:41.876032 12336 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:41.915158 11098 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:41.893468 12446 raft_consensus.cc:2749] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:41.923619 12361 raft_consensus.cc:2804] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:41.924080 12361 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:41.924445 12361 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.918087 12413 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:41.919703 12405 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:41.893082 12391 consensus_queue.cc:1059] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:23:41.914122 12461 raft_consensus.cc:2804] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:41.917186 12424 consensus_queue.cc:1059] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:23:41.917346 12421 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:41.954757 10949 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:41.952363 12405 raft_consensus.cc:697] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:41.941367 12461 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
W20260709 12:23:41.963496 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 103580us
I20260709 12:23:41.940542 11097 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:23:41.969086 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.969838 12408 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:41.971567 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:41.976476 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:41.977037 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:41.977286 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:41.985177 12405 consensus_queue.cc:237] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:41.976468 12381 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:41.988179 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:41.990885 12343 raft_consensus.cc:3055] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:41.978011 12391 raft_consensus.cc:2749] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:41.994666 12361 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:42.010697 11054 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:42.006071 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 66016.7us
I20260709 12:23:41.959404 12421 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:42.019400 11132 raft_consensus.cc:2955] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:42.030732 11097 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:41.999296 12461 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:42.031025 11098 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:42.033541 11098 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:23:42.036969 11098 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:23:42.019994 12343 raft_consensus.cc:740] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:42.025895 11126 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:42.020988 12340 raft_consensus.cc:2749] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:41.995986 12455 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:42.038427 12346 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:42.043565 12467 raft_consensus.cc:2749] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:42.045933 11058 raft_consensus.cc:1240] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:42.050145 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:42.053958 12343 consensus_queue.cc:260] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:42.079879 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 75574.3us
I20260709 12:23:42.054929 12367 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:42.050841 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:42.056600 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:42.059497 12413 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:42.060258 12378 raft_consensus.cc:3055] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:42.053604 12361 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:42.061694 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:42.063352 12421 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:42.066931 11131 raft_consensus.cc:1275] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:42.043985 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:42.051411 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:42.105697 11025 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:42.070469 11674 raft_consensus.cc:2955] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:42.072925 12456 consensus_queue.cc:1059] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:42.073177 12372 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:42.079622 11054 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:42.050498 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:42.081723 12367 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:42.051522 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:42.051023 12466 raft_consensus.cc:2804] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:42.100412 12378 raft_consensus.cc:740] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:42.101754 11133 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:42.102710 11056 raft_consensus.cc:2393] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 3: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:42.183344 11056 raft_consensus.cc:1240] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:42.184482 11056 raft_consensus.cc:1240] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:42.185572 11056 raft_consensus.cc:1240] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:42.103065 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:42.081355 11051 raft_consensus.cc:1240] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:42.069744 11097 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:42.188405 11058 raft_consensus.cc:1240] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:42.132581 11125 raft_consensus.cc:2955] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:42.150959 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:42.116091 10977 raft_consensus.cc:1240] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3. Ops: []
W20260709 12:23:42.154510 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.197022 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:42.198904 11681 raft_consensus.cc:1240] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:42.199184 10976 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:42.155401 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:42.156559 12338 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.202250 12338 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:42.202980 12378 consensus_queue.cc:260] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:42.204543 12378 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:42.116384 12466 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:42.157061 12408 raft_consensus.cc:2749] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:42.161442 11678 raft_consensus.cc:2955] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
W20260709 12:23:42.160279 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 54658us
I20260709 12:23:42.166265 11131 raft_consensus.cc:1275] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:42.166586 12343 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:42.167737 12374 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.168386 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:42.169667 12413 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:42.169946 12398 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.170212 11060 raft_consensus.cc:2393] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 2: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:42.169814 10983 raft_consensus.cc:1275] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:42.117466 12367 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:42.116279 11059 raft_consensus.cc:2393] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 3: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:42.100417 11057 raft_consensus.cc:2393] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 2: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:42.186012 11133 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:42.149204 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:23:42.192822 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 123124us
I20260709 12:23:42.200253 11054 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:42.206816 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:42.208017 11056 raft_consensus.cc:1240] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:42.215242 10948 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:42.210595 12466 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:42.226994 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:42.223753 11672 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:42.228652 11130 raft_consensus.cc:1275] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:42.223130 12338 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:42.201095 12453 consensus_queue.cc:1059] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:23:42.222713 12408 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:23:42.244527 12398 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:42.243724 11097 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:42.243124 10982 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:42.239640 11025 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:42.242484 11055 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:42.238695 11053 raft_consensus.cc:2393] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 2: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:42.251690 10948 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:42.267091 11097 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:42.218456 12336 consensus_queue.cc:1059] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:23:42.243762 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:42.270396 10948 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:42.200714 12461 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:42.258540 11023 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:42.259174 12419 raft_consensus.cc:2749] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:42.273387 12338 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:42.259531 12401 raft_consensus.cc:2749] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:42.259742 11126 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:42.222730 12374 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:42.269276 12469 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:42.273661 10880 catalog_manager.cc:5697] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb reported cstate change: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:42.276624 11097 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:42.266795 12421 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:42.250396 12456 consensus_queue.cc:1059] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:23:42.281272 10880 catalog_manager.cc:5697] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb reported cstate change: config changed from index 2 to 3, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:42.272025 12467 raft_consensus.cc:2749] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:23:42.253309 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 216375us
I20260709 12:23:42.285522 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:42.286389 11132 raft_consensus.cc:2393] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 2: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:23:42.274361 12338 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.301846 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:42.271157 12389 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:23:42.243866 12465 consensus_queue.cc:1059] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:23:42.307247 11025 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:42.304601 10948 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:42.303272 12336 consensus_queue.cc:1059] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
W20260709 12:23:42.314582 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 61551.5us
I20260709 12:23:42.304979 11051 raft_consensus.cc:1240] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:42.276722 11676 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:42.283115 12419 raft_consensus.cc:2749] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:42.318053 11134 raft_consensus.cc:1240] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:42.300189 12346 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:42.291249 12469 raft_consensus.cc:697] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:42.277348 12367 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:42.321834 11097 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:42.300436 12338 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:42.303464 11677 raft_consensus.cc:1240] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:42.340749 11125 raft_consensus.cc:1240] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:42.316076 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:42.344882 12479 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:42.282440 12472 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:23:42.315315 12455 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:42.318008 12471 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:42.315201 12372 consensus_queue.cc:1059] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:23:42.398165 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:42.398514 11133 raft_consensus.cc:1240] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:42.330649 12355 raft_consensus.cc:2749] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:42.399767 10982 raft_consensus.cc:3055] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:42.400120 10982 raft_consensus.cc:740] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:42.358650 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:42.400856 10982 consensus_queue.cc:260] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:42.336856 12482 consensus_queue.cc:1059] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 12:23:42.412194 10982 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:42.415133 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:42.347882 11131 raft_consensus.cc:1240] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:42.348106 12467 raft_consensus.cc:2749] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:42.354841 11129 raft_consensus.cc:1240] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:42.354640 12478 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:42.348097 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:42.339648 12421 consensus_queue.cc:1059] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 12:23:42.422153 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:42.420897 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:42.430490 10949 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:42.433921 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:42.439191 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:23:42.348946 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 111635us
I20260709 12:23:42.432044 11098 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:42.442303 10984 raft_consensus.cc:2393] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 2: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
W20260709 12:23:42.439352 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 118756us
I20260709 12:23:42.447834 10949 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:42.449718 10982 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:42.450022 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:42.451927 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:42.454147 10948 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:42.454906 11134 raft_consensus.cc:1240] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:42.459900 11055 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:42.439889 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:42.465850 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:42.448052 12460 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:42.357228 12463 consensus_queue.cc:1059] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 12:23:42.456040 12483 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.488421 10948 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:42.468802 10976 raft_consensus.cc:1275] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:42.486624 12421 raft_consensus.cc:2804] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:42.490633 12419 raft_consensus.cc:2749] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:42.490449 12398 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:42.451967 12469 consensus_queue.cc:237] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:42.494764 12461 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:23:42.512567 12485 log.cc:927] Time spent T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:23:42.502425 12374 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:42.491268 12483 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:42.522380 10949 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:42.507619 12355 raft_consensus.cc:2749] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:42.521083 12491 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.521407 12372 consensus_queue.cc:1059] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:23:42.522677 12489 consensus_queue.cc:1059] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:23:42.521267 12419 raft_consensus.cc:2749] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:42.526942 12421 raft_consensus.cc:697] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:42.522312 12340 raft_consensus.cc:3055] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:42.523113 12490 raft_consensus.cc:3055] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:42.547508 11097 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:42.540431 12488 raft_consensus.cc:2749] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:42.538972 12398 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.539335 12367 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:42.540961 12361 raft_consensus.cc:3055] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:42.571552 10984 raft_consensus.cc:1240] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:42.570077 12467 raft_consensus.cc:2749] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:42.521868 12336 raft_consensus.cc:2749] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:42.549825 12490 raft_consensus.cc:740] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:42.562530 12491 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:42.574427 12490 consensus_queue.cc:260] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:42.510975 12460 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:42.580652 12491 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:42.525944 12466 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:42.550922 12340 raft_consensus.cc:740] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:42.589780 12340 consensus_queue.cc:260] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:42.590977 11125 raft_consensus.cc:1240] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:42.591308 12340 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:42.590633 12466 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:42.573168 12361 raft_consensus.cc:740] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:42.597822 12421 consensus_queue.cc:237] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:42.602650 12483 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:42.604434 12465 raft_consensus.cc:3055] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:42.604877 12465 raft_consensus.cc:740] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:23:42.616545 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 153259us
I20260709 12:23:42.593708 10981 raft_consensus.cc:1240] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:42.585103 12398 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:42.625496 11098 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:42.630190 12466 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:42.630805 12466 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:42.632225 12460 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:42.632860 12466 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:42.633240 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:42.618142 12346 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:42.649648 11098 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:42.621513 10977 raft_consensus.cc:1275] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:23:42.658573 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 170204us
I20260709 12:23:42.659597 10948 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:42.654471 12482 raft_consensus.cc:2749] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:42.664904 11098 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:42.668315 10948 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:42.673070 12346 raft_consensus.cc:2749] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:42.661906 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:42.605760 12465 consensus_queue.cc:260] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:42.659855 12492 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:42.680119 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:42.680799 11132 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:42.672416 12378 raft_consensus.cc:2749] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:42.685730 10948 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:42.689335 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:42.690171 11132 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 3.
I20260709 12:23:42.677006 12483 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:23:42.696085 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:42.696771 11675 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
W20260709 12:23:42.697597 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.698457 11098 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:23:42.699046 12495 raft_consensus.cc:3055] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:42.699493 12495 raft_consensus.cc:740] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:42.682912 12421 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:42.685184 12502 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:42.716629 12502 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:42.717097 12502 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:42.686039 12492 raft_consensus.cc:697] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:42.711375 12378 raft_consensus.cc:2804] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:42.712666 10948 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:42.715947 11126 raft_consensus.cc:1275] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:42.690649 12398 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:42.687871 12465 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:42.719208 12346 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:42.670288 12361 consensus_queue.cc:260] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:42.723109 12355 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:42.737181 12338 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:42.732343 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.748561 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:42.746712 12492 consensus_queue.cc:237] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:42.731452 12378 raft_consensus.cc:697] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 2 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:42.731766 12346 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:42.748106 12471 raft_consensus.cc:697] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:42.761066 12346 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:42.761543 11672 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:42.762478 11681 raft_consensus.cc:1240] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:42.764879 12455 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.765430 12455 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:42.766737 12490 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:42.769914 11059 raft_consensus.cc:2393] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 5: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:42.725651 12421 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:42.775671 12355 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.776242 12355 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:42.741813 11128 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:42.777707 12455 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:42.780359 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:42.781029 11678 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:42.755021 12471 consensus_queue.cc:237] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:42.782884 12413 raft_consensus.cc:3055] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:42.783313 12413 raft_consensus.cc:740] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:42.780388 11060 raft_consensus.cc:1275] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:42.784065 12413 consensus_queue.cc:260] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:42.785216 12413 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:42.784996 12378 consensus_queue.cc:237] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:42.791250 12338 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:42.791778 12260 raft_consensus.cc:476] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Not starting pre-election -- already a leader
I20260709 12:23:42.793475 12260 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.794014 12260 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:42.795296 11098 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:23:42.795971 11645 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:23:42.796263 12260 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:42.796922 11645 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:23:42.798220 12501 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:42.798592 12501 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.798910 12482 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:42.799379 12482 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.799777 12482 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:42.799309 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:42.803864 11133 raft_consensus.cc:1275] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:23:42.804896 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.813885 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:42.814603 11058 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:42.781208 12470 raft_consensus.cc:3055] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:42.798931 12501 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:42.823419 11053 raft_consensus.cc:1240] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:42.822427 10948 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:42.821300 12372 consensus_queue.cc:1059] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:23:42.825847 11057 raft_consensus.cc:1240] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:42.826483 12497 raft_consensus.cc:2804] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:42.808665 12336 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.827817 12372 raft_consensus.cc:3055] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:42.828246 12372 raft_consensus.cc:740] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:42.829095 12372 consensus_queue.cc:260] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:42.808177 12401 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:42.810274 12374 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:23:42.827514 12336 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:42.826997 12497 raft_consensus.cc:697] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 2 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:42.830839 12424 raft_consensus.cc:3055] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:42.819401 12470 raft_consensus.cc:740] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:42.840620 11053 raft_consensus.cc:1240] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:42.833417 12401 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.830763 11678 raft_consensus.cc:1275] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:42.829269 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:42.834972 12372 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:42.830111 12477 raft_consensus.cc:3055] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:42.834646 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:42.834664 12424 raft_consensus.cc:740] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:42.818809 12502 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:42.854323 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:42.859087 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:42.858773 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:42.859964 10982 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:23:42.846428 12401 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:42.859391 11053 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:42.862735 12479 raft_consensus.cc:3055] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:42.864784 12472 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.873977 12472 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:42.875276 11057 raft_consensus.cc:1240] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:42.876241 12472 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:42.852909 12477 raft_consensus.cc:740] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:42.867779 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:42.869544 12479 raft_consensus.cc:740] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:42.873675 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:42.890125 10982 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:23:42.890209 11023 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:42.893718 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:42.894549 10982 raft_consensus.cc:2393] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 5: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:42.896688 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:42.873345 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:42.897255 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:42.897437 11133 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:42.869536 12361 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:42.897908 11675 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:42.864852 12373 consensus_queue.cc:1048] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:23:42.899712 11097 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:23:42.900494 12455 raft_consensus.cc:2749] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:42.904006 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:42.867453 12389 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.906013 11056 raft_consensus.cc:1240] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:42.904760 11053 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:42.907974 10983 raft_consensus.cc:1275] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:42.908692 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:42.909049 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:42.909624 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:42.910274 10978 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:42.910384 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:42.867277 12500 consensus_queue.cc:1059] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 12:23:42.911002 10979 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:42.911702 12500 raft_consensus.cc:3055] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:42.868224 12336 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:42.866451 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:42.867322 12355 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:42.868381 12484 raft_consensus.cc:3055] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:42.915736 12484 raft_consensus.cc:740] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:42.886794 12398 consensus_queue.cc:1059] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:23:42.916810 10984 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 3.
I20260709 12:23:42.914173 12338 consensus_queue.cc:1048] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:23:42.866823 12424 consensus_queue.cc:260] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:42.918978 12424 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:42.918840 12484 consensus_queue.cc:260] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:42.909770 12497 consensus_queue.cc:237] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:42.920306 12484 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:42.907703 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:42.897667 11673 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:42.912063 12500 raft_consensus.cc:740] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:42.924530 10948 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:42.926926 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:42.929788 11132 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:42.867370 12487 consensus_queue.cc:1048] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:23:42.931945 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:42.932977 11025 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:42.912187 10976 raft_consensus.cc:1240] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:42.937713 12336 raft_consensus.cc:2804] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:42.939141 12336 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.939502 12336 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:42.939878 11644 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:42.942137 10949 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:42.945271 10948 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:42.909665 11678 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:42.882081 12479 consensus_queue.cc:260] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:42.902473 12346 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:42.958335 12486 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:42.940557 12500 consensus_queue.cc:260] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:42.961261 11023 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:42.956944 12499 raft_consensus.cc:2749] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:42.965806 10949 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:42.965227 12381 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:42.965104 12391 consensus_queue.cc:1059] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:23:42.970717 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:42.915319 12389 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:42.962509 12488 raft_consensus.cc:2749] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:42.934244 12355 consensus_queue.cc:1059] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:23:42.941946 12483 consensus_queue.cc:1048] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:23:42.984637 10949 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:42.914184 12470 consensus_queue.cc:260] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:42.971244 12486 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.976612 12338 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:42.988790 11057 raft_consensus.cc:2410] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:23:42.967969 12413 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:42.974510 12381 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:42.991560 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 46218.7us
I20260709 12:23:42.976485 12346 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:42.983047 12378 raft_consensus.cc:2804] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:43.002321 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:23:42.992903 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:43.004406 11132 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:42.938669 12469 consensus_queue.cc:1048] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:23:42.968600 12419 consensus_queue.cc:1059] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:23:43.009893 11023 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:42.993759 12488 raft_consensus.cc:3055] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:42.993902 12355 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:42.993526 12486 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:43.019450 12355 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.011515 12373 raft_consensus.cc:2749] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:43.003175 12413 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.005730 12381 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:42.998960 12389 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:43.008067 12421 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:43.006815 12338 raft_consensus.cc:697] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:42.980280 12471 consensus_queue.cc:1048] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:23:43.012848 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:42.955456 12477 consensus_queue.cc:260] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:43.037393 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:43.019805 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:23:43.038921 12505 log.cc:927] Time spent T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 12:23:43.017673 12488 raft_consensus.cc:740] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:43.019907 12355 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:43.052672 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:43.030299 12413 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:43.015689 12401 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:42.974519 12494 consensus_queue.cc:1059] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:23:43.036943 12502 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:43.054472 12421 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.083869 12494 consensus_queue.cc:1059] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:23:43.070245 12507 log.cc:927] Time spent T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:23:43.054304 12482 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:43.089679 12502 raft_consensus.cc:3055] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:43.092386 12502 raft_consensus.cc:740] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:43.093091 11130 raft_consensus.cc:2368] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 2. Current term is 3.
I20260709 12:23:43.085767 12421 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:43.068521 12336 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:43.089287 12494 consensus_queue.cc:1243] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Peer c979ef00e0ad4157b49ebbdc13ce7cd7 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:23:43.093684 11672 raft_consensus.cc:1240] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4. Ops: []
W20260709 12:23:43.118721 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 102298us
W20260709 12:23:43.096475 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 104443us
I20260709 12:23:43.125859 10949 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:43.087002 12501 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:43.133410 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:43.138265 12462 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.138877 12462 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:43.139335 12506 log.cc:927] Time spent T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:23:43.139967 12516 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:43.141245 12462 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:23:43.142197 12511 log.cc:927] Time spent T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:23:43.142457 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:43.143373 12336 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:43.144203 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:43.149385 12479 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:43.153023 11053 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:43.133986 12482 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:23:43.130951 12509 log.cc:927] Time spent T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:23:43.154014 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:43.158275 11134 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:43.120013 12378 raft_consensus.cc:697] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 2 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:43.162001 10948 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:43.109014 12338 consensus_queue.cc:237] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:43.192322 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 66604.7us
W20260709 12:23:43.192559 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:43.098383 12488 consensus_queue.cc:260] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:43.197072 10983 raft_consensus.cc:1275] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:43.194437 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:43.197937 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:43.198560 11053 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:43.177913 11025 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:43.198078 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:43.200706 10983 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:23:43.202054 10980 raft_consensus.cc:2393] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 3: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:43.203146 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:43.203301 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:43.203944 10978 raft_consensus.cc:2393] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 3: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:43.162360 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:43.167627 12471 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.196345 12336 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:43.208142 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:43.226727 11675 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:43.227085 12500 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:43.214286 12378 consensus_queue.cc:237] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:43.230561 12381 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:43.225270 12508 log.cc:927] Time spent T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.298s	user 0.000s	sys 0.002s
I20260709 12:23:43.238400 12355 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:43.239217 11675 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:23:43.240506 11054 raft_consensus.cc:2368] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3.
I20260709 12:23:43.242607 12336 raft_consensus.cc:697] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 2 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:43.244136 12336 consensus_queue.cc:237] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:43.247799 12469 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:43.248284 12469 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.248654 12469 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:43.251348 12477 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:43.131340 12502 consensus_queue.cc:260] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:43.256950 12501 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:43.257921 10977 raft_consensus.cc:2393] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 3: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:43.262440 12421 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:43.262854 12355 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:43.261761 10983 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:23:43.161129 12486 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:43.265480 12486 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:43.210811 12482 consensus_queue.cc:1048] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:23:43.267743 12472 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.266779 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:43.268296 12472 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:43.271436 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:43.272316 12488 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:43.204433 11678 raft_consensus.cc:2368] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4.
I20260709 12:23:43.270550 10983 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:43.278041 11097 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:43.277385 11053 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:23:43.289389 11097 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:43.290472 11677 raft_consensus.cc:2368] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 2. Current term is 3.
I20260709 12:23:43.299713 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:43.273069 12401 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:43.274796 12471 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:43.304009 12471 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:43.304244 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:43.305930 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:43.306681 11127 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:43.306201 12495 consensus_queue.cc:260] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:43.307348 12495 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:43.311019 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:43.311862 10983 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:43.280323 10981 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:43.312984 11023 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:43.313783 12490 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:43.314860 12471 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:43.315259 12471 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.315598 12471 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:43.312325 10948 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:43.339745 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1349) took 1034 ms. Trace:
I20260709 12:23:43.340205 11130 rpcz_store.cc:276] 0709 12:23:42.284788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.284963 (+   175us) service_pool.cc:224] Handling call
0709 12:23:42.931749 (+646786us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b5800117398. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90daa0a0 00007f8f90da9984 00007f8f8a3246d4 00007f8f8a324662
0709 12:23:43.318685 (+386936us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54003002d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:43.318835 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":361528448}
I20260709 12:23:43.346566 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:43.347698 11053 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:43.363551 11053 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 3.
W20260709 12:23:43.372583 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:43.287659 11673 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:23:43.370812 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:23:43.394508 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 216682us
I20260709 12:23:43.399274 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:43.399905 11125 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:23:43.338229 12490 raft_consensus.cc:697] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:43.344678 12456 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:43.346380 12518 raft_consensus.cc:2804] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:43.404549 12471 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:43.416704 12456 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.423736 12456 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:43.424491 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:43.425645 12471 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:43.444912 11125 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:43.419700 12381 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:43.449254 12373 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.441164 12518 raft_consensus.cc:697] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:43.449818 12373 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:43.451965 12373 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:43.451649 12518 consensus_queue.cc:237] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:43.475561 10949 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 1.801s (SENT)
I20260709 12:23:43.500861 11643 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:43.503275 12401 raft_consensus.cc:2749] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:43.503851 12413 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:43.498142 11127 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 4.
I20260709 12:23:43.526929 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:43.531574 10984 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:43.531816 11643 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:43.478209 12490 consensus_queue.cc:237] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:43.533074 11645 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:23:43.517397 12472 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:23:42.928076 12463 consensus_queue.cc:1175] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bc01179655564f29b83babe396377cbb" responder_term: 2 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:23:43.540488 12531 log.cc:927] Time spent T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:23:43.540935 12413 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:23:43.541221 12530 log.cc:927] Time spent T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:23:43.541702 10983 raft_consensus.cc:1240] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:43.543380 12533 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.541807 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:43.547140 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:43.547812 10979 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:43.546574 10980 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:43.551544 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:43.552173 11054 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:43.554299 11055 raft_consensus.cc:1275] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:43.543828 11673 raft_consensus.cc:1275] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:43.537945 12501 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:43.538333 12486 raft_consensus.cc:2764] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:23:43.568850 11054 raft_consensus.cc:2410] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:23:42.512190  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:43.569252 10879 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39956 (request call id 175) took 2148 ms. Trace:
I20260709 12:23:43.558457 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:43.570061 11060 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:43.562026 12533 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:43.570842 10882 catalog_manager.cc:5697] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 1 to 2, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 2 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:43.571622 12401 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:43.576534 12401 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:43.579788 12401 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:43.580602 10978 raft_consensus.cc:1275] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:43.581365 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:43.581882 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:43.563941 12469 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:43.567462 12501 raft_consensus.cc:697] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:43.583572 12500 consensus_queue.cc:1048] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:43.583818 12501 consensus_queue.cc:237] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:43.592553 10984 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:43.573541 12456 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:43.597289 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 45322us
I20260709 12:23:43.574455 12533 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:43.607054 12469 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:23:43.609426 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:43.612525 11060 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:23:43.607746 10981 raft_consensus.cc:1275] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:43.599287 11025 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:43.614118 10948 leader_election.cc:400] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 2. Current term is 3.
W20260709 12:23:43.626487 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:43.619717 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 87983.7us
W20260709 12:23:43.612926 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 137397us
I20260709 12:23:43.582968 10879 rpcz_store.cc:276] 0709 12:23:41.421089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.421359 (+   270us) service_pool.cc:224] Handling call
0709 12:23:43.569159 (+2147800us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:41.768321 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:41.776696 (+  8375us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:41.776756 (+    60us) write_op.cc:435] Acquired schema lock
0709 12:23:41.776783 (+    27us) tablet.cc:662] Decoding operations
0709 12:23:41.777313 (+   530us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:41.777403 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:41.777437 (+    34us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:23:41.777901 (+   464us) tablet.cc:701] Row locks acquired
0709 12:23:41.777943 (+    42us) write_op.cc:260] PREPARE: finished
0709 12:23:41.778132 (+   189us) write_op.cc:270] Start()
0709 12:23:41.778382 (+   250us) write_op.cc:276] Timestamp: P: 1783599821778045 usec, L: 0
0709 12:23:41.778446 (+    64us) op_driver.cc:348] REPLICATION: starting
0709 12:23:41.781478 (+  3032us) log.cc:844] Serialized 919 byte log entry
0709 12:23:42.075161 (+293683us) op_driver.cc:464] REPLICATION: finished
0709 12:23:42.262470 (+187309us) write_op.cc:301] APPLY: starting
0709 12:23:42.262579 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:42.262738 (+   159us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:42.265412 (+  2674us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:42.403062 (+137650us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:42.422661 (+ 19599us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:23:42.422735 (+    74us) write_op.cc:312] APPLY: finished
0709 12:23:42.433051 (+ 10316us) log.cc:844] Serialized 29 byte log entry
0709 12:23:42.433276 (+   225us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:42.433368 (+    92us) write_op.cc:454] Released schema lock
0709 12:23:42.433421 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:42.461223 (+ 27802us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:42.463627 (+  2404us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":187005,"apply.run_cpu_time_us":3763,"apply.run_wall_time_us":175252,"num_ops":2,"prepare.queue_time_us":61648,"prepare.run_cpu_time_us":13344,"prepare.run_wall_time_us":64555,"raft.queue_time_us":96161,"raft.run_cpu_time_us":24079,"raft.run_wall_time_us":201734,"replication_time_us":266301,"thread_start_us":243662,"threads_started":4,"wal-append.queue_time_us":136231,"wal-append.run_cpu_time_us":11329,"wal-append.run_wall_time_us":1663279}]]}
I20260709 12:23:43.631397 11023 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:43.632520 11023 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:43.647056 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:23:43.645263 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 46007us
I20260709 12:23:43.650493 10979 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:43.650990 11023 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:43.614886 12456 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:43.655285 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:43.657299 11643 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:43.670802 11134 raft_consensus.cc:1275] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:43.644548 12472 raft_consensus.cc:2804] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:43.647570 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:43.644421 12536 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:43.681551 12413 consensus_queue.cc:1048] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:43.681826 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:43.655108 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:43.661362 12460 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:43.687314 10948 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:43.652518 12526 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:43.649984 12463 consensus_queue.cc:1059] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:23:43.683153 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:43.677100 12472 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.704815 11127 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:43.685782 12536 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.677390 12471 consensus_queue.cc:1048] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:23:43.711840 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:43.712479 10982 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:43.688755 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:43.687803 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:43.695372 12501 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:43.714047 12372 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:43.721140 12372 raft_consensus.cc:697] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:43.705771 12477 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:43.721789 12477 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:43.722193 12372 consensus_queue.cc:237] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:43.724032 12477 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:43.700870 12469 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.700500 11129 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:43.724890 12469 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:43.701213 12487 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:43.708947 12472 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:43.703004 12460 raft_consensus.cc:697] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:43.703250 10981 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:43.707214 12526 raft_consensus.cc:697] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:43.745033 10982 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:43.746004 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:43.757383 11678 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:23:43.757490 12526 consensus_queue.cc:237] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:43.713539 12536 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:43.738130 12461 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:43.746779 12540 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.752694 12460 consensus_queue.cc:237] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:43.733393 11131 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:43.736025 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:43.767529 10981 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:23:43.750190 11128 raft_consensus.cc:2393] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 3: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:43.762032 11023 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:43.765229 10948 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:43.769589 11097 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:43.778410 12525 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:43.726442 12487 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:43.780855 12500 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:43.779036 12525 raft_consensus.cc:697] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:43.772846 10977 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:43.792207 12500 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:43.782532 12482 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.796242 12482 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:43.798553 12482 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:43.766960 12540 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:43.799803 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:43.782362 12463 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:43.801017 12463 raft_consensus.cc:697] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:43.802188 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:43.801990 12463 consensus_queue.cc:237] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:43.795670 12500 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:43.783397 12363 consensus_queue.cc:1059] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:23:43.768999 12461 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:43.803280 12525 consensus_queue.cc:237] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:43.801056 12540 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:43.790730 12471 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.819715 11060 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:43.820647 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:43.811316 12534 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:43.810562 12469 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:23:43.822021 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 112238us
W20260709 12:23:43.833026 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:43.821921 10979 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 4.
I20260709 12:23:43.841185 12461 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:43.833130 12513 raft_consensus.cc:3055] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:43.847210 12513 raft_consensus.cc:740] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:43.818220 12471 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:43.847033 12472 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:43.832505 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:43.851567 12513 consensus_queue.cc:260] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:43.852317 10976 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 3.
I20260709 12:23:43.838784 12534 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:43.853420 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:43.850572 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:43.833997 10977 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:43.863917 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:43.850433 10979 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:43.855083 11643 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:43.851370 12487 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:43.857326 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:43.857460 12534 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:43.858323 12471 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:43.834986 12469 consensus_queue.cc:1048] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:23:43.870428 11057 raft_consensus.cc:1240] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:43.873116 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:43.871212 11644 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:43.874955 11098 leader_election.cc:400] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4.
I20260709 12:23:43.875349 11098 leader_election.cc:403] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:23:43.876165 11644 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:43.874773 11097 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:43.879307 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:43.879748 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:43.881409 12490 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:43.881978 12490 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:43.882555 11677 raft_consensus.cc:1240] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:43.883649 11059 raft_consensus.cc:1275] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:43.884120 12490 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:23:43.866922 12541 log.cc:927] Time spent T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:23:43.880016 11680 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:43.892935 11098 leader_election.cc:400] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3.
I20260709 12:23:43.893312 11098 leader_election.cc:403] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:43.889539 12490 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.894358 12490 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:43.884639 12498 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:43.887068 12260 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:43.887521 12487 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:43.886235 12484 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:43.886514 11131 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:43.888814 12499 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.889217 12424 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:43.898057 12421 raft_consensus.cc:2804] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:43.891433 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:43.889143 12413 consensus_queue.cc:1059] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:23:43.892354 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:43.940905 12484 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.942409 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:43.966653 12421 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.989441 12484 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:43.993180 12490 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:43.993806 12490 raft_consensus.cc:2749] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3.
I20260709 12:23:43.946205 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:44.004304 11672 raft_consensus.cc:2393] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 2: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:23:43.945071 12499 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:43.988103 12482 raft_consensus.cc:2749] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4.
I20260709 12:23:43.991036 12421 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:43.983042 12260 raft_consensus.cc:697] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:44.002458 11678 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:44.002458 12490 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:44.008805 12546 log.cc:927] Time spent T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 12:23:43.938019 12498 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:43.999658 12424 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:44.056231 11680 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:44.011243 11675 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:44.042299 12517 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.099460 11130 raft_consensus.cc:1275] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:44.061910 12472 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:23:44.099510 12553 log.cc:927] Time spent T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:23:44.049064 12499 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:44.052192 12260 consensus_queue.cc:237] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:44.109508 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 280536us
I20260709 12:23:44.049454 12536 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:44.070537 12484 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:44.112174 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 237457us
W20260709 12:23:44.114215 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:44.135393 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:44.135835 11025 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:23:44.137408 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:44.105863 12517 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:44.154980 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:44.158748 11129 raft_consensus.cc:2393] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 2: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:44.159854 11054 raft_consensus.cc:2393] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 3: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:44.164822 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:44.165535 10983 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:44.084245 12490 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:44.137243 12482 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:44.174767 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:44.178689 11097 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:44.145728 12413 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.183451 12498 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:44.146306 12389 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:44.167675 12469 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.189042 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:44.164315 12408 consensus_queue.cc:1048] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
W20260709 12:23:44.191006 12518 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.042s	sys 0.023s
W20260709 12:23:44.201660 12518 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.043s	sys 0.024s
I20260709 12:23:44.200938 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:44.186324 12389 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:44.203879 12389 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:44.206632 12558 log.cc:927] Time spent T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:23:44.208247 12517 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:44.212600 12536 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:44.214160 12498 raft_consensus.cc:2804] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:44.214629 12498 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:44.214969 12498 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:44.215096 12502 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:44.226765 12484 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:44.228434 12389 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:44.231375 12389 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:44.231720 12424 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:44.183830 12413 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:44.234032 12413 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:44.196971 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:44.236287 11131 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:44.199040 12469 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:44.247927 12469 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:44.251183 12500 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:44.186816 12482 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:44.255142 12482 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:44.231436 12490 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:23:44.261874 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:44.263613 12500 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:44.263302 12421 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:44.265746 12421 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:44.267088 12533 raft_consensus.cc:3055] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:44.267515 12533 raft_consensus.cc:740] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:44.268399 11677 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:44.269425 12456 raft_consensus.cc:3055] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:44.268925 12422 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:44.269850 12456 raft_consensus.cc:740] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:44.270272 12462 consensus_queue.cc:1048] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:44.270764 12456 consensus_queue.cc:260] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:44.271797 12456 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:44.273936 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:44.274291 12491 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.274750 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:44.275466 10978 raft_consensus.cc:2393] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 3: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:44.275880 10980 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:44.274863 12491 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:44.277213 12408 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:44.277731 12408 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:44.279145 12491 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:44.279987 12408 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:44.281805 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:44.282498 10980 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
W20260709 12:23:44.283689 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 92303.3us
I20260709 12:23:44.284559 12498 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:44.286659 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:44.287431 10978 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:44.287840 12512 raft_consensus.cc:3055] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:44.288262 12512 raft_consensus.cc:740] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:44.288982 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:44.289254 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:44.284493 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:44.289146 12512 consensus_queue.cc:260] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:44.290027 10980 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:44.268347 12533 consensus_queue.cc:260] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:44.291182 12533 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:44.291250 12512 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:44.295002 10984 raft_consensus.cc:1240] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:23:44.289911 10981 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:44.302724 10975 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:44.305940 10983 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:44.309758 10981 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
W20260709 12:23:44.318717 12545 log.cc:927] Time spent T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.358s	user 0.000s	sys 0.003s
I20260709 12:23:44.320937 12498 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:44.314796 10882 catalog_manager.cc:5697] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 2 to 3, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 3 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:44.314038 10880 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41098 (request call id 282) took 2268 ms. Trace:
I20260709 12:23:44.329370 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:44.330088 10978 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:44.302008 12513 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:44.337528 12483 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:44.338186 12483 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:44.340334 12483 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:44.343130 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:44.343871 11126 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:44.349166 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:44.350060 11679 raft_consensus.cc:2368] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4.
I20260709 12:23:44.288335 12408 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:44.362860 11126 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:44.326800 10880 rpcz_store.cc:276] 0709 12:23:42.045673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.046062 (+   389us) service_pool.cc:224] Handling call
0709 12:23:42.231728 (+185666us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54002e9854. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4e090 00007f8f8bdecf3a 00007f8f91ba2e9c 00007f8f91ca104e 00007f8f901622a4 00007f8f90162232 00007f8f90162161 00007f8f901620dc 00007f8f90161392 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:44.313953 (+2082225us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:42.345479 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:42.465102 (+119623us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:42.469060 (+  3958us) write_op.cc:435] Acquired schema lock
0709 12:23:42.474436 (+  5376us) tablet.cc:662] Decoding operations
0709 12:23:42.523184 (+ 48748us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:42.523246 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:42.523276 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:23:42.523581 (+   305us) tablet.cc:701] Row locks acquired
0709 12:23:42.523604 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:23:42.523750 (+   146us) write_op.cc:270] Start()
0709 12:23:42.523861 (+   111us) write_op.cc:276] Timestamp: P: 1783599822523704 usec, L: 0
0709 12:23:42.523883 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:23:42.524573 (+   690us) log.cc:844] Serialized 1045 byte log entry
0709 12:23:42.574511 (+ 49938us) op_driver.cc:464] REPLICATION: finished
0709 12:23:42.575327 (+   816us) write_op.cc:301] APPLY: starting
0709 12:23:42.575416 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:42.575532 (+   116us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:42.577516 (+  1984us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:42.577933 (+   417us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:42.578089 (+   156us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:23:42.578154 (+    65us) write_op.cc:312] APPLY: finished
0709 12:23:42.578377 (+   223us) log.cc:844] Serialized 29 byte log entry
0709 12:23:42.578562 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:42.578649 (+    87us) write_op.cc:454] Released schema lock
0709 12:23:42.578686 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:42.579040 (+   354us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:42.579068 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":990673,"reported_tablets":2,"spinlock_wait_cycles":362046336,"child_traces":[["op",{"apply.queue_time_us":558,"apply.run_cpu_time_us":1821,"apply.run_wall_time_us":3690,"num_ops":2,"prepare.queue_time_us":113,"prepare.run_cpu_time_us":3962,"prepare.run_wall_time_us":187763,"replication_time_us":46562}]]}
I20260709 12:23:44.364260 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:44.365281 10983 raft_consensus.cc:2393] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 3: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:44.367096 11678 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:23:44.368481 12408 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:44.365790 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:44.370452 11676 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:44.371968 12408 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:44.374400 12498 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.375080 12498 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:44.379139 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:44.379798 10983 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:44.382781 12498 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:44.383484 12470 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:44.385437 10980 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:44.384835 10882 catalog_manager.cc:5697] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 2 to 3, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 3 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:44.393373 10975 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 975) took 1199 ms (client timeout 1500 ms). Trace:
I20260709 12:23:44.409269 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:23:44.411208 10975 rpcz_store.cc:269] 0709 12:23:43.193621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.196777 (+  3156us) service_pool.cc:224] Handling call
0709 12:23:44.393094 (+1196317us) spinlock_profiling.cc:243] Waited 978 ms on lock 0x7b5400228b54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:44.393245 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2250051840}
I20260709 12:23:44.429770 12361 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.430470 12361 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:44.446120 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:44.452556 11098 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.013s	sys 0.072s
W20260709 12:23:44.452742 11644 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.032s	sys 0.006s
I20260709 12:23:44.454244 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:23:44.453008 11098 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.013s	sys 0.072s
W20260709 12:23:44.455641 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 565277us
W20260709 12:23:44.457063 11644 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.032s	sys 0.006s
W20260709 12:23:44.457523 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 579255us
I20260709 12:23:44.459755 11125 raft_consensus.cc:1240] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 1. Current term is 3. Ops: []
I20260709 12:23:44.462291 10978 raft_consensus.cc:2393] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 2: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:44.462785 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:44.418635 12381 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:44.463784 11125 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:44.473405 11129 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:44.475545 11125 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:23:44.481910 10983 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:44.481772 10978 raft_consensus.cc:1275] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:44.486047 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:23:44.487893 10979 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.023s	sys 0.056s
I20260709 12:23:44.490895 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:44.491855 10983 raft_consensus.cc:2393] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 3: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:44.496026 11644 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:23:44.501025 10979 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.023s	sys 0.056s
I20260709 12:23:44.510641 11023 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:44.511720 11023 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:44.513049 11023 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:44.514384 12461 raft_consensus.cc:2804] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:44.514890 12461 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:44.515221 12461 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:44.518702 12487 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:44.519381 12408 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:44.519877 12408 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:44.520228 12408 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:44.522491 12550 raft_consensus.cc:2804] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:44.523000 12550 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:44.523365 12550 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:44.519378 12487 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:44.526561 12487 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
I20260709 12:23:44.530841 11130 raft_consensus.cc:1240] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 1. Current term is 2. Ops: []
W20260709 12:23:44.468183 10977 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.012s	sys 0.026s
I20260709 12:23:44.531837 11023 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:44.532321 11127 raft_consensus.cc:1275] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:44.463248 12470 consensus_queue.cc:1048] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
W20260709 12:23:44.534778 11643 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.009s	sys 0.013s
W20260709 12:23:44.535228 11643 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.009s	sys 0.013s
W20260709 12:23:44.500406 11100 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.013s	sys 0.027s
I20260709 12:23:44.539412 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:44.541340 11133 raft_consensus.cc:2410] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:44.542775 10881 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41120 (request call id 263) took 2886 ms. Trace:
I20260709 12:23:44.543188 10881 rpcz_store.cc:276] 0709 12:23:41.500250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.500520 (+   270us) service_pool.cc:224] Handling call
0709 12:23:44.386304 (+2885784us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1043026,"reported_tablets":3,"spinlock_wait_cycles":2816}
W20260709 12:23:44.538916 11100 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.013s	sys 0.027s
I20260709 12:23:44.546435 11024 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:44.545030 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:44.549832 11060 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:23:44.537439 10977 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.012s	sys 0.027s
W20260709 12:23:44.650588 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 470321us
W20260709 12:23:44.500061 12526 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.022s	sys 0.018s
I20260709 12:23:44.636535 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:44.466166 12381 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:44.570657 11130 raft_consensus.cc:1275] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:44.644317 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:44.532864 12361 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:44.566898 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:44.534293 12483 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:44.579820 10949 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:44.581549 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:23:44.675451 12526 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.022s	sys 0.019s
I20260709 12:23:44.585137 11024 leader_election.cc:400] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4.
I20260709 12:23:44.745769 11024 leader_election.cc:403] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:44.588347 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:44.590910 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:44.548295 12527 raft_consensus.cc:2804] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:44.591588 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:44.747756 11133 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:44.568601 12394 raft_consensus.cc:2764] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:23:44.606714 12363 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:23:44.613711 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:44.632668 11058 raft_consensus.cc:1240] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:44.572813 12401 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
W20260709 12:23:44.643448 10950 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.007s	sys 0.020s
I20260709 12:23:44.560123 12338 consensus_queue.cc:1048] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:23:44.547823 11023 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:44.590615 12478 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:44.541293 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:44.855931 10978 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:44.614735 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:44.610615 12562 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.668495 11129 raft_consensus.cc:1275] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:44.567921 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:44.571588 11127 raft_consensus.cc:1275] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:23:44.860770 11127 pending_rounds.cc:85] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 1
I20260709 12:23:44.689493 11060 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 4.
W20260709 12:23:44.692816 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:44.861857 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:44.694792 11025 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:44.583832 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:23:44.731621 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 49284us
I20260709 12:23:44.862937 11053 raft_consensus.cc:2393] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 2: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:44.738893 11057 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
W20260709 12:23:44.751430 10950 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.007s	sys 0.020s
I20260709 12:23:44.750860 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:44.839284 11098 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
W20260709 12:23:44.848057 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 268308us
I20260709 12:23:44.864101 11130 raft_consensus.cc:2393] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 2: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:44.746850 11059 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:44.848999 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:44.861003 11054 raft_consensus.cc:2393] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 2: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:44.864764 11058 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:23:44.684486 12461 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:44.745307 11126 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:44.889082 10949 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
W20260709 12:23:44.883049 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:44.887065 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 47890.9us
I20260709 12:23:44.871829 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:44.868687 11127 pending_rounds.cc:107] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:23:44.898782 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:23:44.900200 11097 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.038s	sys 0.074s
I20260709 12:23:44.898509 11129 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:44.898247 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 313227us
I20260709 12:23:44.903270 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:44.900801 11127 raft_consensus.cc:2889] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:44.899539 11055 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:44.903915 11130 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:44.892138 12361 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:44.905172 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 357401us
I20260709 12:23:44.903810 11644 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:23:44.900777 11097 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.039s	sys 0.075s
I20260709 12:23:44.859498 12413 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:44.860332 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:23:44.909394 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 623690us
W20260709 12:23:44.989333 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 114036us
I20260709 12:23:44.868435 12527 raft_consensus.cc:697] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:44.892650 12421 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.006768 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:44.997133 11097 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:44.897701 12477 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:44.898016 12456 raft_consensus.cc:2749] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:45.000583 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:23:44.996838 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 302114us
I20260709 12:23:44.967170 12570 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:45.004141 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:44.901398 12526 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4.
I20260709 12:23:45.009761 11097 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:44.887640 12562 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:44.865502 12478 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:45.019927 12574 raft_consensus.cc:2749] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:45.020467 12557 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.011829 12498 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:45.022709 12567 log.cc:927] Time spent T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
W20260709 12:23:45.026144 12560 log.cc:927] Time spent T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.336s	user 0.000s	sys 0.001s
I20260709 12:23:45.030522 12527 consensus_queue.cc:237] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:45.059142 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 49480.6us
I20260709 12:23:45.054179 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:45.015605 11129 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:45.092051 11097 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:45.092002 11127 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:45.100224 11125 raft_consensus.cc:2393] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 2: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:45.056731 10978 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 4.
I20260709 12:23:45.057313 11025 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:45.054550 11675 raft_consensus.cc:1240] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:23:44.989089 12394 raft_consensus.cc:2804] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:44.963444 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 150) took 1048 ms. Trace:
I20260709 12:23:44.858332 12401 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:45.033761 12563 raft_consensus.cc:2804] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:45.017449 12472 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:45.072655 12536 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:45.072469 12463 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:23:45.061385 12575 log.cc:927] Time spent T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:23:45.152966 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 231374us
I20260709 12:23:45.072809 12456 raft_consensus.cc:2804] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:23:45.064898 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:45.208170 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 150984us
I20260709 12:23:45.037832 12421 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:45.083629 12462 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:45.166253 11126 raft_consensus.cc:2368] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 2. Current term is 3.
I20260709 12:23:45.220700 11025 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:45.209643 12478 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:45.075945 12570 raft_consensus.cc:697] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:45.054073 12477 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:45.225184 12472 raft_consensus.cc:697] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:45.227886 11678 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:45.228211 12462 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:45.218706 12363 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:23:45.231204 12564 log.cc:927] Time spent T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:23:45.173509 12413 raft_consensus.cc:697] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:45.225870 10980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0"
dest_uuid: "bc01179655564f29b83babe396377cbb"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:41958
I20260709 12:23:45.246471 10980 raft_consensus.cc:606] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:45.246852 10980 raft_consensus.cc:614] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:45.164358 12394 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:45.208068 12533 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:45.084499 12498 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:45.230430 11676 consensus_meta.cc:287] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.859s	user 0.007s	sys 0.012s
I20260709 12:23:45.213586 12563 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:45.010659 12361 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:45.084234 12557 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:45.231621 11126 raft_consensus.cc:1275] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:45.146170 12526 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
W20260709 12:23:45.254084 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 255423us
I20260709 12:23:45.240520 12456 raft_consensus.cc:697] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:45.245788 12363 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:45.218688 12536 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:45.242277 12573 raft_consensus.cc:2749] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:45.219985 12463 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:45.237800 12478 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:45.486320 12536 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:45.487622 12590 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:45.487501 12456 consensus_queue.cc:237] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:45.488188 12590 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:45.292896 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1520) took 1126 ms. Trace:
I20260709 12:23:45.282958 12479 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:45.249058 12381 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:45.248847 12394 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:45.281546 12563 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:45.278309 11676 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
W20260709 12:23:45.519474 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 427468us
I20260709 12:23:45.522219 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1510) took 1732 ms. Trace:
I20260709 12:23:45.164265 10977 rpcz_store.cc:276] 0709 12:23:43.859617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.872888 (+ 13271us) service_pool.cc:224] Handling call
0709 12:23:43.873226 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:43.873460 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:23:44.682912 (+809452us) log.cc:844] Serialized 14 byte log entry
0709 12:23:44.858745 (+175833us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:44.861464 (+  2719us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:44.867420 (+  5956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:44.898811 (+ 31391us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:44.908275 (+  9464us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21151,"prepare.queue_time_us":118279,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":25,"raft.queue_time_us":118343,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":10245,"thread_start_us":714775,"threads_started":1}
I20260709 12:23:45.295444 12574 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:45.251160 12533 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:45.293862 12568 raft_consensus.cc:2804] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:45.522639 10979 rpcz_store.cc:276] 0709 12:23:43.775153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.867333 (+ 92180us) service_pool.cc:224] Handling call
0709 12:23:43.867701 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:43.876141 (+  8440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:43.876177 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:43.876691 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 12:23:44.507393 (+630702us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:44.507432 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:44.507498 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:45.506849 (+999351us) raft_consensus.cc:1685] finished
0709 12:23:45.506869 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.507005 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9420,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":6345,"thread_start_us":575612,"threads_started":1,"wal-append.queue_time_us":1014824}
W20260709 12:23:45.629009 11058 consensus_meta.cc:287] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.763s	user 0.009s	sys 0.006s
I20260709 12:23:45.629498 11058 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:23:45.490272 11134 rpcz_store.cc:276] 0709 12:23:44.153391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.156033 (+  2642us) service_pool.cc:224] Handling call
0709 12:23:44.156386 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:44.170758 (+ 14372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:44.170795 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:44.185906 (+ 15111us) log.cc:844] Serialized 26 byte log entry
0709 12:23:44.605393 (+419487us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:44.605446 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:44.605519 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:45.279223 (+673704us) raft_consensus.cc:1685] finished
0709 12:23:45.279245 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.279446 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":57194,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":102,"thread_start_us":365288,"threads_started":1,"wal-append.queue_time_us":1008480}
I20260709 12:23:45.280329 12572 consensus_queue.cc:1048] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.260s
I20260709 12:23:45.508317 12461 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:45.481328 12526 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:45.530880 12463 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:45.740310 11058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41294 (request call id 1004) took 1016 ms. Trace:
I20260709 12:23:45.758551 11058 rpcz_store.cc:276] 0709 12:23:44.613268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.848700 (+235432us) service_pool.cc:224] Handling call
0709 12:23:45.629982 (+781282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:45.486387 12478 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:45.609117 12568 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:45.609377 11676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41762 (request call id 377) took 1671 ms (client timeout 1744 ms). Trace:
I20260709 12:23:45.766577 11058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1335) took 1158 ms. Trace:
I20260709 12:23:45.767344 11058 rpcz_store.cc:276] 0709 12:23:44.608510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.765254 (+1156744us) service_pool.cc:224] Handling call
0709 12:23:45.765633 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.765817 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:45.765845 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:45.765890 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:45.765920 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.765972 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.766499 (+   527us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:45.521623 12479 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:45.480304 12363 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:45.684300 12562 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:23:45.746667 11100 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.019s	sys 0.098s
W20260709 12:23:45.794695 11100 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.021s	sys 0.099s
W20260709 12:23:45.762080 10948 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.002s	sys 0.015s
W20260709 12:23:45.796437 10948 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.004s	sys 0.016s
W20260709 12:23:45.762957 12408 consensus_meta.cc:287] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 1.239s	user 0.011s	sys 0.011s
I20260709 12:23:45.801101 11058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1336) took 1192 ms. Trace:
I20260709 12:23:45.541849 12472 consensus_queue.cc:237] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:45.502753 12570 consensus_queue.cc:237] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:45.806635 11134 raft_consensus.cc:1275] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:45.762049 12463 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:45.608031 12574 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:45.763113 12568 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:45.769819 12590 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:45.810375 11058 rpcz_store.cc:276] 0709 12:23:44.608760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.768628 (+1159868us) service_pool.cc:224] Handling call
0709 12:23:45.768964 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.800648 (+ 31684us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:45.800688 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:45.800763 (+    75us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:45.800799 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.800873 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.801031 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18224,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":8113}
I20260709 12:23:45.783679 12512 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:45.814476 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 146) took 1168 ms. Trace:
I20260709 12:23:45.832762 11058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1337) took 1223 ms. Trace:
I20260709 12:23:45.833287 11058 rpcz_store.cc:276] 0709 12:23:44.609000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.831933 (+1222933us) service_pool.cc:224] Handling call
0709 12:23:45.832250 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.832420 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:45.832443 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:45.832484 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:45.832515 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.832573 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.832698 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:45.831499 11134 rpcz_store.cc:276] 0709 12:23:44.648660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.798506 (+1149846us) service_pool.cc:224] Handling call
0709 12:23:45.803050 (+  4544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.814180 (+ 11130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.814410 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:45.804955 12401 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:45.836179 12587 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:45.878593 11051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 998) took 1311 ms. Trace:
W20260709 12:23:45.842186 12583 log.cc:927] Time spent T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:23:45.842633 12478 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:45.814065 12584 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.844187 12557 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:45.855996 12572 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:45.626278 12413 consensus_queue.cc:237] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:45.862363 12498 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:45.867259 12526 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:45.874315 12462 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:45.874559 11098 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:45.905205 11098 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:23:45.829785 12581 log.cc:927] Time spent T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.608s	user 0.000s	sys 0.001s
I20260709 12:23:45.837000 12477 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:45.831862 12421 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:45.847733 11059 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:45.886912 12490 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:45.831379 12463 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:45.914260 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:45.893134 12593 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:45.886443 12361 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:45.878672 12587 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:45.843150 12588 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:23:45.765467 11676 rpcz_store.cc:269] 0709 12:23:43.872622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.877490 (+  4868us) service_pool.cc:224] Handling call
0709 12:23:44.365603 (+488113us) spinlock_profiling.cc:243] Waited 4.3 ms on lock 0x7b5800004598. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90daa0a0 00007f8f90da9984 00007f8f8a3246d4 00007f8f8a324662
0709 12:23:45.543525 (+1177922us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9883904}
I20260709 12:23:45.836050 12590 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:45.829855 12562 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:45.830055 12408 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:45.878916 12591 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:45.929208 12477 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:45.953848 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 476977us
I20260709 12:23:45.928226 12421 raft_consensus.cc:2749] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:45.907083 11098 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:23:45.955142 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 48159.3us
I20260709 12:23:45.879168 11051 rpcz_store.cc:276] 0709 12:23:44.566952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.573246 (+  6294us) service_pool.cc:224] Handling call
0709 12:23:44.637031 (+ 63785us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:44.885958 (+248927us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:44.889080 (+  3122us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:44.902359 (+ 13279us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:44.906989 (+  4630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.878283 (+971294us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54002783d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:45.878341 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.878514 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":253656832}
I20260709 12:23:45.892391 12478 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:45.840629 12512 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:45.967197 12512 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:45.967830 12512 consensus_queue.cc:1048] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:45.974522 12478 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:45.977641 12478 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:45.902156 12572 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:45.979583 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1523) took 1566 ms. Trace:
W20260709 12:23:45.948630 11677 consensus_meta.cc:287] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.945s	user 0.015s	sys 0.003s
I20260709 12:23:45.914060 12498 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:45.990782 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1524) took 1539 ms. Trace:
I20260709 12:23:45.991119 12498 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:45.991361 10975 rpcz_store.cc:276] 0709 12:23:44.451899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.452802 (+   903us) service_pool.cc:224] Handling call
0709 12:23:44.534323 (+ 81521us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:44.604350 (+ 70027us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:44.610950 (+  6600us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:44.753011 (+142061us) log.cc:844] Serialized 26 byte log entry
0709 12:23:45.476688 (+723677us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:45.476794 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.476997 (+   203us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:45.986082 (+509085us) raft_consensus.cc:1685] finished
0709 12:23:45.990472 (+  4390us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.990702 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3195,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":21460,"thread_start_us":246884,"threads_started":1,"wal-append.queue_time_us":599372}
I20260709 12:23:45.993541 12498 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:45.917017 12419 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.994406 12419 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:45.996625 12419 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:45.997169 12419 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:23:45.932075 12550 consensus_meta.cc:287] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 1.406s	user 0.008s	sys 0.011s
I20260709 12:23:45.998404 12550 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:46.000556 12550 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:46.003847 11678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41774 (request call id 301) took 1425 ms. Trace:
I20260709 12:23:45.930634 12586 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:45.953814 12361 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:45.964983 12574 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:45.882997 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1533) took 1232 ms. Trace:
I20260709 12:23:45.980041 10981 rpcz_store.cc:276] 0709 12:23:44.413488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.413638 (+   150us) service_pool.cc:224] Handling call
0709 12:23:44.413986 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:44.414417 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:44.414447 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:44.441963 (+ 27516us) log.cc:844] Serialized 26 byte log entry
0709 12:23:44.682351 (+240388us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:44.682390 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:44.682461 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:45.979362 (+1296901us) raft_consensus.cc:1685] finished
0709 12:23:45.979381 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.979519 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":150,"thread_start_us":184137,"threads_started":1,"wal-append.queue_time_us":599652}
I20260709 12:23:45.928718 12490 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:45.956336 11098 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:23:46.019315 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 63084.9us
W20260709 12:23:46.013034 11025 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.034s	sys 0.116s
W20260709 12:23:46.020059 11025 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.034s	sys 0.116s
W20260709 12:23:46.019490 11023 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.029s	sys 0.007s
W20260709 12:23:46.020938 11023 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.029s	sys 0.007s
I20260709 12:23:45.895362 12584 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:45.949272 12533 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:45.969254 12512 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:46.013581 11134 rpcz_store.cc:276] 0709 12:23:44.650987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.881975 (+1230988us) service_pool.cc:224] Handling call
0709 12:23:45.882368 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.882622 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:45.882651 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:45.882698 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:45.882728 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.882783 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.882926 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:45.997650 12419 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:46.028435 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:46.035135 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:46.038028 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:46.041858 10979 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:46.042761 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:46.007109 12421 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:45.952962 12590 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:46.040895 11132 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:23:46.052127 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:46.006728 11677 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:23:46.012756 12498 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:46.007506 12478 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:46.013883 12501 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:45.985702 12487 consensus_queue.cc:1048] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:23:45.980350 12477 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:45.957163 12562 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:45.939724 12593 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:45.962687 12591 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:45.950826 12588 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:46.142688 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:46.116624 11132 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1388) took 1514 ms (client timeout 1534 ms). Trace:
W20260709 12:23:46.478336 11132 rpcz_store.cc:269] 0709 12:23:44.540410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.540761 (+   351us) service_pool.cc:224] Handling call
0709 12:23:46.028270 (+1487509us) spinlock_profiling.cc:243] Waited 7.57 ms on lock 0x7b5800117398. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90daa0a0 00007f8f90da9984 00007f8f8a3246d4 00007f8f8a324662
0709 12:23:46.054352 (+ 26082us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17421568}
I20260709 12:23:46.141952 12598 raft_consensus.cc:2804] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:46.478992 12498 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:46.480036 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:46.480305 12501 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:46.480785 11132 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:46.481387 12498 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:23:46.448534 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 243485us
I20260709 12:23:46.482059 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:46.040644 12479 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:46.004340 11678 rpcz_store.cc:276] 0709 12:23:44.578372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.582761 (+  4389us) service_pool.cc:224] Handling call
0709 12:23:46.003611 (+1420850us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b54005fffd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:46.003766 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1250148096}
I20260709 12:23:46.291392 12605 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:46.484823 11098 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:23:46.110399 12338 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:46.483775 11132 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:46.141095 12361 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:46.485834 12361 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:46.203246 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 318209us
I20260709 12:23:46.485543 12338 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:46.478386 10979 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:46.055070 11134 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:46.486218 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:46.534699 11132 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:46.535934 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:46.032809 12574 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.540863 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:46.141346 11052 raft_consensus.cc:2368] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4.
I20260709 12:23:46.537837 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:46.542829 11057 raft_consensus.cc:2393] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 4: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:46.537789 11132 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:46.503819 11056 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1331) took 1896 ms. Trace:
W20260709 12:23:46.466550 12563 consensus_meta.cc:287] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.911s	user 0.010s	sys 0.000s
I20260709 12:23:46.485199 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:23:46.319718 12527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.007s	sys 0.007s
I20260709 12:23:46.484380 12479 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.481276 12591 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:46.547267 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:46.162268 12408 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:46.410223 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:46.545337 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:46.514441 12598 raft_consensus.cc:697] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:46.562373 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:46.465818 12604 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.142329 12526 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.232168 12609 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.110330 12462 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.603128 12419 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:46.545835 11056 rpcz_store.cc:276] 0709 12:23:44.607194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.607345 (+   151us) service_pool.cc:224] Handling call
0709 12:23:45.886323 (+1278978us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b58001a5e98. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90dbdfc0 00007f8f90da8929 00007f8f90da83d2 00007f8f8a31fbd4
0709 12:23:45.886543 (+   220us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:45.886889 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:45.886917 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:45.891650 (+  4733us) log.cc:844] Serialized 26 byte log entry
0709 12:23:46.193865 (+302215us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:46.193909 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:46.193984 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:46.503484 (+309500us) raft_consensus.cc:1685] finished
0709 12:23:46.503505 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:46.503752 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":679,"raft.queue_time_us":132,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":8239,"spinlock_wait_cycles":8470912,"thread_start_us":273114,"threads_started":1,"wal-append.queue_time_us":599898}
I20260709 12:23:46.570078 12596 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:46.604318 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:46.016407 12586 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:46.536540 12361 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:46.499217 12498 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.571820 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:46.486966 12607 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.438261 12463 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:46.431635 12456 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:46.597398 12490 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:46.208086 12599 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.143263 12600 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:46.321125 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:46.498435 12616 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.537473 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:46.573990 12479 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:46.584022 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:23:46.536799 11677 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41784 (request call id 393) took 1791 ms (client timeout 1864 ms). Trace:
I20260709 12:23:46.052667 12512 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:46.522799 12629 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.508345 12612 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:46.653386 12584 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:46.654081 12584 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.654660 12584 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:46.564138 12590 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:46.066905 12421 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:46.592391 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:23:46.594300 12618 log.cc:927] Time spent T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 12:23:46.482613 12501 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:46.601985 12617 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:23:46.662309 12597 log.cc:927] Time spent T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.360s	user 0.000s	sys 0.001s
I20260709 12:23:46.663686 11679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 389) took 1607 ms. Trace:
I20260709 12:23:46.664081 11679 rpcz_store.cc:276] 0709 12:23:45.056163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.056306 (+   143us) service_pool.cc:224] Handling call
0709 12:23:45.075442 (+ 19136us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:45.234508 (+159066us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:45.234538 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:45.243110 (+  8572us) log.cc:844] Serialized 26 byte log entry
0709 12:23:45.835953 (+592843us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:45.835997 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.836068 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:46.663431 (+827363us) raft_consensus.cc:1685] finished
0709 12:23:46.663454 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:46.663620 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":170382,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":31980,"thread_start_us":695039,"threads_started":2,"wal-append.queue_time_us":793508}
I20260709 12:23:46.666934 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:46.602903 12462 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:46.569546 12621 raft_consensus.cc:2804] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:46.485445 12605 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:46.603899 12526 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:46.605890 12550 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:46.604023 12596 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
W20260709 12:23:46.620690 12363 consensus_meta.cc:287] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.808s	user 0.011s	sys 0.000s
I20260709 12:23:46.568578 11678 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:46.532218 12478 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:46.629573 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:46.143890 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:46.554279 12574 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:46.561834 12563 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:46.630374 12498 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:46.636315 12572 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:46.588721 12587 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:46.640158 10978 raft_consensus.cc:2393] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 2: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:23:46.554028 12527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.075s	user 0.016s	sys 0.013s
I20260709 12:23:46.636062 12607 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:46.628487 12394 consensus_meta.cc:287] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 1.086s	user 0.008s	sys 0.003s
I20260709 12:23:46.587769 12484 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:23:46.646517 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:46.616940 12609 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:46.603778 12419 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.647957 12616 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:46.659077 12593 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:46.660049 12421 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:46.666630 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:46.700578 12498 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:46.700760 12596 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:46.652858 12629 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:46.653578 12612 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:46.645082 11677 rpcz_store.cc:269] 0709 12:23:44.740914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.742889 (+  1975us) service_pool.cc:224] Handling call
0709 12:23:46.532117 (+1789228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:46.692870 11056 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:46.650856 12456 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:46.642321 12623 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:46.697038 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:46.706463 10978 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:23:46.662609 12617 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:46.707473 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:46.708137 10978 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:46.708992 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:46.694862 12394 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:46.710944 11055 raft_consensus.cc:1240] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:46.694836 12572 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.709511 10978 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:46.712332 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:46.659770 12598 consensus_queue.cc:237] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:46.692565 10977 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:46.684995 12363 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:46.685274 12550 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:46.702046 12419 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:46.714290 10978 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:23:46.715363 10979 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.717796 11132 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:46.724395 12609 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:46.724651 12550 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:46.726063 12363 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:46.726485 12419 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:46.731335 11059 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:23:46.733968 10979 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:23:46.715934 11051 raft_consensus.cc:1275] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:46.745491 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:46.767053 10978 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:46.747853 12478 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:46.749290 12526 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:46.787525 10978 raft_consensus.cc:1275] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:46.721071 12338 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:46.796924 12587 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:46.716254 12572 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:46.802172 12572 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:46.774902 12593 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.807840 12563 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:46.815173 12616 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:46.797345 12462 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:46.805918 12394 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:23:46.860985 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 318534us
I20260709 12:23:46.811908 12588 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:46.643029 12599 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:46.841938 12512 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:46.854494 12479 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:46.710121 12623 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:46.648695 12600 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:46.906419 12612 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:46.805415 12587 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:46.871649 12472 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.987s	user 0.020s	sys 0.035s
I20260709 12:23:46.814148 12593 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:46.600418 12604 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:46.897341 12607 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:23:46.918344 11100 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.014s	sys 0.046s
I20260709 12:23:46.897114 12617 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:23:46.914013 12472 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.033s	user 0.020s	sys 0.036s
W20260709 12:23:46.914966 10975 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.018s	sys 0.047s
I20260709 12:23:46.950585 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:46.951423 11679 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:46.952422 12588 consensus_queue.cc:1048] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:46.954150 12588 consensus_queue.cc:1048] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:46.957069 11127 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.928s	user 0.020s	sys 0.102s
W20260709 12:23:46.957512 11127 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.020s	sys 0.102s
I20260709 12:23:46.959188 11058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1006) took 2316 ms. Trace:
I20260709 12:23:46.959630 11058 rpcz_store.cc:276] 0709 12:23:44.642771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.834440 (+1191669us) service_pool.cc:224] Handling call
0709 12:23:45.834833 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:45.885496 (+ 50663us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:45.885534 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:45.908509 (+ 22975us) log.cc:844] Serialized 26 byte log entry
0709 12:23:46.483228 (+574719us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:46.549516 (+ 66288us) log.cc:844] Serialized 14 byte log entry
0709 12:23:46.958867 (+409351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:46.958944 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:46.958984 (+    40us) raft_consensus.cc:1685] finished
0709 12:23:46.958995 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:46.959125 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5498,"prepare.queue_time_us":195103,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":45,"raft.queue_time_us":111151,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":11568,"thread_start_us":791073,"threads_started":3,"wal-append.queue_time_us":579731}
W20260709 12:23:46.974608 11645 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.002s	sys 0.006s
W20260709 12:23:46.975103 11645 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.002s	sys 0.006s
W20260709 12:23:46.975406 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 598728us
I20260709 12:23:46.977878 12632 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:46.978685 12632 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:46.923236 11100 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.014s	sys 0.047s
I20260709 12:23:46.935868 10949 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:23:46.984050 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 48291.3us
I20260709 12:23:46.986343 12479 raft_consensus.cc:2804] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:46.986843 12479 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:46.987238 12479 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.961902 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:46.990417 12630 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:46.991106 12630 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:46.991482 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:46.985734 10949 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:46.994349 12617 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:46.994786 12617 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:46.995205 12617 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.998319 10949 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:46.999657 12588 raft_consensus.cc:2804] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:47.000134 12588 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:47.000519 12588 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.993131 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:47.015323 11058 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
W20260709 12:23:47.033473 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 545962us
I20260709 12:23:46.921986 12562 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:47.045722 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:47.046608 11058 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
W20260709 12:23:47.056849 10948 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.003s	sys 0.022s
W20260709 12:23:47.057441 10948 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.004s	sys 0.022s
I20260709 12:23:46.925750 12456 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:23:47.083618 11097 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.000s	sys 0.014s
W20260709 12:23:47.084076 11097 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.000s	sys 0.014s
I20260709 12:23:46.946291 12607 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
W20260709 12:23:47.354337 11680 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.945s	user 0.002s	sys 0.022s
W20260709 12:23:47.606060 12588 consensus_meta.cc:287] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.000s
W20260709 12:23:47.194952 12533 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.006s	sys 0.005s
W20260709 12:23:47.614188 12533 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.012s	sys 0.006s
I20260709 12:23:47.613953 12588 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:47.114400 12456 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.615479 12456 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:47.608408 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 591388us
I20260709 12:23:47.085695 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:23:47.622218 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 550910us
I20260709 12:23:47.609535 11645 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:23:47.657225 11097 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:23:47.702165 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 92715.8us
I20260709 12:23:47.609525 11056 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1344) took 1070 ms. Trace:
I20260709 12:23:47.613204 11025 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:47.481590 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:23:47.613682 11680 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.204s	user 0.008s	sys 0.022s
I20260709 12:23:47.703553 11056 rpcz_store.cc:276] 0709 12:23:46.538735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.629298 (+ 90563us) service_pool.cc:224] Handling call
0709 12:23:47.609348 (+980050us) spinlock_profiling.cc:243] Waited 8.75 ms on lock 0x7b54002cd654. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:47.609467 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20131072}
I20260709 12:23:47.704913 10982 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:47.072150 12609 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.701488 11023 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:47.707388 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1540) took 1669 ms. Trace:
I20260709 12:23:47.710391 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:47.708633 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:23:47.593521 12568 consensus_meta.cc:287] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 1.753s	user 0.005s	sys 0.008s
I20260709 12:23:47.708082 10982 rpcz_store.cc:276] 0709 12:23:46.038286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.038528 (+   242us) service_pool.cc:224] Handling call
0709 12:23:47.481377 (+1442849us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b5800003698. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90daa0a0 00007f8f90da9984 00007f8f8a3246d4 00007f8f8a324662
0709 12:23:47.707309 (+225932us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2631936}
I20260709 12:23:47.722708 12609 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:47.160946 12361 consensus_meta.cc:287] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.530s	user 0.010s	sys 0.000s
I20260709 12:23:47.079653 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:23:47.669204 12617 consensus_meta.cc:287] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.673s	user 0.004s	sys 0.005s
I20260709 12:23:47.657678 12633 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
W20260709 12:23:47.673862 12479 consensus_meta.cc:287] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.686s	user 0.006s	sys 0.003s
I20260709 12:23:47.619022 12632 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:23:47.662802 11051 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.000s	sys 0.018s
I20260709 12:23:47.609226 11677 raft_consensus.cc:1275] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:23:47.621910 11131 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.254s	user 0.014s	sys 0.030s
I20260709 12:23:47.567093 12599 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:47.616493 12588 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:47.673418 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:47.592010 12623 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:47.609962 12587 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:47.618841 12639 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:47.728962 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:47.610122 12640 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:47.608632 12630 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:47.671743 12593 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:47.671250 12600 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:47.081996 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:47.196552 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:23:47.729020 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 74210.5us
I20260709 12:23:47.766047 12639 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:47.758823 11674 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
W20260709 12:23:47.776208 11125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58414 (request call id 145) took 3188 ms (client timeout 1829 ms). Trace:
W20260709 12:23:47.776592 11674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41762 (request call id 385) took 3031 ms (client timeout 1821 ms). Trace:
W20260709 12:23:47.777004 11674 rpcz_store.cc:269] 0709 12:23:44.745578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.747095 (+  1517us) service_pool.cc:224] Handling call
0709 12:23:47.673260 (+2926165us) spinlock_profiling.cc:243] Waited 6.67 ms on lock 0x7b5800004598. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfeee 000000000036eb39 00007f8f90d331e0 00007f8f90dfc0c4 00007f8f90dfc131 00007f8f90daa0a0 00007f8f90da9984 00007f8f8a3246d4 00007f8f8a324662
0709 12:23:47.776505 (+103245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15342848}
I20260709 12:23:47.777632 12639 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:47.778388 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:47.778724 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1400) took 1202 ms. Trace:
W20260709 12:23:47.730427 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 113408us
I20260709 12:23:47.728641 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:47.169469 12586 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:47.732523 11645 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
W20260709 12:23:47.780833 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 50493.2us
I20260709 12:23:47.744433 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:47.782429 11058 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:23:47.748188 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:23:47.738883 11051 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.000s	sys 0.021s
I20260709 12:23:47.140573 12607 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:47.754032 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 140926us
W20260709 12:23:47.745795 11131 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.374s	user 0.017s	sys 0.033s
W20260709 12:23:47.761891 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 104731us
I20260709 12:23:47.806676 11097 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:47.763171 11680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41784 (request call id 396) took 1554 ms. Trace:
I20260709 12:23:47.763648 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:47.742574 12632 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:47.726042 12609 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:23:47.767598 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 66220.6us
I20260709 12:23:47.733716 12361 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:47.770795 12338 raft_consensus.cc:2804] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:47.771477 12600 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:47.768553 12582 raft_consensus.cc:2804] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:47.766862 12585 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:47.768919 12640 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:47.779103 11132 rpcz_store.cc:276] 0709 12:23:46.576218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.646218 (+ 70000us) service_pool.cc:224] Handling call
0709 12:23:47.778565 (+1132347us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b5400374954. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:47.778668 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54833536}
I20260709 12:23:47.780287 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 1541) took 1236 ms. Trace:
I20260709 12:23:47.739058 12617 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:47.732321 12598 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.910s	user 0.004s	sys 0.013s
W20260709 12:23:47.788197 11059 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1339) took 1251 ms (client timeout 1534 ms). Trace:
I20260709 12:23:47.759804 12422 raft_consensus.cc:2804] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:47.789808 12604 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:47.835896 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:47.836556 12617 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:47.836927 11051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 173) took 1294 ms. Trace:
I20260709 12:23:47.790827 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:47.791579 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:47.830941 12585 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:47.838801 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:47.839654 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:47.840296 11132 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:47.840443 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:47.840847 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1402) took 1200 ms. Trace:
I20260709 12:23:47.841214 11132 rpcz_store.cc:276] 0709 12:23:46.640930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.829697 (+1188767us) service_pool.cc:224] Handling call
0709 12:23:47.840789 (+ 11092us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:47.841414 11060 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:47.792938 12465 raft_consensus.cc:2804] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:47.842393 12465 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:47.842551 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:47.842888 12640 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:47.843026 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:47.843617 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1531) took 3207 ms. Trace:
I20260709 12:23:47.793648 11098 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:23:47.791451 12577 log.cc:927] Time spent T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 2.309s	user 0.004s	sys 0.018s
W20260709 12:23:47.844448 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 50866.4us
I20260709 12:23:47.793700 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:47.845273 11098 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:47.845495 10982 raft_consensus.cc:2376] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2. Re-sending same reply.
I20260709 12:23:47.731173 12568 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:47.846901 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:47.848160 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:47.848764 12568 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:47.794551 12623 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.794744 11053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 172) took 1252 ms. Trace:
W20260709 12:23:47.776641 11125 rpcz_store.cc:269] 0709 12:23:44.587423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.588083 (+   660us) service_pool.cc:224] Handling call
0709 12:23:47.775992 (+3187909us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b5400033ed4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:47.776116 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":812834688}
I20260709 12:23:47.849484 11053 rpcz_store.cc:276] 0709 12:23:46.541943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.702025 (+160082us) service_pool.cc:224] Handling call
0709 12:23:46.702322 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:46.722293 (+ 19971us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:46.722324 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:46.722366 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:46.722396 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.794495 (+1072099us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b54003020d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:47.794542 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.794680 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45481728}
I20260709 12:23:47.794988 12599 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:47.796355 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:47.850291 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:47.798053 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:47.854665 11125 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:47.855232 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 1544) took 1292 ms. Trace:
W20260709 12:23:47.833985 11059 rpcz_store.cc:269] 0709 12:23:46.537201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.537306 (+   105us) service_pool.cc:224] Handling call
0709 12:23:47.787986 (+1250680us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54003e0b54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:47.788094 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":338417920}
I20260709 12:23:47.798547 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:47.799315 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:47.855381 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:47.855338 11134 raft_consensus.cc:2393] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 4: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:47.856598 11057 raft_consensus.cc:2368] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4.
I20260709 12:23:47.799687 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:47.790869 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:47.800336 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:47.824472 12600 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:47.795619 12647 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.739826 12633 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:47.738960 12479 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:47.815047 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:47.883945 11056 raft_consensus.cc:1275] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:47.885259 11056 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.810025 11680 rpcz_store.cc:276] 0709 12:23:46.208765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.209019 (+   254us) service_pool.cc:224] Handling call
0709 12:23:46.289492 (+ 80473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:46.289755 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:23:47.704881 (+1415126us) log.cc:844] Serialized 14 byte log entry
0709 12:23:47.762900 (+ 58019us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:47.762941 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:47.762979 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.763033 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.763123 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":960,"prepare.queue_time_us":1379986,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":12895,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":99,"thread_start_us":1352007,"threads_started":2}
I20260709 12:23:47.829859 11025 leader_election.cc:400] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 2. Current term is 3.
I20260709 12:23:47.829514 11133 rpcz_store.cc:276] 0709 12:23:46.544345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.684636 (+1140291us) service_pool.cc:224] Handling call
0709 12:23:47.780224 (+ 95588us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:47.833519 12593 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:47.887702 11025 leader_election.cc:403] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:47.875787 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:47.889848 11023 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:47.843343 11060 raft_consensus.cc:2393] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 2: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
W20260709 12:23:47.777958 10977 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1534) took 1746 ms (client timeout 1984 ms). Trace:
W20260709 12:23:47.795580 10979 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 997) took 1530 ms (client timeout 1566 ms). Trace:
I20260709 12:23:47.846692 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:47.891681 10982 raft_consensus.cc:2393] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 2: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:47.851533 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:47.848665 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1537) took 1812 ms. Trace:
I20260709 12:23:47.840963 10948 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:47.857103 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:47.846670 12621 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:47.855579 11125 rpcz_store.cc:276] 0709 12:23:46.563230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.849964 (+1286734us) service_pool.cc:224] Handling call
0709 12:23:47.855166 (+  5202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:47.862918 12338 raft_consensus.cc:697] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:47.863811 12659 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:47.900096 12659 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:47.865557 11098 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:47.871691 11057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1341) took 1333 ms. Trace:
I20260709 12:23:47.775039 12566 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.900349 12338 consensus_queue.cc:237] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:47.900873 12566 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:47.902341 12533 raft_consensus.cc:2804] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:47.902607 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:47.845782 12422 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:47.901968 11056 raft_consensus.cc:1275] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:47.903578 12422 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.904323 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:47.905001 11133 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 4.
I20260709 12:23:47.905498 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1404) took 1162 ms. Trace:
I20260709 12:23:47.905794 11133 rpcz_store.cc:276] 0709 12:23:46.743218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.904041 (+1160823us) service_pool.cc:224] Handling call
0709 12:23:47.905438 (+  1397us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:47.906819 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:47.871636 11130 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:47.871168 12640 raft_consensus.cc:2804] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:23:47.838682 11052 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1333) took 3223 ms (client timeout 1538 ms). Trace:
I20260709 12:23:47.842839 12465 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:47.907855 12640 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:47.908478 11057 rpcz_store.cc:276] 0709 12:23:46.537783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.584758 (+ 46975us) service_pool.cc:224] Handling call
0709 12:23:47.799168 (+1214410us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b58001a5e98. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90daa0a0 00007f8f90da9984 00007f8f8a3246d4 00007f8f8a324662
0709 12:23:47.871627 (+ 72459us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3779328}
W20260709 12:23:47.909606 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 44117.1us
I20260709 12:23:47.873003 11678 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:47.837363 11051 rpcz_store.cc:276] 0709 12:23:46.543042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.812298 (+269256us) service_pool.cc:224] Handling call
0709 12:23:46.890630 (+ 78332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:46.900332 (+  9702us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:23:46.926081 (+ 25749us) log.cc:844] Serialized 14 byte log entry
0709 12:23:47.830598 (+904517us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:47.836605 (+  6007us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:47.836672 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.836742 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.836869 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57309,"prepare.queue_time_us":15388,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":13225,"raft.queue_time_us":46430,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"thread_start_us":745917,"threads_started":1,"wal-append.queue_time_us":717219}
I20260709 12:23:47.873799 12599 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:47.910894 12479 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:47.911320 11098 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:47.883360 12647 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:47.912479 12599 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:47.840335 12629 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:47.843773 11675 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
W20260709 12:23:47.834837 12598 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.012s	user 0.005s	sys 0.014s
I20260709 12:23:47.856907 12653 consensus_queue.cc:1048] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:23:47.917389 12598 consensus_queue.cc:1048] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:47.870764 12623 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:47.877995 12361 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:47.878392 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:23:47.857832 11643 connection.cc:256] RPC call timeout handler was delayed by -1.0050107480001316s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
I20260709 12:23:47.873023 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:47.872831 10976 raft_consensus.cc:2368] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 2. Current term is 3.
I20260709 12:23:47.881196 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:23:47.888999 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 61879us
I20260709 12:23:47.894718 12617 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:47.775312 11128 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:47.892904 11054 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
W20260709 12:23:47.892882 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 51992.5us
I20260709 12:23:47.974576 11054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41294 (request call id 1010) took 1043 ms. Trace:
W20260709 12:23:47.891136 10979 rpcz_store.cc:269] 0709 12:23:46.265321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.540626 (+275305us) service_pool.cc:224] Handling call
0709 12:23:47.795424 (+1254798us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b5400229f54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:47.795523 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":399811968}
I20260709 12:23:47.882366 12600 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.896224 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:47.977993 10982 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:47.892563 10980 rpcz_store.cc:276] 0709 12:23:46.036209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.036327 (+   118us) service_pool.cc:224] Handling call
0709 12:23:47.847892 (+1811565us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b5800003698. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90dbdfc0 00007f8f90da8929 00007f8f90da83d2 00007f8f8a31fbd4
0709 12:23:47.848113 (+   221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:47.848330 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:47.848358 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:47.848404 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:47.848434 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.848488 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.848599 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6094080}
I20260709 12:23:47.898833 12607 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:47.899331 12621 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.875819 12477 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:47.983767 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:23:47.907805 11130 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 1545) took 1340 ms (client timeout 1777 ms). Trace:
I20260709 12:23:47.984984 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:23:47.985035 11130 rpcz_store.cc:269] 0709 12:23:46.567706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.790560 (+1222854us) service_pool.cc:224] Handling call
0709 12:23:47.907745 (+117185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:47.986193 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:47.986307 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:47.986840 11130 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:47.987164 12456 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:47.987351 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1407) took 1185 ms. Trace:
I20260709 12:23:47.987773 11130 rpcz_store.cc:276] 0709 12:23:46.801964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.985903 (+1183939us) service_pool.cc:224] Handling call
0709 12:23:47.987295 (+  1392us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:47.988646 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:47.989302 11130 raft_consensus.cc:2393] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 2: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:47.916038 12659 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:47.907881 11052 rpcz_store.cc:269] 0709 12:23:44.607807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.612282 (+  4475us) service_pool.cc:224] Handling call
0709 12:23:47.811639 (+3199357us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54003016d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:47.829125 (+ 17486us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2664493440}
I20260709 12:23:47.907614 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 1539) took 1363 ms. Trace:
I20260709 12:23:47.996145 11133 rpcz_store.cc:276] 0709 12:23:46.543809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.906507 (+1362698us) service_pool.cc:224] Handling call
0709 12:23:47.907555 (+  1048us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:47.915694 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 99925.4us
I20260709 12:23:47.825528 12632 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:47.921612 11643 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:47.889791 12472 raft_consensus.cc:2749] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 2. Current term is 3.
I20260709 12:23:47.889911 12573 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.908420 12640 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.971144 11025 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:47.999516 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:48.000319 10980 raft_consensus.cc:2393] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 2: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:48.001013 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:48.001291 11097 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:47.832405 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1533) took 1801 ms. Trace:
I20260709 12:23:47.915844 12533 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:47.903193 12566 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:47.968838 12260 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
W20260709 12:23:47.972702 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 113771us
W20260709 12:23:47.890942 10977 rpcz_store.cc:269] 0709 12:23:46.031857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.033353 (+  1496us) service_pool.cc:224] Handling call
0709 12:23:47.777770 (+1744417us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b540009ae54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:47.777899 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5792128}
I20260709 12:23:47.910914 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:47.918216 12568 raft_consensus.cc:2804] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:47.918735 12639 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:47.974962 11054 rpcz_store.cc:276] 0709 12:23:46.930661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.856849 (+926188us) service_pool.cc:224] Handling call
0709 12:23:47.974516 (+117667us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:48.053615 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:48.054389 11054 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:47.977103 12636 consensus_queue.cc:1048] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:23:48.055505 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:48.056197 11054 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:48.057140 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:48.057765 11054 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:23:48.058688 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:23:47.975288 10976 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1541) took 1936 ms (client timeout 1593 ms). Trace:
W20260709 12:23:48.059445 10976 rpcz_store.cc:269] 0709 12:23:46.039047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.039532 (+   485us) service_pool.cc:224] Handling call
0709 12:23:47.796191 (+1756659us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b5800003698. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90daa0a0 00007f8f90da9984 00007f8f8a3246d4 00007f8f8a324662
0709 12:23:47.973234 (+177043us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58874624}
I20260709 12:23:48.060931 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:48.061677 10976 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
W20260709 12:23:48.062480 10949 leader_election.cc:336] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 1.534s (SENT)
I20260709 12:23:47.982180 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:48.066725 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:48.067613 11051 raft_consensus.cc:2368] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4.
I20260709 12:23:47.844026 11131 rpcz_store.cc:276] 0709 12:23:44.636071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.482015 (+845944us) service_pool.cc:224] Handling call
0709 12:23:45.684461 (+202446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.762349 (+ 77888us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:23:45.947175 (+184826us) log.cc:844] Serialized 14 byte log entry
0709 12:23:47.809484 (+1862309us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:47.813536 (+  4052us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:47.825023 (+ 11487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.830220 (+  5197us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.843532 (+ 13312us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":398634,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":144752,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":260,"thread_start_us":1913023,"threads_started":3,"wal-append.queue_time_us":542964,"wal-append.run_cpu_time_us":1911,"wal-append.run_wall_time_us":1168932}
I20260709 12:23:47.989655 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 1547) took 1405 ms. Trace:
I20260709 12:23:47.903228 11680 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 4.
W20260709 12:23:47.997648 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 76090.6us
W20260709 12:23:47.995271 11128 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1399) took 1457 ms (client timeout 1749 ms). Trace:
I20260709 12:23:48.014262 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:47.968297 12589 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:47.928265 12623 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:48.018493 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:48.022667 12593 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:47.971994 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:48.025971 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:48.020465 12607 raft_consensus.cc:2804] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:48.154292 12607 raft_consensus.cc:697] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:48.027540 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:48.027827 12633 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:48.028308 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:48.052196 12568 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:48.029548 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:48.030638 12582 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:48.033140 11058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 178) took 1121 ms. Trace:
I20260709 12:23:48.035573 12647 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:48.036988 12632 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:48.038359 12260 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:48.039324 11672 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:48.039556 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:48.224022 11125 raft_consensus.cc:2393] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 3: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:48.224500 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1403) took 1540 ms. Trace:
I20260709 12:23:48.012332 12465 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:48.042574 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:48.155486 12593 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:48.046073 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:48.045543 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:48.047303 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:48.047899 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:48.238442 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:47.973004 12617 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.017467 12471 raft_consensus.cc:2804] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:48.245808 12471 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:48.246284 12471 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:48.015465 12592 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:48.017683 12533 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:48.013756 12361 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:48.077847 11643 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:48.077912 10980 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:48.076628 11130 rpcz_store.cc:276] 0709 12:23:46.584450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.988404 (+1403954us) service_pool.cc:224] Handling call
0709 12:23:47.989605 (+  1201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:48.098701 12479 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:48.013993 10975 rpcz_store.cc:276] 0709 12:23:46.030958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.033255 (+  2297us) service_pool.cc:224] Handling call
0709 12:23:46.264302 (+231047us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:47.080339 (+816037us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:47.083112 (+  2773us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:47.202225 (+119113us) log.cc:844] Serialized 26 byte log entry
0709 12:23:47.752847 (+550622us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:47.761637 (+  8790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.767138 (+  5501us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:47.809981 (+ 42843us) raft_consensus.cc:1685] finished
0709 12:23:47.810001 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.832322 (+ 22321us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":233066,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":143,"thread_start_us":625218,"threads_started":2,"wal-append.queue_time_us":563694}
I20260709 12:23:48.150718 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:48.152412 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1002) took 1885 ms. Trace:
I20260709 12:23:48.254280 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:48.152837 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:48.153681 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1409) took 1300 ms. Trace:
W20260709 12:23:48.155136 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 242269us
I20260709 12:23:48.152454 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:48.051959 12635 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.256343 11060 raft_consensus.cc:2393] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 3: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:48.254247 12361 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:48.256706 12635 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:48.257460 12632 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:48.020278 12660 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:48.258317 12664 consensus_queue.cc:1048] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:48.052984 12599 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:48.260149 12599 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:48.149344 12589 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:48.222024 11058 rpcz_store.cc:276] 0709 12:23:46.911871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.879680 (+967809us) service_pool.cc:224] Handling call
0709 12:23:47.880004 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:47.880412 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:47.880443 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:47.889250 (+  8807us) log.cc:844] Serialized 26 byte log entry
0709 12:23:47.972438 (+ 83188us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:47.972475 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.972539 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:48.032855 (+ 60316us) raft_consensus.cc:1685] finished
0709 12:23:48.032880 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:48.033070 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3511,"raft.queue_time_us":1632,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":6757,"thread_start_us":69422,"threads_started":1,"wal-append.queue_time_us":78384}
I20260709 12:23:48.224877 11125 rpcz_store.cc:276] 0709 12:23:46.684612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.039243 (+1354631us) service_pool.cc:224] Handling call
0709 12:23:48.224446 (+185203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:48.105101 12630 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:48.044538 10948 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:48.254787 10978 rpcz_store.cc:276] 0709 12:23:46.266593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.789342 (+522749us) service_pool.cc:224] Handling call
0709 12:23:47.779751 (+990409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:47.779942 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:47.779967 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:47.780007 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:47.780036 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.780090 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:48.152218 (+372128us) spinlock_profiling.cc:243] Waited 990 ms on lock 0x7b540009ae50. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:48.152345 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2277046016}
I20260709 12:23:48.222676 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:48.263092 12630 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:48.222337 11679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41774 (request call id 305) took 1203 ms. Trace:
I20260709 12:23:48.235914 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:48.021533 12573 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:48.257936 12632 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:48.237829 11057 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:23:48.239456 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:48.243628 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:48.264366 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:48.270838 11680 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 5.
I20260709 12:23:48.271837 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:48.263319 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:48.222740 12582 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:48.220603 12470 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:48.281559 10949 leader_election.cc:336] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 1.749s (SENT)
I20260709 12:23:48.158978 12574 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:48.222997 12568 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:48.258275 12361 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:23:48.253010 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 175269us
I20260709 12:23:48.291486 11643 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:48.224164 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:48.253489 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:48.254737 10984 raft_consensus.cc:2368] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 2. Current term is 3.
I20260709 12:23:48.255770 10979 raft_consensus.cc:2393] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 3: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:48.256999 11098 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:48.292832 11130 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:48.294215 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:48.294731 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1410) took 1398 ms. Trace:
I20260709 12:23:48.295097 11130 rpcz_store.cc:276] 0709 12:23:46.896658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.253228 (+1356570us) service_pool.cc:224] Handling call
0709 12:23:48.294673 (+ 41445us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:48.063495 12639 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:48.259495 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:48.255321 11133 rpcz_store.cc:276] 0709 12:23:46.853805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.025688 (+1171883us) service_pool.cc:224] Handling call
0709 12:23:48.153579 (+127891us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:48.309237 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:48.238871 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:48.264451 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:48.272822 11125 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 1.
I20260709 12:23:48.265514 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:23:48.264210 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 219728us
I20260709 12:23:48.263931 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1408) took 1414 ms. Trace:
I20260709 12:23:48.273604 10978 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:48.313575 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:48.310719 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:48.269455 12632 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:48.266446 12660 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:48.268297 12630 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:48.268487 12629 raft_consensus.cc:2749] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:48.267727 12593 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:48.275672 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:48.268476 11679 rpcz_store.cc:276] 0709 12:23:47.018752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.019062 (+   310us) service_pool.cc:224] Handling call
0709 12:23:48.029375 (+1010313us) spinlock_profiling.cc:243] Waited 6.26 ms on lock 0x7b5800004598. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90daa0a0 00007f8f90da9984 00007f8f8a3246d4 00007f8f8a324662
0709 12:23:48.222266 (+192891us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14391040}
I20260709 12:23:48.277403 12607 consensus_queue.cc:237] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:48.236431 12634 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:48.251170 12617 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:48.285734 11024 leader_election.cc:336] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Timed out: RequestConsensusVote RPC to 127.9.145.196:42197 timed out after 1.744s (SENT)
I20260709 12:23:48.263772 11052 raft_consensus.cc:2410] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:23:48.105594 12513 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.252337 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:48.262401 12599 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:23:48.103906 11128 rpcz_store.cc:269] 0709 12:23:46.537017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.945901 (+408884us) service_pool.cc:224] Handling call
0709 12:23:47.994457 (+1048556us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:48.288093 12470 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:48.302397 12604 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:48.302743 11098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1549) took 1675 ms. Trace:
I20260709 12:23:48.295408 12600 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:48.304085 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:48.345849 11680 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:48.306213 12639 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:48.307520 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:48.357913 10977 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:48.359102 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:48.360378 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:48.367748 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:48.307408 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:48.308248 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1532) took 2278 ms. Trace:
I20260709 12:23:48.385152 10981 rpcz_store.cc:276] 0709 12:23:46.029520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.029700 (+   180us) service_pool.cc:224] Handling call
0709 12:23:46.030045 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:46.641348 (+611303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:46.641381 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:46.641423 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:46.641453 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:48.307975 (+1666522us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b54001ac2d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:48.308024 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:48.308156 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1405311872}
I20260709 12:23:48.254663 11674 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:48.313628 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:48.314769 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:48.388216 10980 raft_consensus.cc:2393] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 3: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:48.388361 10978 raft_consensus.cc:2393] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 3: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:48.267036 12589 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:48.317337 10948 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:48.315430 11130 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 1.
I20260709 12:23:48.315948 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:48.318053 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:23:48.395234 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 77989.7us
I20260709 12:23:48.395793 11125 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:48.320840 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:48.396072 10979 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:48.324100 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:48.396503 10948 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:48.324678 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:48.396971 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:48.397447 11133 raft_consensus.cc:2368] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 2. Current term is 3.
I20260709 12:23:48.280876 12479 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:48.314064 12361 raft_consensus.cc:2804] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:48.400657 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:48.299944 12640 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:48.346498 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:48.401379 11130 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 1.
I20260709 12:23:48.319168 12477 consensus_queue.cc:1048] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:23:48.317482 11126 rpcz_store.cc:276] 0709 12:23:46.841309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.028020 (+1186711us) service_pool.cc:224] Handling call
0709 12:23:48.255128 (+227108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:48.384207 11132 raft_consensus.cc:2393] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 3: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:48.398200 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 1542) took 1853 ms. Trace:
I20260709 12:23:48.396402 10984 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:48.389549 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:48.400346 12599 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:48.400808 12361 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.328430 11054 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:48.325578 12659 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:48.384090 12260 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:48.341495 12513 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:48.328023 12634 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:48.821427 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:48.822319 10979 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:48.467696 11681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 388) took 3562 ms. Trace:
I20260709 12:23:48.406287 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:48.823443 11130 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:48.501343 10984 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:23:48.405175 11125 rpcz_store.cc:276] 0709 12:23:46.544607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.317804 (+1773197us) service_pool.cc:224] Handling call
0709 12:23:48.398142 (+ 80338us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:48.500180 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:48.347724 11098 rpcz_store.cc:276] 0709 12:23:46.627014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.302685 (+1675671us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:23:48.493734 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1529) took 3876 ms. Trace:
I20260709 12:23:48.584721 11055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1334) took 3952 ms. Trace:
I20260709 12:23:48.443013 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 144) took 3855 ms. Trace:
W20260709 12:23:48.822168 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 455837us
I20260709 12:23:48.446672 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:48.829435 11055 rpcz_store.cc:276] 0709 12:23:44.608264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.021972 (+413708us) service_pool.cc:224] Handling call
0709 12:23:45.022457 (+   485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:46.711409 (+1688952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:48.560331 (+1848922us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b54003138d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:48.560583 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3882717568}
W20260709 12:23:48.643224 11097 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.557s (SENT) [suppressed 22 similar messages]
I20260709 12:23:48.830049 11129 rpcz_store.cc:276] 0709 12:23:44.587185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.144809 (+557624us) service_pool.cc:224] Handling call
0709 12:23:45.210632 (+ 65823us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.490057 (+279425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:45.490086 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:45.491845 (+  1759us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:45.491888 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:48.442705 (+2950817us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b540012d254. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:48.442765 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:48.442934 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":642100608}
I20260709 12:23:48.834282 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:48.834460 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:48.835996 10984 raft_consensus.cc:2410] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:23:48.836525 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1008) took 1153 ms. Trace:
I20260709 12:23:48.830368 11127 rpcz_store.cc:276] 0709 12:23:44.617347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.229962 (+612615us) service_pool.cc:224] Handling call
0709 12:23:45.230435 (+   473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:45.883796 (+653361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:45.883826 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:45.892833 (+  9007us) log.cc:844] Serialized 26 byte log entry
0709 12:23:46.957942 (+1065109us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:46.957995 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:48.471666 (+1513671us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b5400031e54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:48.471720 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:48.471771 (+    51us) raft_consensus.cc:1685] finished
0709 12:23:48.471787 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:48.493649 (+ 21862us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25651,"raft.queue_time_us":314343,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":28593,"spinlock_wait_cycles":624281472,"thread_start_us":1309774,"threads_started":2,"wal-append.queue_time_us":1663125,"wal-append.run_cpu_time_us":1714,"wal-append.run_wall_time_us":1001722}
I20260709 12:23:48.837282 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:48.837996 11129 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:48.402784 12574 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:23:48.468056 12665 log.cc:927] Time spent T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 12:23:48.809158 12582 consensus_meta.cc:287] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.000s
I20260709 12:23:48.823079 11681 rpcz_store.cc:276] 0709 12:23:44.905408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.905654 (+   246us) service_pool.cc:224] Handling call
0709 12:23:45.520858 (+615204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.902009 (+381151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:45.902039 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:45.902081 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:45.902132 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.902196 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:48.467432 (+2565236us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b5400592c50. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:48.467595 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":355464,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":148,"spinlock_wait_cycles":1413429632,"thread_start_us":170240,"threads_started":1}
I20260709 12:23:48.746910 12588 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:48.840672 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:48.841812 11133 raft_consensus.cc:2393] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 4: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:48.841150 10980 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:48.823487 12660 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:48.823848 12361 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:48.517622 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:48.449056 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:48.854588 10975 raft_consensus.cc:2410] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:23:48.854884 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:48.855448 11130 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:48.856330 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:48.467213 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:48.465832 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:48.845427 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:48.836982 10984 rpcz_store.cc:276] 0709 12:23:47.683205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.834161 (+1150956us) service_pool.cc:224] Handling call
0709 12:23:48.836466 (+  2305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:48.845835 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1019) took 1093 ms. Trace:
W20260709 12:23:48.832767 12586 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.045s	sys 0.045s
I20260709 12:23:48.522536 12479 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:48.827162 12593 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:48.823326 12599 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:48.842702 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:48.446257 12465 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:48.850133 10979 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:23:48.850888 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:23:48.847419 12621 consensus_meta.cc:287] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.832s	user 0.007s	sys 0.004s
I20260709 12:23:48.536984 12471 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:48.853273 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:48.872171 11052 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:23:48.873381 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:48.853508 12630 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.858191 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:48.873842 11025 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:48.841528 12574 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.847842 12470 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:48.860298 11681 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:48.860328 10980 rpcz_store.cc:276] 0709 12:23:47.752434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.396715 (+644281us) service_pool.cc:224] Handling call
0709 12:23:48.845774 (+449059us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:48.860950 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:48.408113 12422 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:48.864172 11130 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:23:48.855566 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:48.888576 10978 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:48.868127 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:48.868177 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:48.868616 11055 raft_consensus.cc:2368] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4.
I20260709 12:23:48.868242 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:48.890754 10979 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:23:48.848379 10977 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:48.854635 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58414 (request call id 160) took 1053 ms. Trace:
I20260709 12:23:48.861851 11126 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
W20260709 12:23:48.863700 12586 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.045s	sys 0.045s
I20260709 12:23:48.876200 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:48.898501 10978 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:48.878770 11676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41784 (request call id 395) took 2678 ms. Trace:
I20260709 12:23:48.849129 12582 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:48.882339 12634 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:48.884356 12660 raft_consensus.cc:2804] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:48.874486 11058 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:48.885402 12630 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:48.863452 12585 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:48.849982 12588 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:48.869347 12599 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:48.891000 10980 raft_consensus.cc:1240] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:48.897013 11128 rpcz_store.cc:276] 0709 12:23:47.800871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.369380 (+568509us) service_pool.cc:224] Handling call
0709 12:23:48.854572 (+485192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:48.908303 12582 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:48.891239 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1024) took 1060 ms. Trace:
I20260709 12:23:48.891273 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1005) took 1209 ms. Trace:
I20260709 12:23:48.909219 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:48.909560 12605 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:48.910085 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58414 (request call id 161) took 1108 ms. Trace:
I20260709 12:23:48.909086 12471 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:48.911315 11674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41784 (request call id 402) took 1291 ms. Trace:
I20260709 12:23:48.911716 11674 rpcz_store.cc:276] 0709 12:23:47.619825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.986047 (+366222us) service_pool.cc:224] Handling call
0709 12:23:48.911123 (+925076us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54005fffd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:48.911249 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":606740224}
I20260709 12:23:48.910848 11128 rpcz_store.cc:276] 0709 12:23:47.801239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.908920 (+1107681us) service_pool.cc:224] Handling call
0709 12:23:48.910022 (+  1102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:48.912442 11645 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:48.913043 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:48.913653 11674 raft_consensus.cc:2376] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bc01179655564f29b83babe396377cbb in term 3. Re-sending same reply.
I20260709 12:23:48.914021 12659 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:48.914948 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 152) took 2647 ms. Trace:
I20260709 12:23:48.910557 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:48.915385 10980 rpcz_store.cc:276] 0709 12:23:46.267313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.890474 (+2623161us) service_pool.cc:224] Handling call
0709 12:23:48.890826 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:48.914736 (+ 23910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:48.914904 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:48.909053 10984 rpcz_store.cc:276] 0709 12:23:47.682350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.867308 (+1184958us) service_pool.cc:224] Handling call
0709 12:23:48.891219 (+ 23911us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:48.914410 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:48.911955 12361 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:48.894518 12422 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:48.913072 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:48.918256 11128 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:23:48.918366 12260 raft_consensus.cc:2804] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:48.918800 12260 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:48.919170 12260 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:48.919253 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:48.892513 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:48.896360 11057 raft_consensus.cc:1240] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:48.919658 11678 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:48.920071 12361 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:48.920435 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:48.920820 11678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41784 (request call id 404) took 1254 ms. Trace:
I20260709 12:23:48.921183 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:48.921205 11678 rpcz_store.cc:276] 0709 12:23:47.666771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.224808 (+558037us) service_pool.cc:224] Handling call
0709 12:23:48.920652 (+695844us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b5400583754. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:48.920764 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1342776704}
I20260709 12:23:48.921908 11128 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:48.922307 12640 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:48.899077 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1545) took 1076 ms. Trace:
I20260709 12:23:48.922724 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:48.923223 10978 rpcz_store.cc:276] 0709 12:23:47.823140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.860721 (+1037581us) service_pool.cc:224] Handling call
0709 12:23:48.899016 (+ 38295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:48.923921 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:48.924458 10978 raft_consensus.cc:1275] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:48.925019 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1009) took 1241 ms. Trace:
I20260709 12:23:48.925323 10978 rpcz_store.cc:276] 0709 12:23:47.683464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.923869 (+1240405us) service_pool.cc:224] Handling call
0709 12:23:48.924159 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:48.924799 (+   640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:48.924968 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:48.889941 12592 consensus_meta.cc:287] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.640s	user 0.007s	sys 0.004s
I20260709 12:23:48.901255 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:48.873363 12621 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:48.906412 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:48.906282 12513 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:23:48.903182 12632 consensus_meta.cc:287] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.001s
I20260709 12:23:48.917223 10984 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
W20260709 12:23:48.925998 12568 consensus_meta.cc:287] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.628s	user 0.010s	sys 0.000s
I20260709 12:23:48.915782 11679 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:48.920392 11130 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:48.917378 11126 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:48.927485 10978 raft_consensus.cc:1275] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:48.927748 10979 rpcz_store.cc:276] 0709 12:23:47.830798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.867867 (+1037069us) service_pool.cc:224] Handling call
0709 12:23:48.891172 (+ 23305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:48.895021 12639 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:48.921641 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:48.929096 10980 raft_consensus.cc:1275] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:48.940688 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 155) took 2566 ms. Trace:
I20260709 12:23:48.929919 11680 raft_consensus.cc:2376] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3. Re-sending same reply.
I20260709 12:23:48.903798 12660 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:48.934515 12621 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:48.934978 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:23:48.935346 11134 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1398) took 2408 ms (client timeout 1534 ms). Trace:
W20260709 12:23:48.947227 11134 rpcz_store.cc:269] 0709 12:23:46.526534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.541523 (+ 14989us) service_pool.cc:224] Handling call
0709 12:23:48.935118 (+2393595us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400068454. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:48.935257 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2826298624}
W20260709 12:23:48.937399 11098 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36582 dropped due to backpressure: service queue is full with 50 items
I20260709 12:23:48.938374 10984 pending_rounds.cc:85] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 4
I20260709 12:23:48.887780 12574 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:48.941109 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 161) took 1117 ms. Trace:
I20260709 12:23:48.941035 10980 rpcz_store.cc:276] 0709 12:23:46.374026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.916231 (+2542205us) service_pool.cc:224] Handling call
0709 12:23:48.916474 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:48.940430 (+ 23956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:48.940633 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:48.922857 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:48.940538 11681 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:48.943480 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1015) took 1209 ms. Trace:
I20260709 12:23:48.948351 10984 pending_rounds.cc:107] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:23:48.922860 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:48.932252 12592 raft_consensus.cc:2749] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:48.949167 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:23:48.949626 10983 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1544) took 2899 ms (client timeout 2064 ms). Trace:
I20260709 12:23:48.948212 11098 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36582 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1415)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58414 (request call id 164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58414 (request call id 162)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1411)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58414 (request call id 165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1422)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58414 (request call id 167)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58414 (request call id 166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1424)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 148)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1535)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1536)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 150)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 151)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 154)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1391)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1393)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1396)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1546)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1548)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1550)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1405)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1406)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 156)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 157)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 158)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1558)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1560)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1412)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1413)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1418)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1419)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1420)
W20260709 12:23:48.938920 12533 consensus_meta.cc:287] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.669s	user 0.011s	sys 0.001s
I20260709 12:23:48.932018 12635 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:48.952598 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:48.955811 12588 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:48.941860 12660 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:48.947542 11678 raft_consensus.cc:1275] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:48.900496 11676 rpcz_store.cc:276] 0709 12:23:46.200401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.208288 (+  7887us) service_pool.cc:224] Handling call
0709 12:23:47.917741 (+1709453us) spinlock_profiling.cc:243] Waited 9.96 ms on lock 0x7b5800004598. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfeee 000000000036eb39 00007f8f90d331e0 00007f8f90dfc0c4 00007f8f90dfc131 00007f8f90dbdfc0 00007f8f90da8929 00007f8f90da83d2 00007f8f8a31fbd4
0709 12:23:47.917926 (+   185us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:47.918194 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:47.918222 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:47.939302 (+ 21080us) log.cc:844] Serialized 26 byte log entry
0709 12:23:48.158877 (+219575us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:48.221267 (+ 62390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:48.234966 (+ 13699us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:48.875787 (+640821us) raft_consensus.cc:1685] finished
0709 12:23:48.878432 (+  2645us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:48.878701 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22903680,"thread_start_us":85664,"threads_started":1,"wal-append.queue_time_us":336463}
I20260709 12:23:48.954195 10979 rpcz_store.cc:276] 0709 12:23:47.823970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.940366 (+1116396us) service_pool.cc:224] Handling call
0709 12:23:48.940657 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:48.940815 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:48.940841 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:48.940881 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:48.940910 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:48.940959 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:48.941056 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:49.068991 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1547) took 1237 ms. Trace:
I20260709 12:23:48.958783 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:49.070488 11127 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 4.
I20260709 12:23:49.017081 11134 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.016795 10984 raft_consensus.cc:2889] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:48.949681 11131 raft_consensus.cc:2393] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 3: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:48.958285 11130 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:48.958389 10978 rpcz_store.cc:276] 0709 12:23:47.734323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.925999 (+1191676us) service_pool.cc:224] Handling call
0709 12:23:48.927178 (+  1179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:48.939550 (+ 12372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:48.943426 (+  3876us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:49.016853 10983 rpcz_store.cc:269] 0709 12:23:46.047716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.217252 (+169536us) service_pool.cc:224] Handling call
0709 12:23:48.934819 (+2717567us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b5800003698. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90daa0a0 00007f8f90da9984 00007f8f8a3246d4 00007f8f8a324662
0709 12:23:48.947032 (+ 12213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36711680}
I20260709 12:23:48.942624 12568 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:48.985497 11672 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:23:49.059582 12260 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:49.063759 11128 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
W20260709 12:23:49.063970 11024 leader_election.cc:336] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Timed out: RequestConsensusVote RPC to 127.9.145.196:42197 timed out after 1.821s (SENT)
I20260709 12:23:49.065485 11023 leader_election.cc:400] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Vote denied by peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777) with higher term. Message: Invalid argument: T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 2. Current term is 3.
I20260709 12:23:49.123180 11023 leader_election.cc:403] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:49.072340 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 156) took 2668 ms. Trace:
I20260709 12:23:49.069429 10979 rpcz_store.cc:276] 0709 12:23:47.831502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.067885 (+1236383us) service_pool.cc:224] Handling call
0709 12:23:49.068234 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.068407 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.068434 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:49.068703 (+   269us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:49.068740 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.068800 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:49.068927 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:49.127300 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 93019.3us
I20260709 12:23:48.943073 12632 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:49.123631 10984 rpcz_store.cc:276] 0709 12:23:46.404052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.916637 (+2512585us) service_pool.cc:224] Handling call
0709 12:23:48.916904 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.072059 (+155155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.072278 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:49.130447 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 65129.8us
I20260709 12:23:49.136179 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:49.126441 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 1557) took 1092 ms. Trace:
I20260709 12:23:49.129103 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:49.138736 11130 rpcz_store.cc:276] 0709 12:23:48.033519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.892213 (+858694us) service_pool.cc:224] Handling call
0709 12:23:49.126365 (+234152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:49.139794 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:49.140640 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:49.141846 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:49.142014 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:49.142652 11059 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:49.140614 11130 raft_consensus.cc:2410] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:23:49.065929 10976 raft_consensus.cc:2376] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3. Re-sending same reply.
I20260709 12:23:49.151963 11054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1352) took 1103 ms. Trace:
I20260709 12:23:49.160405 11054 rpcz_store.cc:276] 0709 12:23:48.048624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.058433 (+  9809us) service_pool.cc:224] Handling call
0709 12:23:49.151765 (+1093332us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b54000b72d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:49.151900 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":618925440}
I20260709 12:23:49.148124 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:49.148864 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:49.147125 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:23:49.066425 12617 consensus_meta.cc:287] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.733s	user 0.010s	sys 0.000s
I20260709 12:23:49.144073 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:49.174458 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:49.141270 11056 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:23:49.155107 11127 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 3.
I20260709 12:23:49.159651 10978 raft_consensus.cc:1240] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:49.166081 12260 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:23:49.129182 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 65255.2us
W20260709 12:23:49.143321 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 259757us
I20260709 12:23:49.175905 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1548) took 1341 ms. Trace:
I20260709 12:23:49.061738 12533 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:49.176731 11053 raft_consensus.cc:2393] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 3: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:49.176277 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58414 (request call id 162) took 1268 ms. Trace:
I20260709 12:23:49.193120 11130 rpcz_store.cc:276] 0709 12:23:47.908349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.139506 (+1231157us) service_pool.cc:224] Handling call
0709 12:23:49.176207 (+ 36701us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:49.175917 11059 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:23:49.185794 10978 rpcz_store.cc:276] 0709 12:23:47.834036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.125421 (+1291385us) service_pool.cc:224] Handling call
0709 12:23:49.159462 (+ 34041us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.175650 (+ 16188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.175851 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12544}
I20260709 12:23:49.187731 11025 leader_election.cc:400] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 2. Current term is 3.
I20260709 12:23:49.194777 11025 leader_election.cc:403] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:49.195940 11025 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:49.200582 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:49.201323 11055 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:49.203042 11134 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:23:49.204254 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:49.205636 11645 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:49.211153 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:49.190472 12617 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:49.263466 12389 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:49.264165 12389 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:49.137636 12676 raft_consensus.cc:2749] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777) with higher term. Message: Invalid argument: T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 2. Current term is 3.
I20260709 12:23:49.182420 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1030) took 1155 ms. Trace:
I20260709 12:23:49.265712 12617 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:49.267812 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:49.284390 10978 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 1.
I20260709 12:23:49.191201 12630 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:49.277058 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:49.291795 11134 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.277753 11055 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
W20260709 12:23:49.293692 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 88171.9us
W20260709 12:23:49.278462 10949 leader_election.cc:336] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 2.124s (SENT)
I20260709 12:23:49.194551 11674 raft_consensus.cc:1240] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:49.200273 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:49.266317 12675 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:49.337548 12675 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:49.338064 12675 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.339571 12632 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:49.344686 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:49.306778 12569 consensus_queue.cc:1048] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:23:49.285789 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:49.275120 11677 raft_consensus.cc:2393] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 4: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
W20260709 12:23:49.325367 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 46924.7us
I20260709 12:23:49.299036 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:49.172330 11672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41784 (request call id 412) took 1175 ms. Trace:
I20260709 12:23:49.204718 12381 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.327364 12571 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
W20260709 12:23:49.330786 12673 log.cc:927] Time spent T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:23:49.284018 10976 rpcz_store.cc:276] 0709 12:23:48.018672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.952290 (+933618us) service_pool.cc:224] Handling call
0709 12:23:49.173568 (+221278us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:49.288703 12570 consensus_queue.cc:1059] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:23:49.382475 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:49.270931 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:49.273480 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:49.351604 10978 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:49.353199 10949 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
W20260709 12:23:49.397022 10948 leader_election.cc:336] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Timed out: RequestConsensusVote RPC to 127.9.145.194:44483 timed out after 1.534s (SENT)
I20260709 12:23:49.287042 10975 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:49.398216 10948 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:49.307492 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:49.359404 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:49.362521 11023 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:49.403271 10981 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 1.
I20260709 12:23:49.373328 11134 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 3.
I20260709 12:23:49.271359 12568 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:49.355489 11672 rpcz_store.cc:276] 0709 12:23:47.997252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.922587 (+925335us) service_pool.cc:224] Handling call
0709 12:23:49.168550 (+245963us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:49.374974 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:49.364441 12639 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:49.380035 11126 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:23:49.380997 12389 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:49.380415 12675 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:49.306892 12260 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:49.296518 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:49.421197 11128 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:49.421811 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1411) took 1127 ms. Trace:
I20260709 12:23:49.421978 12675 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:49.385040 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:23:49.377948 11097 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.004s	sys 0.012s
W20260709 12:23:49.425585 11097 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.004s	sys 0.012s
I20260709 12:23:49.426059 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:49.427477 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:49.416697 11673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 386) took 4662 ms. Trace:
W20260709 12:23:49.425926 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 782686us
I20260709 12:23:49.391707 11098 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:49.429153 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:49.432716 11055 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.434813 11098 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:49.403307 11129 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:49.404193 11023 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:49.436393 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:49.437703 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:49.439147 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1424) took 1136 ms. Trace:
I20260709 12:23:49.439494 11129 rpcz_store.cc:276] 0709 12:23:48.302379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.437427 (+1135048us) service_pool.cc:224] Handling call
0709 12:23:49.439087 (+  1660us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:49.380578 12593 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
W20260709 12:23:49.417979 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 64884.3us
I20260709 12:23:49.404892 12676 raft_consensus.cc:2749] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:49.394569 12607 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.388499 12621 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:49.420297 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1421) took 1118 ms. Trace:
I20260709 12:23:49.382190 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:49.396643 11674 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.369767 11025 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:49.408870 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:49.440220 11055 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:23:49.446357 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:49.442301 11098 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:49.429193 11675 raft_consensus.cc:1240] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:49.497272 12584 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:49.517730 11126 rpcz_store.cc:276] 0709 12:23:48.301550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.905506 (+603956us) service_pool.cc:224] Handling call
0709 12:23:49.416449 (+510943us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:49.525113 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:49.525264 12598 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:23:49.526409 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 84189.9us
I20260709 12:23:49.420536 12260 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:49.527261 12260 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:49.528731 12573 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:49.427834 11672 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Advancing to term 3
I20260709 12:23:49.424494 12594 raft_consensus.cc:2804] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:23:49.498181 11132 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1397) took 3092 ms (client timeout 1961 ms). Trace:
I20260709 12:23:49.538539 10882 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41106 (request call id 279) took 7376 ms. Trace:
I20260709 12:23:49.405579 12470 consensus_queue.cc:1048] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:23:49.503466 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:49.418797 11677 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.520756 11681 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:49.519399 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:49.497772 12571 raft_consensus.cc:3055] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:49.531504 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:49.552089 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:49.532493 10949 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:49.464717 11097 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:49.541649 11127 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 1.
W20260709 12:23:49.443759 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 46787.7us
W20260709 12:23:49.553696 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 89093.2us
W20260709 12:23:49.553861 10948 leader_election.cc:336] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Timed out: RequestConsensusVote RPC to 127.9.145.194:44483 timed out after 1.538s (SENT)
I20260709 12:23:49.536595 10978 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:23:49.537765 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:49.429286 11673 rpcz_store.cc:276] 0709 12:23:44.746137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.747142 (+  1005us) service_pool.cc:224] Handling call
0709 12:23:48.009278 (+3262136us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b5800004598. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90dbdfc0 00007f8f90da8929 00007f8f90da83d2 00007f8f8a31fbd4
0709 12:23:48.312606 (+303328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:48.316563 (+  3957us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:48.318586 (+  2023us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:48.321486 (+  2900us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:48.323453 (+  1967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:48.326178 (+  2725us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:49.393606 (+1067428us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b5400446bd0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:49.408590 (+ 14984us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":730141952}
W20260709 12:23:49.538733 11132 rpcz_store.cc:269] 0709 12:23:46.406211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.842066 (+1435855us) service_pool.cc:224] Handling call
0709 12:23:49.497923 (+1655857us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b5400033ed4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:49.498077 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1028561792}
I20260709 12:23:49.526693 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:49.374230 12599 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:49.481746 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:49.467135 12389 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:49.562546 11129 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:49.467600 12639 raft_consensus.cc:2804] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:49.555527 10981 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 1.
I20260709 12:23:49.555977 10949 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:49.556712 12598 raft_consensus.cc:2804] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:49.554620 11097 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:23:49.632841 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 78316us
I20260709 12:23:49.422722 11128 rpcz_store.cc:276] 0709 12:23:48.294081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.203688 (+909607us) service_pool.cc:224] Handling call
0709 12:23:49.421745 (+218057us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:49.557740 10948 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:49.414347 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1570) took 1107 ms. Trace:
I20260709 12:23:49.551033 12571 raft_consensus.cc:740] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:49.634721 12470 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:49.631453 12639 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:49.637881 12639 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:49.540963 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:49.637508 12630 raft_consensus.cc:2804] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:49.638814 12630 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.639138 12630 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.634929 12584 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:49.560895 11125 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:49.561261 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 147) took 4894 ms. Trace:
I20260709 12:23:49.554615 12594 raft_consensus.cc:697] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:49.640440 11132 rpcz_store.cc:276] 0709 12:23:44.666642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.559088 (+4892446us) service_pool.cc:224] Handling call
0709 12:23:49.560732 (+  1644us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.560930 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.560956 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:49.561000 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:49.561028 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.561082 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:49.561204 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41088}
I20260709 12:23:49.559901 11127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6506ec2922c24d099538b52b0df81502"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
mode: GRACEFUL
new_leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
 from {username='slave'} at 127.0.0.1:54492
I20260709 12:23:49.443387 12568 raft_consensus.cc:2749] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:49.569625 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:23:49.647717 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 464303us
I20260709 12:23:49.522915 12607 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:49.580837 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:49.581199 10949 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:49.638175 12381 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 2. Current term is 3.
I20260709 12:23:49.490855 12617 raft_consensus.cc:2749] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:49.633597 11097 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:49.634029 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1556) took 1759 ms. Trace:
I20260709 12:23:49.658696 10984 rpcz_store.cc:276] 0709 12:23:47.874634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.133011 (+1258377us) service_pool.cc:224] Handling call
0709 12:23:49.633300 (+500289us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b5800003698. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90dbdfc0 00007f8f90da8929 00007f8f90da83d2 00007f8f8a31fbd4
0709 12:23:49.633509 (+   209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.633687 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.633713 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:49.633752 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:49.633793 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.633848 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:49.633968 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48031104}
I20260709 12:23:49.660259 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:49.661535 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:49.555403 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:49.664484 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:49.665647 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:23:49.636323 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 78672.2us
I20260709 12:23:49.666563 10948 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:49.559381 12512 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:49.550364 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:49.642038 11127 raft_consensus.cc:606] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Received request to transfer leadership to TS c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:49.642921 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 148) took 4970 ms. Trace:
I20260709 12:23:49.645588 11129 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:49.674499 11127 raft_consensus.cc:614] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:49.540064 12621 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:49.674678 11125 rpcz_store.cc:276] 0709 12:23:44.672345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.559149 (+4886804us) service_pool.cc:224] Handling call
0709 12:23:49.560727 (+  1578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.642623 (+ 81896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.642858 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51968}
I20260709 12:23:49.500291 12462 consensus_queue.cc:1059] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 12:23:49.678335 11125 raft_consensus.cc:1240] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:49.678572 12462 raft_consensus.cc:3055] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:49.679046 12462 raft_consensus.cc:740] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:49.679277 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1535) took 4836 ms. Trace:
I20260709 12:23:49.680038 12462 consensus_queue.cc:260] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:49.676584 12674 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:49.673928 12512 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:49.652101 10981 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:49.682001 12512 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:49.639717 12574 consensus_meta.cc:287] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.667s	user 0.006s	sys 0.002s
I20260709 12:23:49.683703 12574 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:49.677138 12568 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:49.686797 12568 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:49.687228 12568 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:49.687803 12621 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:49.683010 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:49.689706 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:49.690404 10981 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
W20260709 12:23:49.652293 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 71167.5us
I20260709 12:23:49.679706 11128 rpcz_store.cc:276] 0709 12:23:44.842718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.651424 (+4808706us) service_pool.cc:224] Handling call
0709 12:23:49.678664 (+ 27240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.678927 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.678957 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:49.679005 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:49.679037 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.679095 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:49.679226 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":787,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106}
I20260709 12:23:49.692494 10949 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:49.422513 12533 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:49.538995 10882 rpcz_store.cc:276] 0709 12:23:42.156529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.157529 (+  1000us) service_pool.cc:224] Handling call
0709 12:23:42.228004 (+ 70475us) spinlock_profiling.cc:243] Waited 51.7 ms on lock 0x7b54002e9854. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4e090 00007f8f8bdecf3a 00007f8f91ba2e9c 00007f8f91ca104e 00007f8f901622a4 00007f8f90162232 00007f8f90162161 00007f8f901620dc 00007f8f90161392 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:49.532541 (+7304537us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:45.209048 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:45.209673 (+   625us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:45.209708 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:23:45.209728 (+    20us) tablet.cc:662] Decoding operations
0709 12:23:45.272130 (+ 62402us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:45.279983 (+  7853us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:45.290753 (+ 10770us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:23:45.547263 (+256510us) tablet.cc:701] Row locks acquired
0709 12:23:45.601625 (+ 54362us) write_op.cc:260] PREPARE: finished
0709 12:23:45.683956 (+ 82331us) write_op.cc:270] Start()
0709 12:23:45.758174 (+ 74218us) write_op.cc:276] Timestamp: P: 1783599825683879 usec, L: 0
0709 12:23:45.760686 (+  2512us) op_driver.cc:348] REPLICATION: starting
0709 12:23:45.875819 (+115133us) log.cc:844] Serialized 1307 byte log entry
0709 12:23:47.610772 (+1734953us) op_driver.cc:464] REPLICATION: finished
0709 12:23:47.778540 (+167768us) write_op.cc:301] APPLY: starting
0709 12:23:47.778661 (+   121us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:47.778790 (+   129us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:47.778910 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:47.797153 (+ 18243us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:47.797332 (+   179us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:23:47.797381 (+    49us) write_op.cc:312] APPLY: finished
0709 12:23:47.797617 (+   236us) log.cc:844] Serialized 35 byte log entry
0709 12:23:47.797786 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:47.797885 (+    99us) write_op.cc:454] Released schema lock
0709 12:23:47.797932 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:47.798344 (+   412us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:47.798374 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1535042,"reported_tablets":7,"spinlock_wait_cycles":118992128,"child_traces":[["op",{"apply.queue_time_us":151607,"apply.run_cpu_time_us":2437,"apply.run_wall_time_us":31952,"num_ops":3,"prepare.queue_time_us":751414,"prepare.run_cpu_time_us":58356,"prepare.run_wall_time_us":1278646,"raft.queue_time_us":938260,"raft.run_cpu_time_us":9712,"raft.run_wall_time_us":126003,"replication_time_us":1849922,"thread_start_us":1129532,"threads_started":4,"wal-append.queue_time_us":719092,"wal-append.run_cpu_time_us":23730,"wal-append.run_wall_time_us":2204285}]]}
I20260709 12:23:49.632104 12672 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:49.631935 12598 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.693583 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 154) took 3753 ms. Trace:
I20260709 12:23:49.652791 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:49.698982 11132 raft_consensus.cc:2368] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3.
I20260709 12:23:49.699260 11023 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:49.700238 11023 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:49.700564 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1391) took 3680 ms. Trace:
I20260709 12:23:49.701192 12533 raft_consensus.cc:2804] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:49.701650 12533 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:49.670182 11097 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:49.691496 12674 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:49.697749 12672 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:49.703214 11097 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:49.703689 12672 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.702020 12533 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.704094 12621 raft_consensus.cc:2749] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:49.671337 10978 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.698087 12598 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:49.691258 11127 raft_consensus.cc:1240] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:49.707425 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 151) took 3789 ms. Trace:
I20260709 12:23:49.707748 11127 rpcz_store.cc:276] 0709 12:23:45.918208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.690773 (+3772565us) service_pool.cc:224] Handling call
0709 12:23:49.691083 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.707141 (+ 16058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.707368 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:49.709062 11127 raft_consensus.cc:1240] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:23:49.709862 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1393) took 3689 ms. Trace:
I20260709 12:23:49.640151 12584 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.681450 12462 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.712812 11097 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:49.686329 10980 raft_consensus.cc:1240] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:49.694630 12574 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:23:49.714339 11131 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1401) took 3088 ms (client timeout 2222 ms). Trace:
I20260709 12:23:49.714666 12574 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:49.715219 12574 raft_consensus.cc:697] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:49.696781 10981 raft_consensus.cc:1240] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:49.717347 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1558) took 1842 ms. Trace:
I20260709 12:23:49.710327 12584 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:49.667513 10948 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:49.720834 10881 catalog_manager.cc:5697] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:49.703076 12674 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.700992 11132 rpcz_store.cc:276] 0709 12:23:46.020222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.699660 (+3679438us) service_pool.cc:224] Handling call
0709 12:23:49.700033 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.700227 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.700255 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:49.700311 (+    56us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:49.700343 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.700396 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:49.700506 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:49.723964 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1537) took 3581 ms. Trace:
I20260709 12:23:49.726186 11132 rpcz_store.cc:276] 0709 12:23:46.142719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.722991 (+3580272us) service_pool.cc:224] Handling call
0709 12:23:49.723391 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.723588 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.723614 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:49.723661 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:49.723695 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.723752 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:49.723897 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:49.678985 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 150) took 4781 ms. Trace:
I20260709 12:23:49.727393 11125 rpcz_store.cc:276] 0709 12:23:44.897896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.676496 (+4778600us) service_pool.cc:224] Handling call
0709 12:23:49.678170 (+  1674us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.678759 (+   589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.678936 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:49.728438 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1538) took 3585 ms. Trace:
I20260709 12:23:49.728904 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1546) took 3154 ms. Trace:
I20260709 12:23:49.728832 11130 rpcz_store.cc:276] 0709 12:23:46.143038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.727626 (+3584588us) service_pool.cc:224] Handling call
0709 12:23:49.727959 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.728127 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.728151 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:49.728202 (+    51us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:49.728230 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.728281 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:49.728386 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:49.718050 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:49.730418 10982 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:49.638018 12389 raft_consensus.cc:697] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:49.732563 12389 consensus_queue.cc:237] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:49.734447 10978 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:49.736409 11645 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:23:49.719039 11133 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 1556) took 1685 ms (client timeout 1792 ms). Trace:
I20260709 12:23:49.719101 11097 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:49.711912 11128 rpcz_store.cc:276] 0709 12:23:45.940210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.692585 (+3752375us) service_pool.cc:224] Handling call
0709 12:23:49.692968 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.693178 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.693214 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:49.693278 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:49.693314 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.693376 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:49.693517 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:49.713615 12621 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:49.724458 10981 rpcz_store.cc:276] 0709 12:23:47.875109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.696163 (+1821054us) service_pool.cc:224] Handling call
0709 12:23:49.696577 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.716980 (+ 20403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.717244 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:49.728490 11132 raft_consensus.cc:1240] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:23:49.742681 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1561) took 1844 ms. Trace:
I20260709 12:23:49.743510 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1396) took 3338 ms. Trace:
I20260709 12:23:49.743157 10981 rpcz_store.cc:276] 0709 12:23:47.897820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.741762 (+1843942us) service_pool.cc:224] Handling call
0709 12:23:49.742144 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.742339 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.742367 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:49.742412 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:49.742444 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.742499 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:49.742614 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:49.744985 11645 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:23:49.745532 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1562) took 1847 ms. Trace:
I20260709 12:23:49.746596 11645 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:49.745993 10981 rpcz_store.cc:276] 0709 12:23:47.898534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.744648 (+1846114us) service_pool.cc:224] Handling call
0709 12:23:49.744982 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.745152 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.745179 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:49.745223 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:49.745254 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.745323 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:49.745469 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:49.749210 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1563) took 1850 ms. Trace:
I20260709 12:23:49.750269 10981 rpcz_store.cc:276] 0709 12:23:47.899208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.748333 (+1849125us) service_pool.cc:224] Handling call
0709 12:23:49.748681 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.748865 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.748893 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:49.748936 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:49.748967 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.749018 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:49.749150 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:49.752183 10981 raft_consensus.cc:1240] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:49.752910 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1564) took 1853 ms. Trace:
I20260709 12:23:49.743893 11132 rpcz_store.cc:276] 0709 12:23:46.405574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.727854 (+3322280us) service_pool.cc:224] Handling call
0709 12:23:49.728230 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:49.742979 (+ 14749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.743450 (+   471us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:49.724995 12568 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:49.725175 12574 consensus_queue.cc:237] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:49.718569 12470 raft_consensus.cc:2749] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:23:49.738330 11133 rpcz_store.cc:269] 0709 12:23:48.033183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.427834 (+394651us) service_pool.cc:224] Handling call
0709 12:23:49.718842 (+1291008us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b5400106b54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:49.718978 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23934208}
I20260709 12:23:49.542866 12593 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:49.671800 10984 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 3.
I20260709 12:23:49.694413 10976 raft_consensus.cc:2393] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 2: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:49.739202 11097 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:23:49.739634 11127 rpcz_store.cc:276] 0709 12:23:46.020767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.708476 (+3687709us) service_pool.cc:224] Handling call
0709 12:23:49.708845 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:49.709391 (+   546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.709803 (+   412us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:49.729316 11125 rpcz_store.cc:276] 0709 12:23:46.574553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.728160 (+3153607us) service_pool.cc:224] Handling call
0709 12:23:49.728441 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.728605 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.728628 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:49.728678 (+    50us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:49.728707 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.728757 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:49.728852 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:49.739336 11023 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:49.753389 10981 rpcz_store.cc:276] 0709 12:23:47.899812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.751684 (+1851872us) service_pool.cc:224] Handling call
0709 12:23:49.752006 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.752657 (+   651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.752854 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:49.754835 11126 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:49.711931 12660 consensus_meta.cc:287] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.591s	user 0.006s	sys 0.003s
I20260709 12:23:49.697141 12607 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:49.640406 10975 rpcz_store.cc:276] 0709 12:23:48.306617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.855280 (+548663us) service_pool.cc:224] Handling call
0709 12:23:49.409778 (+554498us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:49.654219 12629 raft_consensus.cc:2804] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:49.762818 11023 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:49.740089 10881 catalog_manager.cc:5697] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 1 to 2, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 2 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:49.764747 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:49.768630 12660 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:49.770680 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:49.770967 12660 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:49.774226 11645 leader_election.cc:400] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3.
I20260709 12:23:49.774605 11645 leader_election.cc:403] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:23:49.695672 12599 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:49.781536 11129 raft_consensus.cc:1240] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:49.786761 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:49.754155 12592 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:49.773339 10881 catalog_manager.cc:5697] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 1 to 2, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 2 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:49.801226 10881 catalog_manager.cc:5697] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 1 to 2, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 2 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:49.638276 12571 consensus_queue.cc:260] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:49.754289 12621 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:23:49.806484 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 436770us
I20260709 12:23:49.767728 12617 raft_consensus.cc:2804] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:49.767063 12676 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:49.772542 12570 raft_consensus.cc:2804] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:49.764598 12685 raft_consensus.cc:2804] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:49.702500 12594 consensus_queue.cc:237] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:49.844585 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:49.846837 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1029) took 1833 ms. Trace:
W20260709 12:23:49.848672 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 156229us
I20260709 12:23:49.822963 11025 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:49.836619 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:49.775504 12675 raft_consensus.cc:2804] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:49.799389 12607 raft_consensus.cc:2804] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:49.829061 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:49.861253 11130 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:49.798826 12629 raft_consensus.cc:697] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:49.862640 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:49.839494 12690 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:49.855489 11643 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:49.875329 11643 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:49.765827 12260 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:49.739189 11131 rpcz_store.cc:269] 0709 12:23:46.625758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.220640 (+1594882us) service_pool.cc:224] Handling call
0709 12:23:49.714061 (+1493421us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b5400107054. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:49.714255 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1530946816}
I20260709 12:23:49.809872 12621 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.820295 12617 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.791797 12604 consensus_queue.cc:1059] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:23:49.840809 12381 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:49.850898 11025 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:23:49.895269 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 44454.6us
I20260709 12:23:49.896027 11025 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:49.798013 12632 consensus_queue.cc:1059] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:23:49.840523 12676 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.839017 12570 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:49.903748 12570 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:49.827812 12465 consensus_queue.cc:1059] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:23:49.903900 11672 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEARNER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:49.847431 10981 rpcz_store.cc:276] 0709 12:23:48.013410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.762650 (+1749240us) service_pool.cc:224] Handling call
0709 12:23:49.763088 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:49.763442 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.763473 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:49.769282 (+  5809us) log.cc:844] Serialized 26 byte log entry
0709 12:23:49.827475 (+ 58193us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:49.827515 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.827582 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:49.846580 (+ 18998us) raft_consensus.cc:1685] finished
0709 12:23:49.846603 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:49.846765 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38604,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":18147,"thread_start_us":57792,"threads_started":1,"wal-append.queue_time_us":58115}
I20260709 12:23:49.905218 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:49.905434 11674 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:23:49.799317 12660 consensus_queue.cc:1059] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:23:49.864619 12533 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:49.906872 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:49.884474 12573 raft_consensus.cc:2749] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:49.907516 10981 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.908107 12573 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:49.908556 12573 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.909085 12600 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:49.909628 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1566) took 1867 ms. Trace:
I20260709 12:23:49.910030 10975 rpcz_store.cc:276] 0709 12:23:48.042577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.801249 (+1758672us) service_pool.cc:224] Handling call
0709 12:23:49.874426 (+ 73177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.899109 (+ 24683us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.909253 (+ 10144us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:49.909316 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:49.909360 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.909428 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:49.909565 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:49.911502 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:49.912230 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:49.912803 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:49.913465 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:49.914724 12260 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:49.915324 12260 raft_consensus.cc:3055] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:49.915382 12568 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:49.915771 12260 raft_consensus.cc:740] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:49.916471 11125 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:49.908917 12573 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:49.863234 12607 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:49.899986 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:49.956390 11130 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:23:49.914654 12394 raft_consensus.cc:2804] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:49.874713 11052 raft_consensus.cc:1240] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:49.888980 11643 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:23:49.892441 11024 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.9.145.254:35687, user_credentials={real_user=slave}} blocked reactor thread for 53890us
I20260709 12:23:49.894671 12617 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:49.913549 10975 raft_consensus.cc:2368] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3.
I20260709 12:23:49.951572 10981 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
W20260709 12:23:49.901959 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 162829us
I20260709 12:23:49.893841 12569 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:49.906941 12604 raft_consensus.cc:2804] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:49.957410 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1559) took 2082 ms. Trace:
I20260709 12:23:49.916756 12676 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:49.960587 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 293126us
W20260709 12:23:49.965965 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 181028us
I20260709 12:23:49.971467 11676 raft_consensus.cc:2393] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 4: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:23:49.908164 12533 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:23:49.968703 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 79815.2us
I20260709 12:23:49.992522 11643 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:49.965150 12607 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:49.982506 10982 rpcz_store.cc:276] 0709 12:23:47.875361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.731140 (+1855779us) service_pool.cc:224] Handling call
0709 12:23:49.731429 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.731636 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:23:49.826530 (+ 94894us) log.cc:844] Serialized 14 byte log entry
0709 12:23:49.957060 (+130530us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:49.957114 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:49.957171 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.957237 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:49.957352 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":94889,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":4877,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":11776,"thread_start_us":222347,"threads_started":2}
I20260709 12:23:49.917122 12630 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:49.977415 12394 raft_consensus.cc:697] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:49.986896 11097 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
W20260709 12:23:49.988057 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 150779us
I20260709 12:23:49.988512 10948 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:49.983729 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:50.018754 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1555) took 2144 ms. Trace:
I20260709 12:23:49.980783 12569 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:49.967957 11024 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:49.982427 12604 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:23:50.031215 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 63347.5us
I20260709 12:23:50.032022 11024 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:49.984503 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:50.026942 10979 rpcz_store.cc:276] 0709 12:23:47.874394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.128374 (+1253980us) service_pool.cc:224] Handling call
0709 12:23:49.524630 (+396256us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b5800003698. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90dbdfc0 00007f8f90da8929 00007f8f90da83d2 00007f8f8a31fbd4
0709 12:23:49.524819 (+   189us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:49.525040 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.525073 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:49.525561 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 12:23:49.651707 (+126146us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:49.651747 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.651824 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:49.981312 (+329488us) raft_consensus.cc:1685] finished
0709 12:23:49.981332 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:50.018672 (+ 37340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29985664,"thread_start_us":125752,"threads_started":1,"wal-append.queue_time_us":303525}
W20260709 12:23:50.006080 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 110137us
I20260709 12:23:50.020061 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:23:50.034169 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 47374.3us
I20260709 12:23:50.024407 10948 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:50.001579 12593 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:50.038489 10948 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:50.040480 11097 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:50.020323 12675 raft_consensus.cc:697] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:50.018002 12685 raft_consensus.cc:697] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:50.033005 12604 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:49.968722 12260 consensus_queue.cc:260] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:50.042279 10979 raft_consensus.cc:1275] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:50.030459 12569 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:50.054734 11131 raft_consensus.cc:2393] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 3: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:50.035418 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:50.057101 11097 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:50.030413 12693 raft_consensus.cc:2749] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:50.034176 11025 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:50.055778 12675 consensus_queue.cc:237] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:50.057072 10982 raft_consensus.cc:2393] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 3: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:50.068907 11097 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:23:49.985350 12629 consensus_queue.cc:237] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:50.073637 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1546) took 2244 ms. Trace:
I20260709 12:23:50.113206 10980 rpcz_store.cc:276] 0709 12:23:47.829461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.017563 (+1188102us) service_pool.cc:224] Handling call
0709 12:23:49.017918 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.716009 (+698091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.073367 (+357358us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b54001ab3d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:50.073574 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1536652160}
W20260709 12:23:50.088925 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 65801.2us
I20260709 12:23:50.041276 12698 raft_consensus.cc:2749] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:23:50.072901 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 80468.4us
I20260709 12:23:50.059737 12593 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:23:50.115876 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.055712 12703 consensus_queue.cc:1059] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:23:50.063762 12512 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:50.164052 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 132108us
W20260709 12:23:50.150520 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 130999us
W20260709 12:23:50.123502 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 54682.5us
W20260709 12:23:50.323992 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.220719 11643 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:50.125533 10981 raft_consensus.cc:1275] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:50.300032 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:23:50.280855 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 211079us
I20260709 12:23:50.336745 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1577) took 1048 ms. Trace:
I20260709 12:23:50.337167 10981 rpcz_store.cc:276] 0709 12:23:49.287930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.124913 (+836983us) service_pool.cc:224] Handling call
0709 12:23:50.125219 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:50.336323 (+211104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.336627 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:50.163090 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1405) took 3373 ms. Trace:
W20260709 12:23:50.123520 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 89446.1us
I20260709 12:23:50.294776 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1536) took 5445 ms. Trace:
I20260709 12:23:50.338290 11133 rpcz_store.cc:276] 0709 12:23:46.790137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.068512 (+3278375us) service_pool.cc:224] Handling call
0709 12:23:50.153836 (+ 85324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:50.162719 (+  8883us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:50.162750 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:50.162795 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:50.162822 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.162889 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:50.163022 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1144,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":20663}
I20260709 12:23:50.339037 11129 rpcz_store.cc:276] 0709 12:23:44.849248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.675203 (+4825955us) service_pool.cc:224] Handling call
0709 12:23:49.675589 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.782046 (+106457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.294482 (+512436us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400067f54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:50.294696 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243119488}
W20260709 12:23:50.063143 10977 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1023) took 2293 ms (client timeout 2191 ms). Trace:
I20260709 12:23:50.301574 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:50.335543 11023 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:50.384452 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 157) took 2773 ms. Trace:
I20260709 12:23:50.215072 12465 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:23:50.169562 12701 log.cc:927] Time spent T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:23:50.338436 10948 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:23:50.169978 12691 log.cc:927] Time spent T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
I20260709 12:23:50.112352 12568 raft_consensus.cc:2749] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:23:50.387458 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 163905us
I20260709 12:23:50.385859 11129 rpcz_store.cc:276] 0709 12:23:47.610573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.383625 (+2773052us) service_pool.cc:224] Handling call
0709 12:23:50.383958 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:50.384138 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:50.384162 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:50.384203 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:50.384231 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.384280 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:50.384397 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:50.419613 11643 leader_election.cc:400] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Vote denied by peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777) with higher term. Message: Invalid argument: T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3.
I20260709 12:23:50.420586 11643 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:50.147097 12713 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:50.388235 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:50.384229 11097 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:50.386535 11127 raft_consensus.cc:1240] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:50.101902 12699 raft_consensus.cc:2804] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:50.066422 12704 raft_consensus.cc:2749] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:23:50.312240 12674 consensus_meta.cc:287] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.590s	user 0.008s	sys 0.001s
W20260709 12:23:50.170547 12697 log.cc:927] Time spent T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 12:23:50.264535 12471 consensus_queue.cc:1059] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.159s
W20260709 12:23:50.226672 12462 consensus_meta.cc:287] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.515s	user 0.015s	sys 0.003s
I20260709 12:23:50.214339 12702 raft_consensus.cc:2804] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:23:50.398720 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 63263.6us
I20260709 12:23:50.405046 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1554) took 2530 ms. Trace:
I20260709 12:23:50.477941 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:23:50.205962 11677 consensus_meta.cc:287] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.644s	user 0.014s	sys 0.004s
W20260709 12:23:50.210999 11051 consensus_meta.cc:287] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.508s	user 0.014s	sys 0.004s
I20260709 12:23:50.386991 11025 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:50.411350 10984 raft_consensus.cc:1240] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4. Ops: []
W20260709 12:23:50.413196 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 74825.4us
I20260709 12:23:50.231346 12260 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:50.414991 12660 raft_consensus.cc:2764] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:23:50.229409 12703 raft_consensus.cc:3055] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:50.288416 12630 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:50.112542 12705 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:23:50.491565 12594 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.020s	sys 0.029s
I20260709 12:23:50.491521 12705 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:50.388509 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:50.125092 12687 raft_consensus.cc:2804] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:50.340281 12593 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:50.444038 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 158) took 2833 ms. Trace:
I20260709 12:23:50.214538 12685 consensus_queue.cc:237] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:50.495298 11127 rpcz_store.cc:276] 0709 12:23:47.610843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.386014 (+2775171us) service_pool.cc:224] Handling call
0709 12:23:50.386352 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:50.443769 (+ 57417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.443974 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:50.397830 12465 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:50.102046 12672 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:50.186895 10975 raft_consensus.cc:2393] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 3: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:50.247553 12570 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:50.287135 12574 consensus_queue.cc:1059] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.160s
I20260709 12:23:50.171060 12598 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:50.410188 12710 raft_consensus.cc:2749] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:50.478798 11130 raft_consensus.cc:2393] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 3: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:50.479048 10983 rpcz_store.cc:276] 0709 12:23:47.874149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.125968 (+1251819us) service_pool.cc:224] Handling call
0709 12:23:49.523856 (+397888us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b5800003698. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90dbdfc0 00007f8f90da8929 00007f8f90da83d2 00007f8f8a31fbd4
0709 12:23:50.057107 (+533251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:50.057323 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:50.057350 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:50.057400 (+    50us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:50.057430 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.057488 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:50.404800 (+347312us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b54000d9650. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:50.404972 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1274081536}
I20260709 12:23:50.518811 11059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1043) took 1327 ms. Trace:
I20260709 12:23:50.519243 11059 rpcz_store.cc:276] 0709 12:23:49.191619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.517620 (+326001us) service_pool.cc:224] Handling call
0709 12:23:49.518049 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:49.538849 (+ 20800us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.538883 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:49.539391 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 12:23:49.820770 (+281379us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:49.820809 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.820875 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:50.518566 (+697691us) raft_consensus.cc:1685] finished
0709 12:23:50.518586 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:50.518749 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4324,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":10063,"thread_start_us":251239,"threads_started":1,"wal-append.queue_time_us":343864}
I20260709 12:23:50.420771 12694 raft_consensus.cc:2749] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:50.199522 12394 consensus_queue.cc:237] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:50.358558 12604 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:50.484413 10948 leader_election.cc:400] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4.
W20260709 12:23:50.464715 11126 consensus_meta.cc:287] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.670s	user 0.010s	sys 0.001s
I20260709 12:23:50.245980 12707 consensus_queue.cc:1048] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.236s
I20260709 12:23:50.484315 12726 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:50.478960 12698 raft_consensus.cc:2749] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:50.488871 12632 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:50.490475 12703 raft_consensus.cc:740] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:23:50.343019 10977 rpcz_store.cc:269] 0709 12:23:47.766630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.360086 (+593456us) service_pool.cc:224] Handling call
0709 12:23:50.056400 (+1696314us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b54000d9654. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:50.060295 (+  3895us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1112613632}
I20260709 12:23:50.496896 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:50.563203 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:50.563534 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:23:50.493201 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 48816us
W20260709 12:23:50.497953 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 111031us
W20260709 12:23:50.501391 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 117741us
I20260709 12:23:50.537997 12711 raft_consensus.cc:2804] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:50.520313 10983 raft_consensus.cc:1240] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3. Ops: []
W20260709 12:23:50.522311 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 101798us
I20260709 12:23:50.478014 12702 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:50.485654 12592 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:50.540400 10948 leader_election.cc:403] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:23:50.503895 12639 consensus_meta.cc:287] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.865s	user 0.005s	sys 0.007s
W20260709 12:23:50.554456 12584 consensus_meta.cc:287] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.834s	user 0.012s	sys 0.000s
I20260709 12:23:50.550228 12726 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:50.543206 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 100161us
I20260709 12:23:50.496773 12593 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:50.492844 12594 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.020s	sys 0.029s
I20260709 12:23:50.492333 12705 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:50.500849 12465 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:50.495128 12687 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:50.469499 12674 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:50.486392 11677 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:23:50.486586 11051 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:23:50.553462 11125 raft_consensus.cc:1240] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:50.468875 12712 consensus_queue.cc:1059] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.120s
I20260709 12:23:50.468664 12699 raft_consensus.cc:697] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:50.565054 11097 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:50.566363 11127 raft_consensus.cc:2393] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 4: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:50.566928 11644 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:50.567167 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:50.565037 11098 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
W20260709 12:23:50.553942 12718 log.cc:927] Time spent T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:23:50.574571 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:50.597325 12574 raft_consensus.cc:2749] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4.
W20260709 12:23:50.630906 12724 log.cc:927] Time spent T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:23:50.609544 12687 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:50.542793 11060 raft_consensus.cc:1240] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:50.580739 11025 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:50.547446 11126 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:50.570050 12471 consensus_queue.cc:1059] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:23:50.568615 12632 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:50.567651 11676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41774 (request call id 316) took 1434 ms. Trace:
I20260709 12:23:50.570984 12599 raft_consensus.cc:3055] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:50.617424 11680 raft_consensus.cc:1240] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:23:50.647485 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:23:50.575488 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 91228.5us
W20260709 12:23:50.625262 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 60288.1us
I20260709 12:23:50.649346 11098 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:50.649531 10948 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:50.650964 11098 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:23:50.627358 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 62389.8us
I20260709 12:23:50.628168 12592 consensus_queue.cc:1059] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:50.651973 11098 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:23:50.629686 12569 consensus_meta.cc:287] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.551s	user 0.006s	sys 0.000s
W20260709 12:23:50.629830 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 62985.5us
I20260709 12:23:50.612603 12587 raft_consensus.cc:2749] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3.
I20260709 12:23:50.661223 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:50.662211 11130 raft_consensus.cc:2393] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 3: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:50.633108 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:50.575390 12710 consensus_queue.cc:1048] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:23:50.611194 12571 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:50.601454 12726 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:50.671171 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:50.576751 12702 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:50.614784 11677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41774 (request call id 320) took 1468 ms. Trace:
I20260709 12:23:50.600227 12639 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:50.638906 12721 log.cc:927] Time spent T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:23:50.639055 12598 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:50.639376 10976 raft_consensus.cc:1240] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:50.639598 12381 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
W20260709 12:23:50.640367 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 59729.8us
I20260709 12:23:50.612066 12711 raft_consensus.cc:697] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:50.578959 12389 consensus_queue.cc:1048] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:23:50.645841 12737 raft_consensus.cc:2749] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:50.646556 12723 raft_consensus.cc:3055] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:50.652666 11097 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:50.629172 12712 raft_consensus.cc:3055] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:50.607165 12584 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:50.654145 10948 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:50.636803 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:50.631325 12703 consensus_queue.cc:260] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:50.641746 12698 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:50.642117 12568 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:50.672235 11127 raft_consensus.cc:2393] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 3: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:50.652915 12260 raft_consensus.cc:2749] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:50.647267 12599 raft_consensus.cc:740] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:50.656111 12713 raft_consensus.cc:2764] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:23:50.677130 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:50.682554 12733 raft_consensus.cc:2749] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:50.642839 11676 rpcz_store.cc:276] 0709 12:23:49.133441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.160606 (+ 27165us) service_pool.cc:224] Handling call
0709 12:23:50.567431 (+1406825us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b5400592c54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:50.567588 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1312978688}
I20260709 12:23:50.670907 12512 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:50.694859 11134 raft_consensus.cc:2393] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 2: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:50.696468 12740 consensus_queue.cc:1059] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:23:50.699391 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 45340.5us
I20260709 12:23:50.744494 10948 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:23:50.703961 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 51391.7us
I20260709 12:23:50.683482 12381 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:50.705864 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:50.726437 11130 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:50.700446 12698 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:50.704597 12672 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:50.674674 11677 rpcz_store.cc:276] 0709 12:23:49.144927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.374657 (+229730us) service_pool.cc:224] Handling call
0709 12:23:50.613135 (+1238478us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:50.745505 11127 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:50.698949 12598 raft_consensus.cc:2749] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:50.728158 10978 raft_consensus.cc:1240] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:50.731262 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:23:50.730994 12573 consensus_meta.cc:287] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.773s	user 0.008s	sys 0.013s
I20260709 12:23:50.735524 12599 consensus_queue.cc:260] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:50.705749 12735 consensus_queue.cc:1059] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:23:50.738581 12674 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:50.692433 12723 raft_consensus.cc:740] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:50.668996 12569 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:50.767028 12621 consensus_meta.cc:287] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.864s	user 0.004s	sys 0.022s
I20260709 12:23:50.792461 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1560) took 2897 ms. Trace:
I20260709 12:23:50.792876 10978 rpcz_store.cc:276] 0709 12:23:47.895456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.735169 (+1839713us) service_pool.cc:224] Handling call
0709 12:23:49.735491 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:50.753424 (+1017933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.792197 (+ 38773us) spinlock_profiling.cc:243] Waited 992 ms on lock 0x7b5400173754. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:50.792398 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2282518400}
I20260709 12:23:50.793859 12621 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:50.798534 12533 raft_consensus.cc:3055] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:50.798988 12533 raft_consensus.cc:740] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:50.799813 12533 consensus_queue.cc:260] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:50.746657 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:50.801227 12533 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:50.748474 10948 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:50.802158 12629 raft_consensus.cc:2764] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:23:50.802598 11128 raft_consensus.cc:2393] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 3: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:23:50.802863 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 54456us
I20260709 12:23:50.805621 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:50.749475 12694 raft_consensus.cc:2749] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:50.803656 10948 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:50.808676 12694 raft_consensus.cc:2804] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:50.809113 12694 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:50.809420 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1550) took 4171 ms. Trace:
I20260709 12:23:50.678504 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1579) took 1327 ms. Trace:
I20260709 12:23:50.789425 12711 consensus_queue.cc:237] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:50.809872 11125 rpcz_store.cc:276] 0709 12:23:46.638371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.918691 (+3280320us) service_pool.cc:224] Handling call
0709 12:23:49.960607 (+ 41916us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:50.611491 (+650884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.809169 (+197678us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b540012eb54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:50.809358 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1355245440}
I20260709 12:23:50.783293 12573 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:50.754444 12462 raft_consensus.cc:3055] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:50.811228 12462 raft_consensus.cc:740] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:50.812636 12573 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:50.812234 12462 consensus_queue.cc:260] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:50.756109 12660 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:50.813889 12660 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:50.814371 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 165) took 1649 ms. Trace:
I20260709 12:23:50.815083 12621 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:50.815725 12714 raft_consensus.cc:3055] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:50.756829 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:50.757474 11054 raft_consensus.cc:1240] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:23:50.816179 12660 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:50.817188 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:50.730490 12600 raft_consensus.cc:2804] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:50.735667 12584 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:50.750180 12698 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:50.758832 12604 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:50.759150 12639 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:50.763352 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:50.820124 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:50.764001 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:50.809468 12694 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:50.764549 12598 consensus_queue.cc:1048] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:50.820815 11676 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:50.814832 10976 rpcz_store.cc:276] 0709 12:23:49.165183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.828050 (+662867us) service_pool.cc:224] Handling call
0709 12:23:49.862474 (+ 34424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:50.685748 (+823274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.814084 (+128336us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b540033ca54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:50.814302 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1731370752}
I20260709 12:23:50.811282 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:50.818048 12600 raft_consensus.cc:697] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:50.825459 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:50.816133 12714 raft_consensus.cc:740] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:50.825695 11679 raft_consensus.cc:1240] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:50.826083 11678 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:50.827350 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:50.767104 12381 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:50.768255 12607 consensus_meta.cc:287] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.726s	user 0.007s	sys 0.003s
I20260709 12:23:50.768793 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:50.769304 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:50.769778 11025 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
W20260709 12:23:50.770072 12676 consensus_meta.cc:287] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.777s	user 0.009s	sys 0.001s
I20260709 12:23:50.770592 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 156) took 3160 ms. Trace:
I20260709 12:23:50.773317 11680 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:50.777944 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:50.725680 12568 raft_consensus.cc:697] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
W20260709 12:23:50.731503 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.785370 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 1567) took 1456 ms. Trace:
I20260709 12:23:50.785526 12723 consensus_queue.cc:260] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:50.786202 12599 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:50.787297 12569 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:50.788861 12632 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:50.728134 12736 raft_consensus.cc:2804] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:50.750765 12732 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:50.821774 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:50.812088 12730 raft_consensus.cc:3055] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:50.824194 10980 raft_consensus.cc:1275] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:50.810513 10979 rpcz_store.cc:276] 0709 12:23:49.351177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.154632 (+803455us) service_pool.cc:224] Handling call
0709 12:23:50.155002 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:50.155218 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:23:50.200119 (+ 44901us) log.cc:844] Serialized 14 byte log entry
0709 12:23:50.677795 (+477676us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:50.677838 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:50.677868 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.677914 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:50.678003 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29496,"prepare.queue_time_us":55205,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":79100,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"spinlock_wait_cycles":1280,"thread_start_us":476989,"threads_started":2,"wal-append.queue_time_us":290044}
W20260709 12:23:50.765141 12734 log.cc:927] Time spent T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:23:50.829607 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 83573.2us
I20260709 12:23:50.828521 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:50.695358 12712 raft_consensus.cc:740] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:50.833627 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1558) took 2799 ms. Trace:
W20260709 12:23:50.836906 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 184987us
I20260709 12:23:50.822814 10948 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:50.871570 11098 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:50.836896 11133 rpcz_store.cc:276] 0709 12:23:47.610257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.382355 (+2772098us) service_pool.cc:224] Handling call
0709 12:23:50.416845 (+ 34490us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:50.452145 (+ 35300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:50.452178 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:50.463145 (+ 10967us) log.cc:844] Serialized 26 byte log entry
0709 12:23:50.566809 (+103664us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:50.566850 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.566918 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:50.770385 (+203467us) raft_consensus.cc:1685] finished
0709 12:23:50.770405 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:50.770534 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6463,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":16437,"thread_start_us":33055,"threads_started":1,"wal-append.queue_time_us":183853}
I20260709 12:23:50.840477 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1560) took 2806 ms. Trace:
W20260709 12:23:50.805646 12617 consensus_meta.cc:287] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.827s	user 0.005s	sys 0.013s
I20260709 12:23:50.849912 12471 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
W20260709 12:23:50.850489 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 80807.4us
I20260709 12:23:50.882400 11025 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:50.852166 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:50.757895 12702 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:50.868503 11097 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:50.872335 11130 rpcz_store.cc:276] 0709 12:23:48.033817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.832586 (+2798769us) service_pool.cc:224] Handling call
0709 12:23:50.832931 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:50.833258 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:50.833289 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:50.833331 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:50.833361 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.833418 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:50.833550 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":886,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":5220}
W20260709 12:23:50.873556 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 50807.5us
I20260709 12:23:50.874053 11127 rpcz_store.cc:276] 0709 12:23:48.034412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.839632 (+2805220us) service_pool.cc:224] Handling call
0709 12:23:50.839956 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:50.840131 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:50.840159 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:50.840204 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:50.840236 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.840292 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:50.840413 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:50.887286 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:23:50.850529 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.839006 12607 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:50.898937 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:50.878145 11129 raft_consensus.cc:1240] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:23:50.855018 12735 raft_consensus.cc:2804] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:50.814388 12593 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:50.858417 12736 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:50.703483 12699 consensus_queue.cc:237] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:50.892448 11055 raft_consensus.cc:1240] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:50.893007 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:50.893739 10949 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:50.886142 10948 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:50.896039 11679 raft_consensus.cc:1275] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:50.907199 12512 raft_consensus.cc:2749] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:50.907732 10949 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:50.875512 12722 consensus_queue.cc:1059] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:23:50.903311 12568 consensus_queue.cc:237] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:50.908437 12722 consensus_queue.cc:1243] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer bc01179655564f29b83babe396377cbb log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:23:50.908715 12381 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:50.909186 10949 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:50.910392 12712 consensus_queue.cc:260] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:50.912571 12726 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:50.913093 12712 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:50.875845 12693 raft_consensus.cc:2749] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:50.825642 12600 consensus_queue.cc:237] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:50.868537 12723 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:50.841454 12676 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:50.864683 12730 raft_consensus.cc:740] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:50.900298 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1412) took 2605 ms. Trace:
I20260709 12:23:50.891288 11023 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:50.903160 11681 raft_consensus.cc:2393] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 2: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:23:50.870245 12732 raft_consensus.cc:697] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:50.915889 11098 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:50.875744 12708 raft_consensus.cc:3055] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:50.915337 11125 raft_consensus.cc:1240] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:50.897239 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1419) took 2596 ms. Trace:
I20260709 12:23:50.908928 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1565) took 2988 ms. Trace:
I20260709 12:23:50.839120 11126 rpcz_store.cc:276] 0709 12:23:49.329005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.524820 (+195815us) service_pool.cc:224] Handling call
0709 12:23:50.785168 (+1260348us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54000eb0d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:50.785309 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":483038464}
I20260709 12:23:50.891886 12621 raft_consensus.cc:2804] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:23:50.922493 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 48143.8us
I20260709 12:23:50.904963 12736 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:50.916132 10949 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:50.917299 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:50.930166 11680 raft_consensus.cc:1275] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:50.922801 12512 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:50.892057 12471 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:50.919945 10948 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:50.928117 11129 rpcz_store.cc:276] 0709 12:23:48.294386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.877463 (+2583077us) service_pool.cc:224] Handling call
0709 12:23:50.877843 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:50.899986 (+ 22143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.900233 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:50.884586 12617 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:50.901268 12735 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:50.951527 11053 raft_consensus.cc:1240] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:50.954717 10949 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:50.933139 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1418) took 2636 ms. Trace:
I20260709 12:23:50.957037 11125 rpcz_store.cc:276] 0709 12:23:48.296394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.883428 (+2587034us) service_pool.cc:224] Handling call
0709 12:23:50.903945 (+ 20517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:50.932835 (+ 28890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.933076 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:50.957870 10949 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:50.891259 12737 raft_consensus.cc:2749] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:50.926036 12749 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:50.937963 12708 raft_consensus.cc:740] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:23:50.943140 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 51966us
I20260709 12:23:50.935189 12730 consensus_queue.cc:260] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:50.922606 12713 raft_consensus.cc:2804] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:50.890268 12660 consensus_queue.cc:1059] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:23:50.921398 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:50.946518 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:50.912583 12705 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:50.933280 11130 rpcz_store.cc:276] 0709 12:23:48.300891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.896397 (+2595506us) service_pool.cc:224] Handling call
0709 12:23:50.896710 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:50.896910 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:50.896939 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:50.896987 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:50.897019 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.897072 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:50.897177 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:50.933641 10984 rpcz_store.cc:276] 0709 12:23:47.920910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.759904 (+1838994us) service_pool.cc:224] Handling call
0709 12:23:49.760837 (+   933us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:50.483724 (+722887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.908695 (+424971us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b540009a454. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:50.908869 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1495499520}
I20260709 12:23:50.913722 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:50.906195 12629 consensus_queue.cc:1059] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:23:50.965598 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:23:50.942821 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 46632.9us
I20260709 12:23:51.010020 11025 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:50.952495 12693 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:50.968325 11098 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:50.944352 12685 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.971520 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:50.972486 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:23:50.930719 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.995076 11673 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 2: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:23:50.971504 12713 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:50.996332 12593 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:50.949663 12512 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:50.932695 12742 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:50.953748 12735 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:50.966475 12630 raft_consensus.cc:2749] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:50.966322 12584 raft_consensus.cc:2804] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:50.950639 12675 raft_consensus.cc:2749] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:50.997644 12607 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:50.971475 12727 raft_consensus.cc:2749] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:50.969771 12749 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:51.022506 12708 consensus_queue.cc:260] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:51.044615 12702 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:51.072381 12676 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:51.046458 12465 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:51.017822 12759 raft_consensus.cc:2749] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:50.951027 12751 consensus_queue.cc:1048] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.100s
I20260709 12:23:51.055572 12698 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:51.048023 12512 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:51.032352 12713 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:51.032100 12685 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:51.014768 12693 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:50.963780 12760 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:51.070310 12749 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:51.020305 12674 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:23:51.060732 12584 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:51.048700 12742 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:51.019869 12732 consensus_queue.cc:237] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:51.064711 12726 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:51.066498 12621 raft_consensus.cc:697] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:51.079486 12617 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:51.080523 12687 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:51.088447 12685 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:51.089116 12687 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:51.071678 12708 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:51.088891 12694 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:51.078667 12693 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:51.089751 12742 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:51.084978 12760 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:51.099020 12761 raft_consensus.cc:2749] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:51.102284 12760 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:50.914799  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:23:50.999055 10949 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:50.994978 11023 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:51.075773 12574 consensus_queue.cc:1059] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:23:51.130843 11127 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:51.131466 12584 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:51.133014 12621 consensus_queue.cc:237] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:51.018728 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:23:50.998672 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 103654us
I20260709 12:23:51.002918 10981 raft_consensus.cc:1275] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:51.016513 12394 raft_consensus.cc:2804] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:51.058264 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:51.167371 11133 raft_consensus.cc:1240] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:23:51.143092 11056 raft_consensus.cc:1240] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:51.169740 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1033) took 1969 ms. Trace:
I20260709 12:23:51.144866 12698 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:23:51.131496 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 136452us
I20260709 12:23:51.147701 12705 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:51.071678 12471 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:51.175168 12675 raft_consensus.cc:2749] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:51.175907 12394 raft_consensus.cc:697] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:23:51.151943 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 183545us
I20260709 12:23:51.177659 11098 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:23:51.178645 11676 raft_consensus.cc:1240] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:23:51.179349 12760 raft_consensus.cc:2804] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:51.180091 12760 raft_consensus.cc:697] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:51.181620 12760 consensus_queue.cc:237] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:51.182521 12711 consensus_queue.cc:1059] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:51.168469 12685 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.184643 12685 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:51.185413 12675 raft_consensus.cc:3055] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:51.171873 10980 rpcz_store.cc:276] 0709 12:23:49.200340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.114365 (+914025us) service_pool.cc:224] Handling call
0709 12:23:50.114731 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:50.865640 (+750909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.169073 (+303433us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b5400229f54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:51.169520 (+   447us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1630859648}
I20260709 12:23:51.186969 11132 raft_consensus.cc:1240] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:51.144946 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1564) took 1930 ms. Trace:
I20260709 12:23:51.166019 12694 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:51.143447 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1420) took 2842 ms. Trace:
I20260709 12:23:51.147823 11097 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:51.152752 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:23:51.181764 11134 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58414 (request call id 168) took 2014 ms (client timeout 1707 ms). Trace:
I20260709 12:23:51.188694 11053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 192) took 1388 ms. Trace:
W20260709 12:23:51.192523 11134 rpcz_store.cc:269] 0709 12:23:49.166794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.408604 (+241810us) service_pool.cc:224] Handling call
0709 12:23:51.181182 (+1772578us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400030a54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:51.181506 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2702547328}
I20260709 12:23:51.189535 11098 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:51.186074 12675 raft_consensus.cc:740] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:51.188709 12685 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:51.197113 12747 consensus_queue.cc:1059] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:23:51.204736 12726 raft_consensus.cc:2749] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:23:51.207883 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.196156 11053 rpcz_store.cc:276] 0709 12:23:49.799773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.799911 (+   138us) service_pool.cc:224] Handling call
0709 12:23:49.800211 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:50.955653 (+1155442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.188092 (+232439us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400277ed4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:51.188438 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2644744960}
W20260709 12:23:51.207947 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 208838us
I20260709 12:23:51.211948 11675 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
W20260709 12:23:51.219561 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 72119.3us
W20260709 12:23:51.224255 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 250481us
I20260709 12:23:51.064306 11678 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
W20260709 12:23:51.239094 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.243155 12732 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:51.177711 12394 consensus_queue.cc:237] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:51.250450 12761 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:51.251736 12761 raft_consensus.cc:697] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:51.252193 12630 raft_consensus.cc:3055] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:51.252893 12630 raft_consensus.cc:740] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
W20260709 12:23:51.253109 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 49185us
I20260709 12:23:51.192097 11126 rpcz_store.cc:276] 0709 12:23:48.301248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.961321 (+2660073us) service_pool.cc:224] Handling call
0709 12:23:51.002263 (+ 40942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:51.030471 (+ 28208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:51.038539 (+  8068us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:51.142625 (+104086us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:51.142743 (+   118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.142915 (+   172us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:51.143141 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:51.258314 11098 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:23:51.263319 12672 raft_consensus.cc:3055] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:51.283843 11097 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:51.190305 11130 rpcz_store.cc:276] 0709 12:23:49.213924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.003865 (+1789941us) service_pool.cc:224] Handling call
0709 12:23:51.004208 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:51.005520 (+  1312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:51.005545 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:51.005970 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 12:23:51.144101 (+138131us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:51.144208 (+   107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.144358 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:51.144460 (+   102us) raft_consensus.cc:1685] finished
0709 12:23:51.144478 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:51.144750 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3464,"raft.queue_time_us":70231,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":1924,"spinlock_wait_cycles":2816,"thread_start_us":138375,"threads_started":2,"wal-append.queue_time_us":71851}
W20260709 12:23:51.292513 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.298267 12465 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:51.253567 12761 consensus_queue.cc:237] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:51.265470 12672 raft_consensus.cc:740] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:23:51.300635 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 62960.9us
I20260709 12:23:51.311384 12687 raft_consensus.cc:3055] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:51.312096 12687 raft_consensus.cc:740] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:23:51.313547 12533 consensus_meta.cc:287] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.512s	user 0.013s	sys 0.000s
I20260709 12:23:51.314254 12699 raft_consensus.cc:2749] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:51.314714 12630 consensus_queue.cc:260] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:51.316980 12672 consensus_queue.cc:260] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:51.318945 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.323119 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:51.324110 11675 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:51.326640 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 70581.3us
I20260709 12:23:51.307619 12394 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:51.318779 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:51.328799 12394 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:51.329687 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:51.331486 12394 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:51.313689 12687 consensus_queue.cc:260] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:51.332808 12570 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:51.318737 12672 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:51.336371 11060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 189) took 1580 ms. Trace:
I20260709 12:23:51.330050 12584 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:51.336926 11060 rpcz_store.cc:276] 0709 12:23:49.756207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.756334 (+   127us) service_pool.cc:224] Handling call
0709 12:23:49.756634 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:50.634777 (+878143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.335839 (+701062us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b54001879d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:51.336194 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1807469824}
I20260709 12:23:51.327903 10949 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:51.347815 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:23:51.348630 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:51.349298 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.264014 12675 consensus_queue.cc:260] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:51.331648 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:23:51.357223 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 111202us
I20260709 12:23:51.349957 12687 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:51.365374 12260 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:51.366752 12674 raft_consensus.cc:2804] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:51.363749 12512 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:51.368185 11054 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
I20260709 12:23:51.369606 12512 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:51.363404 11125 raft_consensus.cc:1240] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:51.366400 12260 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:51.354467 12766 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:51.350297 12760 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:51.381932 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:51.383857 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:51.385125 10881 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39956 (request call id 176) took 6166 ms. Trace:
I20260709 12:23:51.384977 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:51.385648  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:51.387236 10981 raft_consensus.cc:1240] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:51.387516 12737 raft_consensus.cc:3055] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:51.388056 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:51.370322 12751 consensus_queue.cc:1048] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:23:51.447009 11060 raft_consensus.cc:2410] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:23:51.370934 12674 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:51.447690 12674 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:51.447959 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.448210 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:51.449050 11060 raft_consensus.cc:2368] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5.
I20260709 12:23:51.451400 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1563) took 2238 ms. Trace:
I20260709 12:23:51.397009 11680 raft_consensus.cc:1240] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:51.452139 12747 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:23:51.398622 11051 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41294 (request call id 1033) took 2257 ms (client timeout 1892 ms). Trace:
I20260709 12:23:51.454200 12747 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:51.400049 12703 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:51.351666 11128 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1425) took 1581 ms (client timeout 1910 ms). Trace:
I20260709 12:23:51.397281 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:51.403891 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:51.405429 10978 raft_consensus.cc:1275] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:23:51.407820 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:23:51.401765 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 74042us
I20260709 12:23:51.380534 12714 consensus_queue.cc:260] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:51.413335 11127 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:23:51.422724 12766 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:51.469257 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:51.469440 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:51.470043 11680 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:51.471019 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:51.471306 12766 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:51.424801 10983 raft_consensus.cc:1275] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:51.467453 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1406) took 4676 ms. Trace:
I20260709 12:23:51.464148 10978 pending_rounds.cc:85] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 1
I20260709 12:23:51.472957 10978 pending_rounds.cc:107] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:23:51.425110 11097 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:51.427836  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:51.472657 11131 rpcz_store.cc:276] 0709 12:23:46.790466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.167079 (+3376613us) service_pool.cc:224] Handling call
0709 12:23:50.229496 (+ 62417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:50.463347 (+233851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:50.469875 (+  6528us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:50.482336 (+ 12461us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:50.485486 (+  3150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.466977 (+981491us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b5400066b54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:51.467053 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:51.467274 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":500899584}
W20260709 12:23:51.475252 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 61120.2us
I20260709 12:23:51.475800 12766 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:23:51.454474 11051 rpcz_store.cc:269] 0709 12:23:49.141377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.153225 (+ 11848us) service_pool.cc:224] Handling call
0709 12:23:51.398043 (+2244818us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b54002cd654. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:51.398339 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":752376960}
I20260709 12:23:51.478319 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:51.479285 12685 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:51.463864 11128 rpcz_store.cc:269] 0709 12:23:49.756245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.798574 (+ 42329us) service_pool.cc:224] Handling call
0709 12:23:51.337221 (+1538647us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b540012dc54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:51.337501 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2185163648}
I20260709 12:23:51.473278 10978 raft_consensus.cc:2889] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:51.480108 12260 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:51.476795 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:51.481689 11131 raft_consensus.cc:2393] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 2: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:51.482349 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:51.439330 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1548) took 4817 ms. Trace:
W20260709 12:23:51.442350 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.354673 12394 consensus_queue.cc:1048] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 12:23:51.442919 11053 raft_consensus.cc:2393] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 3: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:51.443985 12735 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:51.463450 12760 raft_consensus.cc:697] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:51.467293 12747 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:51.467440 11673 raft_consensus.cc:2368] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5.
I20260709 12:23:51.468577 12714 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:51.468468 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:51.480096 12685 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:51.429176 12736 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:51.443648 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:51.451823 11125 rpcz_store.cc:276] 0709 12:23:49.212660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.958632 (+1745972us) service_pool.cc:224] Handling call
0709 12:23:51.353621 (+394989us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:51.371923 (+ 18302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.451185 (+ 79262us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b540012dc50. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:51.451316 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":821676928}
I20260709 12:23:51.454186 11675 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
W20260709 12:23:51.472080 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.483014 11132 rpcz_store.cc:276] 0709 12:23:46.622032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.761630 (+3139598us) service_pool.cc:224] Handling call
0709 12:23:51.186412 (+1424782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:51.197057 (+ 10645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.439055 (+241998us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400030a50. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:51.439228 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3275584256}
I20260709 12:23:51.485167 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:51.491688 11680 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:23:51.498449 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:51.476615 11097 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:23:51.501380 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.535605 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:51.536341 11053 raft_consensus.cc:1240] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:51.537050 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:51.537345 12720 consensus_queue.cc:1059] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:51.537611 12594 consensus_queue.cc:1059] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:51.537992 10980 raft_consensus.cc:2393] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 4: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:51.433519 12737 raft_consensus.cc:740] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:51.538085 11053 raft_consensus.cc:1240] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:23:51.545212 11056 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:51.483350 11128 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 3.
I20260709 12:23:51.537073 10948 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:51.548128 12713 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:51.549124 10976 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:51.550946 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.551141 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:51.551930 12760 consensus_queue.cc:237] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:51.552953 10981 raft_consensus.cc:3055] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:51.539381 12512 consensus_queue.cc:1059] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:23:51.555950 12742 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:51.549177 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:51.557613 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:23:51.559322 12779 log.cc:927] Time spent T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:23:51.559587 11645 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:23:51.560289 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 83824.6us
I20260709 12:23:51.559682 11130 raft_consensus.cc:2393] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 4: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:51.556028 12693 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:51.561056 12584 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:51.561954 12568 raft_consensus.cc:2749] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:51.563385 11057 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 4.
I20260709 12:23:51.546283 12720 raft_consensus.cc:3055] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:51.551106 12749 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:51.565192 11053 raft_consensus.cc:1240] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 1. Current term is 2. Ops: []
W20260709 12:23:51.539009 12775 log.cc:927] Time spent T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:23:51.568634 11025 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
W20260709 12:23:51.569852 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 184571us
I20260709 12:23:51.573851 10981 raft_consensus.cc:740] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:51.573077 11023 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:51.583545 11132 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:51.583804 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:51.414263 10881 rpcz_store.cc:276] 0709 12:23:45.218864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.225063 (+  6199us) service_pool.cc:224] Handling call
0709 12:23:51.384839 (+6159776us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:50.248454 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:50.304909 (+ 56455us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:50.304955 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:23:50.304973 (+    18us) tablet.cc:662] Decoding operations
0709 12:23:50.311413 (+  6440us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:50.311478 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:50.311508 (+    30us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:23:50.311945 (+   437us) tablet.cc:701] Row locks acquired
0709 12:23:50.311964 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:23:50.312152 (+   188us) write_op.cc:270] Start()
0709 12:23:50.312277 (+   125us) write_op.cc:276] Timestamp: P: 1783599830312093 usec, L: 0
0709 12:23:50.312299 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:23:50.313049 (+   750us) log.cc:844] Serialized 1686 byte log entry
0709 12:23:50.856744 (+543695us) op_driver.cc:464] REPLICATION: finished
0709 12:23:50.968119 (+111375us) write_op.cc:301] APPLY: starting
0709 12:23:50.968230 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:51.020707 (+ 52477us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:51.020912 (+   205us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:51.021596 (+   684us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:51.021803 (+   207us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:23:51.021852 (+    49us) write_op.cc:312] APPLY: finished
0709 12:23:51.022186 (+   334us) log.cc:844] Serialized 41 byte log entry
0709 12:23:51.022369 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:51.022471 (+   102us) write_op.cc:454] Released schema lock
0709 12:23:51.022520 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:51.022887 (+   367us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:51.022915 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":111052,"apply.run_cpu_time_us":2527,"apply.run_wall_time_us":54741,"num_ops":4,"prepare.queue_time_us":348220,"prepare.run_cpu_time_us":26135,"prepare.run_wall_time_us":160611,"raft.queue_time_us":224416,"raft.run_cpu_time_us":42746,"raft.run_wall_time_us":92717,"replication_time_us":544162,"thread_start_us":572057,"threads_started":4,"wal-append.queue_time_us":178720}]]}
I20260709 12:23:51.587349 12512 raft_consensus.cc:3055] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:51.589466 12685 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:51.538479 12635 consensus_queue.cc:1048] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:23:51.538791 12747 consensus_queue.cc:1048] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:23:51.591648 12720 raft_consensus.cc:740] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:51.607824 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:51.593410 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:51.611565 10977 raft_consensus.cc:1240] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 1. Current term is 2. Ops: []
W20260709 12:23:51.615778 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 47224.4us
I20260709 12:23:51.602473 12512 raft_consensus.cc:740] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
W20260709 12:23:51.618319 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 73870.6us
I20260709 12:23:51.582160 12726 consensus_queue.cc:1059] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:23:51.630329 10979 raft_consensus.cc:1240] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:51.631088 12720 consensus_queue.cc:260] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:51.632774 12720 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:51.634388 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 97437.2us
I20260709 12:23:51.634581 10981 consensus_queue.cc:260] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:51.635907 10981 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:51.637872 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.638979 11130 raft_consensus.cc:2393] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 3: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:51.639710 12730 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:51.639979 12568 consensus_queue.cc:1059] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:51.641031 12568 raft_consensus.cc:3055] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:51.641407 12568 raft_consensus.cc:740] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:51.640194 11098 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:51.642441 12568 consensus_queue.cc:260] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:51.644133 12568 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:51.641268 12736 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:51.648699 11098 leader_election.cc:400] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5.
I20260709 12:23:51.649041 11098 leader_election.cc:403] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:23:51.649647 12761 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5.
I20260709 12:23:51.611577 11674 raft_consensus.cc:2376] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5. Re-sending same reply.
I20260709 12:23:51.642519 12693 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:51.650532 11674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41762 (request call id 412) took 1050 ms. Trace:
I20260709 12:23:51.651214 12761 consensus_queue.cc:1059] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:51.651554 12737 consensus_queue.cc:260] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:51.652329 12593 raft_consensus.cc:3055] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:51.652694 12593 raft_consensus.cc:740] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:51.653789 12593 consensus_queue.cc:260] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:51.655100 12593 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:51.655594 11132 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 4.
I20260709 12:23:51.656517 12674 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:51.654393 10976 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:23:51.614581 12732 raft_consensus.cc:2749] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:51.618202 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:51.658831 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:51.659763 12742 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:51.630230 12763 raft_consensus.cc:2749] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:51.661397 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1565) took 2392 ms. Trace:
I20260709 12:23:51.611924 12570 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:23:51.663673 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 58130.7us
I20260709 12:23:51.660562 11060 raft_consensus.cc:1240] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:23:51.640066 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:51.661757 11132 rpcz_store.cc:276] 0709 12:23:49.276331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.660384 (+2384053us) service_pool.cc:224] Handling call
0709 12:23:51.660797 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:51.661077 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:51.661102 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:51.661140 (+    38us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:51.661166 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.661225 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:51.661326 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:51.630158 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:51.636137 10948 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:51.671581 11098 leader_election.cc:400] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5.
I20260709 12:23:51.622475 12687 raft_consensus.cc:2749] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:51.652612 12737 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:51.659363 11131 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 2: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:23:51.674938 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 115797us
I20260709 12:23:51.620908 12672 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:51.660537 12749 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:23:51.683459 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 61968.7us
W20260709 12:23:51.691221 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.693543 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:51.650950 11674 rpcz_store.cc:276] 0709 12:23:50.599627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.600954 (+  1327us) service_pool.cc:224] Handling call
0709 12:23:51.583491 (+982537us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b5800004598. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90daa0a0 00007f8f90da9984 00007f8f8a3246d4 00007f8f8a324662
0709 12:23:51.650436 (+ 66945us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8191232}
I20260709 12:23:51.694393 11645 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:23:51.695451 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:51.695796 12685 raft_consensus.cc:2804] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:51.696229 11052 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 4.
I20260709 12:23:51.698122 11097 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:51.700109 12674 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:51.700917 12751 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:51.701069 11056 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:23:51.701370 12751 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:51.701783 12751 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:51.702575 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.706344 12621 consensus_queue.cc:1048] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:51.707154 12713 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:51.695495 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:51.709259 11675 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
W20260709 12:23:51.709664 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 73666.4us
I20260709 12:23:51.673938 12732 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:51.710603 12732 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:51.696192 12685 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:51.712083 12674 consensus_queue.cc:1059] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:51.712888 12674 consensus_queue.cc:1243] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [LEADER]: Peer c979ef00e0ad4157b49ebbdc13ce7cd7 log is divergent from this leader: its last log entry 1.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:23:51.713027 12726 consensus_queue.cc:1059] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:51.713235 10948 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:51.713410 12674 raft_consensus.cc:3055] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:51.714088 12713 raft_consensus.cc:3055] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:51.714823 11098 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:23:51.726881 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:51.653541 12512 consensus_queue.cc:260] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:51.714192 12685 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:51.715848 12617 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:51.716243 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:51.716464 12766 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:51.696271 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:51.718803 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:51.722872 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:51.731967 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:51.723810 10981 raft_consensus.cc:1275] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:51.731956 11060 raft_consensus.cc:2376] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3. Re-sending same reply.
I20260709 12:23:51.734654 11023 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:51.726794 12674 raft_consensus.cc:740] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:51.742811 12674 consensus_queue.cc:260] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:51.743772 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:51.730010 12713 raft_consensus.cc:740] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:51.744644 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:51.745126 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:51.730815 12621 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:51.746464 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:51.745828 10980 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:51.745543 12713 consensus_queue.cc:260] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:51.753304 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:23:51.754212 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 62434.6us
W20260709 12:23:51.756256 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.758703 11053 raft_consensus.cc:2393] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 3: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:51.764678 11056 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:51.768167 11059 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
W20260709 12:23:51.768832 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.771287 11675 raft_consensus.cc:1240] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:51.774246 12600 consensus_queue.cc:1059] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:23:51.774521 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:51.775990 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:51.776882 11676 raft_consensus.cc:2393] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 4: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:23:51.777549 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:51.779359 11126 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:23:51.781100 11025 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:51.783929 12389 raft_consensus.cc:2749] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:51.784837 12687 consensus_queue.cc:1059] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:51.758937 12763 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:23:51.786674 12787 log.cc:927] Time spent T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.158s	user 0.002s	sys 0.000s
I20260709 12:23:51.786971 12763 raft_consensus.cc:697] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:51.787381 12790 raft_consensus.cc:3055] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:51.787839 12790 raft_consensus.cc:740] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:51.789089 12790 consensus_queue.cc:260] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:51.791621 12790 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:51.793571 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:51.794379 11128 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:51.794662 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:51.795499 11678 raft_consensus.cc:2393] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 2: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:23:51.750648 12621 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:51.801751 10980 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:51.803025 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:51.803964 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:51.802630 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:51.812631 11130 raft_consensus.cc:2410] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:51.816534 10981 raft_consensus.cc:2393] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 6: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:51.804649 12674 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:51.802779 12621 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:51.802358 12711 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:51.817986 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:51.764290 12705 consensus_queue.cc:1048] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
W20260709 12:23:51.834657 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.838639 12711 raft_consensus.cc:697] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:51.839385 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:51.839849 12711 consensus_queue.cc:237] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:51.840775 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:51.841341 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:51.842374 12685 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:51.842713 12751 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:51.821198 12713 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:51.844587 12685 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:51.844951 12751 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:23:51.845548 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.788074 12763 consensus_queue.cc:237] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:51.846696 11678 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 1 LEARNER]: Advancing to term 3
I20260709 12:23:51.841586 11053 raft_consensus.cc:2393] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 3: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:51.847882 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:51.845561 11131 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 4.
I20260709 12:23:51.849014 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:51.850540 11053 raft_consensus.cc:1240] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:51.851251 11024 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:51.853101 11024 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:51.853863 12737 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.854072 12389 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:51.854525 12737 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:51.856554 12737 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:51.859047 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:23:51.862003 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.863441 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:51.849399 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:51.864185 11676 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:51.865056 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:51.865747 11677 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:51.865414 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:51.870018 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:51.873867 11132 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:23:51.821203 10980 raft_consensus.cc:2393] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 3: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:51.882660 11056 raft_consensus.cc:2410] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:51.882030 11055 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:23:51.886696 11053 raft_consensus.cc:1240] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:51.887207 11056 raft_consensus.cc:1240] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3. Ops: []
W20260709 12:23:51.888761 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.895021 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:51.896226 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:51.902736 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:51.906220 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:51.907048 10980 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 2: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:23:51.907936 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:51.908659 12732 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:51.909361 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:51.910669 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:51.910542 12791 consensus_queue.cc:1048] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:23:51.912735 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:51.889844 12720 consensus_queue.cc:1059] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:23:51.913389 11134 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:51.925516 12694 raft_consensus.cc:3055] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:51.926054 12694 raft_consensus.cc:740] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:51.926347 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 1581) took 1042 ms. Trace:
I20260709 12:23:51.926762 11127 rpcz_store.cc:276] 0709 12:23:50.883730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.886919 (+  3189us) service_pool.cc:224] Handling call
0709 12:23:51.923907 (+1036988us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b54000eabd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:51.926263 (+  2356us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":557452032}
I20260709 12:23:51.927130 12694 consensus_queue.cc:260] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:51.928336 11127 raft_consensus.cc:1240] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:51.928606 12694 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:51.929013 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1576) took 1238 ms. Trace:
I20260709 12:23:51.929419 11127 rpcz_store.cc:276] 0709 12:23:50.690549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.927695 (+1237146us) service_pool.cc:224] Handling call
0709 12:23:51.928070 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:51.928745 (+   675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.928940 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:51.931075 12791 consensus_queue.cc:1059] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:51.932300 12791 raft_consensus.cc:3055] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:51.932641 12791 raft_consensus.cc:740] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:51.936460 12462 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:51.940807 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:51.942206 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 48633.6us
I20260709 12:23:51.933725 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:51.933470 12791 consensus_queue.cc:260] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:51.948323 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 182865us
W20260709 12:23:51.950178 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.956625 11127 raft_consensus.cc:1240] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:51.945269 12389 raft_consensus.cc:2804] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:51.959254 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:51.961498 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1577) took 1266 ms. Trace:
I20260709 12:23:51.962589 11127 rpcz_store.cc:276] 0709 12:23:50.690789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.946409 (+1255620us) service_pool.cc:224] Handling call
0709 12:23:51.956410 (+ 10001us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:51.957169 (+   759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.957390 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:51.961977 11132 raft_consensus.cc:1240] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:51.966655 11131 raft_consensus.cc:1240] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:23:51.967500 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1579) took 1197 ms. Trace:
I20260709 12:23:51.967857 11131 rpcz_store.cc:276] 0709 12:23:50.770014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.958630 (+1188616us) service_pool.cc:224] Handling call
0709 12:23:51.966329 (+  7699us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:51.967185 (+   856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.967437 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:51.971433 11024 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:23:51.973445 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 170) took 2395 ms. Trace:
I20260709 12:23:51.974030 11132 rpcz_store.cc:276] 0709 12:23:49.570907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.886359 (+2315452us) service_pool.cc:224] Handling call
0709 12:23:51.953637 (+ 67278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:51.965551 (+ 11914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.965795 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:51.980443 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:51.982548 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:51.984001 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:51.984871 10982 raft_consensus.cc:2393] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 4: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:51.987229 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1413) took 3692 ms. Trace:
I20260709 12:23:51.987691 11133 rpcz_store.cc:276] 0709 12:23:48.294637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.876343 (+2581706us) service_pool.cc:224] Handling call
0709 12:23:50.876761 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:51.168009 (+291248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.986861 (+818852us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b5400106b54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:51.987152 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":641088768}
I20260709 12:23:51.990979 12675 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:51.993198 11057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1383) took 1224 ms. Trace:
I20260709 12:23:51.993507 12751 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.994270 12751 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:51.994277 11059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41294 (request call id 1053) took 1069 ms. Trace:
I20260709 12:23:51.996671 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:51.953773 11128 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:52.001910 11129 raft_consensus.cc:1240] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:51.996536 11059 rpcz_store.cc:276] 0709 12:23:50.925025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.960413 (+ 35388us) service_pool.cc:224] Handling call
0709 12:23:51.994021 (+1033608us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b54003011d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:51.994181 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1613333888}
I20260709 12:23:51.987087 12791 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:51.997630 11057 rpcz_store.cc:276] 0709 12:23:50.768316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.768545 (+   229us) service_pool.cc:224] Handling call
0709 12:23:51.992922 (+1224377us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b54002df854. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:51.993096 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1688192384}
I20260709 12:23:52.007016 11134 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 4.
I20260709 12:23:51.945278 12621 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:52.013124 10979 raft_consensus.cc:1240] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:23:52.008858 10975 raft_consensus.cc:2393] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 4: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:52.019436 10975 raft_consensus.cc:1240] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:52.020814 10975 raft_consensus.cc:1240] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:52.017252 11678 raft_consensus.cc:1275] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEARNER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:23:52.027571 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:52.029522 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.037948 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1562) took 2835 ms. Trace:
I20260709 12:23:52.038581 11129 rpcz_store.cc:276] 0709 12:23:49.202527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.869662 (+2667135us) service_pool.cc:224] Handling call
0709 12:23:52.001576 (+131914us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:52.002366 (+   790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:52.037722 (+ 35356us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b5400373550. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:52.037882 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302431872}
I20260709 12:23:52.041174 12737 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.041846 12737 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:52.044324 12737 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:23:52.045908 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.046746 11131 raft_consensus.cc:1240] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:52.047547 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1583) took 1037 ms. Trace:
I20260709 12:23:52.047962 11131 rpcz_store.cc:276] 0709 12:23:51.009697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.997494 (+987797us) service_pool.cc:224] Handling call
0709 12:23:52.046530 (+ 49036us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:52.047282 (+   752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:52.047487 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:52.050993 12751 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:52.051398 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:52.022338 12790 raft_consensus.cc:2749] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:23:52.062659 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.064056 11132 raft_consensus.cc:1240] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:52.063532 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1580) took 1293 ms. Trace:
I20260709 12:23:52.064776 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1584) took 1054 ms. Trace:
I20260709 12:23:52.064971 11127 rpcz_store.cc:276] 0709 12:23:50.770427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.969676 (+1199249us) service_pool.cc:224] Handling call
0709 12:23:52.007683 (+ 38007us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:52.063183 (+ 55500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:52.063211 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:52.063259 (+    48us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:52.063290 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:52.063348 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:52.063474 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:52.065572 11132 rpcz_store.cc:276] 0709 12:23:51.009959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.998376 (+988417us) service_pool.cc:224] Handling call
0709 12:23:52.059448 (+ 61072us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:52.064513 (+  5065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:52.064717 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:52.067503 11055 raft_consensus.cc:1275] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:52.067032 12674 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:52.069351 11126 raft_consensus.cc:1275] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:52.070567 11024 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:52.076061 11060 raft_consensus.cc:1275] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:52.072067 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:52.076711 11130 raft_consensus.cc:1240] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:52.080327 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:52.080881 12674 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:52.081863 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:52.082605 10977 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:52.074687 12751 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.088207 12751 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:52.089694 12389 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:52.090235 12389 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:52.090592 11054 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52804 (request call id 201) took 1300 ms (client timeout 1565 ms). Trace:
W20260709 12:23:52.091003 11054 rpcz_store.cc:269] 0709 12:23:50.789776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.816933 (+ 27157us) service_pool.cc:224] Handling call
0709 12:23:52.090371 (+1273438us) spinlock_profiling.cc:243] Waited 526 ms on lock 0x7b540008bbd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:52.090509 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1210948864}
I20260709 12:23:52.097596 11128 raft_consensus.cc:1240] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:52.098448 12621 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:52.099273 11129 raft_consensus.cc:1240] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:52.099617 11128 raft_consensus.cc:1240] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:52.100373 11131 raft_consensus.cc:1240] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:52.100735 11129 raft_consensus.cc:1275] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:52.101192 11128 raft_consensus.cc:1240] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:23:52.102298 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1570) took 2734 ms. Trace:
I20260709 12:23:52.102759 11126 rpcz_store.cc:276] 0709 12:23:49.367834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.778733 (+2410899us) service_pool.cc:224] Handling call
0709 12:23:51.779167 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:52.074824 (+295657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:52.102233 (+ 27409us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:52.104638 11130 raft_consensus.cc:1240] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4. Ops: []
W20260709 12:23:52.105326 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.102802 11059 raft_consensus.cc:1275] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:23:52.109483 12674 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:52.111044 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:52.116595 12763 consensus_queue.cc:1059] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:52.118554 12763 raft_consensus.cc:3055] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:52.119423 11132 raft_consensus.cc:1275] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:52.121018 11645 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:52.125222 12512 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:52.126598 12635 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:52.127233 11058 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:52.127693 12746 raft_consensus.cc:3055] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:52.128166 12746 raft_consensus.cc:740] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:52.128273 11023 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:52.128768 12699 raft_consensus.cc:3055] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:52.129160 12699 raft_consensus.cc:740] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:52.130448 12747 raft_consensus.cc:2749] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:52.130188 12699 consensus_queue.cc:260] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:52.130738 11128 raft_consensus.cc:1275] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:52.130959 12394 consensus_queue.cc:1059] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:52.128397 12462 consensus_queue.cc:1059] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:52.132216 12462 raft_consensus.cc:3055] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:52.132040 12394 consensus_queue.cc:1059] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:52.127203 12635 raft_consensus.cc:697] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:52.136972 12735 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:52.136782 12635 consensus_queue.cc:237] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:52.137203 10949 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:52.133018 10980 raft_consensus.cc:2410] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:52.131441 12699 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:52.133217 10948 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:23:52.127722 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 119582us
I20260709 12:23:52.140406 11134 raft_consensus.cc:3055] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:52.140957 11134 raft_consensus.cc:740] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:52.144290 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:52.119306 12763 raft_consensus.cc:740] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:52.137554 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:52.147575 10980 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:52.148089 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.148558 12389 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:52.149422 11051 raft_consensus.cc:2410] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:23:52.149585 12713 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:52.149955 12751 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:52.150609 10949 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:52.150805 10977 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:23:52.133267 12462 raft_consensus.cc:740] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:52.153584 10948 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:52.138968 12746 consensus_queue.cc:260] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:52.153095 12674 raft_consensus.cc:2804] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:52.162130 12630 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:52.165462 12751 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:52.166320 12751 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:52.166841 12694 raft_consensus.cc:2749] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:52.168013 10948 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:52.165400 11052 raft_consensus.cc:2393] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 2: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:52.164199 11134 consensus_queue.cc:260] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:52.181427 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.184015 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:52.192329 10949 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:23:52.192417 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 385767us
I20260709 12:23:52.190546 10979 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
W20260709 12:23:52.197337 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.199033 12708 consensus_queue.cc:1059] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:52.200381 12708 raft_consensus.cc:3055] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:52.200786 12708 raft_consensus.cc:740] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:52.202548 11134 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:52.203639 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:52.205044 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:52.205719 10976 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:52.206295 12570 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:52.209604 10949 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:52.210685 12260 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.177680 10975 raft_consensus.cc:1240] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3. Ops: []
W20260709 12:23:52.202411 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 81495.3us
W20260709 12:23:52.212368 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 44447.9us
I20260709 12:23:52.170794 12674 raft_consensus.cc:697] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:52.216419 10948 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:52.215530 11645 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:23:52.213735 12260 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:52.230907 11134 raft_consensus.cc:1275] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:23:52.232379 11134 pending_rounds.cc:85] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 1
I20260709 12:23:52.233420 11134 pending_rounds.cc:107] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:23:52.222779 10980 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
W20260709 12:23:52.237188 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.211812 12465 consensus_queue.cc:1059] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:23:52.196267 12774 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:52.202467 12746 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:52.239370 11097 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:23:52.238091 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 80585.7us
I20260709 12:23:52.253007 10948 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:52.212066 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:52.258720 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:52.256453 11134 raft_consensus.cc:2889] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:52.260408 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:52.260978 10980 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:52.258908 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:52.262034 11127 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:52.239997 12716 raft_consensus.cc:2749] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:52.266531 11023 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:52.267925 11645 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:23:52.270501 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:52.255067 12574 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:52.255200 12729 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:52.161284 12462 consensus_queue.cc:260] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:52.259513 12742 raft_consensus.cc:2804] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:52.283628 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:52.287175 11059 raft_consensus.cc:2393] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 3: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
W20260709 12:23:52.285835 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.286171 11053 raft_consensus.cc:1240] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:52.286129 11643 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:52.292328 12717 raft_consensus.cc:2749] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:52.291898 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:52.293093 11128 raft_consensus.cc:1275] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:23:52.293753 12805 log.cc:927] Time spent T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:23:52.294953 12735 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:52.294828 12674 consensus_queue.cc:237] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:52.295563 12735 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:52.297778 12735 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:52.298336 12711 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:52.299141 10982 raft_consensus.cc:1240] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:52.299414 11052 raft_consensus.cc:1275] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:52.292135 12570 raft_consensus.cc:2804] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:23:52.316936 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 77663.7us
I20260709 12:23:52.303803 12260 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:52.303601 11672 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:23:52.289165 12685 consensus_queue.cc:1059] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:23:52.282186 12600 raft_consensus.cc:2749] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:52.305274 11024 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:52.282522 12729 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:52.201809 12708 consensus_queue.cc:260] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:52.291779 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:52.324717 12260 raft_consensus.cc:2749] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:52.345084 11097 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:52.345526 11024 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:52.293085 12717 raft_consensus.cc:2749] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:23:52.310554 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:52.346923 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 60907.5us
W20260709 12:23:52.347412 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.347911 11643 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:52.350410 10949 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:52.316908 12711 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:52.324157 12742 raft_consensus.cc:697] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:52.358636 10949 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:52.345969 12729 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:52.344027 12570 raft_consensus.cc:697] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:52.345634 12735 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:23:52.361590 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 108656us
I20260709 12:23:52.359658 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:52.270211 12763 consensus_queue.cc:260] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:52.371032 11097 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:52.374125 12600 raft_consensus.cc:2749] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:52.374612 11097 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:52.375555 12600 raft_consensus.cc:2749] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:52.375996 11097 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:52.371632 10948 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:52.352593 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:52.357276 12711 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:52.354152 12708 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:52.352977 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:52.355290 12635 raft_consensus.cc:2804] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:52.393599 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:52.396903 11097 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:52.361905 12389 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:52.365720 12465 raft_consensus.cc:2749] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:52.367213 12699 raft_consensus.cc:2749] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:52.403805 10948 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:52.376889 12600 raft_consensus.cc:2749] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:23:52.412213 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.372443 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:52.422547 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:52.370690 12735 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:52.428781 10948 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:52.391251 12716 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:52.420892 11097 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:52.399144 12751 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:52.396837 12635 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:52.433909 10982 raft_consensus.cc:1240] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:52.441187 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:52.411253 11673 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:23:52.445484 11053 raft_consensus.cc:2393] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 3: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:52.429013 11678 raft_consensus.cc:1275] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:52.434625 12761 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:23:52.448730 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 57861.3us
W20260709 12:23:52.443478 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 95646.2us
I20260709 12:23:52.444972 12774 raft_consensus.cc:697] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:52.443233 11097 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:52.424867 12726 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:52.433161 12735 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:52.429896 12811 raft_consensus.cc:2749] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:52.442358 12716 raft_consensus.cc:697] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 2 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:52.453821 10982 raft_consensus.cc:1240] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:23:52.454216 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 91268.6us
I20260709 12:23:52.446297 12635 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:52.428751 12465 consensus_queue.cc:1059] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:23:52.455437 11097 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:23:52.450120 12699 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:52.466566 11672 raft_consensus.cc:1275] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:52.421656 12570 consensus_queue.cc:237] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:52.468815 11676 raft_consensus.cc:1240] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:52.470705 12726 raft_consensus.cc:2749] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:52.471127 12816 consensus_queue.cc:1059] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
W20260709 12:23:52.471987 12804 log.cc:927] Time spent T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:23:52.472790 10981 raft_consensus.cc:2410] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:23:52.473290 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:52.474136 12713 raft_consensus.cc:2749] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:52.491065 12716 consensus_queue.cc:237] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:52.488811 12574 raft_consensus.cc:697] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 4 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
W20260709 12:23:52.475216 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.493477 12574 consensus_queue.cc:237] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:52.495675 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:52.480661 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:52.497732 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.498613 12774 consensus_queue.cc:237] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:52.501627 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1593) took 1047 ms. Trace:
I20260709 12:23:52.486574 10978 raft_consensus.cc:1240] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:23:52.480105 11097 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:52.466181 12747 raft_consensus.cc:3055] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:52.486759 11644 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:23:52.479157 12809 log.cc:927] Time spent T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:23:52.453678 12685 consensus_queue.cc:1048] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:23:52.504055 11097 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:52.461879 12600 raft_consensus.cc:2804] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:52.483299 10976 raft_consensus.cc:1240] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:52.474336 12818 consensus_queue.cc:1059] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:52.486055 12674 raft_consensus.cc:2749] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:52.502045 11131 rpcz_store.cc:276] 0709 12:23:51.454641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.101187 (+646546us) service_pool.cc:224] Handling call
0709 12:23:52.101488 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:52.153277 (+ 51789us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:52.153312 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:52.155963 (+  2651us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:52.156007 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:52.501390 (+345383us) spinlock_profiling.cc:243] Waited 32.2 ms on lock 0x7b54001630d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:52.501439 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:52.501558 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74111360}
I20260709 12:23:52.518935 11644 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:52.521503 11097 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:52.486126 12761 raft_consensus.cc:2749] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:52.451517 12742 consensus_queue.cc:237] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:52.530436 11644 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:52.513947 12751 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:52.511801 12747 raft_consensus.cc:740] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:52.514286 12817 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.514359 12699 raft_consensus.cc:697] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:52.527652 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:52.549947 12639 raft_consensus.cc:2804] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:52.550278 12676 consensus_queue.cc:1059] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:23:52.551167 12621 raft_consensus.cc:2749] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:52.554566 12675 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:52.554800 12812 log.cc:927] Time spent T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:23:52.555130 12821 consensus_queue.cc:1059] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:23:52.559674 12823 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:52.561424 12751 raft_consensus.cc:697] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:52.553802 12729 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:52.565908 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 137181us
W20260709 12:23:52.585464 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 97174.1us
I20260709 12:23:52.586169 10948 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:52.519140 12600 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
W20260709 12:23:52.570739 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 49332.5us
I20260709 12:23:52.572448 10983 raft_consensus.cc:1275] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:23:52.534967 12807 log.cc:927] Time spent T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 12:23:52.570114 12639 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:52.619890 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.519168 12703 consensus_queue.cc:1059] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:23:52.529763 10977 raft_consensus.cc:1240] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:52.577436 12821 raft_consensus.cc:3055] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:52.630934 12617 raft_consensus.cc:2749] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:52.568288 12817 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:52.631515 12471 consensus_queue.cc:1048] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 12:23:52.632050 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1585) took 1621 ms. Trace:
I20260709 12:23:52.632210 12699 consensus_queue.cc:237] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:52.633546 12817 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:52.577646 12823 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:52.635196 12826 raft_consensus.cc:2749] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:52.621881 12639 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:52.623692 12821 raft_consensus.cc:740] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:52.628464 12761 consensus_queue.cc:1059] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:23:52.637048 12761 consensus_queue.cc:1243] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer bc01179655564f29b83babe396377cbb log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:23:52.626147 12694 consensus_queue.cc:1059] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:23:52.637602 12761 raft_consensus.cc:3055] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:52.637990 12761 raft_consensus.cc:740] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:52.638406 12694 raft_consensus.cc:3055] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:52.638824 12694 raft_consensus.cc:740] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:52.635885 12826 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:52.616581 12600 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:52.636229 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 50174.3us
I20260709 12:23:52.632483 11133 rpcz_store.cc:276] 0709 12:23:51.010254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.988859 (+978605us) service_pool.cc:224] Handling call
0709 12:23:51.989277 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:51.989626 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:51.989653 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:52.004629 (+ 14976us) log.cc:844] Serialized 26 byte log entry
0709 12:23:52.262008 (+257379us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:52.262045 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:52.262130 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:52.631785 (+369655us) raft_consensus.cc:1685] finished
0709 12:23:52.631802 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:52.631968 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":188814,"threads_started":1,"wal-append.queue_time_us":255880}
I20260709 12:23:52.639866 12817 raft_consensus.cc:2749] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:52.636086 12823 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:52.647269 12747 consensus_queue.cc:260] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:52.638880 12761 consensus_queue.cc:260] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:52.629312 12621 consensus_queue.cc:1059] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:23:52.648590 12723 consensus_queue.cc:1059] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:23:52.647894 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:23:52.650928 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.653632 12817 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.576745 12675 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:52.664647 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:52.676921 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 107444us
W20260709 12:23:52.661617 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 131283us
I20260709 12:23:52.639631 12694 consensus_queue.cc:260] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:52.717053 12260 raft_consensus.cc:3055] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:52.717568 12260 raft_consensus.cc:740] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:23:52.719719 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.632907 12471 consensus_queue.cc:1048] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:23:52.719781 12823 consensus_queue.cc:1048] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:23:52.721964 12761 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:52.637291 12821 consensus_queue.cc:260] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:52.726907 10977 raft_consensus.cc:1240] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:52.654090 12711 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:52.727738 12694 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:52.728192 11057 raft_consensus.cc:1240] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:52.729338 12711 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:52.731698 12687 raft_consensus.cc:3055] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:52.732146 12687 raft_consensus.cc:740] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:52.732997 12687 consensus_queue.cc:260] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:52.663235 12729 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:52.727186 12821 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:52.739876 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:52.740298 12763 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:52.740604 11054 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
I20260709 12:23:52.742348 12260 consensus_queue.cc:260] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:52.743515 12823 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.743705 12260 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:52.744051 12823 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:52.744990 12687 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:52.746361 12823 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:52.727156 12817 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:52.746934 11644 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
W20260709 12:23:52.831797 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 84930.1us
I20260709 12:23:52.832103 12817 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:52.750545 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:52.832669 12708 raft_consensus.cc:2764] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:23:52.743993 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:52.751400 11051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1393) took 1297 ms. Trace:
I20260709 12:23:52.751703 12675 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:52.834177 12462 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:52.752529 11680 raft_consensus.cc:1275] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:52.834084 10978 raft_consensus.cc:1275] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:52.836988 11051 rpcz_store.cc:276] 0709 12:23:51.453778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.477964 (+ 24186us) service_pool.cc:224] Handling call
0709 12:23:52.751163 (+1273199us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b5400276fd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:52.751330 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1535504640}
I20260709 12:23:52.839183 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1042) took 1045 ms. Trace:
I20260709 12:23:52.754750 12751 consensus_queue.cc:237] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:52.755796 12735 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:52.758194 12639 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:52.759256 10979 raft_consensus.cc:1275] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:23:52.668599 12512 consensus_meta.cc:287] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.543s	user 0.011s	sys 0.002s
I20260709 12:23:52.766538 12747 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:52.663932 10976 raft_consensus.cc:1240] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:52.663941 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:52.767809 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:23:52.774778 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:52.858009 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.792670 12635 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:52.811553 12600 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:52.747498 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:52.863190 10983 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:52.851117 10980 raft_consensus.cc:1275] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:52.839612 10981 rpcz_store.cc:276] 0709 12:23:51.793704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.858722 (+ 65018us) service_pool.cc:224] Handling call
0709 12:23:52.838950 (+980228us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b5400229054. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:52.839114 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1409266944}
I20260709 12:23:52.743448 12685 raft_consensus.cc:3055] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:52.859122 10984 raft_consensus.cc:2410] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:23:52.871598 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:52.878947 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.883299 12512 consensus_queue.cc:1048] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
W20260709 12:23:52.890722 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:52.890980 11058 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52804 (request call id 200) took 2102 ms (client timeout 1990 ms). Trace:
W20260709 12:23:52.891340 11058 rpcz_store.cc:269] 0709 12:23:50.788569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.821524 (+ 32955us) service_pool.cc:224] Handling call
0709 12:23:52.860946 (+2039422us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54001892d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:52.890908 (+ 29962us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2871547136}
I20260709 12:23:52.894945 11644 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
W20260709 12:23:52.896337 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 318512us
I20260709 12:23:52.898331 10948 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:52.905889 12821 raft_consensus.cc:2749] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:52.906293 11680 raft_consensus.cc:1240] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:52.906193 12600 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:52.907202 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:52.867733 11052 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 4.
I20260709 12:23:52.893186 12711 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.910308 12711 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:52.910866 12827 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:52.911372 12827 raft_consensus.cc:697] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:52.912539 12711 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:52.883563 12685 raft_consensus.cc:740] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:52.920576 10976 raft_consensus.cc:1275] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:52.924255 12260 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:52.924832 12260 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:52.883368 12708 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:23:52.937961 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.935024 10975 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:52.939462 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:52.939781 12462 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.907099 12639 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:52.940153 11132 raft_consensus.cc:1275] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:52.935231 12687 consensus_queue.cc:1048] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:23:52.941316 12828 consensus_queue.cc:1059] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:52.941596 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:52.942392 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:52.943100 11675 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:52.922858 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:52.944080 11133 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:23:52.910336 12730 raft_consensus.cc:3055] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:52.945437 12730 raft_consensus.cc:740] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:52.939261 11125 raft_consensus.cc:1275] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:52.950871 11098 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:52.942452 11128 raft_consensus.cc:2393] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:52.939781 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:52.912278 12827 consensus_queue.cc:237] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:52.935503 12711 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.958222 12260 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:52.961292 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:52.974512 11055 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 5.
I20260709 12:23:52.935696 12761 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:52.914425 12389 consensus_queue.cc:1059] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:23:52.969564 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:52.952813 12639 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.976531 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:52.983114 11132 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:52.978348 11127 raft_consensus.cc:1240] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:23:52.969336 11681 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:52.979756 11054 raft_consensus.cc:1275] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:52.979993 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:52.985369 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:52.940332 12462 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:52.980547 11058 raft_consensus.cc:1240] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:52.988142 11056 raft_consensus.cc:1275] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:52.970285 12600 raft_consensus.cc:2804] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:52.980345 11060 raft_consensus.cc:1275] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:52.986047 11053 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 4.
I20260709 12:23:52.955932 10976 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:52.981920 12687 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.014720 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:52.957828 12708 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:53.027828 12831 log.cc:927] Time spent T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 12:23:53.030949 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 53110.2us
I20260709 12:23:53.031747 11025 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:52.991477 12737 raft_consensus.cc:3055] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:53.034438 11025 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
W20260709 12:23:53.059216 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.071470 12833 consensus_queue.cc:1048] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:53.072348 11677 raft_consensus.cc:1240] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:53.079912 11132 raft_consensus.cc:1240] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:52.988178 12761 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:53.051884 12791 raft_consensus.cc:2749] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:52.980142 12711 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
W20260709 12:23:53.074115 12746 consensus_meta.cc:287] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.809s	user 0.005s	sys 0.007s
I20260709 12:23:53.021277 12600 raft_consensus.cc:697] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:52.980799 12730 consensus_queue.cc:260] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:53.092754 10948 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:23:53.082194 12774 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.011s	sys 0.010s
I20260709 12:23:53.074636 12675 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:23:53.106431 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 131654us
I20260709 12:23:53.013700 12639 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:53.054560 12737 raft_consensus.cc:740] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:53.135915 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:53.074084 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:53.088212 12635 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:53.073359 12687 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:53.103883 12735 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:53.162014 12462 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:53.228566 12260 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:53.368012 11097 leader_election.cc:336] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.623s (SENT)
I20260709 12:23:53.375906 12260 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:53.298154 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.084522 12833 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:53.320580 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.015285 12621 consensus_queue.cc:1048] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 12:23:53.323590 11053 raft_consensus.cc:1240] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:53.223646 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:23:53.295284 12790 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.010s	sys 0.012s
I20260709 12:23:53.343966 11060 raft_consensus.cc:1275] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:53.075232 12676 consensus_queue.cc:1048] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.076s
W20260709 12:23:53.346148 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 253474us
I20260709 12:23:53.346964 11057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1071) took 1078 ms. Trace:
W20260709 12:23:53.350688 12774 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.011s	sys 0.010s
I20260709 12:23:53.336289 12821 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.351100 12675 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:53.330930 12747 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.330945 12836 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
W20260709 12:23:53.399164 12790 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.965s	user 0.010s	sys 0.013s
I20260709 12:23:53.345796 12751 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:23:53.396514 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.358352 12742 raft_consensus.cc:2804] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:53.398330 11057 rpcz_store.cc:276] 0709 12:23:52.268835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.268979 (+   144us) service_pool.cc:224] Handling call
0709 12:23:52.559569 (+290590us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b58001a5e98. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90dbdfc0 00007f8f90da8929 00007f8f90da83d2 00007f8f8a31fbd4
0709 12:23:52.559775 (+   206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:52.728588 (+168813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.346558 (+617970us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b54003e0b54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:53.346749 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":389398144}
W20260709 12:23:53.407730 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:53.440423 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.366887 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1623) took 1057 ms. Trace:
I20260709 12:23:53.376565 11097 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:23:53.433454 12823 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:53.455310 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 90704.3us
I20260709 12:23:53.431381 12675 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:53.433997 12723 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.412693 10976 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:23:53.396963 12833 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:53.434593 12730 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:53.439580 12742 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:53.444599 12694 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:53.497759 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.409368 12699 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:23:53.441581 12851 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:53.456252 12832 log.cc:927] Time spent T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.372s	user 0.000s	sys 0.001s
I20260709 12:23:53.513825 12852 consensus_queue.cc:1059] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:53.515184 12860 consensus_queue.cc:1048] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:53.476310 12761 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:53.519369 12465 raft_consensus.cc:3055] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:23:53.522991 12841 log.cc:927] Time spent T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
W20260709 12:23:53.523572 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 164241us
I20260709 12:23:53.458334 12639 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:53.525592 10982 raft_consensus.cc:1275] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:23:53.431975 12821 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:53.460963 12791 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.436546 12747 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:53.523836 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:53.620548 11129 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:53.450994 12774 consensus_queue.cc:1048] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 12:23:53.462934 12737 consensus_queue.cc:260] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:53.665076 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 210958us
I20260709 12:23:53.546892 12465 raft_consensus.cc:740] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:53.445951 12751 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:53.680526 10948 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:53.515030 12857 raft_consensus.cc:2749] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:53.537189 12851 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:53.622304 12735 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:53.542215 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 82568.3us
I20260709 12:23:53.436744 12836 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:53.686846 12858 log.cc:927] Time spent T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:23:53.688205 12836 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
I20260709 12:23:53.515097 10976 raft_consensus.cc:1240] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 2 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 1. Current term is 2. Ops: []
W20260709 12:23:53.688936 12847 log.cc:927] Time spent T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 12:23:53.689301 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1627) took 1124 ms. Trace:
I20260709 12:23:53.689764 10976 rpcz_store.cc:276] 0709 12:23:52.564845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.514496 (+949651us) service_pool.cc:224] Handling call
0709 12:23:53.514880 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:53.688978 (+174098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.689200 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:53.691491 10976 raft_consensus.cc:1275] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:53.692124 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1628) took 1127 ms. Trace:
I20260709 12:23:53.692636 12851 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:23:53.693250 12855 log.cc:927] Time spent T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 12:23:53.666174 12791 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:53.695109 12829 log.cc:927] Time spent T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.257s	user 0.000s	sys 0.000s
I20260709 12:23:53.695863 11672 raft_consensus.cc:1275] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:53.696272 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:23:53.696600 12848 log.cc:927] Time spent T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 12:23:53.697320 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:53.698031 11680 raft_consensus.cc:2368] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5.
I20260709 12:23:53.698264 12791 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:53.699220 11130 raft_consensus.cc:1240] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:53.699254 12774 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:53.700774 12774 raft_consensus.cc:2764] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:23:53.701504 11129 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 5.
W20260709 12:23:53.535763 11675 consensus_meta.cc:287] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.592s	user 0.007s	sys 0.004s
I20260709 12:23:53.537703 12621 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.473608 12723 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:53.585817 11097 leader_election.cc:336] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.661s (SENT)
I20260709 12:23:53.586619 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1626) took 1022 ms. Trace:
I20260709 12:23:53.539112 12708 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:53.441336 12600 consensus_queue.cc:237] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:53.541528 12711 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:53.516192 12699 consensus_queue.cc:1048] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:53.494913 12823 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:53.538885 12694 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:53.615006 12838 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.676230 11025 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:23:53.721829 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 45708.2us
W20260709 12:23:53.539245 10983 consensus_meta.cc:287] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.646s	user 0.009s	sys 0.002s
I20260709 12:23:53.512809 12742 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:53.689124 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:53.692548 11644 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.145.194:44483 timed out after 1.976s (SENT) [suppressed 19 similar messages]
I20260709 12:23:53.708302 10982 rpcz_store.cc:276] 0709 12:23:52.564593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.460109 (+895516us) service_pool.cc:224] Handling call
0709 12:23:53.493754 (+ 33645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:53.572536 (+ 78782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.586534 (+ 13998us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:53.683584 12635 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.444291 10977 rpcz_store.cc:276] 0709 12:23:52.309822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.972547 (+662725us) service_pool.cc:224] Handling call
0709 12:23:52.972887 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:52.973095 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:23:53.099752 (+126657us) log.cc:844] Serialized 14 byte log entry
0709 12:23:53.323131 (+223379us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:53.327146 (+  4015us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:53.335979 (+  8833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.345500 (+  9521us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:53.363670 (+ 18170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":165007,"prepare.queue_time_us":406973,"prepare.run_cpu_time_us":5041,"prepare.run_wall_time_us":30422,"raft.queue_time_us":223324,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":8538,"thread_start_us":126226,"threads_started":1}
I20260709 12:23:53.685256 12790 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.718624 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:53.705478 11675 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:53.624842 12859 consensus_queue.cc:1059] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.092s
I20260709 12:23:53.720697 11125 raft_consensus.cc:1275] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:53.615310 12834 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.722508 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:53.755126 11130 raft_consensus.cc:2368] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5.
I20260709 12:23:53.749318 12465 consensus_queue.cc:260] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:53.722550 12711 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:53.722810 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:53.756306 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:53.756916 11127 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:53.757200 12471 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.756647 12711 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:53.718289 12852 consensus_queue.cc:1048] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:23:53.757921 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:53.758222 12711 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:53.724296 12823 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:53.737377 10983 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:23:53.746575 11129 raft_consensus.cc:2393] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 3: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:53.758818 11127 raft_consensus.cc:2410] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:23:53.718827 11098 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:53.759956 10979 raft_consensus.cc:1240] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:53.759025 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1629) took 1017 ms. Trace:
I20260709 12:23:53.692446 10976 rpcz_store.cc:276] 0709 12:23:52.565085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.690802 (+1125717us) service_pool.cc:224] Handling call
0709 12:23:53.691133 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:53.691874 (+   741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.692071 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:53.711438 12639 consensus_queue.cc:1059] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:23:53.756122 12465 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:53.742619 12836 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.760743 10983 rpcz_store.cc:276] 0709 12:23:52.741284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.747226 (+  5942us) service_pool.cc:224] Handling call
0709 12:23:53.758962 (+1011736us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:53.754922 12834 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:53.766721 12723 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:53.741333 12838 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:53.743621 12791 consensus_queue.cc:1059] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:23:53.768411 12823 raft_consensus.cc:3055] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:53.769204 12751 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:53.747233 12635 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:53.769104 12711 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:53.808207 12635 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:53.808874 12639 raft_consensus.cc:3055] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:53.809042 11057 raft_consensus.cc:1275] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:53.809322 12639 raft_consensus.cc:740] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:53.808240 12711 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:53.810218 12639 consensus_queue.cc:260] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:53.811420 12639 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:53.812431 12851 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.812958 12851 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:53.771034 12742 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:53.814874 12699 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:53.815703 12742 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:53.815469 12699 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:53.816918 12833 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:53.817754 12699 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:53.758750 12462 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:53.818476 12462 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:53.820487 12462 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:53.772933 10978 raft_consensus.cc:1275] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:23:53.821018 10978 pending_rounds.cc:85] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 1
I20260709 12:23:53.821290 10978 pending_rounds.cc:107] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:23:53.821512 10978 raft_consensus.cc:2889] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:53.774715 11677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41784 (request call id 431) took 1349 ms. Trace:
I20260709 12:23:53.822260 11677 rpcz_store.cc:276] 0709 12:23:52.425740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.428087 (+  2347us) service_pool.cc:224] Handling call
0709 12:23:52.453644 (+ 25557us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:53.072861 (+619217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.774446 (+701585us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b5400563e54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:53.774630 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1369441024}
I20260709 12:23:53.711081 12621 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:53.825393 12621 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:53.707832 12735 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:53.826613 12747 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:53.746335 12790 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:53.827867 12735 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:23:53.776273 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 57539.5us
I20260709 12:23:53.828792 12790 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:23:53.770823 10984 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1043) took 1976 ms (client timeout 1661 ms). Trace:
I20260709 12:23:53.829149 11098 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb
W20260709 12:23:53.829375 10984 rpcz_store.cc:269] 0709 12:23:51.793996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.891997 (+ 98001us) service_pool.cc:224] Handling call
0709 12:23:53.770560 (+1878563us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b5400229554. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:53.770726 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2210718464}
I20260709 12:23:53.806367 12823 raft_consensus.cc:740] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:53.831580 12823 consensus_queue.cc:260] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:53.832764 12823 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:53.833385 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:53.834173 11680 raft_consensus.cc:2393] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 2: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:23:53.835913 11677 raft_consensus.cc:1275] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:53.837441 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:53.838369 11056 raft_consensus.cc:2393] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 2: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
W20260709 12:23:53.761270 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 210282us
I20260709 12:23:53.727216 12694 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:53.790412 12836 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:53.791781 11673 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:53.757761 12471 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:53.797544 11681 raft_consensus.cc:1275] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
W20260709 12:23:53.801160 12840 log.cc:927] Time spent T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.449s	user 0.000s	sys 0.007s
I20260709 12:23:53.746817 12862 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:53.876451 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:53.877238 11681 pending_rounds.cc:85] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Aborting all ops after (but not including) 5
I20260709 12:23:53.886372 11681 pending_rounds.cc:107] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:23:53.886699 11681 raft_consensus.cc:2889] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:53.872977 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:53.787063 12860 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:53.887849 11053 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:23:53.920717 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:53.921564 11058 raft_consensus.cc:2393] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 3: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:53.856269 12857 raft_consensus.cc:2804] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:53.878968 12699 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.884579 12621 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:53.944223 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:53.881414 12694 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:53.954262 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:53.954945 11125 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:53.953123 11133 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:53.883217 12742 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.960210 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:53.966192 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:23:53.967275 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 274733us
W20260709 12:23:53.968232 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.925959 12865 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.926386 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:53.969484 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:53.925984 12761 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.967514 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:53.977018 11132 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:53.971134 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:53.931789 12471 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:53.972206 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:23:53.983016 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 316862us
I20260709 12:23:53.983486 11130 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:53.975116 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:53.942871 12821 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:53.889384 12862 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:53.959884 12735 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.923916 12852 consensus_queue.cc:1048] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:23:53.980866 11025 leader_election.cc:400] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5.
I20260709 12:23:53.856786 12751 consensus_queue.cc:1048] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.113s
W20260709 12:23:54.001331 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.978411 11125 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:53.955572 12791 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:53.927165 12857 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:53.984329 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1630) took 1242 ms. Trace:
I20260709 12:23:53.992568 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:54.007287 11058 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:53.962563 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:53.998540 11025 leader_election.cc:403] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:23:53.970961 12790 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.009379 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 188) took 1421 ms. Trace:
I20260709 12:23:54.004634 11024 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:23:53.954488 12699 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:53.983482 12833 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.976853 12817 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.978688 12865 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:54.009827 11134 rpcz_store.cc:276] 0709 12:23:52.587514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.587766 (+   252us) service_pool.cc:224] Handling call
0709 12:23:52.588161 (+   395us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:52.619010 (+ 30849us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:52.619043 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:52.629194 (+ 10151us) log.cc:844] Serialized 52 byte log entry
0709 12:23:53.013148 (+383954us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:53.224246 (+211098us) log.cc:844] Serialized 14 byte log entry
0709 12:23:53.321968 (+ 97722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.322049 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:53.800563 (+478514us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:23:54.004401 (+203838us) raft_consensus.cc:1685] finished
0709 12:23:54.009118 (+  4717us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:54.009309 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1860,"prepare.queue_time_us":417657,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":81188,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":35485,"spinlock_wait_cycles":10852096,"thread_start_us":500473,"threads_started":2,"wal-append.queue_time_us":434604}
W20260709 12:23:54.008574 12849 log.cc:927] Time spent T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.279s	user 0.001s	sys 0.001s
I20260709 12:23:54.014948 12698 raft_consensus.cc:3055] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:54.015381 11676 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:23:54.017880 11098 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:23:54.019380 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.015765 12711 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:54.010176 11025 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:53.958729 12621 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:54.006990 12675 consensus_meta.cc:287] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.000s
I20260709 12:23:54.023931 12817 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.024302 12747 raft_consensus.cc:2749] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:54.014235 12860 raft_consensus.cc:697] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:54.021603 12833 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:54.026834 11052 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52804 (request call id 208) took 1548 ms (client timeout 1976 ms). Trace:
W20260709 12:23:54.028074 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.028582 11023 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:53.986517 11674 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:23:53.972863 12694 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.038045 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:54.073752 11058 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 5.
I20260709 12:23:53.972390 12742 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.009829 12857 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:54.052078 11098 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:54.016420 12821 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:54.020279 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1631) took 1178 ms. Trace:
I20260709 12:23:54.059648 11024 leader_election.cc:400] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5.
W20260709 12:23:54.060119 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 50058.8us
I20260709 12:23:54.006175 12763 consensus_queue.cc:1059] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:23:54.000311 12716 consensus_queue.cc:1048] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:23:54.021584 12790 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.137668 12716 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.138465 12790 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:54.061774 11127 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:54.006525 12574 consensus_queue.cc:1048] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:23:54.140618 12699 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:54.068316 12878 raft_consensus.cc:2804] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:54.005084 12735 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:53.992889 12761 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.003144 12462 consensus_queue.cc:1059] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:23:54.047482 12698 raft_consensus.cc:740] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
W20260709 12:23:54.074523 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 46039.3us
I20260709 12:23:54.075871 12703 raft_consensus.cc:2804] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:54.150820 12703 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:54.151268 12703 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:54.152493 11130 raft_consensus.cc:1275] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:54.153158 12790 raft_consensus.cc:3055] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:54.030652 12791 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.083885 11098 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:23:54.153556 12790 raft_consensus.cc:740] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:23:54.153976 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 70189.9us
I20260709 12:23:54.154525 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:54.155262 12687 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:54.155709 11098 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:54.156175 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 192) took 2364 ms. Trace:
I20260709 12:23:54.156564 10980 rpcz_store.cc:276] 0709 12:23:51.791939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.286677 (+494738us) service_pool.cc:224] Handling call
0709 12:23:52.841501 (+554824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:52.863949 (+ 22448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.155975 (+1292026us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b5400229050. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:54.156112 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1275125632}
I20260709 12:23:54.059513 12851 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:54.150167 12698 consensus_queue.cc:260] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:54.160723 12880 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:54.177554 12880 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.177937 12880 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:54.067657 12723 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:54.078166 12717 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:54.089438 12852 raft_consensus.cc:2804] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:23:54.105145 12867 log.cc:927] Time spent T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:23:54.063987 12875 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:23:54.105985 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1465) took 1193 ms. Trace:
I20260709 12:23:54.106500 12876 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.107170 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:54.107138 11025 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:54.108317 12389 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.109579 12471 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.112668 10981 raft_consensus.cc:1275] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:23:54.119015 12869 log.cc:927] Time spent T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:23:54.218199 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1071) took 1961 ms. Trace:
I20260709 12:23:54.119858 12860 consensus_queue.cc:237] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.122063 12621 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:54.124140 12694 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:54.218945 12394 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:54.219462 12694 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.220001 12694 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:54.204267 11126 rpcz_store.cc:276] 0709 12:23:52.912940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.919923 (+  6983us) service_pool.cc:224] Handling call
0709 12:23:52.920296 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:52.920523 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:52.920551 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:52.921043 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 12:23:53.328124 (+407081us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:53.337522 (+  9398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.346396 (+  8874us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:54.105701 (+759305us) raft_consensus.cc:1685] finished
0709 12:23:54.105723 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:54.105912 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":360778,"threads_started":1,"wal-append.queue_time_us":699470}
I20260709 12:23:54.127549 12833 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:54.123584 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:54.128803 12868 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.099704 12774 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.219403 12394 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.222668 12868 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:54.134506 12821 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.065325 12675 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:54.068066 11052 rpcz_store.cc:269] 0709 12:23:52.478170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.481059 (+  2889us) service_pool.cc:224] Handling call
0709 12:23:54.026649 (+1545590us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b54003714d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:54.026771 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":673752960}
I20260709 12:23:54.102771 11644 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:23:54.224349 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 121660us
I20260709 12:23:54.202719 12698 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:54.141844 12878 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.125735 12260 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:54.148473 12685 consensus_queue.cc:260] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.152410 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:54.098816 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:54.160065 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:54.239595 11058 raft_consensus.cc:2393] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 4: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:54.163457 11645 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:54.167567 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1072) took 1546 ms. Trace:
I20260709 12:23:54.170701 12857 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.173419 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1069) took 2037 ms. Trace:
I20260709 12:23:54.082888 10977 rpcz_store.cc:276] 0709 12:23:52.842266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.753518 (+911252us) service_pool.cc:224] Handling call
0709 12:23:53.774854 (+ 21336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:53.775062 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:23:53.775339 (+   277us) log.cc:844] Serialized 14 byte log entry
0709 12:23:53.975549 (+200210us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:53.982729 (+  7180us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:53.987165 (+  4436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.001149 (+ 13984us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:54.017476 (+ 16327us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":575,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":7101,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":9018,"thread_start_us":185039,"threads_started":1,"wal-append.queue_time_us":231031}
I20260709 12:23:54.250547 10979 rpcz_store.cc:276] 0709 12:23:52.136277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.895646 (+759369us) service_pool.cc:224] Handling call
0709 12:23:53.759764 (+864118us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:53.762518 (+  2754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.173165 (+410647us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b54001a0c50. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:54.173339 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1963317504}
I20260709 12:23:54.227468 12694 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:54.175817 12791 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:54.176955 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:54.225065 11674 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:23:54.262610 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:54.099184 11132 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
W20260709 12:23:54.263196 12840 log.cc:927] Time spent T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 12:23:54.263424 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:54.245548 10975 rpcz_store.cc:276] 0709 12:23:52.620964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.663640 (+ 42676us) service_pool.cc:224] Handling call
0709 12:23:54.167349 (+1503709us) spinlock_profiling.cc:243] Waited 76.9 ms on lock 0x7b540035f054. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:54.167490 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176867072}
I20260709 12:23:54.264945 12600 consensus_queue.cc:1048] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:54.104899 12742 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:54.266407 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:54.267617 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:54.267714 12711 raft_consensus.cc:2749] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5.
I20260709 12:23:54.268325 11129 raft_consensus.cc:2393] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:54.269122 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:54.190078 12717 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.269663 11129 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:23:54.187844 11133 raft_consensus.cc:1240] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 4. Current term is 5. Ops: []
W20260709 12:23:54.270252 12883 log.cc:927] Time spent T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.148s	user 0.000s	sys 0.003s
I20260709 12:23:54.270864 12600 consensus_queue.cc:1059] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:54.271442 12717 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:54.245575 12878 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:54.271745 12600 consensus_queue.cc:1048] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:23:54.273577 12873 log.cc:927] Time spent T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.151s	user 0.000s	sys 0.002s
I20260709 12:23:54.184201 12723 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:54.214568 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.274144 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:54.274956 11056 raft_consensus.cc:2393] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 4: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:54.275244 12851 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.275570 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:54.275763 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:54.249637 12816 consensus_queue.cc:1059] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:23:54.276222 11057 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:54.276650 11060 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 5.
I20260709 12:23:54.209513 12735 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:54.188750 12852 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:54.217046 12635 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:23:54.217885 12471 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.206893 12533 raft_consensus.cc:3055] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:54.125859 12817 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:54.130829 12827 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.132063 12826 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.138352 12716 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.218611 10981 rpcz_store.cc:276] 0709 12:23:52.256879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.903581 (+646702us) service_pool.cc:224] Handling call
0709 12:23:54.112059 (+1208478us) spinlock_profiling.cc:243] Waited 920 us on lock 0x7b5800003698. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90dbdfc0 00007f8f90da8929 00007f8f90da83d2 00007f8f8a31fbd4
0709 12:23:54.112288 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:54.217860 (+105572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.218134 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2114944}
I20260709 12:23:54.226691 12730 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:54.228268 12260 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.219640 12389 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:54.229184 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:54.231084 11051 raft_consensus.cc:1240] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:54.233561 12675 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:54.205042 12834 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:54.239486 11055 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:23:54.160761 12699 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:54.223179 12394 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:54.247110 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 83755.4us
I20260709 12:23:54.249514 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:54.174772 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:23:54.361765 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 91680.1us
I20260709 12:23:54.222817 12774 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.258715 11134 raft_consensus.cc:1275] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:23:54.259585 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.260407 12621 consensus_queue.cc:1048] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:54.260834 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:54.209437 12676 consensus_queue.cc:1048] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 12:23:54.363425 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.261114 12751 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:54.261265 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:54.264091 11674 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:23:54.271010 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:54.213680 12876 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:54.216317 12462 consensus_queue.cc:1048] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:54.100935 12838 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:54.013379 10982 rpcz_store.cc:276] 0709 12:23:52.741600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.745017 (+1003417us) service_pool.cc:224] Handling call
0709 12:23:53.773324 (+ 28307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:53.773508 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:23:53.773874 (+   366us) log.cc:844] Serialized 14 byte log entry
0709 12:23:53.983992 (+210118us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:53.984041 (+    49us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:53.984081 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.984146 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:53.984260 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3308,"prepare.queue_time_us":671,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":15171,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":18191,"thread_start_us":196664,"threads_started":1}
I20260709 12:23:54.154536 12790 consensus_queue.cc:260] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.276333 11056 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
W20260709 12:23:54.213780 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 106709us
I20260709 12:23:54.281217 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:54.276585 12816 consensus_queue.cc:1243] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Peer 7518bdeb78f24e67a530754ae48547eb log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:23:54.263051 12857 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:54.257304 12465 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:54.274235 12723 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:54.261170 12821 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:54.333498 11098 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:23:54.279321 12694 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.262635 12868 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:54.273607 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:54.288477 12742 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.290653 12852 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:54.347270 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.291285 12823 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:54.349295 12260 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.316221 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:23:54.353518 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 151176us
I20260709 12:23:54.328346 12533 raft_consensus.cc:740] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:54.275768 12851 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.443693 12533 consensus_queue.cc:260] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:54.446631 12892 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.446806 12533 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:54.447211 12892 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:54.291543 12836 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:54.449702 12892 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:54.449908 12836 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:54.448288 12703 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:54.450560 12836 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.451345 11056 raft_consensus.cc:1240] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:54.452730 12836 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:54.330292 12711 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.252343 11130 raft_consensus.cc:1275] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:54.352620 12860 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.352378 12730 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:54.367331 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:54.351477 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:54.368218 11133 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 4.
I20260709 12:23:54.357576 12699 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.377916 11025 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:23:54.378716 12881 log.cc:927] Time spent T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 12:23:54.379541 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:54.379992 12471 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:54.381276 12389 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:54.383349 12716 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:54.350217 12826 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.384225 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:54.493232 11134 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 1.
I20260709 12:23:54.371176 11052 raft_consensus.cc:2393] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 3: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:54.354357 12862 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:54.368316 11677 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:23:54.343091 12827 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.390964 12763 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.398187 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1067) took 2288 ms. Trace:
I20260709 12:23:54.399803 10949 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:54.401293 11024 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
W20260709 12:23:54.401831 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 68437.7us
I20260709 12:23:54.500288 10978 rpcz_store.cc:276] 0709 12:23:52.134188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.836484 (+702296us) service_pool.cc:224] Handling call
0709 12:23:53.772577 (+936093us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:53.821957 (+ 49380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.397923 (+575966us) spinlock_profiling.cc:243] Waited 936 ms on lock 0x7b5400229550. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:54.398090 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2152019200}
I20260709 12:23:54.406276 12863 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:54.386590 12870 log.cc:927] Time spent T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.325s	user 0.003s	sys 0.003s
I20260709 12:23:54.437626 12887 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:23:54.440941 11023 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
W20260709 12:23:54.505481 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 64627.1us
I20260709 12:23:54.439636 11675 raft_consensus.cc:2393] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 2: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:23:54.443509 12260 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:54.364604 12817 consensus_queue.cc:1048] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:23:54.328477 12639 raft_consensus.cc:3055] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:54.376587 12865 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:54.408169 12857 raft_consensus.cc:2804] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:54.481812 11125 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:54.465523 12868 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.484110 12898 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:54.485106 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 107272us
I20260709 12:23:54.454526 12703 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:54.489322 12699 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:54.492758 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.482213 12790 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:54.403292 12694 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.509407 12471 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:54.444802 12823 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:54.501744 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 100522us
I20260709 12:23:54.536572 11098 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:54.486054 12730 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:54.507952 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 108228us
I20260709 12:23:54.536892 11024 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:54.537899 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:54.491650 12533 raft_consensus.cc:2804] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:54.539177 10978 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:54.516474 12751 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:54.511068 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.515980 12862 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.521668 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:54.521359 12863 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:54.523238 11025 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:54.507366 12389 raft_consensus.cc:2804] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:54.490499 12860 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:54.484252 10975 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:54.533459 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:54.517692 12857 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.516013 12866 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.441254 12742 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.483129 12711 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:54.511170 12639 raft_consensus.cc:740] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:54.496239 12465 raft_consensus.cc:697] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:54.539271 10949 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:54.508626 12901 raft_consensus.cc:2804] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:54.539235 11645 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:54.546304 12821 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.541447 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:23:54.542415 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 132708us
I20260709 12:23:54.572603 10980 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:54.548763 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:54.505534 12763 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:54.544925 10948 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:54.545168 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:54.556854 12857 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:54.548372 11025 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:54.580179 11058 raft_consensus.cc:1240] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:54.543741 12716 consensus_queue.cc:1048] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:23:54.552368 11643 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:54.541432 12533 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.545527 12703 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.560431 12905 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.527556 12868 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.544200 12471 raft_consensus.cc:697] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:54.561193 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:54.564191 11645 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:54.563427 12901 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:54.566737 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:54.570473 12708 raft_consensus.cc:2804] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:54.570411 12866 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.542613 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:54.554844 12462 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:54.553145 12838 raft_consensus.cc:2804] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:54.576253 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:54.529976 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:54.577942 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:54.578701 12893 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:54.581210 11025 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:54.535813 11678 raft_consensus.cc:1275] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:54.562338 12774 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:54.557945 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:54.592492 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:54.714120  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:54.546670 12751 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:54.555972 12389 raft_consensus.cc:697] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:54.571252 12639 consensus_queue.cc:260] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.528951 12898 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:54.554649 12746 consensus_queue.cc:1048] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:23:54.517253 12761 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:54.598956 10982 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:54.599699 12708 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.599496 12905 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.600065 12823 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:54.600469 12906 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:54.596269 12703 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.600802 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:54.590978 12533 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:54.601101 12891 raft_consensus.cc:2804] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:54.574764 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:54.756776 10975 raft_consensus.cc:2393] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 2: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:54.756690 12906 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:54.757854 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:54.758553 10975 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 1.
I20260709 12:23:54.759011 12906 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:54.759486 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:54.760142 10975 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:54.602295 10984 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:23:54.598678 10978 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:54.604702 12471 consensus_queue.cc:237] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:54.608518 12880 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.578625 12909 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.577742 12821 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:54.677755 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.616194 11023 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:23:54.768795 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 152704us
I20260709 12:23:54.570621 12899 raft_consensus.cc:2804] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:54.684525 11056 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 3.
I20260709 12:23:54.623235 11097 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:54.686537 10980 raft_consensus.cc:2393] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 3: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
W20260709 12:23:54.770483 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 147339us
I20260709 12:23:54.585474 12887 raft_consensus.cc:2749] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:54.686913 12462 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:54.690376 12890 log.cc:927] Time spent T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
W20260709 12:23:54.690016 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 125902us
I20260709 12:23:54.755704 12910 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:23:54.715397 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 134286us
I20260709 12:23:54.750837 12868 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:54.612643 12465 consensus_queue.cc:237] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:54.626535 12897 log.cc:927] Time spent T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:23:54.623677 11052 raft_consensus.cc:1275] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:54.609958 12826 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:54.613241 12716 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.622839 12860 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:54.613057 12742 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:54.621206 12827 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:54.613926 12876 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:54.615363 12711 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:54.714497 10977 raft_consensus.cc:2410] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:23:54.792042 12716 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.793587 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:54.615139 12694 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:54.768462 12891 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:54.745837 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 203036us
I20260709 12:23:54.613391 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:54.624347 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:54.634874 12901 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:54.691063 12838 raft_consensus.cc:697] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:54.778069 12462 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:54.753326 12893 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.683588 12817 consensus_queue.cc:1048] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
W20260709 12:23:54.761816 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:54.763250 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.764264 10983 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:23:54.737787 12774 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.714871 11674 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 5.
I20260709 12:23:54.770967 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:54.769511 11023 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:54.775945 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:54.547545 12862 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:54.761785 12639 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:54.788534 12909 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.847574 12909 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:54.848625 12838 consensus_queue.cc:237] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.782080 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:54.753546 12708 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:54.851286 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:23:54.786397 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.855077 11059 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:54.856117 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:54.856307 11126 raft_consensus.cc:1240] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:23:54.856786 12903 log.cc:927] Time spent T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:23:54.857395 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:54.855265 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:23:54.787952 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.755970 12912 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:54.778221 12735 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:54.778559 12761 raft_consensus.cc:2804] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:54.774900 12899 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.803385 11643 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:54.802829 12676 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.844884 12880 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:54.797763 12389 consensus_queue.cc:237] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.805927 12685 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:54.807094 12835 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:54.807519 12911 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:54.809620 12851 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:54.809932 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:54.810917 12896 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.812249 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:54.914176 11679 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:54.815375 12898 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:54.815652 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:54.815920 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:54.817334 12763 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:54.883647 12899 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:54.818827 12751 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:54.819353 12905 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:54.821615 12723 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:54.799290 12891 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:54.803784 10976 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:54.823367 12866 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:54.827518 11055 raft_consensus.cc:1240] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:23:54.830786 12742 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.829869 12600 consensus_queue.cc:1059] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:54.831142 11129 raft_consensus.cc:1275] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:54.833415 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:54.867956 12774 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.788935 12675 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:54.836002 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 66572us
I20260709 12:23:54.842521 12716 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:54.827992 12865 consensus_queue.cc:1048] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:23:54.844599 10979 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:54.880211 10948 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:23:54.882217 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 78925.7us
I20260709 12:23:54.952260 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:54.945304 12698 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:54.916967 12852 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:54.883853 11134 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:54.955989 12852 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:54.956557 12912 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.956331 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:54.957484 12912 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:54.959139 12857 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.795768 12868 consensus_queue.cc:1048] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 12:23:54.857580 12746 raft_consensus.cc:2804] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:54.800285 12918 consensus_queue.cc:1048] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 12:23:54.881771 12735 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:54.857231 12893 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:54.960774 12462 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:54.887053 12909 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:54.879252 12863 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:54.913383 12911 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:54.938982 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 337290us
I20260709 12:23:54.912424 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:54.943133 10984 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:54.832883 10980 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:23:54.946975 11023 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:54.947834 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:55.018064 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:23:54.948331 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 151633us
I20260709 12:23:54.922933 11672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41774 (request call id 344) took 1044 ms. Trace:
W20260709 12:23:54.963838 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 83730us
I20260709 12:23:54.945930 12763 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.856021 11052 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:23:54.895172 12676 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.884635 12761 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:54.952507 12898 raft_consensus.cc:3055] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:54.951103 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:54.953787 12675 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.777300 12878 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:54.965250 12703 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:54.939066 12896 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:54.947049 12742 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:54.975392 12876 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.963541 12746 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:55.156895 12746 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:55.157745 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:55.158610 11126 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:55.159847 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:55.160650 12708 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:55.161237 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:23:55.056551 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 109679us
I20260709 12:23:55.162935 12723 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:54.954455 12698 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:54.974568 12716 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:55.095355 12898 raft_consensus.cc:740] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:55.164252 12716 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:23:55.050324 12919 log.cc:927] Time spent T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:23:55.006309 12735 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:55.020174 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 239935us
I20260709 12:23:55.050904 12857 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:55.163576 12462 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:55.169258 10975 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
W20260709 12:23:55.169445 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.059290 10949 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:55.051645 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:55.070573 10980 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 4.
I20260709 12:23:55.020115 12512 consensus_queue.cc:1048] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 12:23:55.050436 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:55.179077 11057 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 3.
I20260709 12:23:55.092461 11052 raft_consensus.cc:606] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:55.182888 11052 raft_consensus.cc:614] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:55.183241 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:55.184196 11126 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:55.185207 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:55.063827 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:55.063725 12635 raft_consensus.cc:2804] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:55.018247 11130 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:55.177913 12694 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:23:55.105468 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.188463 12635 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:55.188922 12635 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:55.190268 12751 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.190820 12821 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:55.191015 11055 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:55.190845 12751 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:55.116510 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1614) took 1175 ms. Trace:
I20260709 12:23:55.118580 12675 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:55.119321 12912 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:54.964239 12901 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:55.194178 12871 log.cc:927] Time spent T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 1.051s	user 0.000s	sys 0.015s
I20260709 12:23:55.193742 12751 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:55.095302 12892 consensus_queue.cc:1048] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:23:55.195690 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:55.195915 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:55.122207 12574 raft_consensus.cc:3055] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:55.196591 10977 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:55.196898 12574 raft_consensus.cc:740] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:55.125377 12918 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.198112 12918 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:55.199410 12878 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:23:55.199849 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.126986 11054 raft_consensus.cc:1240] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:23:55.200341 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.128539 11679 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:23:55.201851 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:55.129092 12533 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:55.133059 12774 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:55.139997 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:54.956017 12699 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:55.092103 12761 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:55.163688 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:55.164760 12716 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:55.197789 12730 consensus_meta.cc:287] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.652s	user 0.004s	sys 0.003s
I20260709 12:23:55.172879 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:55.170977 11673 raft_consensus.cc:2393] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 3: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:23:55.206284 10982 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
W20260709 12:23:55.174216 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 115013us
I20260709 12:23:55.060129 11644 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:55.096151 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:55.180730 12717 raft_consensus.cc:2804] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:55.181450 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:55.181963 11051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1404) took 2223 ms. Trace:
I20260709 12:23:55.184075 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:23:55.293335 12394 consensus_meta.cc:287] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.926s	user 0.011s	sys 0.000s
I20260709 12:23:55.164935 12898 consensus_queue.cc:260] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:55.186954 12694 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:55.297227 12751 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:54.971058 11128 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:55.191855 12708 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:55.024950 12911 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:55.196352 10983 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:23:55.100113 12835 raft_consensus.cc:697] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:55.193104 11131 rpcz_store.cc:276] 0709 12:23:53.940963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.941150 (+   187us) service_pool.cc:224] Handling call
0709 12:23:53.970197 (+ 29047us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:54.819211 (+849014us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b180031d440. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f8b98c4bc 00007f8f88cda48b 00007f8f91b349a9 00007f8f88cf669b 00007f8f88cf493f 00007f8f88cf4455 00007f8f8bddc060 00007f8f8bddcbfb 00007f8f8bde764b
0709 12:23:54.819363 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:54.819390 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:54.819927 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 12:23:54.922682 (+102755us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:54.942293 (+ 19611us) log.cc:844] Serialized 14 byte log entry
0709 12:23:54.942494 (+   201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.942563 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:55.116187 (+173624us) raft_consensus.cc:1685] finished
0709 12:23:55.116292 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:55.116439 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6213,"prepare.queue_time_us":17876,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":3012,"raft.queue_time_us":12125,"raft.run_cpu_time_us":408,"raft.run_wall_time_us":36634,"spinlock_wait_cycles":25609472,"thread_start_us":161751,"threads_started":2,"wal-append.queue_time_us":187199}
I20260709 12:23:55.163750 11023 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:55.296942 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:55.298293 10980 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:55.304062 12891 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:55.395066 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:55.391235 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:55.395695 10980 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 5.
I20260709 12:23:55.396277 11681 raft_consensus.cc:2410] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEARNER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:23:55.396559 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:55.299458 10949 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:55.304318 12899 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:55.303531 12730 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:55.092334 12763 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:55.400847 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.056986 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:55.328918 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:55.401615 10981 raft_consensus.cc:2393] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 5: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:55.339713 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:23:55.365046 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.294411 12892 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:23:55.368425 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 308371us
I20260709 12:23:55.403858 11644 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:55.164726 12876 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:55.338702 11127 raft_consensus.cc:2393] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 6: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:55.405478 11644 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:55.369451 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:55.187196 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:55.334455 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:55.338984 11674 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:55.307633 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:23:55.386337 12840 log.cc:927] Time spent T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.077s	user 0.006s	sys 0.003s
I20260709 12:23:55.397168 10980 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:55.338461 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:55.402168 10984 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:55.393996 11676 raft_consensus.cc:2410] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:23:55.403748 12893 consensus_queue.cc:1048] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:55.308622 12717 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.427291 11024 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:55.406426 11130 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:55.406478 11129 raft_consensus.cc:2393] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:23:55.401015 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 101652us
I20260709 12:23:55.197829 12574 consensus_queue.cc:260] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:55.341045 12394 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:55.407086 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 243397us
I20260709 12:23:55.438489 11023 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:55.411814 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:55.412226 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:55.440285 10984 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 3.
I20260709 12:23:55.440469 11023 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:55.418601 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:55.419224 12899 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:23:55.420107 12925 log.cc:927] Time spent T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:23:55.420549 12389 raft_consensus.cc:2804] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:55.421021 12730 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:55.389236 12742 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:55.387601 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:55.456800 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:55.457537 11679 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:55.398190 12735 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:55.457942 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:55.425913 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:55.458670 10981 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:55.459039 10983 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 3.
I20260709 12:23:55.404284 11098 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:23:55.426435 10978 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:55.393654 12737 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:55.437083 12816 raft_consensus.cc:2804] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:55.431378 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:55.328508 11051 rpcz_store.cc:276] 0709 12:23:52.959001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.969051 (+ 10050us) service_pool.cc:224] Handling call
0709 12:23:53.052389 (+ 83338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:54.230883 (+1178494us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540003da20. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bd5bdc0 00007f8f8bde61c0 00007f8f8bde7231 00007f8f8bde3d8f 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c
0709 12:23:54.357357 (+126474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:55.181593 (+824236us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b540003da20. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bd5bdc0 00007f8f8bde7a02 00007f8f8bde3dd6 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2
0709 12:23:55.181880 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2585625216}
I20260709 12:23:55.440171 10980 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:55.400120 12918 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:55.446676 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:55.409461 12916 raft_consensus.cc:2749] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:55.447644 11023 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:55.434543 12905 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:55.442080 12675 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:55.435160 12717 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:55.446483 12929 raft_consensus.cc:2804] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:55.435634 12533 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:55.461189 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:55.442951 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:55.465294 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:55.435055 11677 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
W20260709 12:23:55.450896 12932 log.cc:927] Time spent T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:23:55.464128 11681 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 5.
I20260709 12:23:55.466460 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:55.397075 12751 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:55.446947 12574 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:55.468217 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:55.514585 11057 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:55.515339 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:55.515691 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:55.443517 12921 raft_consensus.cc:2804] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:55.423190 12892 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:55.472303 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 84019.4us
I20260709 12:23:55.451329 12389 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:55.460032 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 55822.7us
W20260709 12:23:55.474020 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.437215 12774 consensus_queue.cc:1048] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:23:55.535063 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:55.481063 11679 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:23:55.471807 12462 raft_consensus.cc:2804] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:55.538241 11097 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:55.454991 12928 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:55.465786 12857 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:55.484138 11129 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:55.546993 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:55.486991 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:55.547851 11679 raft_consensus.cc:2393] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:55.491436 11060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52804 (request call id 217) took 1382 ms. Trace:
I20260709 12:23:55.539343 12462 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:55.499390 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.477774 12929 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.538586 11098 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:23:55.469053 12835 consensus_queue.cc:237] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:55.514565 10976 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:55.543022 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:55.534252 12921 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.539417 12918 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:55.547964 10981 raft_consensus.cc:2393] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 5: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:55.469936 12905 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.469709 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:55.548367 11060 rpcz_store.cc:276] 0709 12:23:54.109003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.123240 (+ 14237us) service_pool.cc:224] Handling call
0709 12:23:55.491252 (+1368012us) spinlock_profiling.cc:243] Waited 54 ms on lock 0x7b54003714d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:55.491375 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124286720}
I20260709 12:23:55.552644 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:55.549041 12923 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:55.556728 12878 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:55.616561 12905 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:55.535506 12896 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:55.561946 11025 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
W20260709 12:23:55.659977 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 98088.8us
I20260709 12:23:55.538129 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:55.661746 11025 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:55.091507 11672 rpcz_store.cc:276] 0709 12:23:53.878735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.881316 (+  2581us) service_pool.cc:224] Handling call
0709 12:23:54.169662 (+288346us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b5800004598. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90dbdfc0 00007f8f90da8929 00007f8f90da83d2 00007f8f8a31fbd4
0709 12:23:54.169922 (+   260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:54.170462 (+   540us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:54.170496 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:54.171069 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 12:23:54.352658 (+181589us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:54.356382 (+  3724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.360094 (+  3712us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:54.857737 (+497643us) raft_consensus.cc:1685] finished
0709 12:23:54.857768 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:54.917556 (+ 59788us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1300,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":126,"spinlock_wait_cycles":36434176,"thread_start_us":162660,"threads_started":1,"wal-append.queue_time_us":271013}
I20260709 12:23:55.546659 12928 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.565862 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:55.545507 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:55.578022 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:55.578756 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:55.694248 11130 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:55.541131 11097 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:23:55.695305 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 154235us
W20260709 12:23:55.697145 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.546119 12857 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:55.697852 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:55.615593 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:55.703761 11060 raft_consensus.cc:2393] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:55.551661 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:55.584803 11681 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:23:55.551148 12462 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:55.622210 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 197259us
W20260709 12:23:55.623143 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 66686.3us
I20260709 12:23:55.631964 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:55.708647 10981 raft_consensus.cc:2410] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:23:55.556933 12929 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:55.538972 12389 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:55.648064 12876 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:55.618501 12918 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:55.648802 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:55.626542 12923 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:55.652518 12735 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:55.566198 12921 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:55.736054 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:55.737195 10981 raft_consensus.cc:2393] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 2: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:55.674108 12875 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:55.700913 11025 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:55.487102 12909 raft_consensus.cc:2749] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:55.704694 11679 raft_consensus.cc:1240] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:55.707108 11058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1085) took 1730 ms. Trace:
I20260709 12:23:55.519474 12699 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:55.710223 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:55.710583 11643 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:23:55.750332 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 49516.8us
I20260709 12:23:55.750943 11643 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:55.658565 12763 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:55.664465 12675 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:55.651672 12892 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:55.636138 12746 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:55.669706 12394 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:55.707238 12857 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:55.746693 11058 rpcz_store.cc:276] 0709 12:23:53.976657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.368673 (+392016us) service_pool.cc:224] Handling call
0709 12:23:54.368973 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:54.580673 (+211700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:55.706867 (+1126194us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b5400187ed4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:55.707047 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":485277568}
I20260709 12:23:55.699764 12928 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:55.754855 11643 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:55.644582 12635 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:55.756143 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:55.769614 11130 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:23:55.757848 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:55.760195 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:55.770970 10981 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:23:55.714654 12896 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.765952 11054 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 5.
I20260709 12:23:55.736181 12923 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:55.745692 12875 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.763276 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:55.769797 11643 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:55.772270 11060 raft_consensus.cc:2393] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 3: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:55.756471 12876 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:55.793046 11058 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 4.
W20260709 12:23:55.794832 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 86804.9us
I20260709 12:23:55.758489 12730 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:55.796758 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:55.757025 10976 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:23:55.798269 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:55.798707 12730 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.799106 12941 consensus_queue.cc:1048] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:23:55.805298 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.806985 12862 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:55.808832 11125 raft_consensus.cc:1275] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 12:23:55.810477 10982 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1651) took 1206 ms (client timeout 1517 ms). Trace:
W20260709 12:23:55.810881 10982 rpcz_store.cc:269] 0709 12:23:54.603770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.761967 (+158197us) service_pool.cc:224] Handling call
0709 12:23:55.810286 (+1048319us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b540035eb54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:55.810418 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":818302848}
I20260709 12:23:55.811470 12635 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:55.812129 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:55.813354 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:55.815436 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:55.815306 12911 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:55.816697 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:55.793967 12896 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:55.820043 10981 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:23:55.809890 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:55.821897 11125 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:55.817803 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:55.822752 11130 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:23:55.823029 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:55.823689 11056 raft_consensus.cc:2393] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:55.823681 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:55.825999 11130 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:55.826798 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:55.817705 12911 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:55.794778 12876 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.797513 12893 raft_consensus.cc:2804] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:55.796089 12875 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:55.796380 12909 raft_consensus.cc:2804] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:55.797240 12940 raft_consensus.cc:2804] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:55.817713 11678 raft_consensus.cc:2393] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 4: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:23:55.767921 12761 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:55.842658 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:55.922142 11681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41784 (request call id 452) took 1116 ms. Trace:
W20260709 12:23:55.871294 12685 consensus_meta.cc:287] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.974s	user 0.010s	sys 0.001s
I20260709 12:23:55.839040 12896 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:55.835978 12909 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.873505 12929 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:55.874612 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:55.922593 11681 rpcz_store.cc:276] 0709 12:23:54.805600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:55.704565 (+898965us) service_pool.cc:224] Handling call
0709 12:23:55.704818 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:55.705022 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:55.857911 (+152889us) log.cc:844] Serialized 14 byte log entry
0709 12:23:55.921718 (+ 63807us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:55.921777 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:55.921825 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:55.921899 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:55.922028 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":186799,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"thread_start_us":197825,"threads_started":2,"wal-append.queue_time_us":54105}
I20260709 12:23:55.833384 12876 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:55.932677 11051 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:55.933080 12929 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:55.865696 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:23:55.865815 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.839507 12751 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:55.867069 12635 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:55.887658 12936 log.cc:927] Time spent T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.367s	user 0.002s	sys 0.000s
W20260709 12:23:55.888402 11675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41784 (request call id 441) took 1701 ms (client timeout 1615 ms). Trace:
I20260709 12:23:55.893244 10975 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 4.
I20260709 12:23:55.933960 11057 raft_consensus.cc:2393] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 3: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
W20260709 12:23:55.936443 11675 rpcz_store.cc:269] 0709 12:23:54.193969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.262340 (+ 68371us) service_pool.cc:224] Handling call
0709 12:23:55.888162 (+1625822us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b540049ff54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:55.888328 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":365062016}
I20260709 12:23:55.873689 12918 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:55.896497 11125 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:23:55.906379 12921 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:55.906401 11053 raft_consensus.cc:1275] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:55.909479 12533 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.865410 12868 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:55.916401 12928 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:55.844076 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:55.928143 10976 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:55.920094 12940 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:55.913478 12923 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:55.835546 12893 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:55.927364 11680 raft_consensus.cc:1275] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:23:55.919305 12716 consensus_meta.cc:287] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.610s	user 0.009s	sys 0.002s
I20260709 12:23:55.803210 12730 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:55.937813 11056 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:55.939150 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.940809 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:55.941921 11131 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 2.
I20260709 12:23:55.936549 12635 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:55.928346 12909 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:55.946718 10982 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:55.919004 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:55.943472 12717 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:55.948156 12921 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:55.948628 12868 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:55.951411 11059 raft_consensus.cc:2368] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 5. Current term is 6.
W20260709 12:23:55.939527 11126 consensus_meta.cc:287] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.755s	user 0.009s	sys 0.002s
I20260709 12:23:55.952441 12940 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:55.955323 12908 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.957927 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:55.984930 10980 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:23:55.985567 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1077) took 1413 ms. Trace:
W20260709 12:23:55.959692 11673 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41784 (request call id 446) took 1452 ms (client timeout 1818 ms). Trace:
I20260709 12:23:55.960295 12876 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:55.962294 11129 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 4.
I20260709 12:23:55.955195 12928 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:55.963948 12923 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:55.968508 12912 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:55.976977 11130 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:55.982484 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:55.930259 12905 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:55.985922 10980 rpcz_store.cc:276] 0709 12:23:54.572166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:55.957604 (+1385438us) service_pool.cc:224] Handling call
0709 12:23:55.985503 (+ 27899us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:55.993860 11644 leader_election.cc:336] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Timed out: RequestConsensusVote RPC to 127.9.145.194:44483 timed out after 1.976s (SENT)
W20260709 12:23:55.987145 11673 rpcz_store.cc:269] 0709 12:23:54.507430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.544118 (+ 36688us) service_pool.cc:224] Handling call
0709 12:23:55.959398 (+1415280us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b54006757d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:55.959603 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":969811200}
I20260709 12:23:55.995435 12717 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:55.946862 12533 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:56.027211 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:56.027999 12533 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:23:56.028353 12930 log.cc:927] Time spent T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.574s	user 0.000s	sys 0.010s
I20260709 12:23:56.029090 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:56.030089 11130 raft_consensus.cc:2410] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:23:56.030660 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58414 (request call id 195) took 1878 ms. Trace:
I20260709 12:23:56.031044 11127 rpcz_store.cc:276] 0709 12:23:54.152031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.152138 (+   107us) service_pool.cc:224] Handling call
0709 12:23:56.030484 (+1878346us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54000eabd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:56.030604 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2506914176}
I20260709 12:23:56.031605 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:56.032171 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:56.032716 11127 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:56.032905 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:56.033672 11130 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:56.038050 11023 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:56.038322 12676 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:56.039300 11023 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:56.039913 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:56.040210 12905 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:56.040491 11023 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:56.041077 12533 raft_consensus.cc:2804] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:56.040340 12928 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:56.041807 12928 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:56.042212 12928 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.042744 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:56.043334 11130 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:23:56.043571 12533 raft_consensus.cc:697] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:56.044543 12533 consensus_queue.cc:237] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:56.046177 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:55.993956 11056 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 4.
I20260709 12:23:56.023816 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:56.046922 10980 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:56.047269 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:56.048264 11056 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.048710 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 1624) took 1195 ms. Trace:
I20260709 12:23:56.046303 12929 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:56.049104 11134 rpcz_store.cc:276] 0709 12:23:54.853275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.854643 (+  1368us) service_pool.cc:224] Handling call
0709 12:23:56.048543 (+1193900us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b5400210a54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:56.048645 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59280128}
I20260709 12:23:56.050212 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:56.050988 11134 raft_consensus.cc:2393] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:56.053180 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:56.055377 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:56.049576 12929 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.056022 12929 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:56.058430 11098 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:23:56.059401 11098 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
W20260709 12:23:56.059597 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.060174 12699 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:56.060451 12923 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:56.060875 12923 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.061240 12923 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:56.061295 11060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:23:56.060684 12699 raft_consensus.cc:697] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 5 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:56.061970 11060 raft_consensus.cc:606] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:56.062451 11060 raft_consensus.cc:614] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:56.063009 12717 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:56.062806 12699 consensus_queue.cc:237] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:56.061810 12639 raft_consensus.cc:1064] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
W20260709 12:23:56.063930 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:56.064090 12639 raft_consensus.cc:1068] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb: Unable to promote non-voter 0f3b1ccd8aa5412393aa7eb90f2bef95: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:23:56.064507 12574 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.065007 12574 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:56.062597 12895 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.066464 12895 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:56.067020 12574 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:56.068524 12895 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:56.069535 10980 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:23:56.063700 12896 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.070479 12896 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:56.072440 12923 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:56.076786 12929 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:56.041320 11023 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:23:56.078299 12923 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:56.078516 12735 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.079066 12735 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:56.079718 12928 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:56.081147 12735 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:56.081461 12891 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:56.081763 12928 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:56.083137 11056 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 4.
I20260709 12:23:56.053967 11134 raft_consensus.cc:2410] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:56.094450 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:56.094774 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:56.095458 11134 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:56.096304 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:56.097008 11134 raft_consensus.cc:1240] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:56.097594 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1632) took 1092 ms. Trace:
I20260709 12:23:56.098774 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58414 (request call id 204) took 1152 ms. Trace:
I20260709 12:23:56.099134 11131 rpcz_store.cc:276] 0709 12:23:54.947425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:55.534515 (+587090us) service_pool.cc:224] Handling call
0709 12:23:56.098612 (+564097us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b5400066b54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:56.098716 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":546499840}
I20260709 12:23:56.100133 11056 raft_consensus.cc:2393] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 2: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:56.101008 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:56.101836 11056 raft_consensus.cc:2410] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:23:56.055974 11058 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:56.083634 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:56.085304 12929 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:56.086050 12898 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:55.976816 12716 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:56.045651 10881 catalog_manager.cc:5697] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 1 to 4, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 4 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:56.083132 11023 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
W20260709 12:23:56.128765 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 45704.6us
I20260709 12:23:56.129382 11023 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:23:56.091663 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.091739 12896 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:56.092003 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:56.138809 10980 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:56.097493 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:56.101630 11134 rpcz_store.cc:276] 0709 12:23:55.005352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.096575 (+1091223us) service_pool.cc:224] Handling call
0709 12:23:56.096852 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:56.097372 (+   520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:56.097544 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:56.142524 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:56.143200 11134 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:56.144197 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:56.145294 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:55.937796 12875 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:56.146220 12929 raft_consensus.cc:2804] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:56.146680 12929 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.147043 12929 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:56.147989 12875 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:56.148713 11680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41774 (request call id 341) took 2304 ms. Trace:
I20260709 12:23:56.149174 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:56.139636 12866 consensus_queue.cc:1059] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:23:56.150746 12790 raft_consensus.cc:2804] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:56.151255 12790 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.151454 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:56.151759 12790 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:56.152429 12635 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:56.153018 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:56.153589 11129 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:23:56.154294 12761 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:56.156260 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1477) took 1909 ms. Trace:
I20260709 12:23:56.150710 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:56.063529 11677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41762 (request call id 437) took 1380 ms. Trace:
I20260709 12:23:56.122244 11645 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:56.163734 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:56.165194 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:56.032980 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1628) took 1160 ms. Trace:
I20260709 12:23:56.022281 11125 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:23:55.984800 11126 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:56.089289 11127 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
W20260709 12:23:56.125787 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 65345.6us
I20260709 12:23:56.168632 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:56.041453 11676 raft_consensus.cc:2393] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 4: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:23:56.037562 12389 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:55.995958 12876 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:56.169867 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:56.064402 12816 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:56.167778 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 1631) took 1217 ms. Trace:
I20260709 12:23:56.171029 11126 rpcz_store.cc:276] 0709 12:23:54.950148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:55.182932 (+232784us) service_pool.cc:224] Handling call
0709 12:23:56.167712 (+984780us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:56.171617 11056 raft_consensus.cc:2393] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 3: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:56.172024 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:56.173418 12389 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:56.174052 10948 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:56.167814 11129 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:23:56.175560 11129 raft_consensus.cc:1240] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:56.135656 10949 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:56.119683 10982 raft_consensus.cc:2410] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:56.158588 11059 raft_consensus.cc:2393] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 3: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:56.177202 11129 raft_consensus.cc:1240] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:23:56.082012 12891 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:55.960522 12893 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.180222 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1074) took 1608 ms. Trace:
I20260709 12:23:56.180603 10982 rpcz_store.cc:276] 0709 12:23:54.571499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:55.828240 (+1256741us) service_pool.cc:224] Handling call
0709 12:23:56.180147 (+351907us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:56.181600 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.181541 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:23:56.182202 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.170442 11127 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:56.182228 10982 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:56.177700 11126 raft_consensus.cc:1240] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:23:56.186398 11126 raft_consensus.cc:1240] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:23:56.158941 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:56.190850 11060 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:56.191980 11060 raft_consensus.cc:1240] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:56.192528 11060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1417) took 1096 ms. Trace:
I20260709 12:23:56.192813 11060 rpcz_store.cc:276] 0709 12:23:55.096195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.191524 (+1095329us) service_pool.cc:224] Handling call
0709 12:23:56.191807 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:56.192319 (+   512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:56.192477 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:56.027768 12868 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:56.170631 12816 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.079435 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:56.151364 10881 catalog_manager.cc:5697] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 1 to 3, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 3 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:56.199841 10881 catalog_manager.cc:5697] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:56.149138 11680 rpcz_store.cc:276] 0709 12:23:53.844787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.844961 (+   174us) service_pool.cc:224] Handling call
0709 12:23:53.873033 (+ 28072us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:55.954399 (+2081366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:56.148408 (+194009us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b54004bee54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:56.148627 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4723570560}
I20260709 12:23:56.201498 10881 catalog_manager.cc:5697] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:56.162269 10980 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:23:56.205358 10881 catalog_manager.cc:5697] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 1 to 2, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 2 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:56.206193 11025 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:56.207613 11025 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:56.166010 11133 rpcz_store.cc:276] 0709 12:23:54.873130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.873386 (+   256us) service_pool.cc:224] Handling call
0709 12:23:54.873728 (+   342us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:54.882753 (+  9025us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:54.882791 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:54.896379 (+ 13588us) log.cc:844] Serialized 52 byte log entry
0709 12:23:55.023750 (+127371us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:55.023795 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:55.023873 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:56.027797 (+1003924us) spinlock_profiling.cc:243] Waited 4.73 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:23:56.032689 (+  4892us) raft_consensus.cc:1685] finished
0709 12:23:56.032709 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:56.032922 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2847,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":7162,"spinlock_wait_cycles":10872192,"thread_start_us":81544,"threads_started":1,"wal-append.queue_time_us":468040}
I20260709 12:23:56.193982 10982 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 3.
I20260709 12:23:56.214226 11127 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:55.986140 12857 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:56.214967 11125 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 3.
I20260709 12:23:56.218245 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58414 (request call id 206) took 1014 ms. Trace:
I20260709 12:23:56.218547 11125 rpcz_store.cc:276] 0709 12:23:55.203729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:55.982173 (+778444us) service_pool.cc:224] Handling call
0709 12:23:56.218185 (+236012us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:56.143273 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:56.225263 11129 raft_consensus.cc:1240] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:56.226087 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:56.227499 10982 raft_consensus.cc:2393] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 3: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:23:56.137668 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:56.209060 10881 catalog_manager.cc:5697] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
W20260709 12:23:56.235172 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 99590.1us
W20260709 12:23:56.235788 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 66603.4us
I20260709 12:23:56.240077 10948 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:56.240556 10949 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:56.238269 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:56.236822 11133 raft_consensus.cc:1275] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:23:56.241641 11133 pending_rounds.cc:85] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 2
I20260709 12:23:56.241992 11133 pending_rounds.cc:107] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:23:56.242297 11133 raft_consensus.cc:2889] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:56.189777 12893 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:56.260464 12921 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:56.262424 12893 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:56.264390 10947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 203) took 1698 ms. Trace:
I20260709 12:23:56.264775 10947 rpcz_store.cc:276] 0709 12:23:54.565993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.264337 (+1698344us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:23:56.063544 12717 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:56.150023 12746 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:56.274514 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:56.245633 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:56.276476 10978 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:56.136171 12462 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:56.255532 10948 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:56.282124 10948 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:56.222609 12891 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:56.265367 11130 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:56.127563 12911 consensus_queue.cc:1048] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.106s
I20260709 12:23:56.235772 11052 raft_consensus.cc:2393] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 4: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:56.294518 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:56.294941 12716 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:56.268298 12866 raft_consensus.cc:2749] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:56.164013 11677 rpcz_store.cc:276] 0709 12:23:54.683663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.940373 (+256710us) service_pool.cc:224] Handling call
0709 12:23:56.063341 (+1122968us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b5400408154. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:56.063463 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1066479360}
I20260709 12:23:56.296945 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:23:56.265462 10947 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:60928 dropped due to backpressure: service queue is full with 50 items
I20260709 12:23:56.298378 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:56.156658 11128 rpcz_store.cc:276] 0709 12:23:54.247098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.273289 (+ 26191us) service_pool.cc:224] Handling call
0709 12:23:56.156075 (+1882786us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b540023f0d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:56.156195 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1277155072}
I20260709 12:23:55.987728 12908 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:56.270063 11051 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:23:56.275528 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:23:56.215659 12933 log.cc:927] Time spent T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.840s	user 0.001s	sys 0.011s
I20260709 12:23:56.255458 10949 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:23:56.309377 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 53984.5us
I20260709 12:23:56.310925 10949 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:56.277311 11133 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.236475 12896 raft_consensus.cc:3055] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:56.320972 12896 raft_consensus.cc:740] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:56.278010 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:56.234259 12389 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:56.285974 11098 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:56.325472 11098 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:56.324198 10982 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:56.287842 10978 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:23:56.247200 11673 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.245050 12574 raft_consensus.cc:2804] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:56.246997 12895 raft_consensus.cc:2804] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:23:56.288928 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 95337.8us
I20260709 12:23:56.295825 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:56.273336 11058 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 3.
I20260709 12:23:56.271099 12868 raft_consensus.cc:2804] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:23:56.339193 10979 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1641) took 1806 ms (client timeout 1851 ms). Trace:
W20260709 12:23:56.368822 10979 rpcz_store.cc:269] 0709 12:23:54.532945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.533139 (+   194us) service_pool.cc:224] Handling call
0709 12:23:56.338977 (+1805838us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b540035dc54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:56.339122 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":674258688}
I20260709 12:23:56.307161 11134 raft_consensus.cc:2393] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 5: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:56.307178 11054 raft_consensus.cc:2393] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 4: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:56.304198 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:56.281420 11126 raft_consensus.cc:1240] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:23:56.289119 12465 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:56.291452 12862 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:56.295688 12716 raft_consensus.cc:2749] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:56.307089 12891 raft_consensus.cc:697] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:56.305358 11674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 439) took 1609 ms. Trace:
I20260709 12:23:56.370353 11129 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.337105 12574 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:56.324136 12866 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:56.374076 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:56.291599 12751 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:23:56.313565 12746 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:56.336424 12895 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.327937 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:56.336913 12943 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:56.298054 10947 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:60928 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1685)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1104)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1665)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 217)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 215)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1107)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1684)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1111)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1681)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1675)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1670)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1672)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1668)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1673)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 216)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1679)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1669)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1666)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1094)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1682)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1093)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1097)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1683)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 218)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1110)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 196)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 197)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 201)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 205)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 206)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1075)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1076)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1079)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1654)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1656)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1657)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1084)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1086)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1087)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1089)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1090)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 210)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1096)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1100)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1103)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1662)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1667)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1671)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1674)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1677)
I20260709 12:23:56.393373 11058 raft_consensus.cc:2393] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 4: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:56.374677 12699 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.369278 12905 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.371223 12868 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.400435 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:56.403195 10976 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:23:56.403829 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:56.391932 12896 consensus_queue.cc:260] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:56.405372 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:56.409250 12694 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:23:56.438901 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 112778us
I20260709 12:23:56.411630 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:56.412236 12717 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:56.399240 12866 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.413568 11676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41762 (request call id 443) took 1651 ms. Trace:
I20260709 12:23:56.414438 11679 raft_consensus.cc:1240] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:56.414611 12790 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:56.416724 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:56.499135 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.499909 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:56.500676 11056 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:23:56.425631 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:56.426322 11129 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:56.340095 12389 raft_consensus.cc:697] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:56.339265 11677 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
W20260709 12:23:56.429708 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 147679us
I20260709 12:23:56.505421 10948 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:56.434482 11644 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:56.416584 12895 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:56.398931 12574 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.437465 11680 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:56.508776 10948 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:56.418370 12943 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.444357 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:23:56.433540 12945 log.cc:927] Time spent T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:23:56.404145 10977 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
W20260709 12:23:56.437937 12957 log.cc:927] Time spent T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.098s	user 0.000s	sys 0.004s
W20260709 12:23:56.435947 12948 log.cc:927] Time spent T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.068s	user 0.004s	sys 0.000s
I20260709 12:23:56.434010 12868 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.465934 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:56.544701 11059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1416) took 1448 ms. Trace:
I20260709 12:23:56.522322 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:56.411101 12462 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:23:56.506938 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 72574.2us
I20260709 12:23:56.445053 11128 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:56.420161 12746 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:56.533223 11055 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.534265 11023 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:23:56.533063 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:56.534257 11057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1428) took 1190 ms. Trace:
I20260709 12:23:56.560326 11057 rpcz_store.cc:276] 0709 12:23:55.343655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:55.534786 (+191131us) service_pool.cc:224] Handling call
0709 12:23:56.533990 (+999204us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b5400278dd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:56.534170 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":914468736}
I20260709 12:23:56.537313 10948 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:56.496666 12866 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:56.442373 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1098) took 1004 ms. Trace:
I20260709 12:23:56.520958 11051 raft_consensus.cc:2393] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 5: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:56.434333 12905 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:56.535367 12896 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.540833 12389 consensus_queue.cc:237] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:56.528656 12911 raft_consensus.cc:2804] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:23:56.541491 10975 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 199) took 1976 ms (client timeout 2205 ms). Trace:
I20260709 12:23:56.541880 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:56.542368 12959 consensus_queue.cc:1059] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:23:56.546350 11058 raft_consensus.cc:2368] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3.
I20260709 12:23:56.498284 12940 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:56.549259 11680 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
I20260709 12:23:56.545092 11059 rpcz_store.cc:276] 0709 12:23:55.095926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.178030 (+1082104us) service_pool.cc:224] Handling call
0709 12:23:56.178423 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:56.178790 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:56.178822 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:56.179322 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 12:23:56.371164 (+191842us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:56.371211 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:56.371288 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:56.544467 (+173179us) raft_consensus.cc:1685] finished
0709 12:23:56.544489 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:56.544630 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":712,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":130,"spinlock_wait_cycles":15744,"thread_start_us":191352,"threads_started":1,"wal-append.queue_time_us":259759}
I20260709 12:23:56.506404 12891 consensus_queue.cc:237] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:56.551993 10984 raft_consensus.cc:2368] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 5. Current term is 6.
I20260709 12:23:56.570533 12462 raft_consensus.cc:2749] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:56.561404 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:56.604200 11057 raft_consensus.cc:2368] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4.
I20260709 12:23:56.559142 11023 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:56.429528 12699 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:56.605945 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:56.536206 12943 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:56.587725 11055 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:23:56.590365 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:56.610263 11125 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:56.595152 12911 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.451326 12694 consensus_queue.cc:1059] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.119s
I20260709 12:23:56.696826 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:56.438596 12816 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:56.504091 12717 consensus_queue.cc:1175] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7518bdeb78f24e67a530754ae48547eb" responder_term: 4 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4. Ops: [3.3-3.3]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:23:56.552201 11644 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:56.601295 11060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1422) took 1370 ms. Trace:
I20260709 12:23:56.602861 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:23:56.804000 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 251866us
I20260709 12:23:56.804486 11680 raft_consensus.cc:2393] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 3: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:23:56.804694 11644 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:56.605795 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:56.805563 11057 raft_consensus.cc:2393] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 4: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:56.805703 11644 leader_election.cc:400] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 5. Current term is 6.
I20260709 12:23:56.547706 12716 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:56.606676 10984 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:23:56.572647 12961 raft_consensus.cc:2804] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:23:56.608043 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 48962.5us
I20260709 12:23:56.809535 11023 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:56.611483 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:56.613700 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:23:56.591136 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 151037us
I20260709 12:23:56.509631 11676 rpcz_store.cc:276] 0709 12:23:54.762344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:55.478787 (+716443us) service_pool.cc:224] Handling call
0709 12:23:56.413322 (+934535us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b54006315d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:56.413493 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":849515904}
I20260709 12:23:56.614248 12875 raft_consensus.cc:2804] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:56.597815 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:56.614660 11681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 447) took 1320 ms. Trace:
I20260709 12:23:56.694521 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:56.827570 11125 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.596732 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:56.698220 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:23:56.689075 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 151785us
I20260709 12:23:56.833112 11058 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:23:56.807485 12708 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:56.835528 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:56.836303 11680 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:23:56.838070 11058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1429) took 1456 ms. Trace:
I20260709 12:23:56.838584 11058 rpcz_store.cc:276] 0709 12:23:55.377271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.832387 (+1455116us) service_pool.cc:224] Handling call
0709 12:23:56.832757 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:56.833584 (+   827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:56.833820 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:56.840257 11058 raft_consensus.cc:1240] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:56.840989 11058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1431) took 1453 ms. Trace:
W20260709 12:23:56.647746 12935 log.cc:927] Time spent T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 1.131s	user 0.002s	sys 0.004s
I20260709 12:23:56.701152 11126 raft_consensus.cc:1275] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:23:56.640648 12699 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:56.845448 12699 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.846038 12699 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:56.848239 12699 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:56.704571 11133 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:56.635252 12746 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:56.809397 12958 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:56.657024 11025 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:56.639865 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:56.852981 10978 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:56.820225 12675 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:23:56.853804 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 196840us
I20260709 12:23:56.853993 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:56.854678 10978 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:56.855002 11025 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:56.643749 11054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1436) took 1126 ms. Trace:
I20260709 12:23:56.858268 11054 rpcz_store.cc:276] 0709 12:23:55.517144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:55.800918 (+283774us) service_pool.cc:224] Handling call
0709 12:23:56.643535 (+842617us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b54002779d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:56.643685 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1102683392}
W20260709 12:23:56.738251 12953 log.cc:927] Time spent T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.318s	user 0.000s	sys 0.001s
W20260709 12:23:56.633972 12909 consensus_meta.cc:287] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.650s	user 0.004s	sys 0.003s
I20260709 12:23:56.862522 12716 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.862288 12909 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:56.863027 12716 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:56.387413 11674 rpcz_store.cc:276] 0709 12:23:54.693466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:55.653072 (+959606us) service_pool.cc:224] Handling call
0709 12:23:55.653422 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:55.653658 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:23:55.868380 (+214722us) log.cc:844] Serialized 14 byte log entry
0709 12:23:56.240561 (+372181us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:56.267222 (+ 26661us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:56.271424 (+  4202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:56.284095 (+ 12671us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:56.302391 (+ 18296us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18453,"prepare.queue_time_us":226715,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":60,"raft.queue_time_us":33833,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":18044,"thread_start_us":507668,"threads_started":2,"wal-append.queue_time_us":452211}
I20260709 12:23:56.614254 11673 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:23:56.657245 12698 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:56.620600 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:56.646656 12929 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:56.872365 11055 raft_consensus.cc:2393] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:56.873234 12929 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:56.645407 12465 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:56.602065 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:56.638978 11053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1080) took 2741 ms. Trace:
W20260709 12:23:56.595669 10975 rpcz_store.cc:269] 0709 12:23:54.564981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:55.290438 (+725457us) service_pool.cc:224] Handling call
0709 12:23:56.541307 (+1250869us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b5400099a54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:56.541431 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1110778624}
I20260709 12:23:56.658890 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:56.877517 10983 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:56.652978 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.648696 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:23:56.878927 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.879123 10980 raft_consensus.cc:2393] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 4: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:56.879705 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1107) took 1005 ms. Trace:
I20260709 12:23:56.615187 12886 raft_consensus.cc:2749] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:56.647603 12790 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:56.646596 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1102) took 1207 ms. Trace:
I20260709 12:23:56.890239 10981 rpcz_store.cc:276] 0709 12:23:55.439370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:55.771711 (+332341us) service_pool.cc:224] Handling call
0709 12:23:56.646423 (+874712us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b54001a0c54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:56.646535 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51127168}
I20260709 12:23:56.891538 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:56.647969 12921 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:56.612610 12901 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:56.647706 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:56.584348 10976 rpcz_store.cc:276] 0709 12:23:55.438401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:55.829169 (+390768us) service_pool.cc:224] Handling call
0709 12:23:56.440522 (+611353us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:56.657811 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:23:56.705896 12952 log.cc:927] Time spent T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
I20260709 12:23:56.639364 12940 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:56.690968 12878 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.692029 11098 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:23:56.755247 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:56.802127 11130 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:56.806000 11644 leader_election.cc:403] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:23:56.808279 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:56.921828 11057 raft_consensus.cc:1240] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:56.922562 11057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 233) took 1160 ms. Trace:
I20260709 12:23:56.922873 11057 rpcz_store.cc:276] 0709 12:23:55.761750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.921276 (+1159526us) service_pool.cc:224] Handling call
0709 12:23:56.921626 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:56.922270 (+   644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:56.922498 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:56.814924 10949 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:23:56.924726 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 109893us
W20260709 12:23:56.803094 12730 consensus_meta.cc:287] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.823s	user 0.008s	sys 0.002s
I20260709 12:23:56.861111 10978 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
I20260709 12:23:57.112407 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:56.793442 12866 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:56.803650 11060 rpcz_store.cc:276] 0709 12:23:55.232214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.193566 (+961352us) service_pool.cc:224] Handling call
0709 12:23:56.193916 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:56.195460 (+  1544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:56.195492 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:56.196230 (+   738us) log.cc:844] Serialized 26 byte log entry
0709 12:23:56.222123 (+ 25893us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:56.225013 (+  2890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:56.225100 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:56.601045 (+375945us) raft_consensus.cc:1685] finished
0709 12:23:56.601077 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:56.601231 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":489,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":25395,"threads_started":1,"wal-append.queue_time_us":82702}
I20260709 12:23:56.796276 12959 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:57.115147 11060 raft_consensus.cc:1240] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:57.116739 11060 raft_consensus.cc:1240] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:23:56.841446 11058 rpcz_store.cc:276] 0709 12:23:55.387820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.839442 (+1451622us) service_pool.cc:224] Handling call
0709 12:23:56.839861 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:56.840711 (+   850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:56.840928 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:56.659735 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1483) took 1455 ms. Trace:
I20260709 12:23:56.825510 11681 rpcz_store.cc:276] 0709 12:23:55.293958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:55.930012 (+636054us) service_pool.cc:224] Handling call
0709 12:23:55.930449 (+   437us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:55.939785 (+  9336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:55.939816 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:55.945581 (+  5765us) log.cc:844] Serialized 52 byte log entry
0709 12:23:56.216328 (+270747us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:56.245092 (+ 28764us) log.cc:844] Serialized 14 byte log entry
0709 12:23:56.245327 (+   235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:56.245401 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:56.614442 (+369041us) raft_consensus.cc:1685] finished
0709 12:23:56.614463 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:56.614600 (+   137us) inbound_call.cc:177] Queueing success response
0709 12:23:56.646015 (+ 31415us) spinlock_profiling.cc:243] Waited 9.42 ms on lock 0x7b1800203740. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cf73f3 00007f8f88cf97c1 00007f8f88cf9779 00007f8f88cf9709 00007f8f88cf96d1 00007f8f88cf89cd 0000000000388634 0000000000388479 00007f8f88cda83a
Metrics: {"prepare.queue_time_us":49422,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":4684,"raft.queue_time_us":20818,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":232,"spinlock_wait_cycles":21658880,"thread_start_us":252112,"threads_started":1,"wal-append.queue_time_us":384187}
I20260709 12:23:56.829975 12875 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.616928 12911 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:57.120803 12875 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:57.121302 11681 raft_consensus.cc:1240] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:56.815665 12964 raft_consensus.cc:3055] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:56.866334 11125 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:56.868181 11059 raft_consensus.cc:1240] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 12:23:56.874933 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 177505us
I20260709 12:23:57.122882 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:23:57.123320 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.124078 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:57.124503 11097 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:56.849874 12621 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.122045 11681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41774 (request call id 361) took 1006 ms. Trace:
I20260709 12:23:57.126369 12621 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:56.875670 11053 rpcz_store.cc:276] 0709 12:23:53.898114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.898247 (+   133us) service_pool.cc:224] Handling call
0709 12:23:53.927792 (+ 29545us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:55.942984 (+2015192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:56.638708 (+695724us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b54002dc8d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:56.638905 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4549394176}
I20260709 12:23:56.854445 12694 raft_consensus.cc:3055] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:57.127626 12694 raft_consensus.cc:740] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:57.128196 11053 raft_consensus.cc:1240] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:57.128509 12694 consensus_queue.cc:260] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:57.129124 12915 raft_consensus.cc:2749] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:56.880079 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:56.874328 12465 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:57.129762 12694 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.859097 12746 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.887135 11054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 230) took 1446 ms. Trace:
I20260709 12:23:56.868278 12389 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:56.873944 12929 raft_consensus.cc:2804] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:57.132014 12746 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:57.132922 12929 raft_consensus.cc:697] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:56.897207 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:57.134600 11057 raft_consensus.cc:1275] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:56.887986 12675 raft_consensus.cc:697] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:56.863677 12708 raft_consensus.cc:697] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:57.135500 12746 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:56.875533 12685 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.135830 12708 consensus_queue.cc:237] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:57.136229 12685 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:56.898903 11675 raft_consensus.cc:2368] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3.
W20260709 12:23:56.917631 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 225679us
I20260709 12:23:56.917011 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 202) took 1972 ms. Trace:
I20260709 12:23:56.877322 10977 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 4.
I20260709 12:23:57.183338 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 215) took 1383 ms. Trace:
I20260709 12:23:57.183789 10977 rpcz_store.cc:276] 0709 12:23:55.800051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.571936 (+771885us) service_pool.cc:224] Handling call
0709 12:23:57.183264 (+611328us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.184866 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:57.185731 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1668) took 1094 ms. Trace:
I20260709 12:23:56.892184 10981 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:57.187572 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:57.188228 10981 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.913345 10983 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:56.928467 12730 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:57.192101 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:57.192788 10983 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 3.
I20260709 12:23:57.193066 12730 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:57.193262 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 216) took 1325 ms. Trace:
I20260709 12:23:56.899345 12905 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:57.193595 10983 rpcz_store.cc:276] 0709 12:23:55.867422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.191840 (+1324418us) service_pool.cc:224] Handling call
0709 12:23:57.193204 (+  1364us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:56.931300 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 125697us
I20260709 12:23:56.815094 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:56.990365 12973 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:57.058969 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:57.286000 10979 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:57.286695 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1665) took 1220 ms. Trace:
I20260709 12:23:57.286718 10976 raft_consensus.cc:2393] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 5: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:57.287534 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1670) took 1156 ms. Trace:
I20260709 12:23:57.287894 10976 rpcz_store.cc:276] 0709 12:23:56.131467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.919716 (+788249us) service_pool.cc:224] Handling call
0709 12:23:57.287470 (+367754us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.288935 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:57.287067 10979 rpcz_store.cc:276] 0709 12:23:56.065864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.814816 (+748952us) service_pool.cc:224] Handling call
0709 12:23:57.286623 (+471807us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.289709 10976 raft_consensus.cc:2393] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 5: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:57.290172 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:57.290622 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:57.290961 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1669) took 1159 ms. Trace:
I20260709 12:23:57.291579 10979 rpcz_store.cc:276] 0709 12:23:56.131136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.289885 (+1158749us) service_pool.cc:224] Handling call
0709 12:23:57.290903 (+  1018us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.292506 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:57.293160 10979 raft_consensus.cc:2376] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6. Re-sending same reply.
I20260709 12:23:57.293635 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1094) took 1857 ms. Trace:
I20260709 12:23:57.293974 10979 rpcz_store.cc:276] 0709 12:23:55.436470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.292246 (+1855776us) service_pool.cc:224] Handling call
0709 12:23:57.293585 (+  1339us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.294914 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:57.295466 10979 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:57.286073 12973 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:57.298776 12973 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:57.062477 10949 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:52820 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1672)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1668)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1673)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 216)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1679)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1688)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1669)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1666)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1094)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1682)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1093)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1687)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 220)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1097)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1113)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1683)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1689)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1690)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 219)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1112)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 218)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1110)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1114)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 221)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:41958 (request call id 11)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 196)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 197)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 201)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 205)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 206)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1075)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1076)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1079)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1654)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1656)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1657)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1084)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1086)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1087)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1089)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1090)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 210)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1096)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1100)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1103)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1662)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1667)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1671)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1674)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1677)
I20260709 12:23:57.079743 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:57.308120 10975 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:57.199393 11059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1423) took 1908 ms. Trace:
I20260709 12:23:57.312004 11059 rpcz_store.cc:276] 0709 12:23:55.291240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.821385 (+1530145us) service_pool.cc:224] Handling call
0709 12:23:56.843215 (+ 21830us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:57.122472 (+279257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.199023 (+ 76551us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b54001888d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:57.199310 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56724224}
I20260709 12:23:57.321460 10979 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:56.879992 10980 rpcz_store.cc:276] 0709 12:23:55.874265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.648455 (+774190us) service_pool.cc:224] Handling call
0709 12:23:56.879630 (+231175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.161860 10947 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:52828 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1668)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1673)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 216)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1679)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1688)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1669)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1666)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1094)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1682)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1093)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1687)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 220)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1097)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1113)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1683)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1689)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1690)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 219)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1112)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 218)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1692)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1110)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1114)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 221)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:41958 (request call id 11)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 196)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 197)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 201)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 205)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 206)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1075)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1076)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1079)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1654)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1656)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1657)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1084)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1086)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1087)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1089)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1090)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 210)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1096)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1100)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1103)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1662)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1667)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1671)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1674)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1677)
I20260709 12:23:56.966604 11023 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:23:57.355114 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 388588us
I20260709 12:23:57.355054 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1682) took 1091 ms. Trace:
I20260709 12:23:57.355762 10979 rpcz_store.cc:276] 0709 12:23:56.263312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.294670 (+1031358us) service_pool.cc:224] Handling call
0709 12:23:57.354996 (+ 60326us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:57.152585 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 330307us
I20260709 12:23:57.357949 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:57.360183 12973 raft_consensus.cc:2804] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:57.360631 12973 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.361001 12973 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:56.967272 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 112366us
I20260709 12:23:57.364001 11025 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:57.365424 11025 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:57.359882 11024 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:56.941824 11052 raft_consensus.cc:2393] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 4: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:56.979360 11056 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 232) took 1476 ms. Trace:
I20260709 12:23:57.417865 11056 rpcz_store.cc:276] 0709 12:23:55.503216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.881258 (+1378042us) service_pool.cc:224] Handling call
0709 12:23:56.899311 (+ 18053us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:56.902504 (+  3193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:56.902533 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:56.903000 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 12:23:56.967586 (+ 64586us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:56.967629 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:56.967897 (+   268us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:56.979103 (+ 11206us) raft_consensus.cc:1685] finished
0709 12:23:56.979125 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:56.979289 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":799,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":10855,"thread_start_us":62197,"threads_started":1,"wal-append.queue_time_us":69331}
I20260709 12:23:57.058148 11051 raft_consensus.cc:1275] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:57.424587 11051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1093) took 1356 ms. Trace:
I20260709 12:23:57.425043 11051 rpcz_store.cc:276] 0709 12:23:56.068470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.057316 (+988846us) service_pool.cc:224] Handling call
0709 12:23:57.057723 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:57.424206 (+366483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.424506 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.132190 11054 rpcz_store.cc:276] 0709 12:23:55.441072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.867413 (+1426341us) service_pool.cc:224] Handling call
0709 12:23:56.886605 (+ 19192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:56.886804 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:56.886830 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:56.886874 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:56.886904 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:56.886955 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:56.887067 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.117895 11060 raft_consensus.cc:1240] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:57.430912 11060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1104) took 1169 ms. Trace:
I20260709 12:23:57.431330 11060 rpcz_store.cc:276] 0709 12:23:56.261154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.117466 (+856312us) service_pool.cc:224] Handling call
0709 12:23:57.117734 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:57.430536 (+312802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.430833 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.087029 11055 raft_consensus.cc:1240] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:57.485771 11055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1095) took 1416 ms. Trace:
I20260709 12:23:57.135790 11097 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:57.124671 11125 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:56.943473 11126 raft_consensus.cc:1275] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:56.942981 11128 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:57.502147 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 1662) took 1132 ms. Trace:
I20260709 12:23:57.502540 11128 rpcz_store.cc:276] 0709 12:23:56.369605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.372539 (+  2934us) service_pool.cc:224] Handling call
0709 12:23:57.502047 (+1129508us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.176637 11057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 234) took 1403 ms. Trace:
I20260709 12:23:57.213117 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:56.951202 11130 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:57.505916 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1679) took 1289 ms. Trace:
I20260709 12:23:57.119076 11131 rpcz_store.cc:276] 0709 12:23:55.204492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.099926 (+895434us) service_pool.cc:224] Handling call
0709 12:23:56.100265 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:56.100627 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:56.100656 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:56.101133 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 12:23:56.537561 (+436428us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:56.537607 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:56.537682 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:56.659473 (+121791us) raft_consensus.cc:1685] finished
0709 12:23:56.659501 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:56.659666 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1649,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":6250,"thread_start_us":436043,"threads_started":1,"wal-append.queue_time_us":516685}
I20260709 12:23:57.138193 11132 rpcz_store.cc:276] 0709 12:23:54.944916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.945043 (+   127us) service_pool.cc:224] Handling call
0709 12:23:54.946664 (+  1621us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:54.971124 (+ 24460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:54.971158 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:55.177954 (+206796us) log.cc:844] Serialized 26 byte log entry
0709 12:23:55.301104 (+123150us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:55.301144 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:55.301211 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:56.503460 (+1202249us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:23:56.906210 (+402750us) raft_consensus.cc:1685] finished
0709 12:23:56.906232 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:56.916939 (+ 10707us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9583,"raft.queue_time_us":22627,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":5815,"spinlock_wait_cycles":6188800,"thread_start_us":119351,"threads_started":1,"wal-append.queue_time_us":278693}
I20260709 12:23:57.138616 11134 raft_consensus.cc:2393] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 4: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:57.236660 10881 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41120 (request call id 264) took 3404 ms. Trace:
I20260709 12:23:57.186070 10977 rpcz_store.cc:276] 0709 12:23:56.091056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.184529 (+1093473us) service_pool.cc:224] Handling call
0709 12:23:57.185670 (+  1141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.172206 11643 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:57.511085 12905 raft_consensus.cc:2804] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:23:57.511281 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 339128us
I20260709 12:23:57.511767 12905 raft_consensus.cc:697] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:57.215945 11644 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:23:57.513161 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 297298us
I20260709 12:23:57.513284 12708 raft_consensus.cc:2804] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:57.513830 12708 raft_consensus.cc:697] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:56.931524 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:57.515734 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:57.516373 11674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41762 (request call id 452) took 1008 ms. Trace:
I20260709 12:23:57.517020 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:56.916944 11678 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:57.212163 12621 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:57.519500 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:57.520078 12621 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.520560 12621 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:57.516762 11674 rpcz_store.cc:276] 0709 12:23:56.508037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.899951 (+391914us) service_pool.cc:224] Handling call
0709 12:23:57.516307 (+616356us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.139003 12675 consensus_queue.cc:237] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:56.934182 11677 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:57.126374 11681 rpcz_store.cc:276] 0709 12:23:56.115797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.120808 (+1005011us) service_pool.cc:224] Handling call
0709 12:23:57.121130 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:57.121787 (+   657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.121987 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:56.945024 12816 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:57.143054 12465 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:56.883494 11679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41774 (request call id 354) took 1775 ms. Trace:
W20260709 12:23:56.959438 12862 consensus_meta.cc:287] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.574s	user 0.007s	sys 0.002s
I20260709 12:23:57.532847 12862 raft_consensus.cc:2749] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:57.119208 12866 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:57.151410 12875 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:57.539043 12875 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:56.931136 12878 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:57.545107 12878 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:57.193990 11672 raft_consensus.cc:1240] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:23:57.548010 11672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 444) took 2593 ms. Trace:
I20260709 12:23:57.549544 11129 raft_consensus.cc:1275] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:56.874455 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:57.563309 11676 raft_consensus.cc:1275] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:56.940479 12895 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:57.566527 12895 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:56.851990 12898 raft_consensus.cc:2749] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:57.569245 10982 raft_consensus.cc:2368] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3.
W20260709 12:23:57.570600 10982 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1104) took 1872 ms (client timeout 2210 ms). Trace:
W20260709 12:23:57.570997 10982 rpcz_store.cc:269] 0709 12:23:55.698149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.665653 (+967504us) service_pool.cc:224] Handling call
0709 12:23:57.570383 (+904730us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b54000d9b54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:57.570535 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1699956096}
I20260709 12:23:57.572147 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:57.573002 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1097) took 2134 ms. Trace:
I20260709 12:23:57.573313 10982 rpcz_store.cc:276] 0709 12:23:55.438152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.571821 (+2133669us) service_pool.cc:224] Handling call
0709 12:23:57.572946 (+  1125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:56.937773 12901 raft_consensus.cc:2804] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:57.575024 12901 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.575474 12901 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:56.905786 12909 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:57.133872 12929 consensus_queue.cc:237] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:56.907136 12574 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:56.932965 12940 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:57.583528 12940 raft_consensus.cc:697] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:57.584352 12574 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:57.584527 12940 consensus_queue.cc:237] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:56.963881 12943 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:57.587275 11127 raft_consensus.cc:1240] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 12:23:57.588820 12943 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:56.951277 12958 raft_consensus.cc:697] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:57.590386 12875 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.590901 12875 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:57.591069 12958 consensus_queue.cc:237] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:56.935458 12961 raft_consensus.cc:697] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 5 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:57.593876 12961 consensus_queue.cc:237] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:57.122018 12964 raft_consensus.cc:740] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:57.600268 12964 consensus_queue.cc:260] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:57.601599 12964 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:57.195120 12965 log.cc:927] Time spent T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.401s	user 0.000s	sys 0.003s
I20260709 12:23:56.969485 12716 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:57.606685 12716 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:56.972016 12868 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:57.609310 10979 raft_consensus.cc:2393] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 4: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:57.610371 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1687) took 1108 ms. Trace:
I20260709 12:23:57.610705 10979 rpcz_store.cc:276] 0709 12:23:56.507080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.357684 (+850604us) service_pool.cc:224] Handling call
0709 12:23:57.610138 (+252454us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54000daf54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:57.610294 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":576217984}
I20260709 12:23:57.611744 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:57.612465 10979 raft_consensus.cc:2393] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 5: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:57.612843 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1683) took 1349 ms. Trace:
I20260709 12:23:57.613125 10979 rpcz_store.cc:276] 0709 12:23:56.263590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.611495 (+1347905us) service_pool.cc:224] Handling call
0709 12:23:57.612792 (+  1297us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:56.957805 12908 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:57.147662 12911 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:57.624382 12911 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:23:57.031440 12949 log.cc:927] Time spent T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.658s	user 0.000s	sys 0.004s
I20260709 12:23:57.625850 11680 raft_consensus.cc:1240] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:23:57.627065 11680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41774 (request call id 360) took 1511 ms. Trace:
I20260709 12:23:57.627380 11680 rpcz_store.cc:276] 0709 12:23:56.115548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.918069 (+802521us) service_pool.cc:224] Handling call
0709 12:23:56.934966 (+ 16897us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:57.626308 (+691342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.626819 (+   511us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b54005794d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:57.627006 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1588321152}
I20260709 12:23:57.251291 10981 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:57.628504 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1673) took 1496 ms. Trace:
I20260709 12:23:57.628827 10981 rpcz_store.cc:276] 0709 12:23:56.132257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.187305 (+1055048us) service_pool.cc:224] Handling call
0709 12:23:57.628442 (+441137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.629767 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:57.630417 10981 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:23:57.631379 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:23:57.263221 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 431800us
I20260709 12:23:57.633049 10948 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:57.633173 12875 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:57.634203 10948 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:57.634799 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:23:57.272806 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:57.635634 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.087424 10984 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:57.637988 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1686) took 1140 ms. Trace:
I20260709 12:23:57.638366 10984 rpcz_store.cc:276] 0709 12:23:56.497936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.605619 (+107683us) service_pool.cc:224] Handling call
0709 12:23:57.637927 (+1032308us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.639268 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:57.639776 10984 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:57.640815 10978 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
W20260709 12:23:57.325562 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.337679 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1666) took 1271 ms. Trace:
I20260709 12:23:57.642390 10976 rpcz_store.cc:276] 0709 12:23:56.090405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.290371 (+1199966us) service_pool.cc:224] Handling call
0709 12:23:57.337588 (+ 47217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.643508 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:57.647004 11678 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
W20260709 12:23:57.647635 11678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41774 (request call id 356) took 1593 ms (client timeout 1620 ms). Trace:
W20260709 12:23:57.648010 11678 rpcz_store.cc:269] 0709 12:23:56.113968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.121385 (+  7417us) service_pool.cc:224] Handling call
0709 12:23:56.657629 (+536244us) spinlock_profiling.cc:243] Waited 4.04 ms on lock 0x7b5800004598. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90daa0a0 00007f8f90da9984 00007f8f8a3246d4 00007f8f8a324662
0709 12:23:57.647570 (+989941us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9293184}
I20260709 12:23:57.338217 10975 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
W20260709 12:23:57.650480 10975 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1675) took 1516 ms (client timeout 1999 ms). Trace:
W20260709 12:23:57.650920 10975 rpcz_store.cc:269] 0709 12:23:56.133897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.903145 (+769248us) service_pool.cc:224] Handling call
0709 12:23:57.650406 (+747261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.652067 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:57.652706 10975 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:57.653187 12909 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:57.341384 12694 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:57.654397 12694 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:57.655409 12816 consensus_queue.cc:1059] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:57.656612 12694 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:57.657183 12694 consensus_queue.cc:1059] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:57.353925 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:57.657907 12909 raft_consensus.cc:3055] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:57.658396 12909 raft_consensus.cc:740] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:57.362993 11673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41774 (request call id 359) took 1247 ms. Trace:
I20260709 12:23:57.368275 12975 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:57.659741 12975 raft_consensus.cc:697] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:57.658882 11673 rpcz_store.cc:276] 0709 12:23:56.115285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.332786 (+1217501us) service_pool.cc:224] Handling call
0709 12:23:57.333177 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:57.333444 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:23:57.333799 (+   355us) log.cc:844] Serialized 14 byte log entry
0709 12:23:57.362587 (+ 28788us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:57.362646 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:57.362699 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.362775 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:57.362926 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":166,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":47542,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":128,"thread_start_us":28378,"threads_started":1,"wal-append.queue_time_us":30414}
I20260709 12:23:57.369216 11025 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:57.369350 11052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41294 (request call id 1101) took 1164 ms. Trace:
I20260709 12:23:57.377668 12635 consensus_queue.cc:1059] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:23:57.384871 12973 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:57.663190 12866 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:57.409726 12730 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:57.433730 12389 raft_consensus.cc:2749] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:23:57.458734 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 80641.1us
I20260709 12:23:57.461529 11675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41774 (request call id 363) took 1345 ms. Trace:
I20260709 12:23:57.476264 12685 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:57.476532 12915 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.486166 11055 rpcz_store.cc:276] 0709 12:23:56.068947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.086454 (+1017507us) service_pool.cc:224] Handling call
0709 12:23:57.086840 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:57.485475 (+398635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.485708 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.658275 11677 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
W20260709 12:23:57.490469 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 354712us
I20260709 12:23:57.670326 12907 raft_consensus.cc:2749] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 5. Current term is 6.
I20260709 12:23:57.670907 12635 raft_consensus.cc:3055] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:57.670579 12915 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:57.671314 12635 raft_consensus.cc:740] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:57.672152 12635 consensus_queue.cc:260] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:57.671396 11675 rpcz_store.cc:276] 0709 12:23:56.116406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.179436 (+1063030us) service_pool.cc:224] Handling call
0709 12:23:57.179817 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:57.180048 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:23:57.441344 (+261296us) log.cc:844] Serialized 14 byte log entry
0709 12:23:57.461119 (+ 19775us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:57.461180 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:57.461230 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.461306 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:57.461454 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":75774,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":106,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"thread_start_us":280264,"threads_started":2,"wal-append.queue_time_us":21191}
I20260709 12:23:57.673383 12635 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:57.673781 11097 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:57.673997 11677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41762 (request call id 451) took 1166 ms. Trace:
I20260709 12:23:57.674206 12730 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:57.663942 11052 rpcz_store.cc:276] 0709 12:23:56.204553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.647392 (+442839us) service_pool.cc:224] Handling call
0709 12:23:57.369269 (+721877us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.660638 12975 consensus_queue.cc:237] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:57.677426 12915 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:57.675141 12940 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:57.678491 12940 raft_consensus.cc:697] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 5 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:57.679332 12940 consensus_queue.cc:237] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:57.681603 12730 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:57.674767 11097 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:57.682973 12973 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:57.663740 12866 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.683332 11097 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:57.683756 12866 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:57.684258 12943 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:57.684801 12943 raft_consensus.cc:697] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:57.685746 12943 consensus_queue.cc:237] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:57.686425 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:57.686800 12898 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:57.687439 12898 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.687783 12898 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:57.659385 12868 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:57.674451 11677 rpcz_store.cc:276] 0709 12:23:56.507741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.660243 (+152502us) service_pool.cc:224] Handling call
0709 12:23:57.673930 (+1013687us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.694630 12895 raft_consensus.cc:3055] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:57.695194 12895 raft_consensus.cc:740] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:57.696170 12895 consensus_queue.cc:260] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:57.697552 12895 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:57.687156 11127 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 4.
W20260709 12:23:57.700169 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.711637 10984 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 4.
I20260709 12:23:57.499006 11058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1114) took 1233 ms. Trace:
W20260709 12:23:57.500566 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 362556us
I20260709 12:23:57.714825 11098 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:57.716172 11098 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:57.503813 12990 raft_consensus.cc:2764] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:23:57.694496 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:57.722855 10979 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:57.723732 12878 raft_consensus.cc:2749] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:57.504884 11125 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 3.
I20260709 12:23:57.506337 10983 rpcz_store.cc:276] 0709 12:23:56.216869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.212776 (+995907us) service_pool.cc:224] Handling call
0709 12:23:57.505855 (+293079us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.725519 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:57.726145 10983 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:23:57.505524 11057 rpcz_store.cc:276] 0709 12:23:55.773537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.923777 (+1150240us) service_pool.cc:224] Handling call
0709 12:23:56.924162 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:57.135000 (+210838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.176306 (+ 41306us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54003714d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:57.176550 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":482829568}
I20260709 12:23:57.509544 10881 rpcz_store.cc:276] 0709 12:23:53.832185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.834248 (+  2063us) service_pool.cc:224] Handling call
0709 12:23:57.236543 (+3402295us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:56.848665 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:56.862331 (+ 13666us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:56.862383 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:23:56.862401 (+    18us) tablet.cc:662] Decoding operations
0709 12:23:56.875336 (+ 12935us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:56.900411 (+ 25075us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:56.906013 (+  5602us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:23:56.947541 (+ 41528us) tablet.cc:701] Row locks acquired
0709 12:23:56.947600 (+    59us) write_op.cc:260] PREPARE: finished
0709 12:23:56.947797 (+   197us) write_op.cc:270] Start()
0709 12:23:56.947967 (+   170us) write_op.cc:276] Timestamp: P: 1783599836947718 usec, L: 0
0709 12:23:56.948008 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 12:23:56.962386 (+ 14378us) log.cc:844] Serialized 2468 byte log entry
0709 12:23:56.983560 (+ 21174us) op_driver.cc:464] REPLICATION: finished
0709 12:23:56.985136 (+  1576us) write_op.cc:301] APPLY: starting
0709 12:23:56.985213 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:56.985370 (+   157us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:56.985489 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:56.986321 (+   832us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:56.986615 (+   294us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:23:56.986685 (+    70us) write_op.cc:312] APPLY: finished
0709 12:23:56.986993 (+   308us) log.cc:844] Serialized 53 byte log entry
0709 12:23:56.987171 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:56.987281 (+   110us) write_op.cc:454] Released schema lock
0709 12:23:56.987348 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:56.987837 (+   489us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:56.987872 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":1342,"apply.run_cpu_time_us":2586,"apply.run_wall_time_us":2671,"num_ops":6,"prepare.queue_time_us":432473,"prepare.run_cpu_time_us":8297,"prepare.run_wall_time_us":120907,"raft.queue_time_us":968,"raft.run_cpu_time_us":1634,"raft.run_wall_time_us":1635,"replication_time_us":35383,"thread_start_us":376992,"threads_started":4,"wal-append.queue_time_us":17385}]]}
I20260709 12:23:57.514810 12708 consensus_queue.cc:237] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:57.512737 12905 consensus_queue.cc:237] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:57.518653 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:57.747679 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:57.748634 10984 raft_consensus.cc:2410] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:57.749037 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1110) took 1625 ms. Trace:
I20260709 12:23:57.749339 10984 rpcz_store.cc:276] 0709 12:23:56.123184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.712999 (+1589815us) service_pool.cc:224] Handling call
0709 12:23:57.748980 (+ 35981us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.522487 11674 raft_consensus.cc:1240] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:57.516528 11060 raft_consensus.cc:2393] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 4: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:57.528061 11681 raft_consensus.cc:1240] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:57.069945 12857 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:57.531037 12465 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:57.530797 11679 rpcz_store.cc:276] 0709 12:23:55.107806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:55.755519 (+647713us) service_pool.cc:224] Handling call
0709 12:23:56.414241 (+658722us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:56.499214 (+ 84973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:56.883244 (+384030us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b54006315d0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:56.883427 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1514319616}
I20260709 12:23:57.551455 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:57.548399 11672 rpcz_store.cc:276] 0709 12:23:54.954365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:55.714142 (+759777us) service_pool.cc:224] Handling call
0709 12:23:55.770589 (+ 56447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:57.546899 (+1776310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.547725 (+   826us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54004f47d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:57.547944 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3267562240}
I20260709 12:23:57.607399 12621 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:57.658524 10980 raft_consensus.cc:2393] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 4: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
W20260709 12:23:57.791911 10980 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1093) took 2355 ms (client timeout 3061 ms). Trace:
W20260709 12:23:57.792301 10980 rpcz_store.cc:269] 0709 12:23:55.436216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.353626 (+1917410us) service_pool.cc:224] Handling call
0709 12:23:57.791851 (+438225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.789242 10977 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 3.
I20260709 12:23:57.793252 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:57.793326 10977 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0"
dest_uuid: "bc01179655564f29b83babe396377cbb"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:41958
I20260709 12:23:57.367743 12891 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:57.793941 10977 raft_consensus.cc:606] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:57.794353 10977 raft_consensus.cc:614] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:57.794453 12891 raft_consensus.cc:697] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:57.794885 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:41958 (request call id 11) took 1253 ms. Trace:
I20260709 12:23:57.795372 12891 consensus_queue.cc:237] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:57.661139 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 291980us
I20260709 12:23:57.635083 10948 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:23:57.800417 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 165385us
I20260709 12:23:57.802328 10948 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:57.803658 10948 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:57.665690 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:23:57.804191 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.666013 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1672) took 1534 ms. Trace:
I20260709 12:23:57.804798 10978 rpcz_store.cc:276] 0709 12:23:56.132013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.112125 (+980112us) service_pool.cc:224] Handling call
0709 12:23:57.665836 (+553711us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b5400229554. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:57.665951 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":981276928}
I20260709 12:23:57.794028 10980 raft_consensus.cc:2368] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4.
I20260709 12:23:57.657966 12694 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:57.668330 11023 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:57.726656 10982 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:57.728526 11098 leader_election.cc:400] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3.
I20260709 12:23:57.807621 11098 leader_election.cc:403] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 12:23:57.808414 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 80021.8us
I20260709 12:23:57.729836 10979 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:23:57.701541 11645 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:23:57.736450 11097 leader_election.cc:400] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Vote denied by peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777) with higher term. Message: Invalid argument: T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3.
I20260709 12:23:57.810837 11097 leader_election.cc:403] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:23:57.739761 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:57.811406 12730 raft_consensus.cc:2804] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:57.811870 12730 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.812166 12857 raft_consensus.cc:2749] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777) with higher term. Message: Invalid argument: T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3.
I20260709 12:23:57.813270 11125 raft_consensus.cc:2393] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 4: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:23:57.810997 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 109555us
I20260709 12:23:57.795228 10977 rpcz_store.cc:276] 0709 12:23:56.541383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.793167 (+1251784us) service_pool.cc:224] Handling call
0709 12:23:57.794805 (+  1638us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.814860 11645 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:23:57.815809 10977 raft_consensus.cc:1240] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:57.816284 12465 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.816574 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 206) took 3245 ms. Trace:
I20260709 12:23:57.816864 12992 raft_consensus.cc:2804] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:23:57.811793 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 75478.8us
I20260709 12:23:57.714365 11058 rpcz_store.cc:276] 0709 12:23:56.272721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.118422 (+845701us) service_pool.cc:224] Handling call
0709 12:23:57.118716 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:57.477203 (+358487us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:23:57.477499 (+   296us) log.cc:844] Serialized 14 byte log entry
0709 12:23:57.493525 (+ 16026us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:57.493581 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:57.493619 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.498729 (+  5110us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b54002df854. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:57.498781 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:57.498937 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":669,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":88,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":117,"spinlock_wait_cycles":823919488,"thread_start_us":15347,"threads_started":1,"wal-append.queue_time_us":15248}
I20260709 12:23:57.664803 12875 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:57.752638 11681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 449) took 1252 ms. Trace:
W20260709 12:23:57.755798 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.738924 10882 catalog_manager.cc:5697] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 2 to 3, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 3 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:57.761363 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:57.730360 12878 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:57.696308 12909 consensus_queue.cc:260] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:57.779472 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:23:57.833645 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 165383us
I20260709 12:23:57.834092 10984 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:57.834506 11023 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:57.762590 10976 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:23:57.782691 10975 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 3.
W20260709 12:23:57.783948 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 271918us
I20260709 12:23:57.839517 11643 leader_election.cc:400] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Vote denied by peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777) with higher term. Message: Invalid argument: T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 5. Current term is 6.
I20260709 12:23:57.835955 11023 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:57.840548 11643 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:57.766887 11674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41784 (request call id 457) took 1650 ms. Trace:
I20260709 12:23:57.818799 11097 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:57.841313 11674 rpcz_store.cc:276] 0709 12:23:56.116783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.521872 (+1405089us) service_pool.cc:224] Handling call
0709 12:23:57.522265 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:57.755567 (+233302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.765291 (+  9724us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.842283 11097 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:57.843163 11097 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:57.762188 12816 consensus_queue.cc:1059] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:23:57.823580 10948 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:57.817584 12868 raft_consensus.cc:2764] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:23:57.818671 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 197) took 3254 ms. Trace:
I20260709 12:23:57.824465 10983 raft_consensus.cc:1240] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 5. Ops: [3.2-3.2]
I20260709 12:23:57.855784 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1075) took 3284 ms. Trace:
I20260709 12:23:57.856176 10983 rpcz_store.cc:276] 0709 12:23:54.571748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.823912 (+3252164us) service_pool.cc:224] Handling call
0709 12:23:57.824248 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:57.855477 (+ 31229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.855726 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.817466 12992 raft_consensus.cc:697] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:57.823163 11681 rpcz_store.cc:276] 0709 12:23:56.499922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.527604 (+1027682us) service_pool.cc:224] Handling call
0709 12:23:57.527893 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:57.751103 (+223210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.752580 (+  1477us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.819662 10982 raft_consensus.cc:1240] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:57.837839 10984 raft_consensus.cc:1275] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:57.771819 12901 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:57.818866 11098 leader_election.cc:400] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4.
W20260709 12:23:57.865633 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 55915.3us
I20260709 12:23:57.844200 11643 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:57.867019 11643 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:57.868330 11643 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
W20260709 12:23:57.844421 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 74595us
W20260709 12:23:57.845144 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 45181.2us
I20260709 12:23:57.843617 12973 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:57.819598 10978 raft_consensus.cc:1240] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:23:57.872685 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 196) took 3308 ms. Trace:
I20260709 12:23:57.873071 10978 rpcz_store.cc:276] 0709 12:23:54.564209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.819049 (+3254840us) service_pool.cc:224] Handling call
0709 12:23:57.819381 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:57.872410 (+ 53029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.872625 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.874456 10978 raft_consensus.cc:1240] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:23:57.875048 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1656) took 3269 ms. Trace:
I20260709 12:23:57.875344 10978 rpcz_store.cc:276] 0709 12:23:54.605244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.873880 (+3268636us) service_pool.cc:224] Handling call
0709 12:23:57.874233 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:57.874811 (+   578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.874997 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.820312 12621 raft_consensus.cc:2749] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3.
I20260709 12:23:57.857704 10983 raft_consensus.cc:1275] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:57.876852 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1079) took 3304 ms. Trace:
I20260709 12:23:57.858350 11097 leader_election.cc:400] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Vote denied by peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777) with higher term. Message: Invalid argument: T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4.
I20260709 12:23:57.877351 11097 leader_election.cc:403] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:57.877723 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1657) took 3272 ms. Trace:
I20260709 12:23:57.878357 12621 raft_consensus.cc:2749] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777) with higher term. Message: Invalid argument: T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4.
I20260709 12:23:57.828436 12975 consensus_queue.cc:1048] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:23:57.825636 10882 catalog_manager.cc:5697] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 3 to 4, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 4 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:23:57.826820 12730 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:57.828337 12964 raft_consensus.cc:2749] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:57.846480 12716 raft_consensus.cc:2804] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:57.843822 12533 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:57.842918 12958 raft_consensus.cc:2764] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:23:57.863402 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 201) took 3298 ms. Trace:
I20260709 12:23:57.863489 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1076) took 3291 ms. Trace:
I20260709 12:23:57.848225 10948 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:57.844893 12875 raft_consensus.cc:697] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:57.850021 11023 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:57.855357 10980 rpcz_store.cc:276] 0709 12:23:54.564460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.817900 (+3253440us) service_pool.cc:224] Handling call
0709 12:23:57.818220 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:57.818382 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:57.818406 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:57.818444 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:57.818472 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.818521 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:57.818616 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:57.917661 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 69537us
I20260709 12:23:57.880007 11097 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:57.881448 11098 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:57.878154 10978 rpcz_store.cc:276] 0709 12:23:54.605506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.876979 (+3271473us) service_pool.cc:224] Handling call
0709 12:23:57.877267 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:57.877436 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:57.877462 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:57.877502 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:57.877530 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.877581 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:57.877672 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.850841 12389 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:57.882892 12694 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:57.828723 12465 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:57.850677 12993 raft_consensus.cc:2749] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:57.911697 10882 catalog_manager.cc:5697] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:57.858472 12878 raft_consensus.cc:2804] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:57.913167 10981 raft_consensus.cc:2393] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 3: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:57.862970 12857 raft_consensus.cc:2749] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:57.883931 11025 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:57.915225 10982 rpcz_store.cc:276] 0709 12:23:54.565495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.819263 (+3253768us) service_pool.cc:224] Handling call
0709 12:23:57.819497 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:57.863143 (+ 43646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.863345 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.915603 10984 rpcz_store.cc:276] 0709 12:23:54.571972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.834895 (+3262923us) service_pool.cc:224] Handling call
0709 12:23:57.835199 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:57.863240 (+ 28041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.863433 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:57.927973 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 44133.8us
I20260709 12:23:57.928516 10984 raft_consensus.cc:1240] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:23:57.929148 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1089) took 3320 ms. Trace:
I20260709 12:23:57.918181 10980 raft_consensus.cc:1240] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:23:57.880465 10983 rpcz_store.cc:276] 0709 12:23:54.572574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.857089 (+3284515us) service_pool.cc:224] Handling call
0709 12:23:57.857386 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:57.876565 (+ 19179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.876795 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.917903 12868 raft_consensus.cc:2749] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:57.850982 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 218) took 1876 ms. Trace:
W20260709 12:23:57.920233 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 70312.5us
I20260709 12:23:57.880112 12973 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.819419 10977 rpcz_store.cc:276] 0709 12:23:54.570877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.815220 (+3244343us) service_pool.cc:224] Handling call
0709 12:23:57.815584 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:57.816283 (+   699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.816511 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.920723 11097 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:57.882823 12905 raft_consensus.cc:2804] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:57.921366 11098 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:57.920271 10978 raft_consensus.cc:1240] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:23:57.927248 12878 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.922325 10948 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:57.921484 12389 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:57.930203 11025 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:23:57.925567 10882 catalog_manager.cc:5697] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 2 to 5, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 5 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:57.930925 10983 raft_consensus.cc:1240] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:57.879192 12908 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:57.961529 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1086) took 3354 ms. Trace:
I20260709 12:23:57.932370 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1084) took 3325 ms. Trace:
I20260709 12:23:57.911211 12929 consensus_queue.cc:1059] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:23:57.926730 12891 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:57.929430 10984 rpcz_store.cc:276] 0709 12:23:54.608298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.928065 (+3319767us) service_pool.cc:224] Handling call
0709 12:23:57.928325 (+   260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:57.928882 (+   557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.929086 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:57.933663 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 65431.2us
I20260709 12:23:57.919826 12533 raft_consensus.cc:697] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:57.924511 12940 raft_consensus.cc:2804] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:57.935227 11023 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:57.924355 12943 raft_consensus.cc:2804] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:23:57.967558 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 46166.8us
I20260709 12:23:57.940421 12973 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:57.961949 10978 rpcz_store.cc:276] 0709 12:23:54.607543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.919665 (+3312122us) service_pool.cc:224] Handling call
0709 12:23:57.920034 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:57.960187 (+ 40153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.961468 (+  1281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.911422 12816 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:23:57.934674 10975 rpcz_store.cc:276] 0709 12:23:55.975138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.651750 (+1676612us) service_pool.cc:224] Handling call
0709 12:23:57.846584 (+194834us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.963431 11025 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:57.963485 10980 rpcz_store.cc:276] 0709 12:23:54.607000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.917526 (+3310526us) service_pool.cc:224] Handling call
0709 12:23:57.917888 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:57.929992 (+ 12104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.932323 (+  2331us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:57.971908 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 50656.6us
I20260709 12:23:57.973089 11023 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:57.973356 11098 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:57.975708 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:57.931494 12972 raft_consensus.cc:2764] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:23:57.921979 12898 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:57.965147 10882 catalog_manager.cc:5697] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 1 to 2, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 2 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:23:57.934367 12708 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:57.960155 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1090) took 3351 ms. Trace:
I20260709 12:23:58.115267 10983 rpcz_store.cc:276] 0709 12:23:54.608573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.930478 (+3321905us) service_pool.cc:224] Handling call
0709 12:23:57.930767 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:57.959862 (+ 29095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.960080 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:57.968195 10948 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:23:58.117449 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 149295us
I20260709 12:23:58.035243 12465 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:57.971262 12993 consensus_queue.cc:1048] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.107s
I20260709 12:23:57.932978 12992 consensus_queue.cc:237] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:58.071475 12964 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.026585 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:57.968055 12868 raft_consensus.cc:2749] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:57.969503 12990 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 12:23:58.036742 12915 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:57.964214 12857 raft_consensus.cc:2764] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:23:57.962781 12389 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:57.968312 12905 raft_consensus.cc:697] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:57.966495 12875 consensus_queue.cc:237] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:58.037688 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1690) took 1224 ms. Trace:
I20260709 12:23:57.961836 12878 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:58.077009 12929 raft_consensus.cc:2749] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:57.966379 12675 raft_consensus.cc:2804] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:57.933171 12462 consensus_queue.cc:1048] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
W20260709 12:23:58.080425 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.079913 12533 consensus_queue.cc:237] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:57.961302 12908 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:58.089641 10882 catalog_manager.cc:5697] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 1 to 3, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 3 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:58.092113 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 222592us
I20260709 12:23:58.116444 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:23:58.122961 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 149659us
I20260709 12:23:58.121861 12943 raft_consensus.cc:697] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:58.126791 10978 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:23:58.157021 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:58.157711 10978 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:23:58.086673 12961 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.086974 12901 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:58.138345 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:58.077711 12866 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:58.088661 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:58.136055 10948 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:58.120466 12708 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:58.126149 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 80369.4us
I20260709 12:23:58.168876 12708 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:58.151576 12465 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:23:58.168607 12943 consensus_queue.cc:237] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:58.170128 12866 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:58.170950 10979 raft_consensus.cc:1240] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:58.171852 10977 raft_consensus.cc:2393] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 5: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:58.125136 12574 raft_consensus.cc:2749] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:58.152225 11644 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:23:58.154641 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 191261us
W20260709 12:23:58.151638 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 178602us
I20260709 12:23:58.149338 10981 rpcz_store.cc:276] 0709 12:23:56.813222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.631144 (+817922us) service_pool.cc:224] Handling call
0709 12:23:58.037458 (+406314us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b5400334354. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:58.037620 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":646434688}
I20260709 12:23:58.158814 10882 catalog_manager.cc:5697] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 2 to 4, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 4 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:58.179749 11025 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:58.180042 11023 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:58.180557 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:58.180727 11025 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:58.120689 12958 consensus_queue.cc:1059] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:23:58.122742 12940 raft_consensus.cc:697] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:58.126458 13010 raft_consensus.cc:2804] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:58.165655 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:58.145710 12964 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:58.173171 10948 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:58.156544 12908 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:58.183405 11023 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:23:58.208600 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:58.147578 13009 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.191805 10882 catalog_manager.cc:5697] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:58.210870 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:58.211591 10882 catalog_manager.cc:5697] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 2 to 4, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 4 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:58.212811 11129 raft_consensus.cc:1275] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:23:58.168198 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:58.164474 12675 raft_consensus.cc:697] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:58.164536 12891 raft_consensus.cc:697] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:58.215691 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:58.216316 11134 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:58.205456 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 52820.6us
I20260709 12:23:58.206634 11125 raft_consensus.cc:1275] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:58.217113 11130 raft_consensus.cc:1240] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:23:58.207050 10983 raft_consensus.cc:1240] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:23:58.218293 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1096) took 2781 ms. Trace:
I20260709 12:23:58.218648 10983 rpcz_store.cc:276] 0709 12:23:55.437862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.206494 (+2768632us) service_pool.cc:224] Handling call
0709 12:23:58.206830 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:58.217984 (+ 11154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:58.218233 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:58.125443 12972 raft_consensus.cc:2749] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:58.178527 12895 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:23:58.204465 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.192618 12857 raft_consensus.cc:2749] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:58.225289 11023 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:58.213269 10882 catalog_manager.cc:5697] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 1 to 3, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 3 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:58.195519 12929 raft_consensus.cc:2804] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:58.227602 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:58.169415 12465 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:58.166514 12961 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:58.237154 11127 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:58.229488 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:58.229554 10948 connection.cc:256] RPC call timeout handler was delayed by -1.3727163819999078s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22340000000000002s for a response
I20260709 12:23:58.239303 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:58.239792 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:58.200294 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:58.244644 11134 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
W20260709 12:23:58.245625 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 232089us
I20260709 12:23:58.249337 11023 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:58.234506 10882 catalog_manager.cc:5697] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:58.215425 12635 raft_consensus.cc:2804] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:58.166921 13014 consensus_queue.cc:1048] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 12:23:58.253661 11127 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:23:58.228801 12862 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:58.266826 10978 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:23:58.267578 11023 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:23:58.271097 13021 log.cc:927] Time spent T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:23:58.235209 13019 raft_consensus.cc:2804] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:58.273113 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1087) took 3665 ms. Trace:
I20260709 12:23:58.265991 10882 catalog_manager.cc:5697] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 1 to 2, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 2 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:58.273478 10982 rpcz_store.cc:276] 0709 12:23:54.607788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.927940 (+3320152us) service_pool.cc:224] Handling call
0709 12:23:57.928279 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:57.928632 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:57.928663 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:57.933938 (+  5275us) log.cc:844] Serialized 26 byte log entry
0709 12:23:58.123163 (+189225us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:58.123204 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:58.124066 (+   862us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:58.272889 (+148823us) raft_consensus.cc:1685] finished
0709 12:23:58.272910 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:58.273053 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1131,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":3013,"thread_start_us":156478,"threads_started":1,"wal-append.queue_time_us":206753}
I20260709 12:23:58.227263 12993 consensus_queue.cc:1059] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:23:58.275755 10982 raft_consensus.cc:1240] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:23:58.206975 13018 consensus_queue.cc:1059] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:23:58.280180 10882 catalog_manager.cc:5697] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 2 to 5, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 5 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:58.235508 12866 consensus_queue.cc:1059] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:23:58.280956 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1103) took 2744 ms. Trace:
I20260709 12:23:58.286653 10982 rpcz_store.cc:276] 0709 12:23:55.536361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.275009 (+2738648us) service_pool.cc:224] Handling call
0709 12:23:58.275524 (+   515us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:58.280650 (+  5126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:58.280892 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:58.272358 12862 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.272174 12635 raft_consensus.cc:697] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:58.227840 13009 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:58.234688 12675 consensus_queue.cc:237] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:58.269594 13013 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.289357 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1667) took 2198 ms. Trace:
W20260709 12:23:58.290035 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 117754us
I20260709 12:23:58.272403 12462 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:58.276854 11098 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:58.260185 12895 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:23:58.266466 12972 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.287149 13032 raft_consensus.cc:2749] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:58.295429 12862 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:58.349401 13014 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:58.319965 12574 raft_consensus.cc:3055] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:58.349999 13014 raft_consensus.cc:697] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:58.307639 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1671) took 2175 ms. Trace:
I20260709 12:23:58.305724 12816 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.350373 12574 raft_consensus.cc:740] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:58.351871 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1662) took 2286 ms. Trace:
I20260709 12:23:58.316387 10978 raft_consensus.cc:1275] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:23:58.330325 12898 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:58.352948 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1674) took 2220 ms. Trace:
I20260709 12:23:58.353346 10978 rpcz_store.cc:276] 0709 12:23:56.132503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.315709 (+2183206us) service_pool.cc:224] Handling call
0709 12:23:58.316048 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:58.352669 (+ 36621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:58.352892 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:58.321681 11006 debug-util.cc:398] Leaking SignalData structure 0x7b08000e4000 after lost signal to thread 9802
W20260709 12:23:58.355049 11006 debug-util.cc:398] Leaking SignalData structure 0x7b080011f640 after lost signal to thread 10916
I20260709 12:23:58.355427 10978 raft_consensus.cc:1275] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:58.279475 12943 consensus_queue.cc:1059] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:23:58.361531 12943 raft_consensus.cc:3055] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:58.361939 12943 raft_consensus.cc:740] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:58.362815 12943 consensus_queue.cc:260] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:58.363267 12716 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.363747 12716 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:58.363991 12943 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:58.365096 10978 raft_consensus.cc:1275] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:23:58.263528 13022 consensus_queue.cc:1048] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:23:58.367152 10978 pending_rounds.cc:85] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 3
I20260709 12:23:58.367524 10978 pending_rounds.cc:107] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 4.4
W20260709 12:23:58.278923 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 126807us
I20260709 12:23:58.370791 12857 raft_consensus.cc:3055] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:58.371214 12857 raft_consensus.cc:740] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:58.258857 13025 consensus_queue.cc:1048] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:23:58.371994 12857 consensus_queue.cc:260] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:58.372406 12878 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:58.326808 10982 rpcz_store.cc:276] 0709 12:23:56.090778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.288508 (+2197730us) service_pool.cc:224] Handling call
0709 12:23:58.288846 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:58.289024 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:58.289047 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:58.289087 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:58.289116 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:58.289170 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:58.289295 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:58.373267 12857 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:58.277777 13016 consensus_queue.cc:1059] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:23:58.263901 12905 consensus_queue.cc:237] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:58.328529 12635 consensus_queue.cc:237] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:58.351279 12964 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:58.377497 12907 raft_consensus.cc:3055] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:58.301216 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 205) took 3734 ms. Trace:
I20260709 12:23:58.377952 12907 raft_consensus.cc:740] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:58.378269 10979 rpcz_store.cc:276] 0709 12:23:54.566645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.812683 (+3246038us) service_pool.cc:224] Handling call
0709 12:23:57.813042 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:58.171366 (+358324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:58.300922 (+129556us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b54001a1154. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:58.301139 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":822669568}
I20260709 12:23:58.303066 12909 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:58.275532 13028 consensus_queue.cc:1048] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:23:58.329697 12462 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:58.342437 12972 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:58.329708 12990 consensus_queue.cc:1059] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:23:58.346954 12465 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:58.350329 13015 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.350807 10975 rpcz_store.cc:276] 0709 12:23:56.131754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.306648 (+2174894us) service_pool.cc:224] Handling call
0709 12:23:58.307060 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:58.307259 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:58.307294 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:58.307343 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:58.307381 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:58.307446 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:58.307572 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:58.352857 13009 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:58.290819 13020 consensus_queue.cc:1048] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 12:23:58.358357 12816 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:58.435794 12462 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:58.352331 12574 consensus_queue.cc:260] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:58.284730 12940 consensus_queue.cc:237] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:58.332352 13013 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:58.366609 12875 raft_consensus.cc:2804] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:58.295742 12891 consensus_queue.cc:237] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:58.465387 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 243460us
I20260709 12:23:58.368788 13022 consensus_queue.cc:1059] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:58.321112 10984 raft_consensus.cc:1240] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:58.470479 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1677) took 2304 ms. Trace:
I20260709 12:23:58.470912 10984 rpcz_store.cc:276] 0709 12:23:56.166189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.320613 (+2154424us) service_pool.cc:224] Handling call
0709 12:23:58.320934 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:58.470138 (+149204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:58.470410 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:58.472223 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:58.369295 12862 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:58.317797 13031 raft_consensus.cc:2804] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:58.382292 10978 raft_consensus.cc:2889] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:58.382069 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 105453us
I20260709 12:23:58.385751 11134 raft_consensus.cc:1275] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:58.426973 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:58.430092 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:58.431411 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:58.431849 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:58.432314 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:58.367239 12961 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:58.445361 10982 raft_consensus.cc:1275] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:23:58.433960 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:58.462455 12929 raft_consensus.cc:697] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:23:58.432464 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 191938us
I20260709 12:23:58.504333 10948 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:23:58.356431 11006 debug-util.cc:398] Leaking SignalData structure 0x7b080004d6e0 after lost signal to thread 11009
I20260709 12:23:58.352267 10977 rpcz_store.cc:276] 0709 12:23:56.065156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.291366 (+2226210us) service_pool.cc:224] Handling call
0709 12:23:58.351304 (+ 59938us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:58.351496 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:58.351523 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:58.351570 (+    47us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:58.351600 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:58.351668 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:58.351807 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:58.345790 12908 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:58.425097 13025 raft_consensus.cc:2749] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:58.359440 12730 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:58.461920 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.435657 12694 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:58.444620 12975 raft_consensus.cc:3055] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:58.476473 11025 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:23:58.490675 11681 raft_consensus.cc:2368] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 5. Current term is 6.
I20260709 12:23:58.491711 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1695) took 1110 ms. Trace:
I20260709 12:23:58.466256 13010 raft_consensus.cc:697] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:58.534324 10948 leader_election.cc:400] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 5. Current term is 6.
I20260709 12:23:58.534662 10948 leader_election.cc:403] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:23:58.458489 13019 raft_consensus.cc:697] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:23:58.448455 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 180927us
I20260709 12:23:58.549520 11023 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:58.549921 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:58.550602 11131 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:58.381163 13016 raft_consensus.cc:3055] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:58.551139 13016 raft_consensus.cc:740] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:58.501835 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:58.508543 10979 raft_consensus.cc:1240] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:23:58.378906 12907 consensus_queue.cc:260] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:58.511991 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:58.552893 11058 raft_consensus.cc:2368] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4.
I20260709 12:23:58.481315 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:58.512900 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:58.514894 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:58.512557 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:58.350996 13014 consensus_queue.cc:237] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:58.555845 11057 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
W20260709 12:23:58.523576 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.491320 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:58.527006 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:58.456480 13015 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:58.499673 12574 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:58.528812 11643 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:58.562042 11643 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:58.563469 11643 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:58.527652 10978 rpcz_store.cc:276] 0709 12:23:57.381253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.364427 (+983174us) service_pool.cc:224] Handling call
0709 12:23:58.364758 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:58.479951 (+115193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:58.491638 (+ 11687us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:58.494701 12675 consensus_queue.cc:1048] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:23:58.532943 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:58.535369 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:58.535652 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:58.536231 12862 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:58.536453 13041 raft_consensus.cc:3055] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:58.537005 13031 raft_consensus.cc:697] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:58.515933 12875 raft_consensus.cc:697] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:23:58.539428 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 63017.3us
I20260709 12:23:58.581881 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:58.582981 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:58.540279 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1654) took 3935 ms. Trace:
I20260709 12:23:58.540773 13047 raft_consensus.cc:2804] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:58.536131 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:58.532030 12975 raft_consensus.cc:740] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:58.498910 13030 consensus_queue.cc:1048] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 12:23:58.554188 12915 raft_consensus.cc:2749] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:58.543551 13010 consensus_queue.cc:237] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:58.531878 12694 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:58.594237 11006 debug-util.cc:398] Leaking SignalData structure 0x7b08003ce040 after lost signal to thread 11084
I20260709 12:23:58.546586 12730 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:58.548300 12462 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:58.509595 12898 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.533967 11674 raft_consensus.cc:2393] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
W20260709 12:23:58.539148 13023 log.cc:927] Time spent T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:23:58.522521 12964 raft_consensus.cc:2749] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:58.523415 11677 raft_consensus.cc:1275] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:23:58.495895 12973 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:58.589819 11643 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:23:58.602387 13039 consensus_queue.cc:1059] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:23:58.595983 11097 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:23:58.660597 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 64704.9us
I20260709 12:23:58.631474 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:58.599931 11051 raft_consensus.cc:2368] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3.
I20260709 12:23:58.600625 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:58.578929 12389 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:58.593007 13053 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:58.603472 11675 raft_consensus.cc:2393] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 3: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:23:58.528012 12961 consensus_queue.cc:1059] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 12:23:58.544821 12868 raft_consensus.cc:2749] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 5. Current term is 6.
I20260709 12:23:58.574928 10975 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:58.609656 10984 raft_consensus.cc:1240] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 4. Ops: []
I20260709 12:23:58.611740 11134 raft_consensus.cc:1275] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:23:58.616146 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 288523us
I20260709 12:23:58.576956 13041 raft_consensus.cc:740] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:58.574384 12635 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:58.624161 11058 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:23:58.620044 11098 connection.cc:256] RPC call timeout handler was delayed by -1.2274477579999257s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
I20260709 12:23:58.683507 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:58.684610 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:58.624359 11059 raft_consensus.cc:1275] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:23:58.585860 11676 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:23:58.574683 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:23:58.631349 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 79476.5us
I20260709 12:23:58.593389 12911 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:58.674678 11673 raft_consensus.cc:1240] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:58.596284 12905 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:58.603788 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:58.640257 11132 raft_consensus.cc:1275] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:58.515352 12533 consensus_queue.cc:1059] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.110s
I20260709 12:23:58.601306 13047 raft_consensus.cc:697] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:23:58.649772 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 60053.6us
I20260709 12:23:58.671231 13049 raft_consensus.cc:2804] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:58.633011 12907 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:58.569362 12708 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:58.629180 13025 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:58.661351 11097 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:23:58.748157 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 86872.6us
I20260709 12:23:58.543741 13013 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:58.600907 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:58.646688 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:58.644138 12898 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:58.673385 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:58.779227 11680 raft_consensus.cc:1240] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:23:58.647346 12975 consensus_queue.cc:260] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:58.674817 12462 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:58.675091 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:58.675894 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:58.678232 11060 raft_consensus.cc:2393] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 3: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:58.552011 13016 consensus_queue.cc:260] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:58.864960 11051 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:58.865622 13016 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:58.866143 11675 raft_consensus.cc:1275] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:23:58.634785 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:58.667387 12730 raft_consensus.cc:2749] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:58.701097 11131 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 5.
I20260709 12:23:58.867835 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:58.704907 11056 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 3: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:58.542521 13051 consensus_queue.cc:1059] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:23:58.682004 11006 debug-util.cc:398] Leaking SignalData structure 0x7b08002fdb00 after lost signal to thread 11159
I20260709 12:23:58.628228 12929 consensus_queue.cc:237] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:58.706522 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:58.889688 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:58.707115 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:58.706892 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:58.706844 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:58.757197 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:58.760576 11097 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:23:58.691169 12878 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:58.691592 12635 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:23:58.733359 12868 raft_consensus.cc:3055] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:58.706178 12816 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:58.707845 12972 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:58.739787 13049 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.157063 13049 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:58.702879 12675 consensus_queue.cc:1048] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:23:58.647728 13019 consensus_queue.cc:237] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:58.873314 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 190706us
I20260709 12:23:58.771967 13013 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.166424 13013 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:59.167057 12878 raft_consensus.cc:2804] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:59.167476 12878 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:59.167860 12878 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:59.168613 13013 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:58.881546 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:59.170033 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:23:59.170854 13045 log.cc:927] Time spent T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
W20260709 12:23:59.172806 13056 log.cc:927] Time spent T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 12:23:59.126214 12635 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:59.174626 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1100) took 3735 ms. Trace:
I20260709 12:23:59.175017 10983 rpcz_store.cc:276] 0709 12:23:55.438900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.219431 (+2780531us) service_pool.cc:224] Handling call
0709 12:23:58.219758 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:58.220145 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:58.220176 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:58.312114 (+ 91938us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b2c00030d28. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8a6dda11 00007f8f8a6ed372 00007f8f8be1fa01 00007f8f8bde443a 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2
0709 12:23:58.312591 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 12:23:58.503061 (+190470us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:58.503492 (+   431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:58.503867 (+   375us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:59.174303 (+670436us) raft_consensus.cc:1685] finished
0709 12:23:59.174322 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:59.174562 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9105,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":22001,"spinlock_wait_cycles":10727808,"thread_start_us":189478,"threads_started":1,"wal-append.queue_time_us":423340}
I20260709 12:23:58.881618 13041 consensus_queue.cc:260] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:58.918573 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:58.980798 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:59.197734 11059 raft_consensus.cc:2368] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 2. Current term is 3.
I20260709 12:23:58.919139 11134 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:23:59.199039 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:59.200109 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:59.201287 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:59.043591 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:23:59.019822 13027 log.cc:927] Time spent T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 12:23:58.926748 11132 raft_consensus.cc:2368] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4.
I20260709 12:23:59.054214 12964 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.029428 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:59.025861 11645 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:23:58.888667 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:23:59.030882 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.925912 11133 raft_consensus.cc:2393] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 4: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:59.225172 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:58.677794 12875 consensus_queue.cc:237] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:59.027063 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:59.183719 11676 raft_consensus.cc:1275] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:23:59.114394 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.775415 12940 consensus_queue.cc:1059] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.203s
I20260709 12:23:58.765196 13025 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:59.034229 11006 debug-util.cc:398] Leaking SignalData structure 0x7b0800322340 after lost signal to thread 11705
I20260709 12:23:58.783231 11128 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
W20260709 12:23:59.312723 11023 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.000s	sys 0.011s
I20260709 12:23:59.039520 12973 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:58.875916 13064 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.874560 13028 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:58.771154 12621 raft_consensus.cc:2804] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:59.322863 12621 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:23:59.323295 12621 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:59.016753 13026 raft_consensus.cc:3055] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:59.326332 13026 raft_consensus.cc:740] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:58.919581 13051 consensus_queue.cc:1243] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer bc01179655564f29b83babe396377cbb log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:23:58.853627 12908 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:58.969244 12961 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.328526 12961 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:59.329017 12716 consensus_meta.cc:287] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.965s	user 0.008s	sys 0.002s
I20260709 12:23:59.329458 12716 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:59.331290 12961 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:58.989866 11672 raft_consensus.cc:1275] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:23:59.125970 12905 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:59.165843 13061 log.cc:927] Time spent T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.248s	user 0.000s	sys 0.000s
I20260709 12:23:59.332629 12905 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:59.334847 12905 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:59.192591 11131 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 4.
I20260709 12:23:59.202575 11060 raft_consensus.cc:2410] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:59.335937 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:59.336127 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:23:59.336781 11060 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:59.337684 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:59.338857 11052 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:23:59.339438 11052 raft_consensus.cc:606] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:23:59.340982 11052 raft_consensus.cc:1275] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:59.343436 13025 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:59.344766 11060 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 3.
W20260709 12:23:59.345118 12694 consensus_meta.cc:287] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.713s	user 0.005s	sys 0.003s
I20260709 12:23:59.332666 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:59.351850 11127 raft_consensus.cc:2393] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 4: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:59.352705 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:59.353408 11127 raft_consensus.cc:2393] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 3: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:59.354893 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:59.214531 11134 raft_consensus.cc:2393] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 3: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:59.356556 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:59.219283 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:59.220639 11057 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 3: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:59.359632 11057 raft_consensus.cc:1275] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:59.336731 11131 raft_consensus.cc:2393] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:23:58.950489 13037 consensus_queue.cc:1059] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.252s
I20260709 12:23:58.592655 10976 rpcz_store.cc:276] 0709 12:23:54.604650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.872006 (+3267356us) service_pool.cc:224] Handling call
0709 12:23:57.919633 (+ 47627us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:57.935959 (+ 16326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:57.939989 (+  4030us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:57.972723 (+ 32734us) log.cc:844] Serialized 26 byte log entry
0709 12:23:58.201335 (+228612us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:58.207446 (+  6111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:58.310874 (+103428us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b540035fa54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:58.310928 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:58.539883 (+228955us) raft_consensus.cc:1685] finished
0709 12:23:58.539916 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:58.540192 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":433,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":5959,"spinlock_wait_cycles":3434240,"thread_start_us":71949,"threads_started":1,"wal-append.queue_time_us":406774}
I20260709 12:23:59.126490 12868 raft_consensus.cc:740] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:23:59.228888 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:23:59.229372 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 203605us
W20260709 12:23:59.371853 10949 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.010s	sys 0.002s
W20260709 12:23:59.372279 10949 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.010s	sys 0.003s
I20260709 12:23:58.701635 13031 consensus_queue.cc:237] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:23:59.372670 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 798217us
I20260709 12:23:59.181059 12635 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:59.282414 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:59.283049 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:59.284895 11024 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:58.926064 13047 consensus_queue.cc:237] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:59.125475 12901 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:59.282701 13046 log.cc:927] Time spent T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.333s	user 0.001s	sys 0.000s
W20260709 12:23:59.312520 12992 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.001s	sys 0.010s
W20260709 12:23:59.310456 13055 log.cc:927] Time spent T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.665s	user 0.005s	sys 0.000s
I20260709 12:23:59.391187 11133 raft_consensus.cc:1240] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:23:59.044691 11055 raft_consensus.cc:1240] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:23:59.313268 11023 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.000s	sys 0.012s
I20260709 12:23:59.287048 13033 raft_consensus.cc:2804] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:23:59.317494 13063 log.cc:927] Time spent T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:23:59.322526 13042 log.cc:927] Time spent T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 12:23:59.344803 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:59.361375 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:59.091995 13015 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:59.362413 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:59.439816 11127 raft_consensus.cc:2393] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 6: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:59.357761 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:59.226214 12964 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:59.368171 11058 raft_consensus.cc:1240] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3. Ops: []
W20260709 12:23:59.336639 12943 consensus_meta.cc:287] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.972s	user 0.007s	sys 0.005s
I20260709 12:23:59.345608 12694 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:59.374709 10949 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 1.682s (SENT) [suppressed 15 similar messages]
W20260709 12:23:59.455356 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 80666.5us
W20260709 12:23:59.379922 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 95129.2us
I20260709 12:23:59.457664 11024 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:59.149099 13054 consensus_queue.cc:1048] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.166s
I20260709 12:23:59.385807 11053 raft_consensus.cc:1275] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:59.486251 11644 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:59.487715 11644 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
W20260709 12:23:59.374995 12921 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.006s	sys 0.006s
I20260709 12:23:59.368520 12961 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:59.392383 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 693391us
I20260709 12:23:59.396597 12866 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:59.381901 11051 consensus_meta.cc:287] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.000s
W20260709 12:23:59.394620 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 634091us
W20260709 12:23:59.386379 12574 consensus_meta.cc:287] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.818s	user 0.002s	sys 0.008s
W20260709 12:23:59.398077 11129 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.951s	user 0.000s	sys 0.031s
I20260709 12:23:59.399505 11025 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:23:59.554868 11129 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.117s	user 0.000s	sys 0.031s
I20260709 12:23:59.435570 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:59.436146 12868 consensus_queue.cc:260] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:59.437649 11098 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:59.442049 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:59.555965 11131 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
I20260709 12:23:59.556438 11133 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 3: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:59.432173 10948 leader_election.cc:400] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 2. Current term is 3.
I20260709 12:23:59.556948 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:59.557667 11131 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:23:59.387262 13052 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:23:59.559064 13052 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:59.559455 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:23:59.387672 12992 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.002s	sys 0.011s
I20260709 12:23:59.490689 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:23:59.561518 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:59.562155 10983 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:59.564072 10979 raft_consensus.cc:1275] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:23:59.565266 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:59.565819 10979 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:59.566433 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:59.568063 10982 raft_consensus.cc:1275] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:59.491523 11644 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:23:59.572093 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 82026.6us
I20260709 12:23:59.322443 13028 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:59.366714 12708 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:59.396790 12389 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:59.439348 13033 raft_consensus.cc:697] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:59.481555 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:23:59.318670 13064 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:59.396971 13037 consensus_queue.cc:1048] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.097s
I20260709 12:23:59.399884 12533 consensus_queue.cc:1048] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.098s
I20260709 12:23:59.510419 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:23:59.497146 12921 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.006s	sys 0.006s
I20260709 12:23:59.492686 13019 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:59.448866 12878 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:59.517942 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:59.518132 13074 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.518736 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:23:59.518924 12898 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:59.520042 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 210) took 4565 ms. Trace:
W20260709 12:23:59.521898 13043 log.cc:927] Time spent T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 12:23:59.523144 12621 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:59.577525 13035 raft_consensus.cc:2749] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:59.704350 13074 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:59.704893 12621 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:59.705555 12621 consensus_queue.cc:1048] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:59.387130 12901 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:59.706775 13074 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:59.707362 13074 consensus_queue.cc:1059] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:59.707739 12901 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:59.494860 12685 raft_consensus.cc:2749] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:59.497042 12465 raft_consensus.cc:2804] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:59.544008 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:59.454259 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:23:59.556981 10948 leader_election.cc:403] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:23:59.561683 11058 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
I20260709 12:23:59.563146 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:59.715785 10984 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:59.699617 10981 rpcz_store.cc:276] 0709 12:23:54.954757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.181570 (+3226813us) service_pool.cc:224] Handling call
0709 12:23:58.181977 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:58.185524 (+  3547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:58.185562 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:58.186075 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 12:23:58.619901 (+433826us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:58.645613 (+ 25712us) log.cc:844] Serialized 14 byte log entry
0709 12:23:58.646502 (+   889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:58.647714 (+  1212us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:59.041525 (+393811us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b18004430e0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cf73f3 00007f8f88cf97c1 00007f8f88cf9779 00007f8f88cf9709 00007f8f88cf96d1 00007f8f88cf89cd 0000000000388634 0000000000388479 00007f8f88cda83a
0709 12:23:59.519691 (+478166us) raft_consensus.cc:1685] finished
0709 12:23:59.519807 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:59.519971 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13464,"prepare.queue_time_us":26659,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":54,"raft.queue_time_us":8843,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":17277,"spinlock_wait_cycles":8299392,"thread_start_us":392631,"threads_started":1,"wal-append.queue_time_us":566007}
I20260709 12:23:59.577965 10980 raft_consensus.cc:1275] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:59.511611 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:59.327320 13026 consensus_queue.cc:260] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:23:59.720227 11134 raft_consensus.cc:1275] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:59.502753 12908 consensus_queue.cc:1048] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:23:59.502987 12973 consensus_queue.cc:1048] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 12:23:59.553639 11052 raft_consensus.cc:1275] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:59.493623 13049 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:59.569700 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:59.512979 12961 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:59.547768 11051 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 5.
I20260709 12:23:59.673892 12708 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.511466 13062 consensus_queue.cc:1059] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 12:23:59.652094 11133 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:59.609115 12730 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.130s
I20260709 12:23:59.717300 10982 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2"
dest_uuid: "bc01179655564f29b83babe396377cbb"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:41958
W20260709 12:23:59.719678 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 320978us
I20260709 12:23:59.719981 11125 raft_consensus.cc:1275] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:59.770803 10982 raft_consensus.cc:606] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:23:59.771230 10982 raft_consensus.cc:614] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:59.716713 11644 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:23:59.772342 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 55696.6us
I20260709 12:23:59.562866 12675 consensus_queue.cc:1059] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.137s
I20260709 12:23:59.534804 13079 consensus_queue.cc:1048] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.186s
I20260709 12:23:59.656790 10983 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:23:59.730674 10984 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:59.605208 12868 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:59.581274 12574 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:59.674062 12857 consensus_meta.cc:287] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 1.282s	user 0.013s	sys 0.002s
I20260709 12:23:59.611699 13041 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:59.708351 13022 raft_consensus.cc:3055] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:59.739101 11134 raft_consensus.cc:1275] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:59.605146 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:59.700284 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1684) took 1083 ms. Trace:
W20260709 12:23:59.734949 12909 consensus_meta.cc:287] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 1.355s	user 0.011s	sys 0.001s
I20260709 12:23:59.757416 11056 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1458) took 1173 ms. Trace:
I20260709 12:23:59.605841 12816 consensus_queue.cc:1059] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.134s
I20260709 12:23:59.552472 12866 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:59.723205 13052 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:59.654578 12992 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.733410 13013 raft_consensus.cc:2804] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:59.732245 12465 raft_consensus.cc:697] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:59.847636 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:23:59.742486 10975 consensus_meta.cc:287] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 1.040s	user 0.010s	sys 0.001s
I20260709 12:23:59.758627 11128 raft_consensus.cc:2393] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:23:59.785503 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1678) took 1567 ms. Trace:
I20260709 12:23:59.774799  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:59.859459  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:59.860550 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:59.857554 11130 rpcz_store.cc:276] 0709 12:23:58.218390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.218682 (+   292us) service_pool.cc:224] Handling call
0709 12:23:58.219002 (+   320us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:58.225981 (+  6979us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:58.226019 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:58.226728 (+   709us) log.cc:844] Serialized 52 byte log entry
0709 12:23:58.464595 (+237867us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:58.464632 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:58.464695 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:59.521256 (+1056561us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:23:59.775401 (+254145us) raft_consensus.cc:1685] finished
0709 12:23:59.775422 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:59.785432 (+ 10010us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6570,"raft.queue_time_us":18735,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":132,"spinlock_wait_cycles":4961152,"thread_start_us":204399,"threads_started":1,"wal-append.queue_time_us":880243}
I20260709 12:23:59.786490 11680 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEARNER]: Advancing to term 4
I20260709 12:23:59.847687 12908 consensus_queue.cc:1048] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:23:59.866761  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:23:59.845955 12907 consensus_meta.cc:287] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 1.089s	user 0.008s	sys 0.003s
I20260709 12:23:59.751047 10976 raft_consensus.cc:1275] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:23:59.751820 13020 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.757285 13074 raft_consensus.cc:2764] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:23:59.856599 10975 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
I20260709 12:23:59.888098 13074 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.888679 13074 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:59.840515 10977 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:59.890025 11054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41294 (request call id 1123) took 1376 ms. Trace:
I20260709 12:23:59.890471 12868 raft_consensus.cc:2749] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 2. Current term is 3.
I20260709 12:23:59.891319 13011 raft_consensus.cc:3055] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:59.891754 13011 raft_consensus.cc:740] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:59.891883 10984 raft_consensus.cc:1275] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:59.890501 11054 rpcz_store.cc:276] 0709 12:23:58.513658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.526746 (+ 13088us) service_pool.cc:224] Handling call
0709 12:23:59.889807 (+1363061us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400187ed4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:59.889957 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2345567360}
W20260709 12:23:59.888041 10975 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1125) took 1445 ms (client timeout 1641 ms). Trace:
I20260709 12:23:59.752578 12716 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:59.896430 12716 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.896911 12716 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:59.899187 12716 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:59.579564 13068 consensus_queue.cc:1048] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.221s
I20260709 12:23:59.899384 13035 raft_consensus.cc:3055] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:59.896801 13011 consensus_queue.cc:260] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:59.900070 13035 raft_consensus.cc:740] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:23:59.900628 13011 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:59.901564 11680 raft_consensus.cc:1275] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 LEARNER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:59.901057 13035 consensus_queue.cc:260] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:59.787861 12915 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.000s	sys 0.030s
I20260709 12:23:59.801726 12730 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:59.763460 11051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1455) took 1179 ms. Trace:
I20260709 12:23:59.782526 12901 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.903259 12901 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:59.904711 12866 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:59.905284 12866 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.812160 11056 rpcz_store.cc:276] 0709 12:23:58.584405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.045034 (+460629us) service_pool.cc:224] Handling call
0709 12:23:59.045339 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:59.045537 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:23:59.370187 (+324650us) log.cc:844] Serialized 14 byte log entry
0709 12:23:59.757035 (+386848us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:59.757091 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:59.757137 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.757207 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:59.757342 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25340,"prepare.queue_time_us":463694,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":24092,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":13212,"thread_start_us":695155,"threads_started":2}
I20260709 12:23:59.818768 13064 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:59.765942 12708 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:59.907761 13028 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:59.908275 12708 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:23:59.807145 13022 raft_consensus.cc:740] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:23:59.909456 13022 consensus_queue.cc:260] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:59.910704 13022 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:59.911067 12878 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:23:59.822511 13075 log.cc:927] Time spent T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 12:23:59.823117 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 59191.3us
I20260709 12:23:59.828502 13049 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:59.926311 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:23:59.849481 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:59.927301 10983 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
I20260709 12:23:59.790874 12964 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:59.855969 10980 raft_consensus.cc:1275] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:59.789629 12574 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:23:59.834669 12911 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.929176 12911 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:59.603684 10979 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:23:59.930009 12574 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:23:59.930840 11679 raft_consensus.cc:2410] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:23:59.877132 10982 raft_consensus.cc:1275] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:59.837934 13013 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.931671 10981 raft_consensus.cc:1240] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:59.881862 11678 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:59.931998 13013 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:59.882421 12465 consensus_queue.cc:237] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:59.775732 13033 consensus_queue.cc:237] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:23:59.860133 13053 consensus_meta.cc:287] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 1.184s	user 0.011s	sys 0.000s
I20260709 12:23:59.942481 13053 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:59.886804 13020 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:59.902487 13035 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:59.943239 11681 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:23:59.820905 11133 raft_consensus.cc:1275] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:59.926532 11128 raft_consensus.cc:3055] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:59.927326 10984 raft_consensus.cc:2393] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 4: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:23:59.846894 12694 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:59.857991 13082 raft_consensus.cc:3055] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:23:59.902422 12915 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.000s	sys 0.030s
I20260709 12:23:59.902765 12730 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.867287 12621 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.905705 12866 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:59.879951 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:23:59.855073 12992 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:23:59.953493 10984 raft_consensus.cc:1240] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:23:59.955679 10979 raft_consensus.cc:1275] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:23:59.965148 12964 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.954486 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:23:59.965896 11643 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:23:59.987295 10982 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 4.
I20260709 12:23:59.978533 11055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1127) took 1460 ms. Trace:
I20260709 12:24:00.000701 11643 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
W20260709 12:23:59.972818 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 573360us
I20260709 12:24:00.000320 11055 rpcz_store.cc:276] 0709 12:23:58.518289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.554689 (+ 36400us) service_pool.cc:224] Handling call
0709 12:23:58.615259 (+ 60570us) spinlock_profiling.cc:243] Waited 5.99 ms on lock 0x7b58001a5e98. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90dbdfc0 00007f8f90da8929 00007f8f90da83d2 00007f8f8a31fbd4
0709 12:23:59.044415 (+429156us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:59.392212 (+347797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.978271 (+586059us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b54002dc8d0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:23:59.978456 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1000123008}
I20260709 12:23:59.956414 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:00.026513 10980 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:59.965735 12716 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.004304 11672 raft_consensus.cc:2376] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6. Re-sending same reply.
I20260709 12:23:59.984448 12964 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:00.039721 13068 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:00.040740 13068 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:00.041749 12964 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:23:59.896021 10975 rpcz_store.cc:269] 0709 12:23:58.442593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.459583 (+ 16990us) service_pool.cc:224] Handling call
0709 12:23:59.887973 (+1428390us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:00.048936 11097 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.000s	sys 0.020s
I20260709 12:23:59.974058 12621 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:00.009521 13048 raft_consensus.cc:2749] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:59.982760 11677 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:00.009953 12675 raft_consensus.cc:3055] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:59.972223 13032 consensus_queue.cc:1048] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:23:59.968209 12730 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:59.902944 11051 rpcz_store.cc:276] 0709 12:23:58.583644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.675584 (+ 91940us) service_pool.cc:224] Handling call
0709 12:23:59.757215 (+1081631us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:00.011629 11679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41784 (request call id 463) took 1580 ms. Trace:
I20260709 12:24:00.013530 12901 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:00.012725 12972 consensus_queue.cc:1048] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:00.010216 12462 raft_consensus.cc:3055] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:59.967057 13082 raft_consensus.cc:740] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:23:59.950544 11128 raft_consensus.cc:740] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
W20260709 12:24:00.015904 13016 consensus_meta.cc:287] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 1.150s	user 0.012s	sys 0.000s
I20260709 12:24:00.015797 11643 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:00.016562 13030 raft_consensus.cc:2749] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:00.016726 12635 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:00.043300 12716 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:00.017300 12816 consensus_queue.cc:1048] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:59.811371 11126 rpcz_store.cc:276] 0709 12:23:58.617147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.618920 (+  1773us) service_pool.cc:224] Handling call
0709 12:23:59.049481 (+430561us) spinlock_profiling.cc:243] Waited 5.78 ms on lock 0x7b5800117398. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfeee 000000000036eb39 00007f8f90d331e0 00007f8f90dfc0c4 00007f8f90dfc131 00007f8f90dbdfc0 00007f8f90da8929 00007f8f90da83d2 00007f8f8a31fbd4
0709 12:23:59.049651 (+   170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:59.345330 (+295679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:59.345371 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:59.345433 (+    62us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:59.345468 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.596370 (+250902us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b5400374454. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:23:59.605694 (+  9324us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:59.675354 (+ 69660us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":692707328}
I20260709 12:24:00.017871 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 228) took 1323 ms. Trace:
I20260709 12:24:00.002940 13053 raft_consensus.cc:2749] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:00.022249 12992 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:00.109499 12716 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:23:59.978210 12975 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:00.023463 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:00.011511 12866 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:00.110378 13035 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:00.110884 13035 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.111217 13035 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:00.109530 11132 rpcz_store.cc:276] 0709 12:23:58.694247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.374645 (+680398us) service_pool.cc:224] Handling call
0709 12:23:59.388521 (+ 13876us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:59.388873 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:59.388901 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:59.395745 (+  6844us) log.cc:844] Serialized 26 byte log entry
0709 12:23:59.735934 (+340189us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:59.735974 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.736072 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:00.017661 (+281589us) raft_consensus.cc:1685] finished
0709 12:24:00.017678 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:00.017808 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":128962,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":134,"thread_start_us":251995,"threads_started":1,"wal-append.queue_time_us":576229}
W20260709 12:23:59.979609 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 541974us
I20260709 12:24:00.032800 12907 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.128628 13082 consensus_queue.cc:260] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:00.131142 13026 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:00.131577 13082 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:00.103591 12462 raft_consensus.cc:740] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:00.145394 12462 consensus_queue.cc:260] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:00.128914 12911 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:00.147838 12462 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:00.149019 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:00.149740 11126 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 3.
I20260709 12:24:00.147856 13020 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:00.155242 12621 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:00.137693 12907 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:00.160319 12907 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:00.164623 13035 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:00.004961 12961 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:00.049422 11097 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.000s	sys 0.020s
I20260709 12:24:00.013218 13074 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:00.050614 13039 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.352s	user 0.006s	sys 0.028s
I20260709 12:24:00.071583 10980 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:24:00.032148 13022 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.950021 13013 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:00.102187 11679 rpcz_store.cc:276] 0709 12:23:58.431461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.431578 (+   117us) service_pool.cc:224] Handling call
0709 12:24:00.011432 (+1579854us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b5400446bd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:00.011568 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3306273152}
W20260709 12:24:00.074018 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 46996.8us
W20260709 12:24:00.266166 11099 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.030s	sys 0.031s
W20260709 12:24:00.266526 11099 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.030s	sys 0.031s
W20260709 12:24:00.104980 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 89261.8us
W20260709 12:24:00.268110 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.076423 12675 raft_consensus.cc:740] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:00.269241 12921 consensus_queue.cc:1048] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:00.269742 12961 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:00.271924 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.272372 11643 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:00.114380 11098 leader_election.cc:400] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3.
W20260709 12:24:00.275420 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 161203us
I20260709 12:24:00.114846 11131 raft_consensus.cc:1275] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:24:00.115227 13068 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:00.126749 11128 consensus_queue.cc:260] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:00.176397 11681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41774 (request call id 372) took 1665 ms (client timeout 1887 ms). Trace:
W20260709 12:23:59.977588 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.192317 11060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1464) took 1583 ms. Trace:
I20260709 12:24:00.214540 11023 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:00.213413 13048 consensus_queue.cc:1048] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:24:00.221436 11647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.021s	sys 0.045s
W20260709 12:24:00.315300 11647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.022s	sys 0.045s
W20260709 12:24:00.316327 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 101885us
I20260709 12:24:00.318655 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:00.320434 10979 raft_consensus.cc:1275] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:24:00.312222 11681 rpcz_store.cc:269] 0709 12:23:58.511378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.634456 (+123078us) service_pool.cc:224] Handling call
0709 12:24:00.176166 (+1541710us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400591fd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:00.176318 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2475092736}
I20260709 12:24:00.322008 10984 raft_consensus.cc:1240] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:24:00.319159 11023 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:00.270376 12961 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:00.260085 13039 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.582s	user 0.006s	sys 0.029s
I20260709 12:24:00.326426 10983 raft_consensus.cc:1275] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:24:00.328312 10983 pending_rounds.cc:85] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 1
I20260709 12:24:00.328575 10983 pending_rounds.cc:107] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:24:00.312893 11060 rpcz_store.cc:276] 0709 12:23:58.609283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.345741 (+736458us) service_pool.cc:224] Handling call
0709 12:23:59.346061 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:59.346452 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:59.346481 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:59.346965 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 12:23:59.561439 (+214474us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:00.062887 (+501448us) log.cc:844] Serialized 14 byte log entry
0709 12:24:00.106866 (+ 43979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:00.191982 (+ 85116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:00.192048 (+    66us) raft_consensus.cc:1685] finished
0709 12:24:00.192060 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:00.192237 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73164,"prepare.queue_time_us":89417,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":47468,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":227,"thread_start_us":660407,"threads_started":2,"wal-append.queue_time_us":511824}
I20260709 12:24:00.328801 10983 raft_consensus.cc:2889] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:00.252260 11129 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.000s	sys 0.017s
W20260709 12:24:00.329556 11129 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.000s	sys 0.017s
I20260709 12:24:00.212953 11675 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
W20260709 12:24:00.253103 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 704386us
I20260709 12:24:00.255391 11059 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:00.257120 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 468412us
W20260709 12:24:00.264364 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 302240us
I20260709 12:24:00.276139 11131 pending_rounds.cc:85] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 5
I20260709 12:24:00.332168 11131 pending_rounds.cc:107] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:24:00.332486 11131 raft_consensus.cc:2889] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:00.277053 10948 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:00.279534 11024 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:00.271466 11127 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.023s	sys 0.048s
W20260709 12:24:00.333309 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.328203 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:00.325941 10984 raft_consensus.cc:1275] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:24:00.333689 11127 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.026s	sys 0.052s
W20260709 12:24:00.280925 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:00.336350 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 59365.7us
I20260709 12:24:00.336609 10978 raft_consensus.cc:1275] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:00.335100 11681 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 5.
I20260709 12:24:00.339768 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:00.340545 11681 raft_consensus.cc:2393] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 4: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
W20260709 12:24:00.341729 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 65439us
W20260709 12:24:00.343400 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.345218 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:00.346119 11125 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 3: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:00.346800 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:00.348273 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:00.349402 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:00.352803 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:00.354314 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:00.355139 11677 raft_consensus.cc:2393] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 6: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:00.354943 13094 consensus_queue.cc:1059] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:00.315083 12866 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.356122 12961 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:00.312561 12921 raft_consensus.cc:2749] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:00.357810 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:00.363987 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:00.364316 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.364670 10982 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:00.365352 11059 raft_consensus.cc:2410] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:00.365078 10948 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:00.364421 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:00.383443 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:00.367017 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.388337 11679 raft_consensus.cc:2393] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 3: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:00.387279 11681 raft_consensus.cc:2410] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEARNER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:24:00.364786 11023 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
W20260709 12:24:00.365053 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 85618.7us
I20260709 12:24:00.366468 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1673) took 2128 ms. Trace:
I20260709 12:24:00.393987 11132 raft_consensus.cc:1240] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:00.393958 10948 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:00.315032 13093 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.394711 11134 raft_consensus.cc:1275] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:00.385579 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:00.396915 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 54488.9us
W20260709 12:24:00.420306 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.268901 12907 consensus_queue.cc:1048] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.097s
I20260709 12:24:00.326961 12975 raft_consensus.cc:2749] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:00.335773 13025 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.399722 12898 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.402747 13096 consensus_queue.cc:1059] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:24:00.384712 12961 consensus_queue.cc:1048] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:24:00.409780 13097 raft_consensus.cc:2804] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:00.363862 12716 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:00.357537 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:00.396507 12964 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:00.415812 11059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52804 (request call id 249) took 1222 ms. Trace:
I20260709 12:24:00.413383 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 231) took 1385 ms. Trace:
I20260709 12:24:00.358825 13068 consensus_queue.cc:1048] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:24:00.397686 13098 raft_consensus.cc:2804] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:00.437165 11131 rpcz_store.cc:276] 0709 12:23:59.028240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.560345 (+532105us) service_pool.cc:224] Handling call
0709 12:23:59.560875 (+   530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:00.332974 (+772099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:00.413123 (+ 80149us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b5400324e54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:00.413299 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1267365120}
I20260709 12:24:00.429011 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:00.414870 11129 rpcz_store.cc:276] 0709 12:23:58.213954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.214059 (+   105us) service_pool.cc:224] Handling call
0709 12:23:58.214353 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:58.214569 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:23:58.238542 (+ 23973us) log.cc:844] Serialized 14 byte log entry
0709 12:23:58.362791 (+124249us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b180031d500. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f8b98c4bc 00007f8f88cda48b 00007f8f91b349a9 00007f8f88cf669b 00007f8f88cf493f 00007f8f88cf6c02 00007f8f8b97e20b 00007f8f8b983d23 00007f8f8b98423a
0709 12:23:59.555292 (+1192501us) log.cc:844] Serialized 14 byte log entry
0709 12:24:00.341852 (+786560us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:00.341915 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:00.341963 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:00.342033 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:00.342184 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85835,"prepare.queue_time_us":126726,"prepare.run_cpu_time_us":130,"prepare.run_wall_time_us":2764,"raft.queue_time_us":32870,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":172,"spinlock_wait_cycles":23087488,"thread_start_us":1901980,"threads_started":3,"wal-append.queue_time_us":87875,"wal-append.run_cpu_time_us":1091,"wal-append.run_wall_time_us":1021989}
I20260709 12:24:00.403421 12911 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.410667 13015 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.436990 10982 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:00.403748 13072 consensus_queue.cc:1048] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:24:00.436825 11059 rpcz_store.cc:276] 0709 12:23:59.193861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.198359 (+  4498us) service_pool.cc:224] Handling call
0709 12:24:00.415608 (+1217249us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400312ed4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:00.415758 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2365093632}
I20260709 12:24:00.439718 11098 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:24:00.427090 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:00.439983 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:00.448495 11129 raft_consensus.cc:1275] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:00.424341 13107 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:00.285910 13022 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:00.356113 12866 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:00.386404 12675 consensus_queue.cc:260] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:00.359429 13069 consensus_queue.cc:1048] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.096s
I20260709 12:24:00.705504 10981 raft_consensus.cc:1240] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:24:00.456036 11131 raft_consensus.cc:1275] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:00.464144 11054 raft_consensus.cc:1240] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:24:00.460245 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:00.706154 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:00.700795 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:00.710089 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:00.706677 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:00.720570 10981 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:24:00.713476 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:00.436386 11126 raft_consensus.cc:1240] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4. Ops: []
W20260709 12:24:00.729063 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.722591 11060 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 3.
I20260709 12:24:00.732820 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:00.733274 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:00.433045 13031 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.015s	sys 0.017s
I20260709 12:24:00.731945 11131 raft_consensus.cc:1275] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:00.731827 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:00.430980 13097 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.734845 10978 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
W20260709 12:24:00.738746 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 298839us
I20260709 12:24:00.738766 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:00.447134 11676 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.000s	sys 0.029s
I20260709 12:24:00.722293 13107 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:00.766471 13033 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.014s	sys 0.038s
I20260709 12:24:00.815186 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:00.445870 13039 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:00.870373 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.596639 13096 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:00.449062 13044 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.011s	sys 0.036s
I20260709 12:24:00.878876 10982 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:24:00.878057 11131 raft_consensus.cc:1240] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:00.693733 13052 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.722321 10977 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 3: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:00.816002 13026 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.884423 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:00.915910 10978 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:00.694168 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:00.885784 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:00.919680 10981 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
W20260709 12:24:00.887053 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 60422.9us
I20260709 12:24:00.919680 10984 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 4.
I20260709 12:24:00.920821 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:00.921450 10981 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:00.433825 13025 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:00.944154 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:00.467535 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:00.908532 11673 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.011s	sys 0.024s
I20260709 12:24:00.959514 11126 raft_consensus.cc:1275] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:00.883785 13107 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:00.728720 13015 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:00.815668 13031 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.026s	sys 0.032s
I20260709 12:24:00.446502 13079 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.432s
I20260709 12:24:00.430227 13093 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:00.842026 11676 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.003s	sys 0.043s
I20260709 12:24:00.901106 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:00.985211 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:01.004807 10984 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
W20260709 12:24:01.005244 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:01.006191 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.903365 11055 raft_consensus.cc:1275] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:24:00.905452 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 405220us
W20260709 12:24:01.009212 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.010128 11644 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:00.901623 13096 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:00.908375 10976 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.003s	sys 0.011s
W20260709 12:24:00.909068 12635 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.004s	sys 0.016s
W20260709 12:24:00.909384 11133 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.890s	user 0.020s	sys 0.029s
W20260709 12:24:01.033460 11133 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.014s	user 0.020s	sys 0.029s
W20260709 12:24:00.536502 12465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.007s	sys 0.025s
W20260709 12:24:00.878232 13033 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.015s	sys 0.038s
I20260709 12:24:00.778604 12940 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:00.721647 12901 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:00.537195 12992 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.346s
W20260709 12:24:00.886343 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 521443us
I20260709 12:24:00.887403 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:00.865540 13035 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:01.039011 12465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.098s	user 0.014s	sys 0.050s
I20260709 12:24:00.947247 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:01.033182 13051 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:00.881455 12675 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:00.433689 12898 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:00.893119 13044 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.994s	user 0.019s	sys 0.052s
I20260709 12:24:00.890507 11129 raft_consensus.cc:1275] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:00.880707 13097 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:00.730441 12911 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:00.999377 10981 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:24:01.105998 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:01.106745 10981 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:01.110698 11126 raft_consensus.cc:1275] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:01.112900 12911 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:00.883081 13074 consensus_queue.cc:1048] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.087s
W20260709 12:24:00.952586 11673 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.012s	sys 0.025s
W20260709 12:24:00.993548 12730 consensus_meta.cc:287] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.810s	user 0.006s	sys 0.018s
W20260709 12:24:01.039538 11130 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.013s	sys 0.045s
W20260709 12:24:01.131106 11130 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.013s	sys 0.045s
I20260709 12:24:00.900153 13039 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:00.892323 13100 consensus_queue.cc:1048] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.145s
W20260709 12:24:01.027904 10976 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.003s	sys 0.011s
W20260709 12:24:01.033195 12635 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.925s	user 0.005s	sys 0.016s
I20260709 12:24:00.946014 10982 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
I20260709 12:24:01.020716 13053 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.071228 11023 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:01.172067 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 101336us
I20260709 12:24:01.172864 11023 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:24:01.173766 13047 raft_consensus.cc:2749] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:01.174623 13047 consensus_queue.cc:1048] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:01.175113 13092 consensus_queue.cc:1048] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:01.175761 11023 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:01.176226 13047 consensus_queue.cc:1048] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:01.177064 13092 consensus_queue.cc:1048] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:01.021473 12975 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:00.794199 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.948616 13052 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:01.094653 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:00.956612 13026 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:01.083362 11053 raft_consensus.cc:2376] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bc01179655564f29b83babe396377cbb in term 5. Re-sending same reply.
I20260709 12:24:01.181774 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:24:01.049139 11678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.009s	sys 0.024s
I20260709 12:24:01.038767 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:01.099370 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:01.101840 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:01.166829 13102 log.cc:927] Time spent T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.629s	user 0.000s	sys 0.001s
I20260709 12:24:01.144647 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:24:01.171607 13116 log.cc:927] Time spent T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260709 12:24:01.170805 13103 log.cc:927] Time spent T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.076s	user 0.001s	sys 0.001s
I20260709 12:24:01.170131 10978 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:24:01.186558 11129 raft_consensus.cc:1275] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:01.105371 13082 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.121634 10981 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:24:01.161688 10949 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:01.194548 11681 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:01.171098 13108 log.cc:927] Time spent T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260709 12:24:01.171217 13112 log.cc:927] Time spent T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:24:01.196692 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:01.207674 10982 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:24:01.197134 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:01.186030 11678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.010s	sys 0.024s
I20260709 12:24:01.166836 13104 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.208195 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:01.212561 10978 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
W20260709 12:24:01.209136 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 47564.2us
I20260709 12:24:01.094806 13051 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.213882 10949 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:01.186882 13054 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:01.095110 12901 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:01.211181 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:01.196534 11672 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:01.226228 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 197726us
I20260709 12:24:01.197551 11053 raft_consensus.cc:2410] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:01.177623 13031 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:01.215999 10949 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:01.219553 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:01.237252 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:01.220613 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:01.238453 10982 raft_consensus.cc:2410] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:24:01.223973 10981 raft_consensus.cc:1240] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:01.238776 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:01.218779 11127 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.010s	sys 0.038s
W20260709 12:24:01.239687 11127 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.011s	sys 0.038s
I20260709 12:24:01.170925 12730 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:01.209671 12961 raft_consensus.cc:2749] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:01.260042 11097 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.000s	sys 0.009s
W20260709 12:24:01.260715 11097 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.000s	sys 0.009s
W20260709 12:24:01.261140 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 722462us
I20260709 12:24:01.189741 13053 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:01.218175 13051 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:01.190007 12975 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:01.222124 12964 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:01.244442 12868 raft_consensus.cc:2749] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:01.295871 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 240) took 1281 ms. Trace:
I20260709 12:24:01.258569 13054 raft_consensus.cc:697] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:01.218650 13104 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:01.298959 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:01.353246 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:01.354310 12975 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:01.354491 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:01.354911 12975 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.355629 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:01.356470 11056 raft_consensus.cc:2410] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:01.357251 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:01.220431 13015 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:01.245436 13094 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.888s	user 0.000s	sys 0.008s
I20260709 12:24:01.406517 11681 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:24:01.320389 11675 raft_consensus.cc:1240] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:01.297910 11097 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:01.412189 11643 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:01.324963 13034 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.331758 13050 raft_consensus.cc:3055] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:01.334688 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:01.220718 12866 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:01.291436 13096 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:01.309621 12961 consensus_queue.cc:1048] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:24:01.259358 13079 consensus_queue.cc:1048] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 12:24:01.355417 12975 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:01.378427 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.309144 12964 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.358511 13015 consensus_queue.cc:1048] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:01.357955 12868 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:01.215044 13082 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:24:01.245846 13048 consensus_queue.cc:1048] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.098s
I20260709 12:24:01.307036 11133 rpcz_store.cc:276] 0709 12:24:00.014245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.014413 (+   168us) service_pool.cc:224] Handling call
0709 12:24:00.014786 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:00.018454 (+  3668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:00.018484 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:00.018921 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 12:24:01.033867 (+1014946us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:01.033913 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.033981 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:01.291098 (+257117us) raft_consensus.cc:1685] finished
0709 12:24:01.291123 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:01.295782 (+  4659us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1014545,"threads_started":1,"wal-append.queue_time_us":1089094}
I20260709 12:24:01.421279 11643 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:01.422639 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:01.500084 11681 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 4.
I20260709 12:24:01.471011 13050 raft_consensus.cc:740] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:24:01.406901 13094 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.050s	user 0.000s	sys 0.014s
W20260709 12:24:01.514144 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 92934.5us
I20260709 12:24:01.515036 11643 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:01.337970 11676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 461) took 1902 ms. Trace:
I20260709 12:24:01.481562 13033 raft_consensus.cc:2804] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:01.485857 12465 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.486713 13093 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:01.409665 13098 raft_consensus.cc:697] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:01.485844 13096 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:01.493883 12964 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:01.494515 12992 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.490756 13022 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:01.498277 11675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 475) took 1104 ms. Trace:
I20260709 12:24:01.513221 12898 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:01.518282 13100 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.528554 13074 raft_consensus.cc:2804] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:01.520124 13026 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:01.517313 13106 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:01.549144 13101 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:01.556653 13101 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:01.557205 13101 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:01.549129 13050 consensus_queue.cc:260] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:01.557940 13050 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:01.556571 13026 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.559626 13026 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:01.561658 13026 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:01.547303 13039 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:01.539206 13031 raft_consensus.cc:697] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:01.562471 12730 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:01.556232 13106 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:01.563237 12730 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:01.563596 12730 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.563966 12730 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:01.564881 13106 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:01.548112 12975 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:01.548306 13053 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:01.540511 12465 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:01.533726 13033 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:01.566458 12901 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:01.549264 13100 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:01.566883 13031 consensus_queue.cc:237] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:01.568624 13100 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:01.551285 13130 log.cc:927] Time spent T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:24:01.569195 13104 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:01.551496 13015 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:01.544979 13107 consensus_meta.cc:287] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.584s	user 0.011s	sys 0.000s
I20260709 12:24:01.570374 13015 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:01.570483 13107 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:01.571712 13097 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:01.533842 13034 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:01.575744 13034 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:01.573873 13107 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:01.544571 13096 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:01.554724 13098 consensus_queue.cc:237] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:01.546182 12992 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:01.566524 13033 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:01.550434 13109 log.cc:927] Time spent T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:24:01.507494 12868 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:01.583945 12992 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:01.536585 13054 consensus_queue.cc:237] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:01.572700 13074 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:01.592442 13074 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:01.580349 13026 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:01.594549 13026 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:01.596844 13026 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:01.573207 12716 consensus_meta.cc:287] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 1.125s	user 0.007s	sys 0.009s
I20260709 12:24:01.598553 12716 raft_consensus.cc:2749] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:01.599687 13033 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:01.601011 13015 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:01.601965 12868 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:01.597064 12964 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:01.578004 13101 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:01.662668 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 424517us
I20260709 12:24:01.667704 10948 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:01.669515 10975 raft_consensus.cc:1240] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:01.671233 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 255178us
I20260709 12:24:01.671955 10978 raft_consensus.cc:1240] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:24:01.673075 10948 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:01.673880 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1706) took 1358 ms. Trace:
I20260709 12:24:01.673877 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 241) took 1244 ms. Trace:
I20260709 12:24:01.674732 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 243) took 1152 ms. Trace:
I20260709 12:24:01.674734 10983 rpcz_store.cc:276] 0709 12:24:00.429798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.430356 (+   558us) service_pool.cc:224] Handling call
0709 12:24:00.430711 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:00.431273 (+   562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:00.431307 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:00.437039 (+  5732us) log.cc:844] Serialized 26 byte log entry
0709 12:24:00.983727 (+546688us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:00.983779 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:00.983873 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:01.673345 (+689472us) raft_consensus.cc:1685] finished
0709 12:24:01.673395 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:01.673676 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":202,"raft.queue_time_us":764,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":13477,"thread_start_us":332778,"threads_started":1,"wal-append.queue_time_us":1088180}
I20260709 12:24:01.676385 10979 rpcz_store.cc:276] 0709 12:24:00.522647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.522788 (+   141us) service_pool.cc:224] Handling call
0709 12:24:00.648225 (+125437us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:00.694852 (+ 46627us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:00.694889 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:00.695439 (+   550us) log.cc:844] Serialized 52 byte log entry
0709 12:24:01.245898 (+550459us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:01.245943 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.246021 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:01.674075 (+428054us) raft_consensus.cc:1685] finished
0709 12:24:01.674129 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:01.674535 (+   406us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46137,"raft.queue_time_us":46870,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":60769,"thread_start_us":363443,"threads_started":1,"wal-append.queue_time_us":760512}
I20260709 12:24:01.678829 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:01.678902 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:01.679900 10948 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:01.681288 10979 raft_consensus.cc:2410] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:01.683104 10979 raft_consensus.cc:1240] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:01.674671 10980 rpcz_store.cc:276] 0709 12:24:00.315055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.317739 (+  2684us) service_pool.cc:224] Handling call
0709 12:24:00.318053 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:00.326709 (+  8656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:00.326796 (+    87us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:00.327551 (+   755us) log.cc:844] Serialized 26 byte log entry
0709 12:24:00.772698 (+445147us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:00.772748 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:00.772832 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:01.673195 (+900363us) raft_consensus.cc:1685] finished
0709 12:24:01.673240 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:01.673602 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42557,"raft.queue_time_us":17200,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":125,"thread_start_us":444754,"threads_started":1,"wal-append.queue_time_us":1201886}
I20260709 12:24:01.684923 10979 raft_consensus.cc:1275] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:01.684923 10980 raft_consensus.cc:1275] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:01.687199 10980 raft_consensus.cc:1240] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:01.687348 10979 raft_consensus.cc:1275] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:24:01.687722 10979 pending_rounds.cc:85] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 2
I20260709 12:24:01.688012 10979 pending_rounds.cc:107] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:24:01.688289 10979 raft_consensus.cc:2889] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:01.698652 10980 raft_consensus.cc:1275] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:01.701258 10980 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:01.680195 10983 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:01.707165 11024 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.020s	sys 0.038s
W20260709 12:24:01.707675 11024 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.020s	sys 0.038s
W20260709 12:24:01.708232 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 547529us
W20260709 12:24:01.713359 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.715731 11023 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:01.719194 10983 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:24:01.720415 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:01.721189 10983 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:01.251834 11025 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:01.722363 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:01.723009 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 471115us
I20260709 12:24:01.723259 10983 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:24:01.725129 10983 raft_consensus.cc:1275] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:01.727106 11025 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
W20260709 12:24:01.728531 11051 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.001s	sys 0.010s
W20260709 12:24:01.729128 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 431109us
I20260709 12:24:01.730406 11051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 253) took 1293 ms. Trace:
I20260709 12:24:01.730494 11097 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:01.731099 11051 rpcz_store.cc:276] 0709 12:24:00.437699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.443407 (+  5708us) service_pool.cc:224] Handling call
0709 12:24:00.653649 (+210242us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:01.024243 (+370594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:01.029509 (+  5266us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:01.172648 (+143139us) log.cc:844] Serialized 26 byte log entry
0709 12:24:01.729524 (+556876us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:01.729630 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.729775 (+   145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:01.729859 (+    84us) raft_consensus.cc:1685] finished
0709 12:24:01.729876 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:01.730067 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":262703,"raft.queue_time_us":265186,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":19543,"thread_start_us":505191,"threads_started":1,"wal-append.queue_time_us":419160}
I20260709 12:24:01.738953 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 242) took 1331 ms. Trace:
I20260709 12:24:01.739125 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:01.739493 11129 raft_consensus.cc:3055] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:01.740005 11129 raft_consensus.cc:740] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:01.740226 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1696) took 1393 ms. Trace:
I20260709 12:24:01.740664 11132 rpcz_store.cc:276] 0709 12:24:00.346533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.431159 (+ 84626us) service_pool.cc:224] Handling call
0709 12:24:00.431486 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:00.437898 (+  6412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:00.437930 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:00.695142 (+257212us) log.cc:844] Serialized 26 byte log entry
0709 12:24:01.227471 (+532329us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:01.227513 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.227583 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:01.739720 (+512137us) raft_consensus.cc:1685] finished
0709 12:24:01.739756 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:01.740027 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":102467,"raft.queue_time_us":13607,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":94138,"thread_start_us":362409,"threads_started":1,"wal-append.queue_time_us":589830}
I20260709 12:24:01.739526 11131 rpcz_store.cc:276] 0709 12:24:00.407410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.893918 (+486508us) service_pool.cc:224] Handling call
0709 12:24:00.894298 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:00.894684 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:00.894712 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:00.945254 (+ 50542us) log.cc:844] Serialized 26 byte log entry
0709 12:24:01.225564 (+280310us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:01.225637 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.225724 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:01.738414 (+512690us) raft_consensus.cc:1685] finished
0709 12:24:01.738451 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:01.738727 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4859,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":10382,"thread_start_us":186290,"threads_started":1,"wal-append.queue_time_us":556104}
I20260709 12:24:01.742522 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:01.745399 11051 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:01.746347 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.747768 11129 consensus_queue.cc:260] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:01.750869 11129 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:01.751183 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.534358 11676 rpcz_store.cc:276] 0709 12:23:59.435426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.439733 (+  4307us) service_pool.cc:224] Handling call
0709 12:23:59.827060 (+387327us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b5800004598. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfeee 000000000036eb39 00007f8f90d331e0 00007f8f90dfc0c4 00007f8f90dfc131 00007f8f90dbdfc0 00007f8f90da8929 00007f8f90da83d2 00007f8f8a31fbd4
0709 12:23:59.827231 (+   171us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:59.914580 (+ 87349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:59.914617 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:59.915164 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 12:24:01.033991 (+1118827us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:01.043871 (+  9880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.337493 (+293622us) spinlock_profiling.cc:243] Waited 86.9 ms on lock 0x7b54005a8cd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:01.337565 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:01.337630 (+    65us) raft_consensus.cc:1685] finished
0709 12:24:01.337656 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:01.337876 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5130,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":6213,"spinlock_wait_cycles":235801600,"thread_start_us":1097183,"threads_started":1,"wal-append.queue_time_us":1194839}
I20260709 12:24:01.764994 12635 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.766140 12635 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:01.543187 11675 rpcz_store.cc:276] 0709 12:24:00.395139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.319706 (+924567us) service_pool.cc:224] Handling call
0709 12:24:01.320137 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:01.416637 (+ 96500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.494044 (+ 77407us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:01.769412 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:01.770615 11673 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:01.772555 11672 consensus_meta.cc:287] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.508s	user 0.005s	sys 0.009s
I20260709 12:24:01.778458 11672 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:24:01.777629 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:01.808187 11675 raft_consensus.cc:2393] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 4: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:01.808069 13093 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:01.808732 13093 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.809140 13093 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:01.809226 13097 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:01.623281 13096 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:01.778824 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:01.775079 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:01.795652 13022 consensus_queue.cc:1048] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:01.781720 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:01.774955 12635 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:01.782898 12675 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.783689 11060 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:01.784915 12716 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.785705 12868 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.601984 12730 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:01.786561 12901 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:01.870232 10979 raft_consensus.cc:1275] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:24:01.790572 13026 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:01.792618 12964 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:01.794319 13031 consensus_queue.cc:1048] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:01.797575 13054 consensus_queue.cc:1059] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:01.798123 13034 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.798794 13033 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:01.798902 13079 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:01.799851 13039 consensus_queue.cc:1059] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:01.800869 13047 consensus_queue.cc:1048] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:01.801985 13050 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:01.805270 13082 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:01.780757 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:01.890705 11131 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:01.893536 11676 raft_consensus.cc:2393] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:01.817538 11673 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:01.788632 13015 raft_consensus.cc:2804] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:01.810772 13097 consensus_queue.cc:1048] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:24:01.894951 13015 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.895476 13015 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:01.870824 10979 pending_rounds.cc:85] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 2
I20260709 12:24:01.896148 10979 pending_rounds.cc:107] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:24:01.896443 10979 raft_consensus.cc:2889] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:01.788640 12975 raft_consensus.cc:2804] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:01.897604 12975 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:01.898038 12975 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:01.902688 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1685) took 2616 ms. Trace:
I20260709 12:24:01.903154 11127 rpcz_store.cc:276] 0709 12:23:59.286473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.595782 (+309309us) service_pool.cc:224] Handling call
0709 12:23:59.596153 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:00.334537 (+738384us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:01.245045 (+910508us) log.cc:844] Serialized 14 byte log entry
0709 12:24:01.736886 (+491841us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:01.737693 (+   807us) log.cc:844] Serialized 26 byte log entry
0709 12:24:01.737929 (+   236us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:01.737961 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.738084 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:01.902200 (+164116us) raft_consensus.cc:1685] finished
0709 12:24:01.902220 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:01.902461 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":876879,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":238777,"raft.run_cpu_time_us":444,"raft.run_wall_time_us":34850,"thread_start_us":2009182,"threads_started":3,"wal-append.queue_time_us":334054}
I20260709 12:24:01.805699 13051 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:01.906586 13026 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:01.907436 13051 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:01.896456 13052 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:01.873960 11132 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 4.
I20260709 12:24:01.909477 13026 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:01.875710 12716 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:01.877148 13101 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:01.878073 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 362968us
I20260709 12:24:01.879050 13098 consensus_queue.cc:1048] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:01.880609 13074 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:01.881605 12675 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:01.882349 11060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1470) took 1400 ms. Trace:
I20260709 12:24:01.940797 11060 rpcz_store.cc:276] 0709 12:24:00.482177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.740414 (+258237us) service_pool.cc:224] Handling call
0709 12:24:01.334530 (+594116us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b58001a5e98. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfeee 000000000036eb39 00007f8f90d331e0 00007f8f90dfc0c4 00007f8f90dfc131 00007f8f90daa0a0 00007f8f90da9984 00007f8f8a3246d4 00007f8f8a324662
0709 12:24:01.882201 (+547671us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":331185536}
I20260709 12:24:01.942589 12675 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:01.943393 12891 raft_consensus.cc:3055] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:01.944016 12891 raft_consensus.cc:740] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:24:01.882639 10949 leader_election.cc:336] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 1.541s (SENT)
I20260709 12:24:01.889164 13149 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:01.889622 13157 log.cc:927] Time spent T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 12:24:01.874806 12868 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:01.949868 11060 raft_consensus.cc:1240] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:24:01.951256 12868 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:01.951586 11060 raft_consensus.cc:1240] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:01.911005 11131 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:24:01.912562 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1714) took 1595 ms. Trace:
I20260709 12:24:01.955749 10976 rpcz_store.cc:276] 0709 12:24:00.317374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.323720 (+  6346us) service_pool.cc:224] Handling call
0709 12:24:00.383768 (+ 60048us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:00.384193 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:01.193881 (+809688us) log.cc:844] Serialized 14 byte log entry
0709 12:24:01.671906 (+478025us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:01.673290 (+  1384us) log.cc:844] Serialized 26 byte log entry
0709 12:24:01.673636 (+   346us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:01.673694 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.673814 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:01.912146 (+238332us) raft_consensus.cc:1685] finished
0709 12:24:01.912168 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:01.912381 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":824518,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":124480,"raft.run_cpu_time_us":404,"raft.run_wall_time_us":6073,"thread_start_us":1254920,"threads_started":2,"wal-append.queue_time_us":416845}
I20260709 12:24:01.957839 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1142) took 1043 ms. Trace:
I20260709 12:24:01.945845 12716 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:01.960301 10981 rpcz_store.cc:276] 0709 12:24:00.914495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.239753 (+325258us) service_pool.cc:224] Handling call
0709 12:24:01.240031 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:01.296891 (+ 56860us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:01.310119 (+ 13228us) log.cc:844] Serialized 14 byte log entry
0709 12:24:01.675285 (+365166us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:01.675398 (+   113us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:01.675516 (+   118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.957446 (+281930us) spinlock_profiling.cc:243] Waited 56.6 ms on lock 0x7b5400229a54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:01.957495 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:01.957650 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3264,"prepare.queue_time_us":13172,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":6457,"raft.queue_time_us":135753,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":167,"spinlock_wait_cycles":130097408,"thread_start_us":361056,"threads_started":1,"wal-append.queue_time_us":324057}
I20260709 12:24:01.963433 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:01.916688 13034 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:01.964354 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:01.965412 11052 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1467) took 1501 ms (client timeout 1798 ms). Trace:
I20260709 12:24:01.918289 13054 raft_consensus.cc:3055] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:01.915901 12730 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:01.936573 12465 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:01.937704 12621 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:24:01.938951 12901 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:01.940910 11681 raft_consensus.cc:1240] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:24:01.915464 12975 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:01.948390 13149 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:01.958917 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:01.949136 10949 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:01.945343 12891 consensus_queue.cc:260] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:01.909509 13015 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:01.965924 13034 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:01.978171 13054 raft_consensus.cc:740] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:24:01.965826 11052 rpcz_store.cc:269] 0709 12:24:00.463569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.487141 (+ 23572us) service_pool.cc:224] Handling call
0709 12:24:01.963951 (+1476810us) spinlock_profiling.cc:243] Waited 26.5 ms on lock 0x7b58001a5e98. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90daa0a0 00007f8f90da9984 00007f8f8a3246d4 00007f8f8a324662
0709 12:24:01.965346 (+  1395us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60868864}
W20260709 12:24:02.036949 11098 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.030s	sys 0.037s
W20260709 12:24:02.121721 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 352475us
W20260709 12:24:02.037288 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 154736us
I20260709 12:24:01.981583 11051 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
W20260709 12:24:02.205650 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 459006us
W20260709 12:24:02.163743 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:02.215286 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:02.163090 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:02.036608 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1141) took 1122 ms. Trace:
I20260709 12:24:02.016760 10981 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:24:02.042433 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:02.193619 11055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 255) took 1754 ms. Trace:
W20260709 12:24:02.245092 11098 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.030s	sys 0.075s
I20260709 12:24:02.248201 11055 rpcz_store.cc:276] 0709 12:24:00.439239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.439933 (+   694us) service_pool.cc:224] Handling call
0709 12:24:00.440269 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:01.008247 (+567978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.193018 (+1184771us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b5400278dd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:02.193416 (+   398us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1063989504}
I20260709 12:24:02.037243 12716 raft_consensus.cc:2749] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:02.246065 12891 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:02.256596 10949 leader_election.cc:336] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 1.682s (SENT)
I20260709 12:24:02.035760 10976 raft_consensus.cc:2376] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6. Re-sending same reply.
I20260709 12:24:02.249564 12868 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:02.246464 10982 rpcz_store.cc:276] 0709 12:24:00.914080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.239043 (+324963us) service_pool.cc:224] Handling call
0709 12:24:01.301331 (+ 62288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:01.301567 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:24:01.672380 (+370813us) log.cc:844] Serialized 14 byte log entry
0709 12:24:02.035922 (+363542us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:02.036024 (+   102us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:02.036096 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.036191 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:02.036410 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9577,"prepare.queue_time_us":47381,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":128,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":158,"thread_start_us":685455,"threads_started":2}
W20260709 12:24:02.269629 11023 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.013s	sys 0.028s
W20260709 12:24:02.275451 11023 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.013s	sys 0.028s
I20260709 12:24:02.263119 13052 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.227128 11128 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:02.279179 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 515590us
I20260709 12:24:02.268675 13074 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:02.295363 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:02.210597 12901 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:02.267881 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:02.294301 11681 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:02.309731 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:02.290647 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:02.314901 11055 raft_consensus.cc:1240] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:02.315246 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 58791.6us
I20260709 12:24:02.316481 11098 leader_election.cc:400] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4.
I20260709 12:24:02.323331 11098 leader_election.cc:403] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:24:02.319406 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:02.314956 11056 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.019s	sys 0.021s
W20260709 12:24:02.328853 11056 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.020s	sys 0.022s
I20260709 12:24:02.331252 11055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1140) took 1162 ms. Trace:
I20260709 12:24:02.293701 12866 raft_consensus.cc:2749] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:02.331700 11055 rpcz_store.cc:276] 0709 12:24:01.164064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.267509 (+1103445us) service_pool.cc:224] Handling call
0709 12:24:02.310865 (+ 43356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:02.321585 (+ 10720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.326315 (+  4730us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:02.333357 13150 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.334122 13150 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:02.334882 11023 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:02.335486 13013 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:02.336370 13013 consensus_queue.cc:1048] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:02.336653 13150 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:02.348325 10981 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
W20260709 12:24:02.355366 13114 log.cc:927] Time spent T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 1.255s	user 0.002s	sys 0.015s
W20260709 12:24:02.349218 10949 leader_election.cc:336] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 1.777s (SENT)
W20260709 12:24:02.358235 11133 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.019s	sys 0.022s
W20260709 12:24:02.383980 11133 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.019s	sys 0.025s
I20260709 12:24:02.349177 11131 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:02.311528 13052 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:02.328413 12975 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:02.357507 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:02.315310 12462 raft_consensus.cc:2804] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:02.337595 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:02.391690 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 51739.4us
W20260709 12:24:02.348822 13110 log.cc:927] Time spent T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 1.091s	user 0.001s	sys 0.003s
I20260709 12:24:02.348141 13092 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:02.383562 10949 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:02.373670 11672 raft_consensus.cc:2376] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3. Re-sending same reply.
I20260709 12:24:02.370716 13149 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:02.384447 13150 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:02.409052 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 92862us
I20260709 12:24:02.417034 11128 raft_consensus.cc:1275] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:02.417408 11098 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:02.417881 10976 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:24:02.419194 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:02.419826 11098 leader_election.cc:400] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3.
I20260709 12:24:02.405179 13092 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.420634 13092 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:02.347913 13133 consensus_queue.cc:1048] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 12:24:02.423256 13054 consensus_queue.cc:260] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:02.423535 13150 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:02.424715 13054 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:02.426517 13100 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4.
I20260709 12:24:02.427742 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:02.428872 11059 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1473) took 1945 ms (client timeout 1705 ms). Trace:
W20260709 12:24:02.429265 11059 rpcz_store.cc:269] 0709 12:24:00.482957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.729695 (+246738us) service_pool.cc:224] Handling call
0709 12:24:02.427368 (+1697673us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b58001a5e98. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90daa0a0 00007f8f90da9984 00007f8f8a3246d4 00007f8f8a324662
0709 12:24:02.428751 (+  1383us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51248384}
W20260709 12:24:02.430038 10977 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1709) took 2113 ms (client timeout 2058 ms). Trace:
I20260709 12:24:02.401609 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:02.431609 13034 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:02.432358 13034 consensus_queue.cc:1243] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer c979ef00e0ad4157b49ebbdc13ce7cd7 log is divergent from this leader: its last log entry 1.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:24:02.432717 13074 consensus_queue.cc:1048] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:02.404246 11052 raft_consensus.cc:1240] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:02.434419 11052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1138) took 1288 ms. Trace:
I20260709 12:24:02.391034 11645 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
W20260709 12:24:02.435465 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 149125us
I20260709 12:24:02.435842 12992 raft_consensus.cc:2804] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:02.436316 12992 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.436484 11645 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:02.438519 12675 consensus_queue.cc:1048] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:02.438923 13174 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:02.439558 13174 raft_consensus.cc:697] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:02.440303 12675 consensus_queue.cc:1048] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:02.440755 13174 consensus_queue.cc:237] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:02.441368 11056 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 260) took 1719 ms. Trace:
I20260709 12:24:02.441747 11056 rpcz_store.cc:276] 0709 12:24:00.767245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.378969 (+611724us) service_pool.cc:224] Handling call
0709 12:24:01.397475 (+ 18506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:01.743752 (+346277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:01.743810 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:01.744506 (+   696us) log.cc:844] Serialized 26 byte log entry
0709 12:24:02.329290 (+584784us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:02.329332 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.440894 (+111562us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b54001879d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:02.440943 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:02.440988 (+    45us) raft_consensus.cc:1685] finished
0709 12:24:02.441000 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:02.441299 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14501,"raft.queue_time_us":81179,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":241,"spinlock_wait_cycles":761121664,"thread_start_us":584301,"threads_started":1,"wal-append.queue_time_us":604732}
I20260709 12:24:02.413932 13160 raft_consensus.cc:2749] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:02.439287 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 720692us
W20260709 12:24:02.430527 10977 rpcz_store.cc:269] 0709 12:24:00.316021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.337036 (+ 21015us) service_pool.cc:224] Handling call
0709 12:24:02.429603 (+2092567us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b54001a1154. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:02.429840 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28925312}
W20260709 12:24:02.434870 11053 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52804 (request call id 262) took 1323 ms (client timeout 1643 ms). Trace:
I20260709 12:24:02.348881 13041 consensus_queue.cc:1048] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 12:24:02.437925 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1134) took 1551 ms. Trace:
I20260709 12:24:02.459098 11131 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 4.
W20260709 12:24:02.449695 11053 rpcz_store.cc:269] 0709 12:24:01.111791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.181491 (+ 69700us) service_pool.cc:224] Handling call
0709 12:24:02.434488 (+1252997us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b5400312ed4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:02.434697 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34082688}
W20260709 12:24:02.460175 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 56883.2us
I20260709 12:24:02.461314 11098 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:02.463025 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1727) took 1267 ms. Trace:
W20260709 12:24:02.469175 12943 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:24:02.467571 10980 rpcz_store.cc:276] 0709 12:24:01.195562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.702945 (+507383us) service_pool.cc:224] Handling call
0709 12:24:01.703552 (+   607us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:02.210177 (+506625us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:24:02.380574 (+170397us) log.cc:844] Serialized 14 byte log entry
0709 12:24:02.462289 (+ 81715us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:02.462342 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:02.462392 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.462455 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:02.462966 (+   511us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113028,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":3094,"thread_start_us":479197,"threads_started":3}
I20260709 12:24:02.449200 12992 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:02.470937 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:02.471029 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:02.472043 10977 raft_consensus.cc:2410] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:02.473156 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:02.473945 10977 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:24:02.475015 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:02.475785 10977 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:24:02.348508 13069 consensus_queue.cc:1048] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.106s
I20260709 12:24:02.478286 10980 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:02.484807 10980 raft_consensus.cc:1240] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 12:24:02.485594 13025 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:02.420071 10976 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:24:02.486600 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:02.488029 13052 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:02.338864 12868 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:02.488725 13113 log.cc:927] Time spent T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 1.138s	user 0.000s	sys 0.003s
I20260709 12:24:02.463209 10978 rpcz_store.cc:276] 0709 12:24:00.886584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.218208 (+331624us) service_pool.cc:224] Handling call
0709 12:24:01.218578 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:01.672649 (+454071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.437520 (+764871us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b5400173c54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:02.437800 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1040774016}
I20260709 12:24:02.491063 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1732) took 1239 ms. Trace:
I20260709 12:24:02.502064 10981 raft_consensus.cc:2376] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4. Re-sending same reply.
I20260709 12:24:02.508283 10980 rpcz_store.cc:276] 0709 12:24:01.251797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.482052 (+1230255us) service_pool.cc:224] Handling call
0709 12:24:02.483711 (+  1659us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:02.490776 (+  7065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.491007 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:02.455473 13149 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:02.430544 13150 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:02.515692 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:02.521973 10984 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:24:02.391639 13079 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.129s
I20260709 12:24:02.530062 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:02.532016 13167 consensus_queue.cc:1048] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
W20260709 12:24:02.530135 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 68965us
I20260709 12:24:02.515401 10948 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:24:02.533839 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 69370.9us
I20260709 12:24:02.534564 11057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 254) took 2096 ms. Trace:
I20260709 12:24:02.534889 10978 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:02.535789 11134 pending_rounds.cc:85] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 4
I20260709 12:24:02.536101 11134 pending_rounds.cc:107] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:24:02.536357 11134 raft_consensus.cc:2889] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:02.536849 10948 leader_election.cc:336] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Timed out: RequestConsensusVote RPC to 127.9.145.194:44483 timed out after 1.709s (SENT)
I20260709 12:24:02.538074 12964 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:02.538700 12964 raft_consensus.cc:697] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
W20260709 12:24:02.540479 13118 log.cc:927] Time spent T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 1.239s	user 0.000s	sys 0.002s
I20260709 12:24:02.539896 12964 consensus_queue.cc:237] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:02.534593 11098 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:02.542645 13095 log.cc:927] Time spent T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 1.582s	user 0.000s	sys 0.012s
I20260709 12:24:02.441226 13048 consensus_queue.cc:1048] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 12:24:02.543119 12462 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:02.543782 12462 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:02.531714 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1733) took 1276 ms. Trace:
I20260709 12:24:02.544891 10981 rpcz_store.cc:276] 0709 12:24:01.254955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.508231 (+1253276us) service_pool.cc:224] Handling call
0709 12:24:02.531072 (+ 22841us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:02.531380 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:02.531404 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:02.531447 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:02.531478 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.531531 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:02.531632 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:02.533634 13151 raft_consensus.cc:2749] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:02.426420 13072 consensus_queue.cc:1048] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.090s
I20260709 12:24:02.434841 11052 rpcz_store.cc:276] 0709 12:24:01.150142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.262375 (+1112233us) service_pool.cc:224] Handling call
0709 12:24:02.328291 (+ 65916us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:02.434041 (+105750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.434330 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:02.521260 13093 consensus_meta.cc:287] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.712s	user 0.010s	sys 0.005s
W20260709 12:24:02.560508 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 211370us
W20260709 12:24:02.562984 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 62635.2us
I20260709 12:24:02.586975 11678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 471) took 2257 ms. Trace:
I20260709 12:24:02.587543 11678 rpcz_store.cc:276] 0709 12:24:00.329800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.350610 (+ 20810us) service_pool.cc:224] Handling call
0709 12:24:00.351007 (+   397us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:00.351452 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:00.351486 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:00.352135 (+   649us) log.cc:844] Serialized 52 byte log entry
0709 12:24:01.221181 (+869046us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:01.240874 (+ 19693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.260392 (+ 19518us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:02.539454 (+1279062us) spinlock_profiling.cc:243] Waited 73.9 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:02.544577 (+  5123us) raft_consensus.cc:1685] finished
0709 12:24:02.544601 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:02.586777 (+ 42176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5690,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":170044160,"thread_start_us":858771,"threads_started":1,"wal-append.queue_time_us":860279}
I20260709 12:24:02.546352 11057 rpcz_store.cc:276] 0709 12:24:00.438183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.438307 (+   124us) service_pool.cc:224] Handling call
0709 12:24:00.438675 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:00.444319 (+  5644us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:00.444354 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:01.805347 (+1360993us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b18003326e0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cc52a6 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8a6dda11 00007f8f8a6ed372 00007f8f8be1fa01 00007f8f8bde443a
0709 12:24:01.805824 (+   477us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b2c00000de8. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8a6dda11 00007f8f8a6ed372 00007f8f8be1fa01 00007f8f8bde443a 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2
0709 12:24:01.806644 (+   820us) log.cc:844] Serialized 26 byte log entry
0709 12:24:02.088465 (+281821us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:02.089944 (+  1479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.098782 (+  8838us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:02.534181 (+435399us) raft_consensus.cc:1685] finished
0709 12:24:02.534201 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:02.534366 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":387528,"raft.queue_time_us":8051,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":148425,"spinlock_wait_cycles":11512576,"thread_start_us":281236,"threads_started":1,"wal-append.queue_time_us":594351}
W20260709 12:24:02.591344 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:02.591900 12868 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:02.562466 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 239) took 2636 ms. Trace:
I20260709 12:24:02.594517 11128 rpcz_store.cc:276] 0709 12:23:59.925793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.925982 (+   189us) service_pool.cc:224] Handling call
0709 12:23:59.926388 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:02.209666 (+2283278us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b58006ae2d0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bd400aa 00007f8f8bdc2447 00007f8f8bddafe7 00007f8f8bddc7de 00007f8f8bde6b49 00007f8f8bde7416 00007f8f8bde3d8f 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4
0709 12:24:02.446667 (+237001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.552562 (+105895us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53683072}
I20260709 12:24:02.598889 10984 raft_consensus.cc:1240] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:24:02.599673 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1736) took 1300 ms. Trace:
I20260709 12:24:02.599984 10984 rpcz_store.cc:276] 0709 12:24:01.299080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.526928 (+1227848us) service_pool.cc:224] Handling call
0709 12:24:02.598587 (+ 71659us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:02.599362 (+   775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.599588 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:02.601243 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:02.538012 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1707) took 2222 ms. Trace:
I20260709 12:24:02.536862 11674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 469) took 2753 ms. Trace:
W20260709 12:24:02.636271 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 188026us
I20260709 12:24:02.576367 13052 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.601615 12975 raft_consensus.cc:1064] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:24:02.579512 10977 raft_consensus.cc:1275] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:02.573920 13025 raft_consensus.cc:2749] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:02.662565 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 69303.2us
I20260709 12:24:02.575169 13100 consensus_queue.cc:1059] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
W20260709 12:24:02.694293 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 119973us
I20260709 12:24:02.694659 13100 raft_consensus.cc:3055] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:02.695197 13100 raft_consensus.cc:740] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:02.696415 13100 consensus_queue.cc:260] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:02.698067 13100 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:02.699342 11131 raft_consensus.cc:1275] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:24:02.700805 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:02.672914 12975 raft_consensus.cc:1068] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7: Unable to promote non-voter 0f3b1ccd8aa5412393aa7eb90f2bef95: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:24:02.693454 10949 leader_election.cc:336] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 1.781s (SENT)
W20260709 12:24:02.703121 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 49220us
I20260709 12:24:02.703194 13170 consensus_queue.cc:1059] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:24:02.704314 11060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 264) took 1572 ms. Trace:
I20260709 12:24:02.704749 11060 rpcz_store.cc:276] 0709 12:24:01.131820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.953691 (+821871us) service_pool.cc:224] Handling call
0709 12:24:02.444662 (+490971us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:02.610287 (+165625us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:02.610351 (+    64us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:02.610409 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:02.610457 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.610533 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:02.704082 (+ 93549us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b5400312ed0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:02.704230 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":46871,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":21852,"spinlock_wait_cycles":1124040832}
I20260709 12:24:02.601979 13093 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:02.708555 13093 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:02.714880 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:02.715642 11060 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 4.
I20260709 12:24:02.719923 12992 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:02.720353 12462 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:02.722255 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 89500.1us
I20260709 12:24:02.722663 13150 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.723266 13150 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:02.725509 13150 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:02.726635 11097 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:02.727005 12901 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:02.730247 11643 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:02.730492 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:02.731664 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:02.732074 13169 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:02.732372 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:02.732620 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:02.733327 11673 raft_consensus.cc:2393] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 4: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:02.733875 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:02.734553 11132 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:02.734711 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:02.735313 11678 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:02.739353 11129 raft_consensus.cc:1275] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:02.754982 11023 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:02.771648 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:02.772653 12462 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:02.704351 13170 raft_consensus.cc:3055] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:02.773475 13170 raft_consensus.cc:740] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:02.774396 13175 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:02.774900 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 48361.7us
I20260709 12:24:02.775167 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1731) took 1534 ms. Trace:
I20260709 12:24:02.776266 13169 consensus_queue.cc:1048] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:02.778419 11643 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:02.778848 11673 raft_consensus.cc:1240] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:02.779541 10949 leader_election.cc:336] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 1.689s (SENT)
I20260709 12:24:02.779759 13015 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:02.780052 10949 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:02.781338 10949 leader_election.cc:336] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 1.709s (SENT)
I20260709 12:24:02.781781 10979 raft_consensus.cc:1240] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:24:02.782219 11023 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:02.782521 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1738) took 1075 ms. Trace:
I20260709 12:24:02.761507 13092 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:02.783087 12901 raft_consensus.cc:2749] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:02.783725 13151 raft_consensus.cc:2804] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:02.775108 13175 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:02.784171 13151 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.784583 13151 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:02.785735 12992 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:02.796906 10979 rpcz_store.cc:276] 0709 12:24:01.707435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.781126 (+1073691us) service_pool.cc:224] Handling call
0709 12:24:02.781495 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:02.782254 (+   759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.782462 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:02.786469 11098 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:02.786808 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:02.781809 10949 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:02.792447 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:02.792928 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:02.793946 13072 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:02.795372 13041 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.789776 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:02.795778 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1730) took 1574 ms. Trace:
I20260709 12:24:02.775689 10977 rpcz_store.cc:276] 0709 12:24:01.240577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.476554 (+1235977us) service_pool.cc:224] Handling call
0709 12:24:02.506188 (+ 29634us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:02.664068 (+157880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.774893 (+110825us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b5400334350. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:02.775059 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52042624}
W20260709 12:24:02.795250 13121 log.cc:927] Time spent T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 1.493s	user 0.003s	sys 0.000s
I20260709 12:24:02.611297 10975 rpcz_store.cc:276] 0709 12:24:00.315406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.323579 (+  8173us) service_pool.cc:224] Handling call
0709 12:24:00.397605 (+ 74026us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:01.670583 (+1272978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.537693 (+867110us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540028aad4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:02.537933 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2918256000}
I20260709 12:24:02.813218 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:02.826126 11129 raft_consensus.cc:1240] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:02.821112 10983 rpcz_store.cc:276] 0709 12:24:01.221744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.725962 (+504218us) service_pool.cc:224] Handling call
0709 12:24:01.726436 (+   474us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:01.992071 (+265635us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:01.992100 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:02.084954 (+ 92854us) log.cc:844] Serialized 52 byte log entry
0709 12:24:02.293374 (+208420us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:02.293413 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.293498 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:02.795548 (+502050us) raft_consensus.cc:1685] finished
0709 12:24:02.795567 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:02.795719 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":123802,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":4067,"thread_start_us":394839,"threads_started":2,"wal-append.queue_time_us":665238}
I20260709 12:24:02.851039 11055 raft_consensus.cc:2393] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 5: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:02.672477 13052 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:02.853700 10982 raft_consensus.cc:2393] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 5: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:02.792414 13092 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:02.862733 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:02.867807 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1156) took 1084 ms. Trace:
I20260709 12:24:02.868247 10982 rpcz_store.cc:276] 0709 12:24:01.783810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.789483 (+1005673us) service_pool.cc:224] Handling call
0709 12:24:02.867741 (+ 78258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:02.815961 13072 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.820981 12891 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:02.876392 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 110044us
W20260709 12:24:02.874981 11054 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52804 (request call id 257) took 2390 ms (client timeout 2207 ms). Trace:
I20260709 12:24:02.872016 10984 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:02.825488 13100 raft_consensus.cc:2749] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:02.881219 10979 raft_consensus.cc:1275] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:02.883265 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1739) took 1175 ms. Trace:
I20260709 12:24:02.883769 10979 rpcz_store.cc:276] 0709 12:24:01.707816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.854892 (+1147076us) service_pool.cc:224] Handling call
0709 12:24:02.875170 (+ 20278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:02.882927 (+  7757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.883177 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:02.888387 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 102052us
I20260709 12:24:02.875911 12866 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:02.890389 11097 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:02.867589 12465 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:24:02.878398 11054 rpcz_store.cc:269] 0709 12:24:00.484583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.816951 (+332368us) service_pool.cc:224] Handling call
0709 12:24:02.786462 (+1969511us) spinlock_profiling.cc:243] Waited 70.1 ms on lock 0x7b58001a5e98. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90daa0a0 00007f8f90da9984 00007f8f8a3246d4 00007f8f8a324662
0709 12:24:02.874900 (+ 88438us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161175936}
I20260709 12:24:02.900627 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:02.901296 11681 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:02.646396 11674 rpcz_store.cc:276] 0709 12:23:59.783316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.786116 (+  2800us) service_pool.cc:224] Handling call
0709 12:24:00.040870 (+254754us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:00.041332 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:00.041365 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:00.041912 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 12:24:00.449011 (+407099us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:00.497667 (+ 48656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:00.622070 (+124403us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:02.354394 (+1732324us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:02.417550 (+ 63156us) raft_consensus.cc:1685] finished
0709 12:24:02.417569 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:02.536484 (+118915us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b5400408150. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:02.536662 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1209,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":12165,"spinlock_wait_cycles":485495296,"thread_start_us":391837,"threads_started":1,"wal-append.queue_time_us":962912}
I20260709 12:24:02.903901 12462 consensus_queue.cc:1059] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:02.904865 12462 raft_consensus.cc:3055] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:02.905267 12462 raft_consensus.cc:740] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:02.903977 13048 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.907313 13048 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:02.909232 13052 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:02.875885 12891 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.910063 12891 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:02.871919 13013 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:02.897675 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:02.911592 13013 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:02.906893 11058 raft_consensus.cc:1240] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:02.881433 13041 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:02.888098 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:02.872886 13175 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:02.917857 13149 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:02.918505 13149 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:02.922449 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:02.923535 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 149503us
I20260709 12:24:02.925302 11644 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:02.909372 13048 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:02.926630 13048 consensus_queue.cc:1059] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:24:02.932983 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 151661us
W20260709 12:24:02.933709 13054 consensus_meta.cc:287] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.509s	user 0.012s	sys 0.000s
I20260709 12:24:02.875624 13072 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:02.934758 12465 raft_consensus.cc:697] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:24:02.949256 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 51427us
I20260709 12:24:02.938112 10979 raft_consensus.cc:1275] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:02.947219 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:02.950703 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1146) took 1208 ms. Trace:
I20260709 12:24:02.953905 10979 rpcz_store.cc:276] 0709 12:24:01.742017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.884661 (+1142644us) service_pool.cc:224] Handling call
0709 12:24:02.937747 (+ 53086us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:02.950393 (+ 12646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.950633 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:02.957939 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:02.959987 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 104712us
I20260709 12:24:02.962545 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:02.774514 13170 consensus_queue.cc:260] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:02.963299 11056 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 4.
I20260709 12:24:02.966825 11097 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:02.974270 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:02.975028 10979 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:02.949844 11678 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:02.977375 11057 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:02.981814 13041 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:02.983011 12891 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:02.983736 13092 raft_consensus.cc:3055] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:02.984165 13092 raft_consensus.cc:740] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:24:02.985298 10949 leader_election.cc:336] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 1.802s (SENT)
I20260709 12:24:02.985152 13092 consensus_queue.cc:260] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:02.985661 11681 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:02.985780 10949 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:02.987231 13052 raft_consensus.cc:2749] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:02.988072 13015 consensus_queue.cc:1059] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:24:02.988682 10949 leader_election.cc:336] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 1.895s (SENT)
I20260709 12:24:02.988451 12465 consensus_queue.cc:237] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:02.989117 10949 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:02.990621 10949 leader_election.cc:336] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 1.910s (SENT)
I20260709 12:24:02.991037 10949 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:02.994212 12961 raft_consensus.cc:2749] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:02.995055 12891 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:02.994663 10949 leader_election.cc:336] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 1.992s (SENT)
I20260709 12:24:02.995519 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:02.996389 10975 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 3.
W20260709 12:24:02.996728 10949 leader_election.cc:336] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 2.130s (SENT)
I20260709 12:24:02.997152 10949 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:02.997411 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:02.997978 12961 raft_consensus.cc:2749] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:02.998248 13163 log.cc:927] Time spent T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.050s	user 0.004s	sys 0.001s
I20260709 12:24:02.999487 13035 raft_consensus.cc:2804] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:02.999984 13035 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.000344 13035 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:03.001784 11643 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:03.002836 13032 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:03.003216 13032 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.003569 13032 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:03.004784 12961 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.005520 12961 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:03.006956 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:03.007630 11053 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 5.
I20260709 12:24:03.008674 12921 consensus_queue.cc:1048] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:03.009138 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:03.009886 10977 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:03.006120 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.010424 12940 consensus_queue.cc:1059] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:03.011505 13074 raft_consensus.cc:3055] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:03.011868 13074 raft_consensus.cc:740] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
W20260709 12:24:03.012315 13118 log.cc:927] Time spent T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:24:03.012765 13074 consensus_queue.cc:260] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:03.013831 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:02.954265 12462 consensus_queue.cc:260] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:03.015910 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1737) took 1706 ms. Trace:
I20260709 12:24:02.992439 13013 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:03.016188 11024 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:03.015003 12462 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:03.021050 11057 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 4.
I20260709 12:24:03.031777 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:03.017705 10978 rpcz_store.cc:276] 0709 12:24:01.309620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.535570 (+1225950us) service_pool.cc:224] Handling call
0709 12:24:02.535947 (+   377us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:02.536393 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:02.536419 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:02.537352 (+   933us) log.cc:844] Serialized 52 byte log entry
0709 12:24:02.642755 (+105403us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:02.642950 (+   195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.643066 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:03.015695 (+372629us) raft_consensus.cc:1685] finished
0709 12:24:03.015714 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:03.015852 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5920,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":146,"thread_start_us":104824,"threads_started":1,"wal-append.queue_time_us":314346}
I20260709 12:24:03.033962 11024 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:03.036778 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:03.037442 11125 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:24:03.010016 13015 consensus_queue.cc:1243] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer c979ef00e0ad4157b49ebbdc13ce7cd7 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:24:03.016425 13074 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:03.039268 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:03.052491 10983 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:03.040011 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:03.053269 11134 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:03.040493 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:03.008808 12961 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:03.031960 13100 raft_consensus.cc:2804] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:03.057111 11133 raft_consensus.cc:2410] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:24:03.058542 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.056413 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:03.037600 13170 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:03.080089 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:03.053555 13092 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:03.052968 13041 raft_consensus.cc:2804] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:03.084986 10975 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:24:03.084703 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:03.051158 13052 raft_consensus.cc:2749] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:24:03.086761 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.052800 13098 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:03.088940 12462 consensus_queue.cc:1048] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:03.087765 11023 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:03.090564 10978 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:03.091536 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1693) took 2745 ms. Trace:
W20260709 12:24:03.091396 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 64866.3us
I20260709 12:24:03.063556 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:03.098417 11644 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:03.079900 13013 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.051558 13025 consensus_queue.cc:1059] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:24:03.080626 13054 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:03.111716 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:03.042584 13151 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:03.113025 11644 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:03.116724 10975 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 3: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:03.097518 11130 rpcz_store.cc:276] 0709 12:24:00.345624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.345745 (+   121us) service_pool.cc:224] Handling call
0709 12:24:00.360407 (+ 14662us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:00.394039 (+ 33632us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:00.394091 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:00.394624 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 12:24:01.131544 (+736920us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:01.131591 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.131676 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:02.794434 (+1662758us) spinlock_profiling.cc:243] Waited 58.3 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:03.081379 (+286945us) raft_consensus.cc:1685] finished
0709 12:24:03.081402 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:03.091367 (+  9965us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52720,"raft.queue_time_us":35972,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":3444,"spinlock_wait_cycles":133989632,"thread_start_us":736600,"threads_started":1,"wal-append.queue_time_us":825989}
I20260709 12:24:03.105302 13015 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:03.121809 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:03.123659 10975 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:03.109544 12675 raft_consensus.cc:2804] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:24:03.133025 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.113715 13041 raft_consensus.cc:697] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:03.109251 13167 consensus_queue.cc:1048] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:24:03.117063 13098 raft_consensus.cc:697] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:03.150135 11058 raft_consensus.cc:1240] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:03.120525 11678 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:03.143841 11056 pending_rounds.cc:85] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting all ops after (but not including) 5
I20260709 12:24:03.122643 13015 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:03.162127 13015 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:03.142612 13149 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:03.167446 11024 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:03.168325 13149 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:03.168550 12891 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:03.168962 12891 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.169334 12891 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:03.170902 13098 consensus_queue.cc:237] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:03.153967 11056 pending_rounds.cc:107] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:24:03.173238 11056 raft_consensus.cc:2889] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:03.155916 13162 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:03.141258 11673 raft_consensus.cc:1240] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:03.124506 13013 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:03.156669 12921 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:03.158265 12940 raft_consensus.cc:3055] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:03.160048 11051 raft_consensus.cc:1275] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:03.178354 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:03.119554 13054 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:03.140491 12675 raft_consensus.cc:697] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:03.208933 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:03.212651 10949 leader_election.cc:336] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 2.150s (SENT)
I20260709 12:24:03.214190 11130 raft_consensus.cc:2368] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4.
I20260709 12:24:03.213238 10949 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:03.188740 12940 raft_consensus.cc:740] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:03.207928 13162 raft_consensus.cc:697] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:03.278416 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:03.279138 11130 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:24:03.294044 10978 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
I20260709 12:24:03.295195 13032 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:03.297463 13032 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:03.306084 11125 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
I20260709 12:24:03.308301 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:03.324968 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 358213us
I20260709 12:24:03.280925 12961 raft_consensus.cc:2749] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:03.359697 10983 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:03.373013 13035 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:03.374461 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:03.375528 11128 raft_consensus.cc:2410] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:24:03.377025 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:03.377866 11128 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 4.
I20260709 12:24:03.379341 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:03.355710 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:24:03.365155 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 156170us
I20260709 12:24:03.382534 13013 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:03.295437 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:03.382592 13151 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:03.399531 10978 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
W20260709 12:24:03.400097 10949 leader_election.cc:336] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 2.163s (SENT)
I20260709 12:24:03.400609 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:03.401439 10978 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 5.
I20260709 12:24:03.386750 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:03.401813 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:03.402318 10983 raft_consensus.cc:2376] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6. Re-sending same reply.
I20260709 12:24:03.403504 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:03.403995 11128 raft_consensus.cc:2368] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 4. Current term is 5.
I20260709 12:24:03.394649 11052 raft_consensus.cc:2410] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:24:03.405550 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:03.406802 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:03.396780 12940 consensus_queue.cc:260] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:03.400573 10949 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:03.391716 11129 raft_consensus.cc:2410] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:03.404165 10983 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:03.403519 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:03.391105 11125 raft_consensus.cc:2410] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:03.393594 11097 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:03.395633 10979 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:03.395481 13162 consensus_queue.cc:237] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:03.423000 11680 raft_consensus.cc:1275] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:03.411002 10978 raft_consensus.cc:2393] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 5: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:03.422859 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:03.431448 10975 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 4.
I20260709 12:24:03.479933 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:03.480558 10975 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:03.412218 13192 log.cc:927] Time spent T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 12:24:03.428041 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:03.490052 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:03.426601 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:03.500293 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:03.411602 13054 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:03.494861 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:03.427464 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:03.426113 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:03.423688 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:03.427067 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:03.414745 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:03.424187 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:03.294129 12675 consensus_queue.cc:237] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:03.421044 13015 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:03.408514 10977 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 5.
W20260709 12:24:03.549595 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 149543us
I20260709 12:24:03.501446 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:03.562846 10978 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
W20260709 12:24:03.570480 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 203027us
I20260709 12:24:03.488375 13100 raft_consensus.cc:697] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 5 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:03.565636 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:03.409181 13041 consensus_queue.cc:237] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:03.568615 12940 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:03.576571 10983 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:03.571557 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:03.517246 10979 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 3.
W20260709 12:24:03.548962 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.577435 10978 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 4.
I20260709 12:24:03.578460 11125 raft_consensus.cc:2368] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 6. Current term is 7.
I20260709 12:24:03.488639 12901 raft_consensus.cc:2749] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:03.571524 11672 raft_consensus.cc:2393] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:03.581482 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:03.590451 11132 raft_consensus.cc:2410] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:03.522390 13203 raft_consensus.cc:2804] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:03.578855 11128 raft_consensus.cc:2410] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:03.592419 10975 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:03.576129 13025 consensus_queue.cc:1243] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer c979ef00e0ad4157b49ebbdc13ce7cd7 log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:24:03.572216 11126 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 4.
I20260709 12:24:03.611299 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 245) took 1943 ms. Trace:
I20260709 12:24:03.611747 10981 rpcz_store.cc:276] 0709 12:24:01.667739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.560235 (+892496us) service_pool.cc:224] Handling call
0709 12:24:02.604248 (+ 44013us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:02.671787 (+ 67539us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:02.671830 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:02.702659 (+ 30829us) log.cc:844] Serialized 26 byte log entry
0709 12:24:03.042291 (+339632us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:03.042335 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:03.042403 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:03.611057 (+568654us) raft_consensus.cc:1685] finished
0709 12:24:03.611082 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:03.611227 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16208,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":25407,"thread_start_us":339137,"threads_started":1,"wal-append.queue_time_us":415713}
I20260709 12:24:03.613281 11097 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:03.617810 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:03.596210 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:03.566283 13052 consensus_queue.cc:1048] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:24:03.620966 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:03.624632 10978 raft_consensus.cc:1240] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:24:03.625360 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1149) took 1877 ms. Trace:
I20260709 12:24:03.625687 10978 rpcz_store.cc:276] 0709 12:24:01.747866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.600776 (+1852910us) service_pool.cc:224] Handling call
0709 12:24:03.624391 (+ 23615us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:03.625080 (+   689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:03.625305 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:03.601570 11675 raft_consensus.cc:2393] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:03.409473 13072 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:03.618798 10975 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 4.
I20260709 12:24:03.635341 10981 raft_consensus.cc:1240] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:03.636447 11679 raft_consensus.cc:1240] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:24:03.638660 10983 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
W20260709 12:24:03.639451 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 51627us
I20260709 12:24:03.639627 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1745) took 1232 ms. Trace:
I20260709 12:24:03.602075 13203 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:03.641650 10981 rpcz_store.cc:276] 0709 12:24:02.406776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.613140 (+1206364us) service_pool.cc:224] Handling call
0709 12:24:03.635157 (+ 22017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:03.639383 (+  4226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:03.639575 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:03.620070 13035 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:03.643730 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:03.645664 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:03.648489 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:24:03.636524 13202 log.cc:927] Time spent T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:24:03.637833 11676 raft_consensus.cc:2410] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:24:03.649806 11675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41784 (request call id 479) took 1268 ms (client timeout 1539 ms). Trace:
I20260709 12:24:03.658769 13015 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:03.649174 12891 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:03.650256 13100 consensus_queue.cc:237] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:03.649518 13203 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:03.661841 11134 consensus_meta.cc:287] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.597s	user 0.006s	sys 0.000s
I20260709 12:24:03.662602 11097 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:24:03.662853 13200 log.cc:927] Time spent T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:24:03.663283 13206 consensus_queue.cc:1059] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:03.667131 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:03.668056 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:03.682737 11680 raft_consensus.cc:1240] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 5. Current term is 6. Ops: [3.5-5.6]
W20260709 12:24:03.656466 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 162019us
W20260709 12:24:03.652493 13195 log.cc:927] Time spent T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:24:03.673041 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:03.660966 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1743) took 1951 ms. Trace:
W20260709 12:24:03.678079 10949 leader_election.cc:336] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 2.604s (SENT)
I20260709 12:24:03.652930 13025 raft_consensus.cc:2804] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:24:03.679844 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 163384us
I20260709 12:24:03.678679 11134 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:03.693392 10949 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:03.685058 11681 raft_consensus.cc:1240] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:03.693162 10984 rpcz_store.cc:276] 0709 12:24:01.709144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.879196 (+1170052us) service_pool.cc:224] Handling call
0709 12:24:02.879540 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:02.893451 (+ 13911us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:02.893486 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:02.950351 (+ 56865us) log.cc:844] Serialized 26 byte log entry
0709 12:24:03.481569 (+531218us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:03.481619 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:03.481684 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:03.660732 (+179048us) raft_consensus.cc:1685] finished
0709 12:24:03.660754 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:03.660899 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":319,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":8033,"thread_start_us":458744,"threads_started":1,"wal-append.queue_time_us":626546}
I20260709 12:24:03.686388 12891 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:03.687770 13072 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:03.688321 11673 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEARNER]: Advancing to term 4
I20260709 12:24:03.688644 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:03.690141 11126 raft_consensus.cc:2410] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:03.691283 11097 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:03.695513 11132 raft_consensus.cc:2410] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:24:03.670163 11675 rpcz_store.cc:269] 0709 12:24:02.380335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.423398 (+1043063us) service_pool.cc:224] Handling call
0709 12:24:03.648430 (+225032us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:03.698382 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:03.699596 13191 log.cc:927] Time spent T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.303s	user 0.002s	sys 0.001s
I20260709 12:24:03.709553 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:03.711853 11127 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 4: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:03.741092 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:03.742583 13209 log.cc:927] Time spent T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 12:24:03.743111 11098 connection.cc:256] RPC call timeout handler was delayed by -1.139182609999807s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1673s for a response
I20260709 12:24:03.743605 13151 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:03.744006 11098 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:03.744202 13151 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:03.745271 11676 raft_consensus.cc:1217] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEADER]: Deduplicated request from leader. Original: 1.4->[2.5-2.5]   Dedup: 2.5->[]
I20260709 12:24:03.745885 11676 raft_consensus.cc:1240] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:24:03.746409 13206 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.746580 13211 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:03.747001 13206 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:03.747326 13074 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:03.740489 13025 raft_consensus.cc:697] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 5 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:03.742439 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:04.272559 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1741) took 2564 ms. Trace:
I20260709 12:24:03.747915 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:03.747984 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1734) took 2488 ms. Trace:
I20260709 12:24:03.747718 11134 raft_consensus.cc:2376] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bc01179655564f29b83babe396377cbb in term 4. Re-sending same reply.
W20260709 12:24:04.287732 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:04.287917 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:03.750886 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:04.270046 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 526097us
I20260709 12:24:03.778671 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:03.752525 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:04.271210 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:04.270486 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:24:04.082046 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 49313.2us
W20260709 12:24:04.271759 13100 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.000s	sys 0.025s
W20260709 12:24:04.277156 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 585930us
I20260709 12:24:03.786864 11676 raft_consensus.cc:1240] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:04.278131 10982 rpcz_store.cc:276] 0709 12:24:01.708489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.868982 (+1160493us) service_pool.cc:224] Handling call
0709 12:24:02.892889 (+ 23907us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:02.896092 (+  3203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:02.896127 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:02.896757 (+   630us) log.cc:844] Serialized 52 byte log entry
0709 12:24:03.215809 (+319052us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:03.215855 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:03.215936 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:04.272300 (+1056364us) raft_consensus.cc:1685] finished
0709 12:24:04.272323 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:04.272488 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2456,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":141,"thread_start_us":318553,"threads_started":1,"wal-append.queue_time_us":595171}
W20260709 12:24:04.270213 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 597394us
I20260709 12:24:04.286823 11056 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:24:03.847162 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:03.713037 13204 raft_consensus.cc:2804] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:04.123378 13212 log.cc:927] Time spent T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.282s	user 0.000s	sys 0.000s
W20260709 12:24:04.122663 13215 log.cc:927] Time spent T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:24:04.296090 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:03.750800 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:04.286782 10980 rpcz_store.cc:276] 0709 12:24:01.259480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.509198 (+1249718us) service_pool.cc:224] Handling call
0709 12:24:02.575702 (+ 66504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:02.600788 (+ 25086us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:02.600819 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:02.601314 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 12:24:03.042634 (+441320us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:03.042670 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:03.042738 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:03.698992 (+656254us) spinlock_profiling.cc:243] Waited 30 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:03.747670 (+ 48678us) raft_consensus.cc:1685] finished
0709 12:24:03.747692 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:03.747921 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1735,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":58244,"spinlock_wait_cycles":68973824,"thread_start_us":440932,"threads_started":1,"wal-append.queue_time_us":630543}
I20260709 12:24:04.298218 11097 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:04.299711 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:04.298611 11054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1484) took 1337 ms. Trace:
I20260709 12:24:04.277842 13151 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:04.310861 10982 raft_consensus.cc:1240] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:04.293937 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:04.302729 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:03.743400 13015 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.311492 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1753) took 1586 ms. Trace:
I20260709 12:24:04.305998 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:24:04.296803 13100 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.001s	sys 0.026s
I20260709 12:24:04.308161 11057 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:24:04.311684 11132 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:24:04.311863 10982 rpcz_store.cc:276] 0709 12:24:02.725036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.304977 (+1579941us) service_pool.cc:224] Handling call
0709 12:24:04.310644 (+  5667us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:04.311268 (+   624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.311434 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:04.308844 11054 rpcz_store.cc:276] 0709 12:24:02.961667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.702151 (+740484us) service_pool.cc:224] Handling call
0709 12:24:04.298542 (+596391us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:04.309162 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:03.780606 13203 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:04.313426 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:04.315608 11097 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:04.318339 11675 raft_consensus.cc:2368] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 5. Current term is 6.
I20260709 12:24:04.318463 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:04.306375 13204 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:04.319202 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:04.298588 11677 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:24:04.316826 11127 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 1.
I20260709 12:24:04.324235 11098 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:04.325939 11132 raft_consensus.cc:2393] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 3: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:04.321894 10949 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:04.321156 10982 raft_consensus.cc:1240] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:24:04.326495 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:04.326450 11134 raft_consensus.cc:2368] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4.
I20260709 12:24:04.329511 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1755) took 1604 ms. Trace:
I20260709 12:24:04.329327 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:04.330960 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:04.332479 11056 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 4: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:04.332634 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:04.333498 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:04.333798 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:04.334961 11059 raft_consensus.cc:2410] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:04.335021 11127 raft_consensus.cc:2410] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:04.330274 10982 rpcz_store.cc:276] 0709 12:24:02.725547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.312718 (+1587171us) service_pool.cc:224] Handling call
0709 12:24:04.320941 (+  8223us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:04.329253 (+  8312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.329450 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:04.336540 11097 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:04.332695 13025 consensus_queue.cc:237] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:04.339735 11673 consensus_meta.cc:287] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.623s	user 0.006s	sys 0.002s
I20260709 12:24:04.340544 11673 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 LEARNER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:04.323165 13211 raft_consensus.cc:2804] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:04.341642 13211 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:04.342008 13211 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:04.333854 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:04.343820 11126 raft_consensus.cc:2393] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:04.345047 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:04.346458 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:04.322878 13204 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:04.348783 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:04.350209 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:04.329270 13151 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:04.351284 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:04.352739 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:04.352038 11059 raft_consensus.cc:2393] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 7: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:04.352890 11132 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:24:04.353679 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:04.354981 11056 raft_consensus.cc:2393] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 6: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:04.357558 10982 raft_consensus.cc:1275] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:24:04.358301 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:04.358711 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:04.325531 13015 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:04.360198 11053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 277) took 1231 ms. Trace:
I20260709 12:24:04.356318 13151 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:04.363067 11057 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:04.365464 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1722) took 1310 ms. Trace:
I20260709 12:24:04.364131 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:04.349418 13100 raft_consensus.cc:2804] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:04.360464 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1756) took 1634 ms. Trace:
I20260709 12:24:04.367816 10982 rpcz_store.cc:276] 0709 12:24:02.725821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.336070 (+1610249us) service_pool.cc:224] Handling call
0709 12:24:04.356565 (+ 20495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:04.358525 (+  1960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.360401 (+  1876us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:04.363680 11053 rpcz_store.cc:276] 0709 12:24:03.128296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.133061 (+  4765us) service_pool.cc:224] Handling call
0709 12:24:03.146234 (+ 13173us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:03.146482 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:03.146507 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:03.151922 (+  5415us) log.cc:844] Serialized 26 byte log entry
0709 12:24:03.515500 (+363578us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:03.515540 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:03.515613 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:04.359957 (+844344us) raft_consensus.cc:1685] finished
0709 12:24:04.359981 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:04.360130 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":305139,"threads_started":1,"wal-append.queue_time_us":576848}
I20260709 12:24:04.365533 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:04.370579 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:04.371258 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:04.371333 11053 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:24:04.372217 11059 raft_consensus.cc:2393] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 4: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:04.376437 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:04.366446 11133 rpcz_store.cc:276] 0709 12:24:03.057884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.084793 (+ 26909us) service_pool.cc:224] Handling call
0709 12:24:03.114994 (+ 30201us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:03.626180 (+511186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:03.626244 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:03.637927 (+ 11683us) log.cc:844] Serialized 26 byte log entry
0709 12:24:04.107952 (+470025us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:04.107996 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.108062 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:04.365208 (+257146us) raft_consensus.cc:1685] finished
0709 12:24:04.365233 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:04.365399 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35501,"raft.queue_time_us":241198,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":114,"thread_start_us":809068,"threads_started":2,"wal-append.queue_time_us":646069}
I20260709 12:24:04.367195 13151 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:04.383462 10982 raft_consensus.cc:1275] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:24:04.384229 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1757) took 1658 ms. Trace:
I20260709 12:24:04.384570 10982 rpcz_store.cc:276] 0709 12:24:02.726091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.368648 (+1642557us) service_pool.cc:224] Handling call
0709 12:24:04.374914 (+  6266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:04.383934 (+  9020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.384167 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:04.385988 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:04.387390 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:04.390064 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:04.390529 11054 raft_consensus.cc:1240] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5. Ops: [3.3-4.4]
I20260709 12:24:04.392175 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:04.393007 11133 raft_consensus.cc:2393] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 4: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:04.398970 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1544) took 1027 ms. Trace:
I20260709 12:24:04.399374 11133 rpcz_store.cc:276] 0709 12:24:03.371307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.381423 (+1010116us) service_pool.cc:224] Handling call
0709 12:24:04.398888 (+ 17465us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:04.402035 11056 raft_consensus.cc:1240] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:24:04.382262 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:04.405004 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1760) took 1482 ms. Trace:
I20260709 12:24:04.405481 10982 rpcz_store.cc:276] 0709 12:24:02.922271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.388195 (+1465924us) service_pool.cc:224] Handling call
0709 12:24:04.404443 (+ 16248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:04.404634 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:04.404664 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:04.404708 (+    44us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:04.404741 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.404794 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:04.404910 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:04.409749 13225 log.cc:927] Time spent T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 12:24:04.416194 12940 consensus_meta.cc:287] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.838s	user 0.010s	sys 0.000s
I20260709 12:24:04.416927 12940 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:04.417483 12940 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:04.420965 11057 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
I20260709 12:24:04.424912 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1746) took 1974 ms. Trace:
I20260709 12:24:04.429550 10978 rpcz_store.cc:276] 0709 12:24:02.450825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.626488 (+1175663us) service_pool.cc:224] Handling call
0709 12:24:03.626832 (+   344us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:03.648471 (+ 21639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:03.648507 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:03.650166 (+  1659us) log.cc:844] Serialized 52 byte log entry
0709 12:24:04.270146 (+619980us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:04.270201 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.270278 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:04.424648 (+154370us) raft_consensus.cc:1685] finished
0709 12:24:04.424672 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:04.424840 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11665,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":5472,"thread_start_us":64926,"threads_started":1,"wal-append.queue_time_us":677344}
W20260709 12:24:04.446148 13224 log.cc:927] Time spent T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:24:04.446528 13041 consensus_queue.cc:1048] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:04.447544 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1752) took 1722 ms. Trace:
I20260709 12:24:04.447871 13228 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.448562 13228 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:04.447952 10984 rpcz_store.cc:276] 0709 12:24:02.724793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.694886 (+970093us) service_pool.cc:224] Handling call
0709 12:24:03.698944 (+  4058us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:03.699378 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:03.699408 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:03.699861 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 12:24:04.106862 (+407001us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:04.106904 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.106984 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:04.447320 (+340336us) raft_consensus.cc:1685] finished
0709 12:24:04.447339 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:04.447475 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10599,"raft.run_cpu_time_us":60,"raft.run_wall_time_us":59,"thread_start_us":406539,"threads_started":1,"wal-append.queue_time_us":651062}
I20260709 12:24:04.455493 10978 raft_consensus.cc:1275] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:04.456259 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1762) took 1508 ms. Trace:
I20260709 12:24:04.456571 10978 rpcz_store.cc:276] 0709 12:24:02.947808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.445063 (+1497255us) service_pool.cc:224] Handling call
0709 12:24:04.455134 (+ 10071us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:04.455973 (+   839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.456196 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:04.460651 11098 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:04.434325 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1553) took 1060 ms. Trace:
I20260709 12:24:04.425606 13206 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:04.443615 13203 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:04.475894 10978 raft_consensus.cc:1240] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:04.476898 13015 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:04.469957 11128 raft_consensus.cc:2410] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:04.480187 13204 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:24:04.484164 13211 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:04.505457 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1164) took 1525 ms. Trace:
I20260709 12:24:04.505929 10978 rpcz_store.cc:276] 0709 12:24:02.977700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.457334 (+1479634us) service_pool.cc:224] Handling call
0709 12:24:04.472562 (+ 15228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:04.502566 (+ 30004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.502829 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:04.507310 10978 raft_consensus.cc:1240] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:04.507956 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 260) took 1506 ms. Trace:
I20260709 12:24:04.508845 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 256) took 1547 ms. Trace:
I20260709 12:24:04.509248 10984 rpcz_store.cc:276] 0709 12:24:02.960961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.452826 (+1491865us) service_pool.cc:224] Handling call
0709 12:24:04.486197 (+ 33371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:04.508510 (+ 22313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:04.508539 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:04.508584 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:04.508620 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.508675 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:04.508790 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:04.508244 10978 rpcz_store.cc:276] 0709 12:24:03.001303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.506761 (+1505458us) service_pool.cc:224] Handling call
0709 12:24:04.507124 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:04.507697 (+   573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.507898 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:04.477169 12940 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:04.518959 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 58424.5us
I20260709 12:24:04.504411 13206 raft_consensus.cc:2804] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:04.521662 11098 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:04.520754 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 198916us
I20260709 12:24:04.471773 11126 rpcz_store.cc:276] 0709 12:24:03.373937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.357590 (+983653us) service_pool.cc:224] Handling call
0709 12:24:04.433840 (+ 76250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:04.511636 12901 raft_consensus.cc:2749] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:04.529315 10949 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:04.534170 13164 consensus_queue.cc:1059] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:24:04.593499 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 71908.9us
I20260709 12:24:04.536458 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:04.542351 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:04.564689 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:04.570762 13174 consensus_queue.cc:1059] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:04.571695 12992 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:04.600170 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1546) took 1228 ms. Trace:
I20260709 12:24:04.520314 13203 raft_consensus.cc:2749] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:04.600608 11127 rpcz_store.cc:276] 0709 12:24:03.371870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.542067 (+1170197us) service_pool.cc:224] Handling call
0709 12:24:04.600091 (+ 58024us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:04.575183 13199 log.cc:927] Time spent T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 1.188s	user 0.014s	sys 0.007s
I20260709 12:24:04.579692 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1564) took 1168 ms. Trace:
I20260709 12:24:04.580632 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58414 (request call id 260) took 1569 ms. Trace:
I20260709 12:24:04.581372 12921 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:04.528545 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 223813us
W20260709 12:24:04.585000 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 253174us
W20260709 12:24:04.601656 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 160292us
I20260709 12:24:04.604152 11129 rpcz_store.cc:276] 0709 12:24:03.011264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.013547 (+  2283us) service_pool.cc:224] Handling call
0709 12:24:04.580407 (+1566860us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b540012d254. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:04.580538 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":866873600}
W20260709 12:24:04.603155 11643 connection.cc:256] RPC call timeout handler was delayed by -1.048283220000485s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17350000000000002s for a response
I20260709 12:24:04.603582 11132 raft_consensus.cc:2393] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:04.616416 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1545) took 1244 ms. Trace:
I20260709 12:24:04.616801 11132 rpcz_store.cc:276] 0709 12:24:03.371567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.536123 (+1164556us) service_pool.cc:224] Handling call
0709 12:24:04.616349 (+ 80226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:04.617743 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:04.618381 11132 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 4.
I20260709 12:24:04.618881 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1570) took 1206 ms. Trace:
I20260709 12:24:04.619190 11132 rpcz_store.cc:276] 0709 12:24:03.412721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.617487 (+1204766us) service_pool.cc:224] Handling call
0709 12:24:04.618825 (+  1338us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:04.620054 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:04.620730 11132 raft_consensus.cc:2393] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 3: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:04.521628 13206 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:04.606204 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:04.621501 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:04.622174 11127 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 4.
I20260709 12:24:04.622635 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1566) took 1211 ms. Trace:
I20260709 12:24:04.622949 11127 rpcz_store.cc:276] 0709 12:24:03.411473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.621251 (+1209778us) service_pool.cc:224] Handling call
0709 12:24:04.622578 (+  1327us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:04.623816 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:04.624459 11127 raft_consensus.cc:2393] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 4: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:04.601333 13100 raft_consensus.cc:697] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:04.527618 13228 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:04.627250 11098 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:04.628276 11025 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:04.632506 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:04.633404 11133 raft_consensus.cc:2410] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:04.633812 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1543) took 1262 ms. Trace:
W20260709 12:24:04.636320 11125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1529) took 1340 ms (client timeout 1777 ms). Trace:
W20260709 12:24:04.636783 11125 rpcz_store.cc:269] 0709 12:24:03.296273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.483005 (+186732us) service_pool.cc:224] Handling call
0709 12:24:04.636118 (+1153113us) spinlock_profiling.cc:243] Waited 7.47 ms on lock 0x7b5400373f54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:04.636254 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17172864}
I20260709 12:24:04.596333 12940 raft_consensus.cc:2749] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:04.624846 12921 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:04.599392 13074 raft_consensus.cc:697] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:04.605366 13025 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:04.625684 13206 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:04.657889 13052 raft_consensus.cc:2804] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:04.658730 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 129506us
I20260709 12:24:04.659752 10949 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:04.644654 11098 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:04.637918 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:04.663065 11125 raft_consensus.cc:2393] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:04.663519 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1531) took 1366 ms. Trace:
I20260709 12:24:04.663842 11125 rpcz_store.cc:276] 0709 12:24:03.296855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.637628 (+1340773us) service_pool.cc:224] Handling call
0709 12:24:04.663454 (+ 25826us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:04.645375 11133 rpcz_store.cc:276] 0709 12:24:03.371012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.632229 (+1261217us) service_pool.cc:224] Handling call
0709 12:24:04.633738 (+  1509us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:04.628794 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1547) took 1256 ms. Trace:
I20260709 12:24:04.665179 11127 rpcz_store.cc:276] 0709 12:24:03.372161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.623577 (+1251416us) service_pool.cc:224] Handling call
0709 12:24:04.628723 (+  5146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:04.666260 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:04.646045 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1571) took 1215 ms. Trace:
I20260709 12:24:04.667097 11132 rpcz_store.cc:276] 0709 12:24:03.413095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.619822 (+1206727us) service_pool.cc:224] Handling call
0709 12:24:04.627993 (+  8171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:04.636010 13151 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:04.647574 13197 log.cc:927] Time spent T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 1.280s	user 0.003s	sys 0.015s
I20260709 12:24:04.649369 13041 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.650967 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1539) took 1281 ms. Trace:
I20260709 12:24:04.614758 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:04.643659 11052 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52804 (request call id 270) took 1853 ms (client timeout 2178 ms). Trace:
I20260709 12:24:04.652611 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:04.655642 11025 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:04.655815 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:04.702709 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1560) took 1305 ms. Trace:
W20260709 12:24:04.702833 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 47302.4us
I20260709 12:24:04.703140 11129 rpcz_store.cc:276] 0709 12:24:03.397274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.640542 (+1243268us) service_pool.cc:224] Handling call
0709 12:24:04.702632 (+ 62090us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:04.704244 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:04.705037 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1569) took 1292 ms. Trace:
I20260709 12:24:04.706525 13149 raft_consensus.cc:3055] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:04.705408 11129 rpcz_store.cc:276] 0709 12:24:03.412401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.703920 (+1291519us) service_pool.cc:224] Handling call
0709 12:24:04.704973 (+  1053us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:04.658049 13228 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.662977 13052 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:04.671250 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1542) took 1300 ms. Trace:
I20260709 12:24:04.709550 11127 rpcz_store.cc:276] 0709 12:24:03.370726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.665923 (+1295197us) service_pool.cc:224] Handling call
0709 12:24:04.671185 (+  5262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:04.671729 10949 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:04.684875 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:04.710145 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:04.710908 10979 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:04.711896 11130 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1548) took 1339 ms (client timeout 1686 ms). Trace:
W20260709 12:24:04.712363 11130 rpcz_store.cc:269] 0709 12:24:03.372438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.403235 (+ 30797us) service_pool.cc:224] Handling call
0709 12:24:04.711661 (+1308426us) spinlock_profiling.cc:243] Waited 841 ms on lock 0x7b540012e154. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:04.711827 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1934031232}
I20260709 12:24:04.670888 13164 raft_consensus.cc:3055] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:04.718447 13164 raft_consensus.cc:740] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:04.719040 11097 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:04.719481 13164 consensus_queue.cc:260] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:04.719938 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 105502us
I20260709 12:24:04.720793 13164 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:04.677515 13234 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:04.722285 13041 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:04.724852 13041 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:04.725379 13041 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.664395 13235 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:04.680939 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:04.603981 11128 rpcz_store.cc:276] 0709 12:24:03.410881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.637283 (+226402us) service_pool.cc:224] Handling call
0709 12:24:04.579456 (+942173us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b5400068954. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:04.579621 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1764211072}
I20260709 12:24:04.668165 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:04.707871 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1718) took 1872 ms. Trace:
I20260709 12:24:04.743026 11131 rpcz_store.cc:276] 0709 12:24:02.835740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.835889 (+   149us) service_pool.cc:224] Handling call
0709 12:24:02.836309 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:02.870617 (+ 34308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:02.870649 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:02.880379 (+  9730us) log.cc:844] Serialized 26 byte log entry
0709 12:24:03.189875 (+309496us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:03.189919 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:03.189992 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:04.574373 (+1384381us) spinlock_profiling.cc:243] Waited 42.7 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:04.680940 (+106567us) raft_consensus.cc:1685] finished
0709 12:24:04.680962 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:04.707794 (+ 26832us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1720,"raft.queue_time_us":2360,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":6810,"spinlock_wait_cycles":98270976,"thread_start_us":265429,"threads_started":1,"wal-append.queue_time_us":462157}
I20260709 12:24:04.656323 13203 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:04.683336 10948 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.145.194:44483 timed out after 1.669s (SENT) [suppressed 45 similar messages]
I20260709 12:24:04.716923 11127 raft_consensus.cc:1275] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:04.717548 13228 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:04.677407 11134 rpcz_store.cc:276] 0709 12:24:03.369806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.287600 (+917794us) service_pool.cc:224] Handling call
0709 12:24:04.650761 (+363161us) spinlock_profiling.cc:243] Waited 37.8 ms on lock 0x7b5400373a54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:04.650901 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86946560}
I20260709 12:24:04.675957 12940 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.734191 11125 raft_consensus.cc:2393] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:24:04.762184 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 78890us
I20260709 12:24:04.762372 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1573) took 1348 ms. Trace:
I20260709 12:24:04.762883 11125 rpcz_store.cc:276] 0709 12:24:03.413684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.664529 (+1250845us) service_pool.cc:224] Handling call
0709 12:24:04.762296 (+ 97767us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:04.797703 11130 raft_consensus.cc:1240] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 5. Current term is 6. Ops: [4.3-5.4]
I20260709 12:24:04.798570 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1562) took 1400 ms. Trace:
I20260709 12:24:04.799346 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1556) took 1409 ms. Trace:
I20260709 12:24:04.798907 11130 rpcz_store.cc:276] 0709 12:24:03.397842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.713218 (+1315376us) service_pool.cc:224] Handling call
0709 12:24:04.743864 (+ 30646us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:04.798257 (+ 54393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.798510 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:04.799723 11132 rpcz_store.cc:276] 0709 12:24:03.389656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.667873 (+1278217us) service_pool.cc:224] Handling call
0709 12:24:04.799281 (+131408us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:04.762997 10948 leader_election.cc:336] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Timed out: RequestConsensusVote RPC to 127.9.145.194:44483 timed out after 1.705s (SENT)
W20260709 12:24:04.801009 10948 leader_election.cc:336] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Timed out: RequestConsensusVote RPC to 127.9.145.194:44483 timed out after 1.798s (SENT)
I20260709 12:24:04.801416 10948 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:04.804721 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 266) took 1697 ms. Trace:
I20260709 12:24:04.805150 11127 rpcz_store.cc:276] 0709 12:24:03.064248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.716304 (+1652056us) service_pool.cc:224] Handling call
0709 12:24:04.716614 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:04.761459 (+ 44845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.761702 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:04.804445 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1751) took 2079 ms. Trace:
I20260709 12:24:04.715068 13149 raft_consensus.cc:740] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:04.717027 13052 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:04.670245 13025 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:04.716248 12992 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:04.702816 11126 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 4.
I20260709 12:24:04.743045 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:04.842409 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 170763us
I20260709 12:24:04.843222 10949 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:04.843603 13025 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:04.844235 12992 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:04.845295 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1535) took 1476 ms. Trace:
I20260709 12:24:04.845703 11126 rpcz_store.cc:276] 0709 12:24:03.368660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.625534 (+1256874us) service_pool.cc:224] Handling call
0709 12:24:04.845212 (+219678us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:04.846468 12992 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:04.847000 11134 raft_consensus.cc:3055] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:04.847388 11134 raft_consensus.cc:740] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:04.848498 13236 raft_consensus.cc:2804] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:04.818030 12675 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:04.840408 12921 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:04.695462 11052 rpcz_store.cc:269] 0709 12:24:02.789745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.826458 (+ 36713us) service_pool.cc:224] Handling call
0709 12:24:04.643382 (+1816924us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b54003e0654. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:04.643576 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1032092032}
I20260709 12:24:04.725905 13041 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:04.860049 13041 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:04.860656 13041 consensus_queue.cc:1059] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:04.848137 11134 consensus_queue.cc:260] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:04.820628 10979 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
W20260709 12:24:04.854195 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:04.862250 13237 log.cc:927] Time spent T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:24:04.841974 11678 raft_consensus.cc:2393] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:04.863757 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1750) took 2139 ms. Trace:
I20260709 12:24:04.806996 12940 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:04.864241 10983 rpcz_store.cc:276] 0709 12:24:02.724195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.640877 (+916682us) service_pool.cc:224] Handling call
0709 12:24:03.641237 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:03.655543 (+ 14306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:03.655592 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:03.675856 (+ 20264us) log.cc:844] Serialized 26 byte log entry
0709 12:24:04.504916 (+829060us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:04.504954 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.505020 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:04.863526 (+358506us) raft_consensus.cc:1685] finished
0709 12:24:04.863550 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:04.863696 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6726,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"thread_start_us":234181,"threads_started":1,"wal-append.queue_time_us":919001}
I20260709 12:24:04.809276 13015 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:04.866142 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:04.866741 13216 raft_consensus.cc:2749] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:04.867174 10983 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:04.867560 13216 raft_consensus.cc:2749] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:04.868170 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:04.866143 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:04.869066 10979 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:04.869231 13151 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:04.869973 13151 consensus_queue.cc:1059] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:04.822445 13232 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:04.871335 13232 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:04.873656 13232 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:04.807601 12964 raft_consensus.cc:2749] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:04.850471 13240 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:04.926877 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 83718.4us
I20260709 12:24:04.928133 10949 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:04.813570 13234 raft_consensus.cc:2749] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:04.847003 12992 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.863922 13204 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:04.866395 13015 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:04.851166 13236 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:04.808036 13203 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:04.809362 13235 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:04.925884 13074 consensus_queue.cc:237] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:04.932896 11643 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:24:04.834525 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 262531us
W20260709 12:24:04.931931 10948 leader_election.cc:336] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Timed out: RequestConsensusVote RPC to 127.9.145.194:44483 timed out after 2.132s (SENT)
I20260709 12:24:05.188301 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:05.037781 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 265) took 1982 ms. Trace:
I20260709 12:24:05.222687 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:05.097664 12940 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:04.975250 13149 consensus_queue.cc:260] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:05.221530 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:05.287075 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 354255us
I20260709 12:24:05.220690 11129 rpcz_store.cc:276] 0709 12:24:03.055776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.717365 (+1661589us) service_pool.cc:224] Handling call
0709 12:24:04.798545 (+ 81180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:04.798785 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:04.987758 (+188973us) log.cc:844] Serialized 14 byte log entry
0709 12:24:05.037378 (+ 49620us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:05.037441 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:05.037487 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.037561 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:05.037708 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":708,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":127,"thread_start_us":224699,"threads_started":2,"wal-append.queue_time_us":243543}
W20260709 12:24:05.126291 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:05.176414 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 78342.4us
I20260709 12:24:05.193104 10948 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:05.069583 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 290510us
W20260709 12:24:05.167158 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 461995us
I20260709 12:24:05.293957 11025 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:04.974799 11127 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:04.940997 10979 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
W20260709 12:24:05.142304 13131 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.970s	user 0.024s	sys 0.035s
I20260709 12:24:04.930576 13228 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:05.069034 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 348297us
I20260709 12:24:04.943024 10949 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:05.115149 13164 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:05.327791 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:05.310427 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:04.876854 13025 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:05.227128 13242 log.cc:927] Time spent T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.097s	user 0.000s	sys 0.002s
W20260709 12:24:05.227099 13238 log.cc:927] Time spent T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.068s	user 0.002s	sys 0.000s
W20260709 12:24:05.227109 13244 log.cc:927] Time spent T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.251s	user 0.000s	sys 0.002s
W20260709 12:24:05.432238 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 489234us
I20260709 12:24:05.433277 10949 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:05.190644 11051 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:04.931142 13230 raft_consensus.cc:2804] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:05.446128 13230 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:05.446579 13230 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:05.167367 10976 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.007s	sys 0.007s
W20260709 12:24:05.447103 10976 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.010s	sys 0.014s
I20260709 12:24:05.307684 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:05.142343 13250 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.182367 13258 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:05.226933 13247 log.cc:927] Time spent T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:24:04.948644 12921 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:04.974592 13240 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.330049 13216 raft_consensus.cc:2749] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:05.332208 11643 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
W20260709 12:24:05.462134 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 558800us
W20260709 12:24:05.463812 10948 leader_election.cc:336] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Timed out: RequestConsensusVote RPC to 127.9.145.194:44483 timed out after 1.539s (SENT)
I20260709 12:24:05.464274 10948 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:05.191006 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:05.286562 13149 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:04.984853 12675 raft_consensus.cc:3055] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:05.345402 10979 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:04.940490 13015 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:05.148830 13233 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.413298 11133 raft_consensus.cc:2410] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:24:05.414569 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 107452us
I20260709 12:24:05.299600 11644 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:05.297494 13265 raft_consensus.cc:2804] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:05.298314 13236 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:05.311604 13259 log.cc:927] Time spent T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
W20260709 12:24:05.431145 13248 log.cc:927] Time spent T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 12:24:05.443305 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:05.444123 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:05.311264 13234 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:05.309998 12940 consensus_queue.cc:1059] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.136s
I20260709 12:24:04.925745 13241 consensus_queue.cc:1048] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.471s
I20260709 12:24:05.497326 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:05.497947 10979 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
W20260709 12:24:05.453329 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:05.308229 13131 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.323s	user 0.034s	sys 0.058s
I20260709 12:24:05.455384 11097 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:05.449064 13206 consensus_meta.cc:287] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.759s	user 0.008s	sys 0.003s
I20260709 12:24:04.943229 12992 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:05.413699 13025 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:24:05.462285 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 130186us
I20260709 12:24:05.142447 13245 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:04.931620 13100 consensus_queue.cc:237] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:05.466409 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 172534us
W20260709 12:24:05.453540 11128 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.013s	sys 0.042s
W20260709 12:24:05.488901 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 189366us
I20260709 12:24:05.490355 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 248) took 2551 ms. Trace:
I20260709 12:24:05.491416 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:05.435930 13164 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:05.458407 13260 consensus_queue.cc:1059] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 12:24:05.493768 11098 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:05.470906 13251 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:05.166880 13035 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.009s	sys 0.005s
I20260709 12:24:05.499132 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:05.478344 12675 raft_consensus.cc:740] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:05.467581 13261 consensus_queue.cc:1059] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 12:24:05.467002 13240 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:05.644569 11125 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:05.507493 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1747) took 3011 ms. Trace:
I20260709 12:24:05.638820 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:05.647050 10982 rpcz_store.cc:276] 0709 12:24:02.938997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.406476 (+1467479us) service_pool.cc:224] Handling call
0709 12:24:04.419742 (+ 13266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:04.472815 (+ 53073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:04.472846 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:04.475493 (+  2647us) log.cc:844] Serialized 26 byte log entry
0709 12:24:04.613149 (+137656us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:04.613186 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.613261 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:05.489997 (+876736us) raft_consensus.cc:1685] finished
0709 12:24:05.490024 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:05.490257 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":111091,"threads_started":1,"wal-append.queue_time_us":464666}
I20260709 12:24:05.647182 10979 raft_consensus.cc:2410] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:05.646696 10975 rpcz_store.cc:276] 0709 12:24:02.495666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.639563 (+1143897us) service_pool.cc:224] Handling call
0709 12:24:03.643487 (+  3924us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:04.532332 (+888845us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:04.532366 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:04.532916 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 12:24:04.658858 (+125942us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:04.658901 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.734699 (+ 75798us) spinlock_profiling.cc:243] Waited 888 ms on lock 0x7b540035dc54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:04.734761 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:05.507163 (+772402us) raft_consensus.cc:1685] finished
0709 12:24:05.507187 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:05.507421 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109776,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":12034,"spinlock_wait_cycles":2043231104,"thread_start_us":125521,"threads_started":1,"wal-append.queue_time_us":283870}
I20260709 12:24:05.494681 12921 raft_consensus.cc:2749] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:05.646186 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1767) took 1102 ms. Trace:
I20260709 12:24:05.657006 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:05.658646 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 194862us
W20260709 12:24:05.503304 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 88221.3us
I20260709 12:24:05.456073 13250 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:05.660985 11097 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:05.662586 11125 raft_consensus.cc:2393] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 5: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:05.656359 10978 rpcz_store.cc:276] 0709 12:24:04.544160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.546855 (+  2695us) service_pool.cc:224] Handling call
0709 12:24:04.547185 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:04.754354 (+207169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:04.754391 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:04.809494 (+ 55103us) log.cc:844] Serialized 26 byte log entry
0709 12:24:05.155523 (+346029us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:05.155567 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.155643 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:05.645950 (+490307us) raft_consensus.cc:1685] finished
0709 12:24:05.645971 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:05.646123 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":557,"raft.queue_time_us":108736,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":11195,"thread_start_us":428228,"threads_started":2,"wal-append.queue_time_us":559325}
W20260709 12:24:05.644676 11128 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.020s	sys 0.049s
I20260709 12:24:05.458055 13258 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:05.646399 13035 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.012s	sys 0.007s
I20260709 12:24:05.690310 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:24:05.619993 13052 consensus_meta.cc:287] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.768s	user 0.008s	sys 0.004s
W20260709 12:24:05.504760 13253 log.cc:927] Time spent T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:24:05.688511 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:05.644996 13216 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:05.654855 13025 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:05.495484 13265 raft_consensus.cc:697] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:24:05.572950 13255 log.cc:927] Time spent T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:24:05.504266 13235 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:05.694267 10975 raft_consensus.cc:1275] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:05.694796 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:05.720772 11053 raft_consensus.cc:2393] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 6: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:05.720743 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1774) took 1174 ms. Trace:
I20260709 12:24:05.695899 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 272) took 1038 ms. Trace:
I20260709 12:24:05.721626 10975 rpcz_store.cc:276] 0709 12:24:04.545880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.651090 (+1105210us) service_pool.cc:224] Handling call
0709 12:24:05.689295 (+ 38205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:05.720448 (+ 31153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.720683 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:05.571013 13234 raft_consensus.cc:2749] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:05.652467 13251 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:05.507364 12940 consensus_queue.cc:1243] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer c979ef00e0ad4157b49ebbdc13ce7cd7 log is divergent from this leader: its last log entry 1.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:24:05.708856 13243 log.cc:927] Time spent T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.250s	user 0.000s	sys 0.000s
I20260709 12:24:05.709275 11060 raft_consensus.cc:2410] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:24:05.712159 11133 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1551) took 2338 ms (client timeout 3110 ms). Trace:
W20260709 12:24:05.735210 11133 rpcz_store.cc:269] 0709 12:24:03.373366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.664846 (+1291480us) service_pool.cc:224] Handling call
0709 12:24:05.711895 (+1047049us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b54000334d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:05.712085 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1433501440}
I20260709 12:24:05.712512 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:05.716329 12964 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:05.718791 11127 raft_consensus.cc:1240] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 12:24:05.719523 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:05.722308 11125 rpcz_store.cc:276] 0709 12:24:04.657429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.695063 (+1037634us) service_pool.cc:224] Handling call
0709 12:24:05.695388 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:05.695582 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:05.695607 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:05.695647 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:05.695681 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.695732 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:05.695838 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:05.707007 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1754) took 2981 ms. Trace:
I20260709 12:24:05.503392 13257 raft_consensus.cc:2804] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:05.655428 13206 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:05.742695 10980 rpcz_store.cc:276] 0709 12:24:02.725281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.308361 (+1583080us) service_pool.cc:224] Handling call
0709 12:24:04.320112 (+ 11751us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:04.511662 (+191550us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:04.511704 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:04.519761 (+  8057us) log.cc:844] Serialized 26 byte log entry
0709 12:24:04.983985 (+464224us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:04.984033 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.984111 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:05.697693 (+713582us) raft_consensus.cc:1685] finished
0709 12:24:05.697713 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:05.706939 (+  9226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":227048,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":525387,"threads_started":2,"wal-append.queue_time_us":528646}
I20260709 12:24:05.696476 13272 raft_consensus.cc:2749] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:05.749266 12961 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:24:05.731472 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:05.665934 13231 consensus_queue.cc:1059] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 12:24:05.698200 13052 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:05.736588 13203 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:05.500042 13233 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
W20260709 12:24:05.804857 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 311124us
W20260709 12:24:05.801291 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 344393us
I20260709 12:24:05.747114 13257 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:05.796370 11133 raft_consensus.cc:1240] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:05.816428 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:05.735371 13251 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:05.735636 13277 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.741006 11672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41784 (request call id 489) took 1054 ms. Trace:
I20260709 12:24:05.741559 12940 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:05.827035 10977 raft_consensus.cc:1240] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:05.807232 11678 raft_consensus.cc:2393] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 7: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:05.830906 11133 raft_consensus.cc:1240] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:24:05.837199 10982 raft_consensus.cc:2410] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
W20260709 12:24:05.814894 13253 log.cc:927] Time spent T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:24:05.849494 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:05.849717 13285 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.824676 13261 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:05.692481 13245 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:05.810448 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1735) took 4520 ms. Trace:
I20260709 12:24:05.749904 12964 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:05.873247 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1765) took 2846 ms. Trace:
W20260709 12:24:05.873854 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:05.873677 10984 rpcz_store.cc:276] 0709 12:24:03.026942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.510215 (+1483273us) service_pool.cc:224] Handling call
0709 12:24:04.522951 (+ 12736us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:04.523206 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:04.523232 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:04.523762 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 12:24:04.745314 (+221552us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:04.745360 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.745435 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:05.872993 (+1127558us) raft_consensus.cc:1685] finished
0709 12:24:05.873016 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:05.873176 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":221210,"threads_started":1,"wal-append.queue_time_us":786673}
W20260709 12:24:05.861886 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 54412.2us
I20260709 12:24:05.814154 12961 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:05.851538 12940 raft_consensus.cc:697] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
W20260709 12:24:05.869748 13246 log.cc:927] Time spent T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.374s	user 0.000s	sys 0.001s
W20260709 12:24:05.930402 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 48974.7us
I20260709 12:24:05.891968 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 268) took 1282 ms. Trace:
I20260709 12:24:05.778070 12675 consensus_queue.cc:260] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:05.921304 13245 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:05.920114 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:05.932838 11023 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:05.955935 11023 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:05.818998 13257 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:05.953691 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 292775us
I20260709 12:24:05.816272 13203 raft_consensus.cc:2804] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:05.872264 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:05.965679 11125 raft_consensus.cc:1240] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4. Ops: []
W20260709 12:24:05.861596 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 117308us
W20260709 12:24:05.969110 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 316441us
I20260709 12:24:05.919838 13052 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:05.985075 11125 raft_consensus.cc:1240] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:05.893064 13261 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:06.077265 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 644018us
I20260709 12:24:06.005383 11097 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:05.987968 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.024546 13291 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.964906 13203 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:05.918813 13164 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:05.925347 13230 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:05.861112 13277 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:05.919800 12964 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:06.081313 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 117755us
W20260709 12:24:06.025002 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.094877 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1730) took 1028 ms. Trace:
I20260709 12:24:06.037250 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:06.108656 10949 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:06.074060 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:05.925981 13236 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:05.891345 13285 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:05.871739 13265 consensus_queue.cc:237] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:06.087988 13273 raft_consensus.cc:2804] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:06.149302 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:06.156817 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:06.108242 13149 consensus_meta.cc:287] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.002s
I20260709 12:24:06.149602 11125 rpcz_store.cc:276] 0709 12:24:05.066605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.984595 (+917990us) service_pool.cc:224] Handling call
0709 12:24:05.984901 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:06.094558 (+109657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:06.094806 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:06.164014 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 66649.1us
I20260709 12:24:06.164945 10949 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:06.165549 13235 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:06.167567 13230 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:06.169061 13297 log.cc:927] Time spent T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:24:06.190678 11129 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:06.107815 13206 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:06.168479 13288 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.150453 13250 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:06.098692 12940 consensus_queue.cc:237] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:06.193127 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 199297us
I20260709 12:24:06.113440 12992 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:06.198874 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:06.200682 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 270) took 1548 ms. Trace:
W20260709 12:24:06.202023 13264 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.970s	user 0.020s	sys 0.019s
I20260709 12:24:06.169843 13278 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:06.169682 13304 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.110488 13240 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:06.111064 13203 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:06.158207 13273 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.211238 11126 rpcz_store.cc:276] 0709 12:24:04.652046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.846425 (+194379us) service_pool.cc:224] Handling call
0709 12:24:04.846752 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:04.877475 (+ 30723us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:04.877511 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:04.877559 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:04.877594 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:06.200383 (+1322789us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b54000eecd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:06.200443 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:06.200606 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70058752}
I20260709 12:24:06.209015 11025 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:06.159101 11678 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
W20260709 12:24:06.206748 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 201718us
I20260709 12:24:06.209887 11679 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 5.
I20260709 12:24:06.215452 10949 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:06.234577 11097 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:06.235325 10949 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:06.217837 13206 consensus_queue.cc:1059] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:06.219853 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1733) took 1152 ms. Trace:
I20260709 12:24:06.087018 13286 consensus_queue.cc:1048] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.140s
I20260709 12:24:06.242940 11130 rpcz_store.cc:276] 0709 12:24:05.067268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:06.218960 (+1151692us) service_pool.cc:224] Handling call
0709 12:24:06.219281 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:06.219512 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:06.219535 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:06.219576 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:06.219622 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:06.219674 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:06.219797 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:06.197669 13285 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:06.170246 13292 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:06.235406 11097 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:06.236440 13287 raft_consensus.cc:2749] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:06.113214 13291 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:06.221943 13278 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:06.231390 13211 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:06.205245 13258 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:06.239202 13306 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:06.241257 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:06.212247 13290 log.cc:927] Time spent T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 12:24:05.829082 11672 rpcz_store.cc:276] 0709 12:24:04.684371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.705799 (+ 21428us) service_pool.cc:224] Handling call
0709 12:24:04.706280 (+   481us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:05.122907 (+416627us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:05.127463 (+  4556us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:05.221356 (+ 93893us) log.cc:844] Serialized 52 byte log entry
0709 12:24:05.496965 (+275609us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:05.502786 (+  5821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.570308 (+ 67522us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:05.710820 (+140512us) raft_consensus.cc:1685] finished
0709 12:24:05.710847 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:05.738272 (+ 27425us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":394599,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":37849,"thread_start_us":540532,"threads_started":2,"wal-append.queue_time_us":388494}
I20260709 12:24:05.933261 11128 rpcz_store.cc:276] 0709 12:24:04.593678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.809798 (+216120us) service_pool.cc:224] Handling call
0709 12:24:04.874717 (+ 64919us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:04.874982 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:05.706499 (+831517us) log.cc:844] Serialized 14 byte log entry
0709 12:24:05.826082 (+119583us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:05.834608 (+  8526us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:05.848516 (+ 13908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.863426 (+ 14910us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:05.876202 (+ 12776us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1510,"prepare.queue_time_us":569834,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":76464,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":31065,"thread_start_us":908891,"threads_started":2,"wal-append.queue_time_us":256301}
I20260709 12:24:06.249655 10949 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:06.252125 10948 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:06.221271 13273 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:06.213229 13296 raft_consensus.cc:2804] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:06.229795 13305 raft_consensus.cc:3055] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:06.221397 13233 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:06.262418 13261 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:06.232785 13264 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.001s	user 0.020s	sys 0.020s
I20260709 12:24:06.266147 11097 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:06.248786 13235 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:06.251042 13230 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:06.250749 13206 consensus_queue.cc:1243] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:24:06.262928 13298 log.cc:927] Time spent T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:24:06.271277 13303 raft_consensus.cc:2804] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:24:06.271719 13293 log.cc:927] Time spent T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
W20260709 12:24:06.274962 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 114304us
I20260709 12:24:06.277114 12964 raft_consensus.cc:2804] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:06.277344 13296 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:06.276641 13292 raft_consensus.cc:697] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:24:06.279173 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 128932us
I20260709 12:24:06.211660 13288 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:06.281329 11126 raft_consensus.cc:1275] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:24:06.297870 11126 pending_rounds.cc:85] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 1
I20260709 12:24:06.298161 11126 pending_rounds.cc:107] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:24:06.298518 11126 raft_consensus.cc:2889] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:06.232276 13304 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:06.269979 13306 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.270112 13100 raft_consensus.cc:2749] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:24:06.283780 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 62863.1us
W20260709 12:24:06.284497 13015 consensus_meta.cc:287] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.790s	user 0.012s	sys 0.000s
I20260709 12:24:06.278054 10949 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:06.280196 13305 raft_consensus.cc:740] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:06.271579 13236 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:06.299265 11644 leader_election.cc:336] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Timed out: RequestConsensusVote RPC to 127.9.145.194:44483 timed out after 2.178s (SENT)
I20260709 12:24:06.290920 13230 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:06.301280 11098 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:06.303224 11025 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:06.283557 13285 raft_consensus.cc:2804] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:06.298956 13296 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:06.305330 13288 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:06.300511 11097 connection.cc:256] RPC call timeout handler was delayed by -1.520272974999898s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24209999999999998s for a response
I20260709 12:24:06.307411 11644 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:06.303419 13306 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:06.308706 13015 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:06.294543 12964 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.311491 13278 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:06.314637 13292 consensus_queue.cc:237] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:06.318300 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1778) took 1217 ms. Trace:
I20260709 12:24:06.375195 10982 rpcz_store.cc:276] 0709 12:24:05.100855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.649149 (+548294us) service_pool.cc:224] Handling call
0709 12:24:06.318018 (+668869us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54003bae54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:06.318227 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":321608576}
W20260709 12:24:06.375721 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.296350 13261 raft_consensus.cc:2804] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:06.321265 13303 raft_consensus.cc:697] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:06.322770 13230 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:06.328032 11098 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:06.302194 13206 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:06.301993 13286 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:06.314699 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:06.323535 13233 raft_consensus.cc:2749] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:06.431831 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1732) took 1364 ms. Trace:
I20260709 12:24:06.344789 13282 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:06.432222 11126 rpcz_store.cc:276] 0709 12:24:05.067048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:06.216946 (+1149898us) service_pool.cc:224] Handling call
0709 12:24:06.217323 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:06.302142 (+ 84819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:06.431585 (+129443us) spinlock_profiling.cc:243] Waited 57.9 ms on lock 0x7b5400068954. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:06.431767 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133196544}
I20260709 12:24:06.344828 13041 consensus_queue.cc:1048] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:24:06.337455 12992 raft_consensus.cc:2749] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:24:06.348940 13216 consensus_meta.cc:287] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.628s	user 0.010s	sys 0.000s
W20260709 12:24:06.359102 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 1.23658e+06us
I20260709 12:24:06.347595 11134 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:06.370810 13100 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:05.872417 10976 rpcz_store.cc:276] 0709 12:24:01.289738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.545441 (+1255703us) service_pool.cc:224] Handling call
0709 12:24:02.655539 (+110098us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:02.779586 (+124047us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:02.779625 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:02.780377 (+   752us) log.cc:844] Serialized 52 byte log entry
0709 12:24:03.035081 (+254704us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:03.101019 (+ 65938us) log.cc:844] Serialized 14 byte log entry
0709 12:24:03.709506 (+608487us) spinlock_profiling.cc:243] Waited 6.85 ms on lock 0x7b18003c1f60. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cf73f3 00007f8f88cf97c1 00007f8f88cf9779 00007f8f88cf9709 00007f8f88cf96d1 00007f8f88cf89cd 0000000000388634 0000000000388479 00007f8f88cda83a
0709 12:24:04.551500 (+841994us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b18003c1f60. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88c71c0a 00007f8f923b1219 00007f8f88cf9a40 00007f8f88cf44e4 00007f8f88cf4455 00007f8f8f7dc3c7 00007f8f8bdee9a7 00007f8f8bdfe0bf 00007f8f8bdfe038
0709 12:24:04.551744 (+   244us) log.cc:844] Serialized 14 byte log entry
0709 12:24:05.737044 (+1185300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.750953 (+ 13909us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:05.775847 (+ 24894us) raft_consensus.cc:1685] finished
0709 12:24:05.778531 (+  2684us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:05.805181 (+ 26650us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1303,"prepare.queue_time_us":1472621,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":86,"raft.queue_time_us":57911,"raft.run_cpu_time_us":415,"raft.run_wall_time_us":63637,"spinlock_wait_cycles":19500800,"thread_start_us":1352082,"threads_started":3,"wal-append.queue_time_us":1350925,"wal-append.run_cpu_time_us":2655,"wal-append.run_wall_time_us":1174920}
I20260709 12:24:06.342767 13314 consensus_queue.cc:1059] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
W20260709 12:24:06.364030 13251 consensus_meta.cc:287] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.529s	user 0.004s	sys 0.005s
I20260709 12:24:06.342758 13203 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:06.423049 13303 consensus_queue.cc:237] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:06.422432 13288 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:06.371169 13277 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:06.330399 12964 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:06.418272 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 74290.8us
W20260709 12:24:06.436949 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 108963us
I20260709 12:24:06.341138 11131 raft_consensus.cc:1240] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4. Ops: []
W20260709 12:24:06.344669 13025 consensus_meta.cc:287] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.606s	user 0.006s	sys 0.002s
I20260709 12:24:06.438958 13206 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:06.699544 11098 leader_election.cc:400] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 5. Current term is 6.
I20260709 12:24:06.699899 11098 leader_election.cc:403] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:06.321307 13285 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:24:06.330415 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 52423.9us
I20260709 12:24:06.447574 11645 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:06.500669 10948 leader_election.cc:336] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Timed out: RequestConsensusVote RPC to 127.9.145.194:44483 timed out after 1.812s (SENT)
I20260709 12:24:06.700969 10948 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:06.701122 10949 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
W20260709 12:24:06.701411 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 253909us
I20260709 12:24:06.346424 13264 consensus_queue.cc:1059] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.214s
I20260709 12:24:04.806550 10981 rpcz_store.cc:276] 0709 12:24:02.724512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.650316 (+925804us) service_pool.cc:224] Handling call
0709 12:24:03.676988 (+ 26672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:03.679308 (+  2320us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:04.553460 (+874152us) log.cc:844] Serialized 14 byte log entry
0709 12:24:04.804070 (+250610us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:04.804126 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:04.804174 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.804248 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:04.804380 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":873836,"prepare.queue_time_us":902615,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":488,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":6515,"thread_start_us":249721,"threads_started":1}
I20260709 12:24:06.427970 13074 raft_consensus.cc:3055] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:06.430966 13291 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:06.437672 13149 raft_consensus.cc:2749] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:06.615952 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.426748 13304 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:06.755507 12961 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:06.707268 13265 raft_consensus.cc:2749] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:06.756829 12961 raft_consensus.cc:2749] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:06.758890 13206 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:06.776291 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 275665us
I20260709 12:24:06.777796 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1769) took 2233 ms. Trace:
I20260709 12:24:06.778530 13288 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:06.781051 13288 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:06.431411 13257 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:06.784022 13257 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:06.784945 11133 raft_consensus.cc:1240] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:24:06.785519 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 130000us
I20260709 12:24:06.786245 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1728) took 1720 ms. Trace:
I20260709 12:24:06.786839 11023 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:06.787685 11023 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:06.787884 13306 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:06.789422 13260 consensus_queue.cc:1048] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:06.791743 13260 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:06.805853 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:06.806380 13260 raft_consensus.cc:697] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:06.806593 11059 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
W20260709 12:24:06.694396 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 160158us
I20260709 12:24:06.808766 11023 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
W20260709 12:24:06.809864 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 108837us
I20260709 12:24:06.810799 10949 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:06.697403 11134 raft_consensus.cc:1275] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:24:06.342314 13015 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:06.345510 13258 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.217s
I20260709 12:24:06.446841 13216 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:06.383662 13261 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:06.699201 13100 consensus_queue.cc:1059] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:24:06.793921 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:06.794261 12992 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:06.795011 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:06.808866 13234 raft_consensus.cc:2749] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:06.796782 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:06.840507 13100 raft_consensus.cc:3055] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:06.840940 13100 raft_consensus.cc:740] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:06.841903 13100 consensus_queue.cc:260] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:06.843214 13100 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:06.797034 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 117346us
I20260709 12:24:06.797581 13291 raft_consensus.cc:2749] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 5. Current term is 6.
I20260709 12:24:06.797508 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:06.437925 13282 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:06.851186 11098 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:06.778244 10977 rpcz_store.cc:276] 0709 12:24:04.544719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.981085 (+436366us) service_pool.cc:224] Handling call
0709 12:24:04.981583 (+   498us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:05.832936 (+851353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:06.777443 (+944507us) spinlock_profiling.cc:243] Waited 845 ms on lock 0x7b54002553d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:06.777684 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1943649152}
W20260709 12:24:06.777729 10948 leader_election.cc:336] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Timed out: RequestConsensusVote RPC to 127.9.145.194:44483 timed out after 1.861s (SENT)
I20260709 12:24:06.825469 13230 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:06.813400 11134 pending_rounds.cc:85] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 5
I20260709 12:24:06.816533 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1731) took 1749 ms. Trace:
I20260709 12:24:06.820914 10949 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:06.808373 13321 raft_consensus.cc:2804] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:06.825986 11023 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:06.831133 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1768) took 2286 ms. Trace:
I20260709 12:24:06.890813 11134 pending_rounds.cc:107] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:24:06.891848 11134 raft_consensus.cc:2889] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:06.707538 13285 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:06.790047 13306 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:06.891057 10983 rpcz_store.cc:276] 0709 12:24:04.544476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.871941 (+327465us) service_pool.cc:224] Handling call
0709 12:24:04.874035 (+  2094us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:05.414568 (+540533us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:05.543441 (+128873us) log.cc:844] Serialized 14 byte log entry
0709 12:24:05.732011 (+188570us) log.cc:844] Serialized 14 byte log entry
0709 12:24:05.732140 (+   129us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:05.732177 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:05.732227 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:06.262322 (+530095us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b18003c2320. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cf7522 00007f8f88cf97c1 00007f8f88cf9779 00007f8f88cf9709 00007f8f88cf96d1 00007f8f88cf89cd 0000000000388634 0000000000388479 00007f8f88cda83a
0709 12:24:06.795429 (+533107us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b18003c2320. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cf73f3 00007f8f88cf97c1 00007f8f88cf9779 00007f8f88cf9709 00007f8f88cf96d1 00007f8f88cf89cd 0000000000388634 0000000000388479 00007f8f88cda83a
0709 12:24:06.830876 (+ 35447us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b54001ab3d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:06.830924 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:06.831061 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":486264,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":104,"raft.queue_time_us":180033,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":29522,"spinlock_wait_cycles":1302884096,"thread_start_us":283782,"threads_started":2,"wal-append.queue_time_us":261087}
I20260709 12:24:06.894930 13234 raft_consensus.cc:2749] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:06.837301 11056 raft_consensus.cc:2410] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 5 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:24:06.796028 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:06.849512 11060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52804 (request call id 287) took 1613 ms. Trace:
I20260709 12:24:06.896021 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1574) took 3400 ms. Trace:
I20260709 12:24:06.896299 11060 rpcz_store.cc:276] 0709 12:24:05.236544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.236690 (+   146us) service_pool.cc:224] Handling call
0709 12:24:06.849362 (+1612672us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b54003e0654. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:06.849465 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":598369024}
I20260709 12:24:06.896420 11134 rpcz_store.cc:276] 0709 12:24:03.495599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.761891 (+1266292us) service_pool.cc:224] Handling call
0709 12:24:04.816724 (+ 54833us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:06.347191 (+1530467us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b58001e11d0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bd400aa 00007f8f8bdc2447 00007f8f8bddafe7 00007f8f8bddc7de 00007f8f8bde6b49 00007f8f8bde7416 00007f8f8bde3d8f 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4
0709 12:24:06.895799 (+548608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:06.895962 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":476010752}
I20260709 12:24:06.857367 10948 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:06.786609 11133 rpcz_store.cc:276] 0709 12:24:05.066152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.835030 (+768878us) service_pool.cc:224] Handling call
0709 12:24:05.931270 (+ 96240us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:06.785421 (+854151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:06.785974 (+   553us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b540023f0d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:06.786186 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1962600832}
W20260709 12:24:06.857937 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.862438 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:24:06.897955 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 120260us
W20260709 12:24:06.898715 10948 leader_election.cc:336] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Timed out: RequestConsensusVote RPC to 127.9.145.194:44483 timed out after 1.669s (SENT)
W20260709 12:24:06.899523 10948 leader_election.cc:336] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Timed out: RequestConsensusVote RPC to 127.9.145.194:44483 timed out after 2.007s (SENT)
I20260709 12:24:06.899928 10948 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:06.863229 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:06.863618 13015 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:06.864494 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:06.702428 13025 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:06.860968 11098 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:06.833376 13308 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:24:06.890770 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 64857.3us
I20260709 12:24:06.909852 11023 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:06.813998 13074 raft_consensus.cc:740] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:06.609155 13251 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:06.913661 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 100806us
I20260709 12:24:06.914268 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:06.914623 10949 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:06.830672 13261 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:06.890312 11125 rpcz_store.cc:276] 0709 12:24:05.066833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:06.160469 (+1093636us) service_pool.cc:224] Handling call
0709 12:24:06.160810 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:06.252811 (+ 92001us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:06.252862 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:06.265917 (+ 13055us) log.cc:844] Serialized 26 byte log entry
0709 12:24:06.384638 (+118721us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b4800061a58. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f90d0daa1 00007f8f90d04b37 00007f8f90d049ca 00007f8f90dfc26f 00007f8f90dfbf37 00007f8f90e1055c 00007f8f90e10508 00007f8f90e10488 00007f8f90e10443 00007f8f90e0f6ec 00007f8f8fd39a96
0709 12:24:06.441149 (+ 56511us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:06.441193 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:06.441261 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:06.803229 (+361968us) raft_consensus.cc:1685] finished
0709 12:24:06.803257 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:06.816366 (+ 13109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15783,"raft.queue_time_us":30991,"raft.run_cpu_time_us":3037,"raft.run_wall_time_us":209603,"spinlock_wait_cycles":23227648,"thread_start_us":204009,"threads_started":2,"wal-append.queue_time_us":400916}
I20260709 12:24:06.862725 11059 raft_consensus.cc:1275] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:24:06.892853 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 190213us
I20260709 12:24:06.917960 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:06.861904 13204 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:06.826609 13277 raft_consensus.cc:2749] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:06.372221 13305 consensus_queue.cc:260] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:06.540506 13286 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:06.865422 13282 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:06.908179 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 47250.5us
I20260709 12:24:06.891364 13321 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.905413 13015 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:06.918619 11060 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:06.902611 12961 raft_consensus.cc:2749] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:06.905256 13216 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.913203 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:06.912822 13292 raft_consensus.cc:2804] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:06.917279 13308 raft_consensus.cc:697] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:06.930081 11098 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:06.921013 13273 consensus_meta.cc:287] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.641s	user 0.009s	sys 0.001s
I20260709 12:24:06.911233 13288 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:06.923573 10949 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:06.916939 13234 raft_consensus.cc:2749] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:06.923593 11025 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.076s	sys 0.174s
I20260709 12:24:06.927250 13258 raft_consensus.cc:2804] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:06.950614 11025 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.076s	sys 0.174s
W20260709 12:24:06.942269 13235 consensus_meta.cc:287] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.649s	user 0.007s	sys 0.002s
I20260709 12:24:06.953143 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1563) took 3544 ms. Trace:
I20260709 12:24:06.953444 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:06.971812 11059 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:24:06.954223 13273 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:06.954725 12961 raft_consensus.cc:2749] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:06.939759 13015 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:06.960826 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 616439us
I20260709 12:24:07.005733 12964 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:06.943778 13277 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:06.971535 11131 rpcz_store.cc:276] 0709 12:24:03.410433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.744768 (+1334335us) service_pool.cc:224] Handling call
0709 12:24:04.811379 (+ 66611us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:06.657537 (+1846158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:06.952867 (+295330us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54002f2e54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:06.953080 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3517628800}
I20260709 12:24:06.958933 13172 raft_consensus.cc:3055] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:06.959084 13256 raft_consensus.cc:3055] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:06.952242 13291 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:06.951988 13288 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.958384 13257 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.004858 13251 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:06.961810 13074 consensus_queue.cc:260] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:06.944228 12992 consensus_queue.cc:1059] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:24:07.011947 11060 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:24:07.012775 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:06.972209 13235 raft_consensus.cc:2749] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:06.944939 13216 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:06.922811 13260 consensus_queue.cc:237] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:06.958429 13206 consensus_queue.cc:1048] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:24:06.940558 13305 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:06.945122 13292 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.940372 13321 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:06.927528 13240 consensus_queue.cc:1048] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:24:07.006300 13203 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:07.039636 10949 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:07.040060 11098 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:07.040556 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 141052us
I20260709 12:24:07.043685 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:24:07.048678 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 130046us
I20260709 12:24:07.066344 11679 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:07.053022 13322 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:24:07.049871 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.038620 13256 raft_consensus.cc:740] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:07.063627 13074 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:07.069608 13256 consensus_queue.cc:260] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:24:07.070590 12964 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:07.073001 13291 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:07.073406 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:07.074069 11673 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:24:07.054643 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:07.076514 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:07.036391 13172 raft_consensus.cc:740] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:07.019243 13308 consensus_queue.cc:237] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:07.060585 11059 raft_consensus.cc:1240] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5. Ops: [3.3-4.4]
I20260709 12:24:07.046478 13288 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:07.058420 11052 raft_consensus.cc:2393] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 5: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:07.068193 13322 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:07.078451 11098 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:07.076047 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:07.064091 13292 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:07.088656 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 49095.8us
I20260709 12:24:07.059180 13251 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:07.051272 13257 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:07.094453 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:07.070838 13256 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:07.111095 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:07.080902 13230 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:07.119369 11059 raft_consensus.cc:1240] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:24:07.096314 12961 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:07.102720 13304 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:07.103750 13235 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.102933 13328 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.110365 13149 raft_consensus.cc:2804] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:07.082530 13041 consensus_queue.cc:1059] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:24:07.107604 12964 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:07.108144 13286 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:07.141867 13273 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:07.142268 13216 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:07.137555 12961 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:07.119510 13339 consensus_queue.cc:1059] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:24:07.139698 13235 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:07.110600 13234 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:07.162988 11679 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:24:07.163671 13332 consensus_queue.cc:1059] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:24:07.139974 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:07.176993 11098 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:07.115280 13251 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:07.139612 13149 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:07.137374 13338 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:07.177928 13286 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:07.139551 13303 consensus_queue.cc:1059] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:24:07.163743 13304 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:07.201393 11133 raft_consensus.cc:1275] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:24:07.180367 11673 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.183504 13149 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.169029 13216 consensus_queue.cc:1048] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:24:07.187192 13273 consensus_queue.cc:1059] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:24:07.167287 13284 consensus_queue.cc:1048] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:24:07.198279 13235 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:07.151997 13328 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:07.204958 13286 raft_consensus.cc:697] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 5 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:07.208232 13341 raft_consensus.cc:3055] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:24:07.230795 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.176133 13234 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:07.213284 13296 consensus_meta.cc:287] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.838s	user 0.001s	sys 0.010s
I20260709 12:24:07.239496 13296 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:07.240389 13234 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:07.241721 13296 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:07.242300 13322 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:07.197175 13285 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:07.243773 13257 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:07.212299 13339 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:07.246523 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:07.246999 12961 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:07.248869 12964 raft_consensus.cc:2749] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:07.248641 13261 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:07.249785 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:07.266993 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.195974 13338 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:07.253203 13234 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:07.255679 13328 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:07.256084 10948 leader_election.cc:336] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Timed out: RequestConsensusVote RPC to 127.9.145.194:44483 timed out after 1.751s (SENT)
W20260709 12:24:07.278599 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 170351us
W20260709 12:24:07.253037 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 112210us
I20260709 12:24:07.167977 13172 consensus_queue.cc:260] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:07.232790 13341 raft_consensus.cc:740] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:07.280946 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:07.260874 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:07.284147 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:07.291230 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.292268 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:07.293859 11126 raft_consensus.cc:2393] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:07.293083 11133 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:07.260895 13288 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:07.282068 13234 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:07.274712 13339 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:07.249042 13321 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:07.329217 13282 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:07.329663 13172 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:07.465914 13256 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:07.502461 11055 raft_consensus.cc:2368] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5.
I20260709 12:24:07.503999 13282 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:07.504933 13338 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:07.299517 13277 raft_consensus.cc:2749] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:07.258895 13286 consensus_queue.cc:237] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:07.283562 13296 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.464385 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:07.507557 11133 raft_consensus.cc:2393] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 4: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:07.508234 13261 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:07.508599 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:07.467146 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.510133 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:07.510855 11134 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:07.511780 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:07.513345 11024 connection.cc:256] RPC call timeout handler was delayed by -1.2136515310003233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
I20260709 12:24:07.514040 13339 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:07.514684 13304 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:07.509812 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:07.457386 13250 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.238s	user 0.007s	sys 0.021s
W20260709 12:24:07.498400 10948 leader_election.cc:336] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Timed out: RequestConsensusVote RPC to 127.9.145.194:44483 timed out after 1.950s (SENT)
I20260709 12:24:07.502357 13256 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:07.506942 13341 consensus_queue.cc:260] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:07.516373 11134 raft_consensus.cc:2393] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 4: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:07.516755 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:07.467223 13100 consensus_meta.cc:287] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.624s	user 0.018s	sys 0.000s
W20260709 12:24:07.476052 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.523578 10948 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:07.463294 13239 raft_consensus.cc:3055] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:07.526146 11125 raft_consensus.cc:1275] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:24:07.531371 11125 pending_rounds.cc:85] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 6
I20260709 12:24:07.531737 11125 pending_rounds.cc:107] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:24:07.532063 11125 raft_consensus.cc:2889] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:07.498538 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:07.463758 13041 raft_consensus.cc:3055] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:07.533795 11126 raft_consensus.cc:2410] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:24:07.533550 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:07.534587 11133 raft_consensus.cc:2410] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:24:07.534751 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.535446 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:07.536934 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:07.508180 12675 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:07.540187 10982 raft_consensus.cc:2393] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 5: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:07.517117 13203 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.540244 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:07.540194 11133 raft_consensus.cc:2393] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 7: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:24:07.526146 13250 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.307s	user 0.007s	sys 0.021s
I20260709 12:24:07.543931 11130 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:07.547282 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 48919.2us
I20260709 12:24:07.548327 10978 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:07.548316 11025 connection.cc:256] RPC call timeout handler was delayed by -1.656081730000551s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20640000000000003s for a response
I20260709 12:24:07.549957 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:07.538817 13041 raft_consensus.cc:740] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:07.522603 11673 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:07.531276 13239 raft_consensus.cc:740] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:07.560266 10979 raft_consensus.cc:1240] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:07.540445 13251 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:07.544243 12961 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.540087 13347 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.487069 13015 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:07.525792 13296 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:07.559286 11133 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:24:07.680670 10948 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:07.685876 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:07.686730 11133 raft_consensus.cc:2393] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 4: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:07.638337 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:07.563283 11053 raft_consensus.cc:1240] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:07.656126 11060 raft_consensus.cc:1240] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:07.673046 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:07.688936 10982 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.549407 12964 raft_consensus.cc:2749] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:07.691841 13256 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:07.561283 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:07.700896 10978 raft_consensus.cc:2410] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:07.703883 11131 raft_consensus.cc:2393] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 6: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:07.705530 13015 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:07.614312 13346 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:07.706359 13041 consensus_queue.cc:260] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:07.706489 13346 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:07.706887 13296 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:07.679046 12992 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.709947 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:07.711010 10948 leader_election.cc:336] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Timed out: RequestConsensusVote RPC to 127.9.145.194:44483 timed out after 2.053s (SENT)
I20260709 12:24:07.728592 10948 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:07.712044 10978 raft_consensus.cc:1240] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:07.562270 13343 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.714120 11130 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 5.
I20260709 12:24:07.712700 13285 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:07.715770 13344 log.cc:927] Time spent T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.240s	user 0.000s	sys 0.000s
W20260709 12:24:07.716485 13345 log.cc:927] Time spent T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
W20260709 12:24:07.717319 13350 log.cc:927] Time spent T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 12:24:07.718853 13288 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:07.720139 13339 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.701627 13347 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:07.709072 12961 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:07.722517 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:07.723073 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:07.723629 13305 consensus_meta.cc:287] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.654s	user 0.011s	sys 0.006s
I20260709 12:24:07.724246 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:07.725744 13292 consensus_meta.cc:287] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.612s	user 0.009s	sys 0.007s
I20260709 12:24:07.656329 13338 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:07.732064 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.694015 13328 raft_consensus.cc:2804] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:07.553999 13203 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:07.728075 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:07.733114 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:07.730604 11126 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:07.757266 11053 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 4: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:07.757652 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:07.708654 13149 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:07.758076 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:07.758311 11126 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 5.
I20260709 12:24:07.758915 11053 raft_consensus.cc:2410] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:07.759169 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:07.759550 13149 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:07.759747 11126 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 5.
I20260709 12:24:07.739148 10978 raft_consensus.cc:1275] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:07.733279 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:07.736495 13296 raft_consensus.cc:2749] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:07.746379 13256 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:07.762219 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:07.744357 11098 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:07.762837 11126 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
I20260709 12:24:07.734750 12992 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:07.759732 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:07.741698 13239 consensus_queue.cc:260] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:07.775354 13239 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.778048 11097 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:24:07.751436 13015 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:07.760859 11133 raft_consensus.cc:2393] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 5: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:07.751464 13339 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:07.763602 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:07.751748 10979 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:24:07.762369 13256 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:07.755306 13292 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:07.785895 13292 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:07.765869 13234 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:07.766049 13315 log.cc:927] Time spent T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 1.456s	user 0.009s	sys 0.008s
I20260709 12:24:07.766644 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:07.787358 11678 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:07.788712 10948 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:07.789597 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:07.737525 13343 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:07.769003 13346 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:07.771471 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:07.771925 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:07.773066 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:07.768818 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:07.774400 11057 raft_consensus.cc:1240] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:07.773910 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.780570 11097 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:07.782231 11126 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:07.794550 11057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1165) took 1001 ms. Trace:
I20260709 12:24:07.793630 11679 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:07.765259 12961 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:07.767047 11673 raft_consensus.cc:2393] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:07.799467 13256 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:07.799621 13258 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:07.799965 13100 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:07.800161 11679 raft_consensus.cc:1275] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:07.795814 13254 raft_consensus.cc:3055] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:07.801069 13254 raft_consensus.cc:740] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:07.792073 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:07.792970 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:07.783236 13288 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:07.791074 11676 raft_consensus.cc:1240] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:07.795131 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:07.794519 10977 raft_consensus.cc:2410] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:07.762938 13328 raft_consensus.cc:697] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:07.795075 11057 rpcz_store.cc:276] 0709 12:24:06.793147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:06.793281 (+   134us) service_pool.cc:224] Handling call
0709 12:24:06.793596 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:07.774252 (+980656us) spinlock_profiling.cc:243] Waited 34.8 ms on lock 0x7b5400038020. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bd5bdc0 00007f8f8bde61c0 00007f8f8bde7231 00007f8f8bde3d8f 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c
0709 12:24:07.794300 (+ 20048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:07.794496 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80123264}
I20260709 12:24:07.807224 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:07.807834 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:07.795971 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:07.809028 11126 raft_consensus.cc:2393] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 4: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:07.793862 10978 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:24:07.810169 13346 raft_consensus.cc:3055] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:07.810556 13346 raft_consensus.cc:740] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:07.810636 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:07.811069 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:07.811427 10978 raft_consensus.cc:2393] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 4: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:07.812052 13328 consensus_queue.cc:237] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:07.811460 13346 consensus_queue.cc:260] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:24:07.813460 13346 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:07.814855 13100 consensus_queue.cc:1048] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:07.816808 13203 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:07.818771 10981 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:07.819168 12992 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:07.821096 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:07.821807 11673 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:07.800052 13258 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.809931 13228 raft_consensus.cc:1064] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:24:07.808454 10977 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:07.825356 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:07.826046 11134 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:07.827004 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:07.828097 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:07.803452 13254 consensus_queue.cc:260] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:07.831477 13254 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.808229 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:07.834838 10976 raft_consensus.cc:2393] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 4: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:07.835812 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:07.836561 10976 raft_consensus.cc:2376] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4. Re-sending same reply.
I20260709 12:24:07.837792 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:07.835760 13314 consensus_queue.cc:1059] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:24:07.839340 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:07.839397 13314 raft_consensus.cc:3055] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:07.840049 13314 raft_consensus.cc:740] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:07.802503 13292 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.841311 13292 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:07.841579 13314 consensus_queue.cc:260] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:07.842795 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:07.843478 10983 raft_consensus.cc:2376] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5. Re-sending same reply.
I20260709 12:24:07.843653 13292 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:07.796470 13233 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:07.844274 13233 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:07.809877 13343 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:07.761436 13338 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:07.845351 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:07.845929 10984 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:07.846678 13338 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:07.847054 10981 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:07.848461 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:07.848601 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:07.849071 11052 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 5.
I20260709 12:24:07.798650 11675 raft_consensus.cc:2393] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 6: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:07.778916 13149 raft_consensus.cc:2749] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:07.805192 11679 raft_consensus.cc:1240] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:07.840682 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:07.867769 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:07.842909 13314 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:07.844413 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:07.873973 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:07.874562 10983 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:24:07.875204 11055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41294 (request call id 1176) took 1018 ms. Trace:
I20260709 12:24:07.875532 11055 rpcz_store.cc:276] 0709 12:24:06.856380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:06.856511 (+   131us) service_pool.cc:224] Handling call
0709 12:24:07.872979 (+1016468us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b5400313dd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:07.875146 (+  2167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1388654848}
I20260709 12:24:07.785766 13335 raft_consensus.cc:3055] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:07.791741 13015 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:07.823807 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:07.812235 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:07.878655 10978 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:07.809835 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:07.849310 11673 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:07.889683 13288 raft_consensus.cc:2749] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:07.858904 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:07.910079 11024 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:07.911918 10981 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:24:07.860097 11097 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:07.864007 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:07.914482 11133 raft_consensus.cc:2393] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 4: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:24:07.914508 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 54515.7us
I20260709 12:24:07.864917 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:07.797461 10982 raft_consensus.cc:2410] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:24:07.866170 10977 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 4.
I20260709 12:24:07.865406 11025 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:07.918624 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:07.868217 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:07.920166 10979 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:07.863754 13233 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:07.868988 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:07.869145 13338 consensus_queue.cc:1059] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:07.850026 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:07.869626 11678 raft_consensus.cc:1275] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:07.870018 13347 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:07.871402 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:07.808321 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:07.879560 11126 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:07.878180 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:07.883394 10984 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:24:07.802510 11059 raft_consensus.cc:2410] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:24:07.930511 10983 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:07.877651 13335 raft_consensus.cc:740] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:07.930764 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:07.858780 11134 raft_consensus.cc:2393] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:24:07.893410 13279 log.cc:927] Time spent T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 2.044s	user 0.017s	sys 0.024s
I20260709 12:24:07.895972 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:07.897418 13317 log.cc:927] Time spent T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 1.093s	user 0.002s	sys 0.000s
I20260709 12:24:07.878455 11058 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:24:07.899652 11674 raft_consensus.cc:1275] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:07.919216 13149 raft_consensus.cc:2749] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:07.901472 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:07.901738 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:07.902667 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:07.940975 10980 raft_consensus.cc:2393] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 5: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:07.903403 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:07.904181 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:07.906680 11672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41784 (request call id 495) took 1599 ms. Trace:
I20260709 12:24:07.907284 11645 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:07.907156 12992 consensus_queue.cc:1048] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:07.949561 13327 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:07.933938 13322 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:07.910959 13357 log.cc:927] Time spent T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:24:07.920089 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:07.955322 10982 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:07.955912 11676 raft_consensus.cc:2393] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 6: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:07.959959 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:07.960258 11129 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 1737) took 2892 ms (client timeout 2064 ms). Trace:
W20260709 12:24:07.960701 11129 rpcz_store.cc:269] 0709 12:24:05.068255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.335937 (+267682us) service_pool.cc:224] Handling call
0709 12:24:07.960030 (+2624093us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b54000eb0d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:07.960140 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1601513728}
I20260709 12:24:07.920998 11097 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:07.919721 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 54401.3us
I20260709 12:24:07.962317 11025 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:07.964910 11132 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 5.
I20260709 12:24:07.966948 10979 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:24:07.967626 11126 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 4.
I20260709 12:24:07.967903 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:07.928270 10978 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:24:07.895900 13331 raft_consensus.cc:3055] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:07.911125 13304 consensus_queue.cc:1059] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:24:07.929347 11056 raft_consensus.cc:2393] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 6: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
W20260709 12:24:07.929872 11643 connection.cc:256] RPC call timeout handler was delayed by -2.0298778370001855s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33210000000000006s for a response
I20260709 12:24:07.891440 10948 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:07.932628 11057 raft_consensus.cc:2393] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 4: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
W20260709 12:24:07.971951 11643 connection.cc:256] RPC call timeout handler was delayed by -1.9397401719998015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
I20260709 12:24:07.933256 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:07.972802 11134 raft_consensus.cc:2393] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:07.932318 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:07.899920 13015 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:07.935124 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:07.935128 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.936476 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:07.936414 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:07.940366 13321 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:07.991758 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:07.992446 10975 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
W20260709 12:24:07.992782 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 71862.7us
I20260709 12:24:07.946724 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:07.947816 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.931631 13265 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.910279 13310 consensus_queue.cc:1048] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:07.993499 11097 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:07.952479 11023 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
W20260709 12:24:07.950780 13164 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.645s	user 0.014s	sys 0.021s
I20260709 12:24:07.953471 11128 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 5.
W20260709 12:24:07.995182 13164 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.689s	user 0.014s	sys 0.022s
I20260709 12:24:07.995458 13015 raft_consensus.cc:2804] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:07.954597 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:07.969470 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:07.969264 10983 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:24:07.970377 10982 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:24:07.973299 11133 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 5.
I20260709 12:24:07.973829 11055 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 5.
I20260709 12:24:07.975047 10981 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:24:07.941447 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:07.930374 13258 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:07.975544 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 84200.2us
W20260709 12:24:07.999493 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 47109.3us
I20260709 12:24:07.976516 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:08.000082 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.000254 11058 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:07.971071 13272 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:08.006668 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:07.977430 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:07.977753 13328 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:07.979327 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:07.980183 11644 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:07.983006 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:07.942243 11672 rpcz_store.cc:276] 0709 12:24:06.306993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.147685 (+840692us) service_pool.cc:224] Handling call
0709 12:24:07.148055 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:07.206572 (+ 58517us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:07.280651 (+ 74079us) log.cc:844] Serialized 14 byte log entry
0709 12:24:07.686971 (+406320us) log.cc:844] Serialized 14 byte log entry
0709 12:24:07.726285 (+ 39314us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:07.726358 (+    73us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:07.726423 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:07.906439 (+180016us) spinlock_profiling.cc:243] Waited 50.2 ms on lock 0x7b54005631d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:07.906484 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:07.906619 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21308,"prepare.queue_time_us":86548,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":75,"raft.queue_time_us":84176,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":16439,"spinlock_wait_cycles":115528448,"thread_start_us":291921,"threads_started":2,"wal-append.queue_time_us":421424}
I20260709 12:24:07.984229 13304 raft_consensus.cc:3055] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:07.985109 11025 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
W20260709 12:24:07.985359 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.012681 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:07.985939 13025 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:07.988281 11677 raft_consensus.cc:1275] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:07.949995 13327 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:07.990882 13341 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.929342 13273 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:07.950582 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:07.996827 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:07.998600 11643 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:08.018744 13327 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:08.023173 11643 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:08.007979 13272 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:08.001672 13015 raft_consensus.cc:697] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 5 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:08.002267 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:07.995528 13239 consensus_queue.cc:1048] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:24:08.002796 10948 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:08.003672 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:08.035575 10983 raft_consensus.cc:2393] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 4: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:08.036376 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:08.004524 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:08.037386 10982 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:24:08.004815 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:07.998245 13265 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:08.063019 11676 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:08.064177 12961 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:08.005348 13321 raft_consensus.cc:2804] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:08.065127 13321 raft_consensus.cc:697] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:08.066118 13321 consensus_queue.cc:237] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:08.005852 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:08.069631 10980 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:08.070309 13216 consensus_queue.cc:1059] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:07.948462 13335 consensus_queue.cc:260] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:08.074771 13343 consensus_queue.cc:1048] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:08.076006 13335 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:08.077234 13162 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:08.077828 13162 raft_consensus.cc:697] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:07.994328 13338 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.078768 13162 consensus_queue.cc:237] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:08.079281 13338 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:08.032389 13251 raft_consensus.cc:2764] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:24:08.004436 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:08.010313 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:08.082487 10981 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:08.083791 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:08.087332 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:08.088186 10979 raft_consensus.cc:2393] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 4: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:08.089037 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:08.009840 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:08.089686 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.090135 11126 raft_consensus.cc:2410] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:24:08.090634 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:08.091040 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:08.091439 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:08.092046 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:08.089576 10979 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:08.092793 11125 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:08.093343 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:08.093487 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:08.010747 13347 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:08.018867 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:08.094530 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:08.094992 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:07.969291 13331 raft_consensus.cc:740] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:08.027768 11060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1181) took 1168 ms. Trace:
I20260709 12:24:08.107009 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:08.099331 10948 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:08.029798 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:08.031857 10975 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
I20260709 12:24:08.010413 13328 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:08.041150 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.116319 11024 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:08.019100 13310 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:08.016232 13149 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:08.020757 13273 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:08.016165 11673 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:08.016420 13304 raft_consensus.cc:740] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:08.045948 13015 consensus_queue.cc:237] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:08.046943 11052 raft_consensus.cc:1240] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:08.034143 13272 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:08.054996 13233 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:08.031019 11128 raft_consensus.cc:1275] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:24:08.092097 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:08.011809 11097 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:24:08.138909 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 127158us
I20260709 12:24:08.139801 11097 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:08.089531 10981 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:08.082435 10984 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:08.074935 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58414 (request call id 273) took 1001 ms. Trace:
I20260709 12:24:08.142330 11131 rpcz_store.cc:276] 0709 12:24:07.073988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.075788 (+  1800us) service_pool.cc:224] Handling call
0709 12:24:08.074749 (+998961us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b540012d754. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:08.074876 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1383790464}
I20260709 12:24:08.092722 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:08.033663 11645 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:08.107651 10979 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:08.029296 10949 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:08.106420 11060 rpcz_store.cc:276] 0709 12:24:06.859413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.121436 (+262023us) service_pool.cc:224] Handling call
0709 12:24:07.140533 (+ 19097us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:07.688447 (+547914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:08.027546 (+339099us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b54003e0b54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:08.027705 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1185246080}
I20260709 12:24:08.143540 10978 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:08.121053 10980 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:08.121739 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:08.122977 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:24:08.132423 13300 log.cc:927] Time spent T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.617s	user 0.010s	sys 0.001s
I20260709 12:24:08.126085 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:08.147436 10982 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:08.064682 12961 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:08.130405 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:08.130430 11023 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
W20260709 12:24:08.150524 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 116938us
W20260709 12:24:08.070092 13228 raft_consensus.cc:1068] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7: Unable to promote non-voter 0f3b1ccd8aa5412393aa7eb90f2bef95: Illegal state: Replica c979ef00e0ad4157b49ebbdc13ce7cd7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:24:08.135592 13234 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:08.078836 13285 raft_consensus.cc:3055] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:08.135080 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:08.173410 10975 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 5.
I20260709 12:24:08.094178 11051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41294 (request call id 1172) took 1241 ms. Trace:
I20260709 12:24:08.064597 13265 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
I20260709 12:24:08.110941 11098 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:08.174752 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 63874.3us
I20260709 12:24:08.175048 10978 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:08.175474 11098 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:08.144702 11097 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:08.176903 11097 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:08.177412 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:08.178067 11097 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:08.125231 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:08.124897 13273 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:08.145916 11059 raft_consensus.cc:2393] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:08.121447 13328 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:08.131371 13254 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:08.150403 10983 raft_consensus.cc:2376] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5. Re-sending same reply.
I20260709 12:24:08.187355 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:08.132706 13343 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:08.151568 11023 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:08.197909 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 46425.4us
I20260709 12:24:08.132592 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:08.132992 13149 raft_consensus.cc:697] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 7 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:08.163611 10976 raft_consensus.cc:2368] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 6. Current term is 7.
I20260709 12:24:08.164330 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:08.202339 10981 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:08.163877 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:08.157708 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:08.206287 10980 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:08.156750 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:08.157378 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 128156us
I20260709 12:24:08.208036 11098 leader_election.cc:400] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5.
I20260709 12:24:08.208376 11098 leader_election.cc:403] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:24:08.179388 11125 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:08.210942 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:08.211621 11125 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:08.198698 11023 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:08.179874 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:08.178121 10978 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:08.129256 13292 consensus_queue.cc:1048] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:24:08.188570 10979 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:08.150238 13257 raft_consensus.cc:2804] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:08.190295 13306 raft_consensus.cc:2804] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:08.190830 13025 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:08.170630 13285 raft_consensus.cc:740] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:08.163781 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:08.166474 13172 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:08.154631 13206 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:08.192776 13286 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:08.164552 13346 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:08.180148 11051 rpcz_store.cc:276] 0709 12:24:06.852615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:06.865630 (+ 13015us) service_pool.cc:224] Handling call
0709 12:24:08.093173 (+1227543us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b58001a5e98. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90daa0a0 00007f8f90da9984 00007f8f8a3246d4 00007f8f8a324662
0709 12:24:08.094086 (+   913us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3953408}
I20260709 12:24:08.162930 13331 consensus_queue.cc:260] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:08.182622 13204 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:08.157073 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:08.193053 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:08.194789 13239 raft_consensus.cc:2749] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:08.196754 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1726) took 3131 ms. Trace:
I20260709 12:24:08.200903 10983 raft_consensus.cc:1275] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:08.204434 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:08.203596 10982 raft_consensus.cc:2393] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 4: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:08.213575 11097 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:08.155145 12961 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:08.219062 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:08.219971 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.193883 13288 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.131558 13347 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:08.163177 13296 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:08.225387 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:08.172067 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:08.274959 11127 rpcz_store.cc:276] 0709 12:24:05.065680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.778067 (+712387us) service_pool.cc:224] Handling call
0709 12:24:05.807850 (+ 29783us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:05.834418 (+ 26568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:05.834456 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:05.853494 (+ 19038us) log.cc:844] Serialized 52 byte log entry
0709 12:24:06.052828 (+199334us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:06.107268 (+ 54440us) log.cc:844] Serialized 14 byte log entry
0709 12:24:06.193940 (+ 86672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:06.194027 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:07.514592 (+1320565us) spinlock_profiling.cc:243] Waited 6.24 ms on lock 0x7b180016ea60. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cf73f3 00007f8f88cf97c1 00007f8f88cf9779 00007f8f88cf9709 00007f8f88cf96d1 00007f8f88cf89cd 0000000000388634 0000000000388479 00007f8f88cda83a
0709 12:24:08.081753 (+567161us) spinlock_profiling.cc:243] Waited 6.64 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:08.196465 (+114712us) raft_consensus.cc:1685] finished
0709 12:24:08.196488 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:08.196662 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25401,"prepare.queue_time_us":54204,"prepare.run_cpu_time_us":919,"prepare.run_wall_time_us":1263,"raft.queue_time_us":198694,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":4799,"spinlock_wait_cycles":29627008,"thread_start_us":178801,"threads_started":2,"wal-append.queue_time_us":342378}
I20260709 12:24:08.298065 10975 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 5.
I20260709 12:24:08.232613 11129 raft_consensus.cc:1240] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:24:08.234707 11023 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:08.235965 11132 raft_consensus.cc:1240] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:08.298939 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 64308.6us
I20260709 12:24:08.300027 10975 raft_consensus.cc:1240] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 12:24:08.240638 11133 raft_consensus.cc:1240] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:08.242240 10984 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:24:08.302395 10984 raft_consensus.cc:1240] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:08.243546 11126 raft_consensus.cc:1240] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:08.193940 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:08.244640 10949 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:08.244877 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:08.206045 13343 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:08.307441 13343 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:08.294337 12961 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:24:08.308693 11673 raft_consensus.cc:1275] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:24:08.255193 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.256917 10981 raft_consensus.cc:2410] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:08.296072 13288 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:08.311401 10981 raft_consensus.cc:1240] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:08.311796 11098 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:08.312302 13288 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:08.312927 13296 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:08.312836 13015 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:08.314034 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:08.314393 13015 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:08.314761 11674 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:08.315681 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:08.316077 11674 raft_consensus.cc:1275] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:08.258271 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:08.316874 10980 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 1.
I20260709 12:24:08.317479 13233 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:08.218885 13228 raft_consensus.cc:2804] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:08.163358 13304 consensus_queue.cc:260] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:08.318423 13228 raft_consensus.cc:697] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:08.318902 13304 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:08.319362 13228 consensus_queue.cc:237] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:08.306584 13265 consensus_queue.cc:1048] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:24:08.320986 13286 raft_consensus.cc:2749] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:08.311125 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 66566.5us
I20260709 12:24:08.181121 13352 consensus_queue.cc:1059] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:24:08.221349 13131 raft_consensus.cc:3055] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:08.321974 13285 consensus_queue.cc:260] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:08.322413 10949 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:08.322564 13131 raft_consensus.cc:740] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:08.323730 10949 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:08.323524 13131 consensus_queue.cc:260] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:08.324487 13131 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:08.324936 13347 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:08.233520 13100 consensus_queue.cc:1059] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 12:24:08.325428 10949 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:08.221580 13203 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:08.325960 13100 consensus_queue.cc:1243] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer c979ef00e0ad4157b49ebbdc13ce7cd7 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:24:08.326538 13100 raft_consensus.cc:3055] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:08.327065 13100 raft_consensus.cc:740] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:08.273888 11134 raft_consensus.cc:1240] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:08.267678 11054 raft_consensus.cc:1275] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:24:08.278406 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 64904.3us
I20260709 12:24:08.279614 11676 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:08.166447 13234 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:08.368553 13234 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:08.273465 13204 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:08.370366 13204 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:08.280189 11052 raft_consensus.cc:1240] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:08.327716 13352 raft_consensus.cc:3055] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:08.374624 13352 raft_consensus.cc:740] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:08.284617 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:08.375579 13352 consensus_queue.cc:260] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:08.376844 13352 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:08.279321 13331 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:08.285357 13149 consensus_queue.cc:237] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:08.379477 13321 raft_consensus.cc:2804] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:08.267076 13306 raft_consensus.cc:697] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:08.287000 13206 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:08.288676 13339 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:08.289896 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:08.286934 13256 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:24:08.295590 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 188001us
I20260709 12:24:08.296743 11645 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:08.400738 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 104118us
I20260709 12:24:08.230495 10978 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 5.
W20260709 12:24:08.402148 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.402973 10978 raft_consensus.cc:1240] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:08.403311 13251 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:08.300311 10983 raft_consensus.cc:1240] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:08.407269 10983 raft_consensus.cc:1240] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:08.407763 11024 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:08.408601 10983 raft_consensus.cc:1240] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:24:08.261888 12675 raft_consensus.cc:2804] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:08.306896 10984 raft_consensus.cc:1275] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:05.717522  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:08.222434 13257 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:08.317929 10980 raft_consensus.cc:1240] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:08.327867 10977 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:24:08.312587 10981 raft_consensus.cc:1240] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:08.332496 11097 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:08.427695 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 95305.4us
I20260709 12:24:08.428514 11097 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:24:08.324944 13328 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:08.352945 13338 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:08.353312 13216 raft_consensus.cc:2749] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:08.312135 11677 raft_consensus.cc:1275] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:08.337387 13296 raft_consensus.cc:2749] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:08.356155 13100 consensus_queue.cc:260] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:08.435784 13347 raft_consensus.cc:2749] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:08.436124 13100 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:08.440784 13343 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:08.442386 13256 raft_consensus.cc:697] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:08.443488 13256 consensus_queue.cc:237] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:08.357797 13288 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:08.360615 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:08.361060 12961 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:08.363623 10975 raft_consensus.cc:1275] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:08.334237 10949 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:08.367115 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:08.367938 11098 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:08.475960 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:08.380604 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:08.395040 11680 raft_consensus.cc:1240] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:08.398895 13206 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:08.294031 13273 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:08.402909 11643 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:08.409896 11024 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:08.414597 13306 consensus_queue.cc:237] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:08.417251 13254 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:08.487460 13254 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:08.488276 13343 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:08.488768 13100 raft_consensus.cc:2749] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:08.489475 13100 raft_consensus.cc:2749] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:08.422250 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:08.490798 11134 raft_consensus.cc:1240] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:08.492151 11133 raft_consensus.cc:1240] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:08.423870 13272 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:08.380070 13321 raft_consensus.cc:697] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:08.442303 11055 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:08.447281 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:08.518369 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:08.519670 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.416878 13234 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:08.446200 13257 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:08.460055 10983 raft_consensus.cc:1240] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:08.458966 10980 raft_consensus.cc:1240] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4. Ops: []
W20260709 12:24:08.465081 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.428184 13292 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:08.481263 10981 raft_consensus.cc:1240] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 5. Current term is 6. Ops: [3.2-5.4]
I20260709 12:24:08.408636 13310 raft_consensus.cc:2749] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:08.428692 13334 consensus_queue.cc:1059] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
W20260709 12:24:08.485729 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 82878.4us
I20260709 12:24:08.528640 11643 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:08.454722 13204 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:08.532682 10980 raft_consensus.cc:1275] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:24:08.486315 13346 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:08.486699 13296 raft_consensus.cc:2749] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:24:08.484606 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 150496us
I20260709 12:24:08.492093 11134 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:08.484519 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 74690.4us
I20260709 12:24:08.541253 10949 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:08.449839 12675 raft_consensus.cc:697] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:08.517174 13172 raft_consensus.cc:697] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:08.482817 11674 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:08.477164 13327 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:08.542665 10949 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:08.543045 11024 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:24:08.544320 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:08.522230 13304 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:08.554052 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 276835us
I20260709 12:24:08.556774 10981 raft_consensus.cc:1240] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:24:08.558663 13172 consensus_queue.cc:237] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:08.560727 12675 consensus_queue.cc:237] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:08.561877 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:08.563606 13273 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:08.563755 13206 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:08.564150 13321 consensus_queue.cc:237] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:08.566675 13204 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:08.568310 13285 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:08.569711 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1739) took 1273 ms. Trace:
W20260709 12:24:08.570513 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.571621 13328 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:08.524410 13272 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:08.524096 13265 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:08.638780 13265 consensus_queue.cc:1059] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:08.639871 13265 consensus_queue.cc:1059] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:08.578622 10983 raft_consensus.cc:1240] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:08.526372 13292 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:08.641932 13292 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:08.642570 13322 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:08.643114 13322 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:08.645592 10983 raft_consensus.cc:1275] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:24:08.599215 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 56639.5us
I20260709 12:24:08.537024 11051 raft_consensus.cc:1240] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:08.613106 11060 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
W20260709 12:24:08.615103 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 72155.5us
W20260709 12:24:08.656234 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.555974 12961 raft_consensus.cc:2749] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:08.621755 11134 raft_consensus.cc:1240] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:08.618022 13331 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:08.631105 10981 raft_consensus.cc:1275] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:24:08.665750 10981 pending_rounds.cc:85] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 3
I20260709 12:24:08.614375 13296 raft_consensus.cc:2749] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:08.614504 13304 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:08.606506 13025 raft_consensus.cc:697] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:08.635488 10977 raft_consensus.cc:1275] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:24:08.650524 10949 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:08.666049 10981 pending_rounds.cc:107] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:24:08.678736 10981 raft_consensus.cc:2889] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:08.683578 10977 raft_consensus.cc:1240] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:08.685479 10949 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:08.704998 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.678721 13203 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5.
I20260709 12:24:08.715642 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1746) took 1245 ms. Trace:
I20260709 12:24:08.677770 13304 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:08.686424 13296 raft_consensus.cc:2749] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:24:08.714716 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 333681us
W20260709 12:24:08.718398 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 289958us
I20260709 12:24:08.667452 13272 consensus_queue.cc:1059] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:24:08.687541 13041 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:08.732672 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 364795us
I20260709 12:24:08.710319 10949 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:08.735829 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.744866 11097 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
W20260709 12:24:08.748870 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.632952 11128 rpcz_store.cc:276] 0709 12:24:07.296604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.995657 (+699053us) service_pool.cc:224] Handling call
0709 12:24:08.006829 (+ 11172us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:08.143906 (+137077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:08.569455 (+425549us) spinlock_profiling.cc:243] Waited 4.85 ms on lock 0x7b540012e650. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:08.569638 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11161344}
I20260709 12:24:08.718672 12961 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:08.756927 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 46702.7us
I20260709 12:24:08.759896 10949 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:08.757611 11097 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:08.729940 13239 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:08.738407 13251 raft_consensus.cc:2749] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:08.763242 11134 raft_consensus.cc:1275] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:24:08.796859 11134 pending_rounds.cc:85] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 2
I20260709 12:24:08.767360 11097 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:08.767829 11130 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
W20260709 12:24:08.762009 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 265425us
I20260709 12:24:08.772217 10949 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:08.799726 10949 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:08.802955 10949 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:08.799485 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:08.797363 11134 pending_rounds.cc:107] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:24:08.805649 11057 raft_consensus.cc:2368] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5.
I20260709 12:24:08.805927 11134 raft_consensus.cc:2889] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:08.806674 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.807719 11097 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
W20260709 12:24:08.813944 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.812625 10949 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:08.821913 13288 consensus_queue.cc:1059] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:08.822697 11097 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:08.822846 13306 consensus_queue.cc:1059] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:08.759738 13015 raft_consensus.cc:2804] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:08.824448 11097 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:08.826642 10949 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:08.842229 11023 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:08.843113 10949 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:08.848724 11097 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:08.793916 13374 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:08.811542 13344 log.cc:927] Time spent T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:24:08.770054 13234 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:08.762230 12961 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:08.857796 11023 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:08.798916 13233 raft_consensus.cc:2804] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:08.746165 13254 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:08.798625 13256 raft_consensus.cc:2804] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:08.809234 13328 raft_consensus.cc:2749] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:08.768054 13228 raft_consensus.cc:3055] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:08.824800 13296 raft_consensus.cc:2749] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:08.819859 13162 raft_consensus.cc:3055] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:08.841665 13216 raft_consensus.cc:2749] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:08.804986 11676 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
I20260709 12:24:08.849954 13338 raft_consensus.cc:2804] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:08.849589 12992 raft_consensus.cc:2804] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:08.860582 13331 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:08.849151 13373 raft_consensus.cc:3055] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:08.883821 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 265) took 1106 ms. Trace:
I20260709 12:24:08.887996 13162 raft_consensus.cc:740] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:08.888644 13216 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:08.862850 13374 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:08.891420 13254 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:08.894730 11127 raft_consensus.cc:1240] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:08.897531 11672 raft_consensus.cc:1240] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:24:08.899062 13346 consensus_queue.cc:1059] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:08.899824 13335 consensus_queue.cc:1059] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:08.900565 13273 consensus_queue.cc:1059] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:08.878854 13228 raft_consensus.cc:740] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:08.880013 13272 raft_consensus.cc:2804] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:08.901773 13339 consensus_queue.cc:1059] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:08.902982 13322 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:08.905377 13386 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:08.852219 13164 raft_consensus.cc:2764] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:24:08.907650 10976 rpcz_store.cc:276] 0709 12:24:07.777300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.837530 (+ 60230us) service_pool.cc:224] Handling call
0709 12:24:08.883582 (+1046052us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b540028aad4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:08.883749 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":721048960}
I20260709 12:24:08.909304 11126 raft_consensus.cc:1240] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:08.870230 12961 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:08.867861 13233 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:08.857988 13149 consensus_queue.cc:1048] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:24:08.870791 13327 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:08.905623 13375 raft_consensus.cc:3055] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:08.870641 13389 raft_consensus.cc:2749] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:08.804030 13025 consensus_queue.cc:237] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:08.869292 13251 consensus_queue.cc:1048] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 12:24:08.906827 13206 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:08.910823 13331 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:08.909852 13256 raft_consensus.cc:697] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 5 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:08.911752 13373 raft_consensus.cc:740] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:08.939149 13240 raft_consensus.cc:3055] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:08.938750 13386 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:08.960813 11127 raft_consensus.cc:1275] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:24:08.987473 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 144436us
I20260709 12:24:08.916488 13338 raft_consensus.cc:697] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 4 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:08.933615 11128 raft_consensus.cc:1240] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:24:08.910218 13216 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:08.943583 13303 raft_consensus.cc:3055] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:08.959628 13233 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:08.991153 10949 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:08.951157 13375 raft_consensus.cc:740] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:24:08.986414 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 220991us
W20260709 12:24:08.958434 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 109796us
I20260709 12:24:08.979746 11674 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:08.975368 13240 raft_consensus.cc:740] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:08.958652 13335 consensus_queue.cc:1059] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:24:08.980360 13258 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:09.029747 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1795) took 1152 ms. Trace:
I20260709 12:24:08.962941 13272 raft_consensus.cc:697] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:09.100013 10975 rpcz_store.cc:276] 0709 12:24:07.877690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.475128 (+597438us) service_pool.cc:224] Handling call
0709 12:24:08.494654 (+ 19526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:08.494842 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:08.521663 (+ 26821us) log.cc:844] Serialized 14 byte log entry
0709 12:24:09.029374 (+507711us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:09.029432 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:09.029477 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:09.029551 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:09.029679 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6949,"prepare.queue_time_us":28285,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":25985,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":10666,"thread_start_us":454593,"threads_started":2,"wal-append.queue_time_us":411976}
I20260709 12:24:09.002148 11126 raft_consensus.cc:1240] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:08.938948 13346 consensus_queue.cc:1059] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:24:08.966367 13331 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:08.994443 13386 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:08.965942 13273 consensus_queue.cc:1048] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:24:09.043192 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:08.965327 13131 consensus_queue.cc:1048] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.052s
W20260709 12:24:09.023665 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 215774us
I20260709 12:24:09.014801 13206 raft_consensus.cc:2804] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:24:09.053467 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:09.081634 13164 raft_consensus.cc:2749] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:09.053918 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 84115us
I20260709 12:24:09.054913 13406 raft_consensus.cc:2749] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:08.989981 13310 consensus_queue.cc:1048] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
W20260709 12:24:09.067379 13370 log.cc:927] Time spent T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.787s	user 0.003s	sys 0.002s
I20260709 12:24:09.068874 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:08.992977 13162 consensus_queue.cc:260] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:09.075971 11130 raft_consensus.cc:1240] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:09.031863 13394 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.079873 13301 raft_consensus.cc:3055] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:09.080024 11675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 508) took 1178 ms. Trace:
I20260709 12:24:09.041466 13347 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:09.086702 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1748) took 1615 ms. Trace:
I20260709 12:24:09.142565 11125 rpcz_store.cc:276] 0709 12:24:07.471043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.212249 (+741206us) service_pool.cc:224] Handling call
0709 12:24:08.212516 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:08.212716 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:08.649835 (+437119us) log.cc:844] Serialized 14 byte log entry
0709 12:24:09.086303 (+436468us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:09.086373 (+    70us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:09.086433 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:09.086510 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:09.086639 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38895,"prepare.queue_time_us":337890,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":186791,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":16534,"spinlock_wait_cycles":16465792,"thread_start_us":801494,"threads_started":3,"wal-append.queue_time_us":300105}
I20260709 12:24:09.086948 11680 raft_consensus.cc:1240] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:24:09.087523 11681 raft_consensus.cc:1240] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:09.089025 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:09.054235 13216 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:09.005532 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1597) took 1220 ms. Trace:
I20260709 12:24:09.048909 13373 consensus_queue.cc:260] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:09.147423 11125 raft_consensus.cc:1275] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:09.146406 11129 rpcz_store.cc:276] 0709 12:24:07.784789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.564288 (+779499us) service_pool.cc:224] Handling call
0709 12:24:08.564658 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:08.565014 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:08.565039 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:08.565530 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 12:24:08.769363 (+203833us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:08.848132 (+ 78769us) log.cc:844] Serialized 14 byte log entry
0709 12:24:08.992722 (+144590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:08.992795 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:09.004476 (+ 11681us) raft_consensus.cc:1685] finished
0709 12:24:09.004853 (+   377us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:09.005463 (+   610us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26732,"prepare.queue_time_us":82452,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":179859,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":12829,"thread_start_us":347742,"threads_started":2,"wal-append.queue_time_us":332321}
I20260709 12:24:09.051239 13303 raft_consensus.cc:740] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:09.115782 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:09.118448 11098 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:09.148456 11126 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:09.148711 11125 raft_consensus.cc:1240] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:24:08.991369 13228 consensus_queue.cc:260] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:09.120988 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:09.132301 13206 raft_consensus.cc:697] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 5 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
W20260709 12:24:09.054668 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 63605.2us
I20260709 12:24:09.122771 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:09.125854 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:09.128393 10977 raft_consensus.cc:1275] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:09.096038 13204 raft_consensus.cc:2804] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:09.099727 13203 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.094573 13389 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:09.180289 10949 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:09.130229 11134 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:09.132253 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1763) took 1112 ms. Trace:
I20260709 12:24:09.187919 11130 rpcz_store.cc:276] 0709 12:24:08.020135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.904221 (+884086us) service_pool.cc:224] Handling call
0709 12:24:09.075529 (+171308us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b5800117398. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfeee 000000000036eb39 00007f8f90d331e0 00007f8f90dfc0c4 00007f8f90dfc131 00007f8f90dbdfc0 00007f8f90da8929 00007f8f90da83d2 00007f8f8a31fbd4
0709 12:24:09.075763 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:09.132004 (+ 56241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:09.132198 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6562176}
I20260709 12:24:09.133122 10975 raft_consensus.cc:1240] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:09.111905 12675 raft_consensus.cc:3055] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:09.135574 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:09.136080 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:09.137362 13301 raft_consensus.cc:740] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:09.053414 13015 raft_consensus.cc:697] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:09.138536 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:09.138162 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:09.139832 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:09.139427 10982 raft_consensus.cc:1240] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:09.139278 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:09.152252 11098 leader_election.cc:400] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5.
I20260709 12:24:09.152462 10976 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:09.199855 11098 leader_election.cc:403] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:24:09.199749 11060 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:09.200588 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 48480.4us
W20260709 12:24:09.153205 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:09.154908 13374 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:09.155175 13303 consensus_queue.cc:260] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:09.157503 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:09.131009 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1760) took 1096 ms. Trace:
W20260709 12:24:09.160233 13397 log.cc:927] Time spent T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:24:09.139906 13339 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.148396 13162 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:09.177284 13398 log.cc:927] Time spent T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.176s	user 0.002s	sys 0.000s
I20260709 12:24:09.162355 10948 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:24:09.163077 13391 log.cc:927] Time spent T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 12:24:09.167266 13288 raft_consensus.cc:3055] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:09.171518 13273 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.171412 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:09.172433 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:09.173242 13322 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:09.146555 13382 log.cc:927] Time spent T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 12:24:09.175048 13258 consensus_queue.cc:1059] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:08.716130 11131 rpcz_store.cc:276] 0709 12:24:07.470464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.143257 (+672793us) service_pool.cc:224] Handling call
0709 12:24:08.156157 (+ 12900us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:08.156408 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:08.390406 (+233998us) log.cc:844] Serialized 14 byte log entry
0709 12:24:08.715223 (+324817us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:08.715281 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:08.715324 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:08.715457 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:08.715585 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5528,"prepare.queue_time_us":368081,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":49,"raft.queue_time_us":7921,"thread_start_us":424935,"threads_started":2}
W20260709 12:24:09.177291 13292 consensus_meta.cc:287] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.535s	user 0.006s	sys 0.003s
W20260709 12:24:09.101615 13387 log.cc:927] Time spent T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
W20260709 12:24:09.147910 13396 log.cc:927] Time spent T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 12:24:09.180270 10979 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:09.199749 10981 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:09.202481 11097 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:09.159416 13239 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:09.217626 11055 raft_consensus.cc:1275] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:24:09.220961 11130 raft_consensus.cc:1275] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:09.161692 11126 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:09.111066 13256 consensus_queue.cc:237] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:09.178292 13413 raft_consensus.cc:2804] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:09.223667 13412 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.191758 13373 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:09.245280 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:09.303475 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:09.140050 13394 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:09.251020 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:24:09.225206 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 85928.3us
W20260709 12:24:09.253072 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:09.253113 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 90852.9us
I20260709 12:24:09.191615 12675 raft_consensus.cc:740] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:24:09.223598 13257 consensus_meta.cc:287] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.685s	user 0.012s	sys 0.000s
I20260709 12:24:09.256068 11060 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:09.260872 11134 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:09.324311 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:24:09.225610 13285 consensus_meta.cc:287] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.590s	user 0.011s	sys 0.000s
I20260709 12:24:09.327004 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:09.218488 13241 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.218338 13164 raft_consensus.cc:2804] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:09.265214 11058 raft_consensus.cc:1275] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:09.284874 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:09.287533 11055 pending_rounds.cc:85] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting all ops after (but not including) 5
I20260709 12:24:09.332695 11055 pending_rounds.cc:107] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:24:09.246990 13339 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:09.333026 11055 raft_consensus.cc:2889] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:09.245983 13288 raft_consensus.cc:740] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:09.288825 11054 raft_consensus.cc:1240] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:09.127599 13338 consensus_queue.cc:237] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:09.198865 13203 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:09.289894 10979 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:09.226935 13374 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.255199 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:09.291958 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:09.247223 13228 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:09.265468 13277 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:09.271317 13292 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:09.305603 13254 consensus_queue.cc:1048] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:24:09.325265 11127 raft_consensus.cc:1240] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:09.375447 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1789) took 1538 ms. Trace:
I20260709 12:24:09.322778 11025 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
W20260709 12:24:09.376847 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 54265.6us
I20260709 12:24:09.375947 10978 rpcz_store.cc:276] 0709 12:24:07.836864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.403733 (+566869us) service_pool.cc:224] Handling call
0709 12:24:08.404020 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:08.404382 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:08.404408 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:08.404892 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 12:24:08.653265 (+248373us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:08.653654 (+   389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:08.653726 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:09.375230 (+721504us) raft_consensus.cc:1685] finished
0709 12:24:09.375251 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:09.375385 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7609,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":21852,"thread_start_us":247944,"threads_started":1,"wal-append.queue_time_us":399239}
I20260709 12:24:09.377336 11130 raft_consensus.cc:1240] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:24:09.377583 11025 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:09.377876 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:09.379031 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:09.379683 10978 raft_consensus.cc:2368] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5.
I20260709 12:24:09.263566 13296 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.211212 11128 rpcz_store.cc:276] 0709 12:24:08.014560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.844159 (+829599us) service_pool.cc:224] Handling call
0709 12:24:08.880811 (+ 36652us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:09.054576 (+173765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:09.110790 (+ 56214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:09.289539 13239 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:09.331648 10981 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:09.254395 13272 consensus_queue.cc:237] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:09.329926 10948 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:09.199090 13389 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:09.345379 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:09.346050 13100 raft_consensus.cc:3055] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:09.346711 13418 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.331065 13257 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:09.325668 13412 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:09.380874 11052 raft_consensus.cc:1275] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:24:09.402429 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 200048us
W20260709 12:24:09.389103 13304 consensus_meta.cc:287] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.637s	user 0.012s	sys 0.000s
W20260709 12:24:09.321815 13415 log.cc:927] Time spent T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:24:09.406014 10980 raft_consensus.cc:1240] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:09.181185 13240 consensus_queue.cc:260] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:09.288740 13406 raft_consensus.cc:2749] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5.
I20260709 12:24:09.261560 13273 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:09.410702 13410 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:09.411249 13410 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:09.411648 11673 raft_consensus.cc:1240] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:09.413184 11673 raft_consensus.cc:1275] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:09.362812 11678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41774 (request call id 408) took 1033 ms. Trace:
I20260709 12:24:09.362804 11681 raft_consensus.cc:1275] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:09.367262 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:09.320878 13407 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.421028 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1793) took 1583 ms. Trace:
I20260709 12:24:09.388314 13277 raft_consensus.cc:697] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 7 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:09.332072 13206 consensus_queue.cc:237] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:09.367048 13416 consensus_queue.cc:1048] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.108s
I20260709 12:24:09.374655 13203 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:09.379755 11025 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:09.381397 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:09.383056 11131 raft_consensus.cc:1240] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:09.342621 13025 raft_consensus.cc:2749] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:09.387677 11051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 302) took 1376 ms. Trace:
W20260709 12:24:09.389926 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 60107.5us
I20260709 12:24:09.393730 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:09.452319 10981 raft_consensus.cc:2376] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 5. Re-sending same reply.
I20260709 12:24:09.364522 13164 raft_consensus.cc:697] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 5 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:09.397622 11059 raft_consensus.cc:2393] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 8: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:09.351900 13394 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:09.385313 13346 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:09.404117 11097 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:09.385766 13258 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:09.447468 13407 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:09.466794 13025 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:09.467401 13025 raft_consensus.cc:697] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 5 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:09.467728 13375 consensus_queue.cc:260] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:09.468291 13025 consensus_queue.cc:237] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:09.408450 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:09.471048 11672 raft_consensus.cc:2368] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8.
I20260709 12:24:09.470659 13277 consensus_queue.cc:237] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:09.471328 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:09.408968 13411 consensus_queue.cc:1048] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:09.410209 13414 raft_consensus.cc:3055] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:09.472813 13414 raft_consensus.cc:740] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:09.414647 11678 rpcz_store.cc:276] 0709 12:24:08.329411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.423924 (+ 94513us) service_pool.cc:224] Handling call
0709 12:24:08.424269 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:08.424595 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:08.424620 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:08.425055 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 12:24:08.758940 (+333885us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:08.758979 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:08.759043 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:09.362553 (+603510us) raft_consensus.cc:1685] finished
0709 12:24:09.362575 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:09.362739 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":59699,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":23129,"thread_start_us":333069,"threads_started":1,"wal-append.queue_time_us":513123}
I20260709 12:24:09.388633 13296 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:09.370150 10949 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
W20260709 12:24:09.426214 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:09.484818 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 114791us
W20260709 12:24:09.485265 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:09.485430 10949 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:09.356182 13241 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:09.421540 10984 rpcz_store.cc:276] 0709 12:24:07.837798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.412651 (+574853us) service_pool.cc:224] Handling call
0709 12:24:08.413009 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:08.448413 (+ 35404us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:08.484566 (+ 36153us) log.cc:844] Serialized 14 byte log entry
0709 12:24:08.740657 (+256091us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:08.746769 (+  6112us) log.cc:844] Serialized 26 byte log entry
0709 12:24:08.746904 (+   135us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:08.746936 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:08.747001 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:09.420755 (+673754us) raft_consensus.cc:1685] finished
0709 12:24:09.420781 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:09.420954 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8629,"prepare.queue_time_us":35975,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":3524,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":29934,"thread_start_us":207827,"threads_started":1,"wal-append.queue_time_us":348158}
W20260709 12:24:09.433446 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:09.433846 11133 raft_consensus.cc:1240] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:24:09.435941 10980 raft_consensus.cc:1275] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:09.439631 13273 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:09.355721 13015 consensus_queue.cc:237] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:09.440994 13408 raft_consensus.cc:2749] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:09.403285 13418 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:09.442526 13384 log.cc:927] Time spent T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:24:09.444283 11128 raft_consensus.cc:1240] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:09.414628 13304 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:09.446404 13389 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:09.393669 13100 raft_consensus.cc:740] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
W20260709 12:24:09.448112 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 68505.3us
I20260709 12:24:09.448882 10978 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
I20260709 12:24:09.455322 13412 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:09.396632 13288 consensus_queue.cc:260] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:09.450608 12961 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:09.456795 13233 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:09.385411 12675 consensus_queue.cc:260] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:09.372349 13374 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:24:09.457597 13235 consensus_queue.cc:1059] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:09.463760 11131 raft_consensus.cc:1240] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4. Ops: []
W20260709 12:24:09.465791 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 61781us
I20260709 12:24:09.413342 13410 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:09.417476 10979 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:09.468889 13375 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:09.545912 11097 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:09.483632 13414 consensus_queue.cc:260] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:09.460042 11051 rpcz_store.cc:276] 0709 12:24:08.011361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.279506 (+268145us) service_pool.cc:224] Handling call
0709 12:24:08.279851 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:08.666115 (+386264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:09.387360 (+721245us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b54001879d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:09.387585 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":556889472}
I20260709 12:24:09.498564 13327 consensus_queue.cc:1048] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:24:09.502123 13241 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:09.494088 13285 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:09.483199 13423 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:09.504065 13418 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:09.576282 13418 consensus_queue.cc:1048] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:09.576956 13239 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:09.506829 13339 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:09.468506 13407 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:09.516891 11025 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
W20260709 12:24:09.579154 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 62359.7us
I20260709 12:24:09.579744 13239 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:09.518219 10981 raft_consensus.cc:1275] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:09.502485 13408 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:09.489282 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:09.542366 10979 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
I20260709 12:24:09.553520 10983 raft_consensus.cc:1240] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:24:09.558012 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:09.559914 13424 raft_consensus.cc:2749] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:09.560171 11134 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:09.483707 13331 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:09.563383 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 78008.7us
I20260709 12:24:09.550441 12675 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:09.566870 13413 raft_consensus.cc:697] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
W20260709 12:24:09.574218 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 85613.2us
I20260709 12:24:09.556075 13296 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:09.558521 11097 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:09.635769 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 77342.3us
I20260709 12:24:09.638299 10948 leader_election.cc:400] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8.
I20260709 12:24:09.638640 10948 leader_election.cc:403] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:24:09.575176 13257 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:09.613207 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:09.483834 13164 consensus_queue.cc:237] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:09.645498 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:09.672748 11131 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:09.630498 11130 raft_consensus.cc:1240] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:09.637143 13239 raft_consensus.cc:2804] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:09.568360 13386 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:09.585939 13394 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.591142 13404 consensus_queue.cc:1059] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
W20260709 12:24:09.638129 13377 log.cc:927] Time spent T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:24:09.646410 13410 consensus_queue.cc:1048] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:09.630784 13241 consensus_queue.cc:1059] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:24:09.602633 13416 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:09.772116 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 138239us
I20260709 12:24:09.584973 13414 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:09.696918 11060 raft_consensus.cc:1240] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:24:09.643384 11097 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:09.728871 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 96806.4us
I20260709 12:24:09.590270 13273 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:09.746889 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:09.634917 13292 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:09.789347 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 146065us
I20260709 12:24:09.695415 13239 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:09.796651 10948 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:09.572031 13100 consensus_queue.cc:260] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:09.792968 11097 leader_election.cc:400] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Vote denied by peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777) with higher term. Message: Invalid argument: T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5.
I20260709 12:24:09.600945 11134 raft_consensus.cc:2410] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:09.747308 13408 raft_consensus.cc:2749] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8.
I20260709 12:24:09.696935 13412 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.658072 13131 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.132s
I20260709 12:24:09.640216 13322 consensus_queue.cc:1059] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.150s
W20260709 12:24:09.804538 13162 consensus_meta.cc:287] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.561s	user 0.010s	sys 0.000s
I20260709 12:24:09.806234 13015 consensus_queue.cc:1059] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
W20260709 12:24:09.816538 13401 log.cc:927] Time spent T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.528s	user 0.004s	sys 0.006s
I20260709 12:24:09.817823 13386 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:09.818526 13434 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:09.819190 13433 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:09.822237 13373 consensus_meta.cc:287] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.000s
I20260709 12:24:09.812513 13412 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:09.824203 13331 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:09.825068 13412 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:09.697549 13423 consensus_queue.cc:1048] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.110s
W20260709 12:24:09.825929 13216 consensus_meta.cc:287] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.663s	user 0.009s	sys 0.001s
I20260709 12:24:09.826050 13233 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:09.826714 13322 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.822283 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:09.827217 13322 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:09.828825 13374 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:09.829782 11131 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 5.
I20260709 12:24:09.834764 11097 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:09.794960 13203 raft_consensus.cc:2749] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:09.805025 13239 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:09.769304 13394 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:09.839560 11097 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:09.850564 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:09.851536 10978 raft_consensus.cc:2393] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 5: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:09.787514 13416 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:09.819725 13433 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:09.864300 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:09.869240 10979 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:09.870270 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:09.866497 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:09.868775 10984 raft_consensus.cc:1275] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:09.852352 13412 consensus_queue.cc:1059] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:24:09.873402 13412 raft_consensus.cc:3055] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:09.873698 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:09.873782 13412 raft_consensus.cc:740] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:09.874859 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:09.874861 13412 consensus_queue.cc:260] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:09.876222 13412 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:09.877152 13277 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:09.872552 11097 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:09.843884 13374 raft_consensus.cc:2749] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:09.877683 13277 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:09.878643 13374 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:09.879026 13374 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:09.879417 13374 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:09.876101 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:09.875638 13041 consensus_meta.cc:287] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 1.122s	user 0.009s	sys 0.002s
I20260709 12:24:09.837476 13434 raft_consensus.cc:697] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:09.886021 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:09.886674 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:09.887822 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:09.890045 10984 raft_consensus.cc:2410] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:09.879962 13277 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:09.868108 13257 raft_consensus.cc:2804] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:09.887473 11053 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 4.
I20260709 12:24:09.862869 13304 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:09.835470 13216 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:09.879457 13322 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:09.879526 13431 consensus_queue.cc:1048] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:24:09.863772 13410 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:24:09.812709 13413 consensus_queue.cc:237] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:09.898037 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:09.923626 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:09.928407 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:09.874171 13433 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:09.962791 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:09.945935 13442 log.cc:927] Time spent T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:24:09.968797 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:09.970533 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:09.971128 13416 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:09.971799 11051 raft_consensus.cc:1275] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:09.972131 13434 consensus_queue.cc:237] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:24:09.973968 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:09.988297 11057 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:09.141695 11675 rpcz_store.cc:276] 0709 12:24:07.902000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.419339 (+517339us) service_pool.cc:224] Handling call
0709 12:24:08.419713 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:08.419941 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:08.724475 (+304534us) log.cc:844] Serialized 14 byte log entry
0709 12:24:09.048674 (+324199us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:09.051085 (+  2411us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:09.057045 (+  5960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:09.079792 (+ 22747us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:09.079953 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23999,"prepare.queue_time_us":433497,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":46063,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":32159,"spinlock_wait_cycles":6246144,"thread_start_us":501781,"threads_started":2,"wal-append.queue_time_us":442792}
W20260709 12:24:09.977344 13417 log.cc:927] Time spent T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.588s	user 0.001s	sys 0.005s
I20260709 12:24:09.897291 13310 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.945755 13204 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:24:09.961380 13425 log.cc:927] Time spent T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.520s	user 0.009s	sys 0.000s
I20260709 12:24:09.896723 13257 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:09.898291 13273 raft_consensus.cc:697] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:10.000010 10948 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:10.003576 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:10.004570 11677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41784 (request call id 506) took 1032 ms. Trace:
I20260709 12:24:10.005240 13216 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:10.005873 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:10.009550 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.014513 13406 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.015265 13406 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:24:10.016742 12961 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:09.993618 13204 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:10.019443 10982 raft_consensus.cc:1275] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:10.020713 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:10.021641 10982 raft_consensus.cc:2410] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:10.004945 11677 rpcz_store.cc:276] 0709 12:24:08.971926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.989270 (+ 17344us) service_pool.cc:224] Handling call
0709 12:24:10.003377 (+1014107us) spinlock_profiling.cc:243] Waited 4.92 ms on lock 0x7b5800004598. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90daa0a0 00007f8f90da9984 00007f8f8a3246d4 00007f8f8a324662
0709 12:24:10.004494 (+  1117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11313536}
I20260709 12:24:09.991024 13347 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:10.031337 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:10.027982 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:09.996172 13257 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:10.034528 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:10.042363 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:10.046088 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.029390 13433 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:10.033110 13347 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:10.053694 13405 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.054198 11674 raft_consensus.cc:1240] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:10.056684 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:10.032105 13386 consensus_queue.cc:1048] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:24:10.050797 13433 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.059437 13433 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:10.059198 13277 consensus_queue.cc:1048] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:10.060055 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:10.061347 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:10.062047 13406 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:10.063120 13273 consensus_queue.cc:237] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:10.055411 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:10.067420 13239 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:10.069779 13438 raft_consensus.cc:3055] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:10.070245 13438 raft_consensus.cc:740] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:10.070611 13239 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:10.070534 13375 consensus_meta.cc:287] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.521s	user 0.007s	sys 0.003s
I20260709 12:24:10.048089 13394 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:10.080832 11057 raft_consensus.cc:3055] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:09.993925 13310 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:10.051371 13296 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.087584 11057 raft_consensus.cc:740] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:10.081640 11051 raft_consensus.cc:1240] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:10.078884 10948 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:10.092171 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:10.092844 10984 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:10.054368 13405 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:10.090773 11057 consensus_queue.cc:260] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:10.113162 11057 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:10.071084 13438 consensus_queue.cc:260] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:10.166193 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:10.169338 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.139397 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 290) took 1845 ms. Trace:
I20260709 12:24:10.170781 11129 rpcz_store.cc:276] 0709 12:24:08.294001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.149258 (+855257us) service_pool.cc:224] Handling call
0709 12:24:09.156068 (+  6810us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:09.414090 (+258022us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:09.414156 (+    66us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:09.414203 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:09.414235 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.139103 (+724868us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b54001630d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:10.139166 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:10.139324 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":592899456}
I20260709 12:24:10.112433 12675 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.172838 12675 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:10.173619 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:10.174288 11129 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 5.
I20260709 12:24:10.175028 12675 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:10.175922 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:10.176117 11645 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:10.176926 13375 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:10.177315 13375 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.177699 13375 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:10.176643 11129 raft_consensus.cc:2393] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 6: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:10.174021 10984 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 2.
I20260709 12:24:10.181859 11097 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:10.183370 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:10.184158 10984 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:10.185523 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:10.187158 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:10.187970 10984 raft_consensus.cc:2393] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 8: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:10.182740 13239 raft_consensus.cc:2804] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:10.190891 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:10.194152 10984 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:10.195727 13449 log.cc:927] Time spent T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:24:10.193542 13406 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.189491 13306 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:10.208046 10984 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:10.110031 13296 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:10.148571 12992 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:10.202396 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:10.242246 13251 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.111925 13216 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:10.202533 13438 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:10.266309 13257 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:10.270668 13257 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:10.165365 13374 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:10.241617 13204 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:10.271090 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 298) took 1064 ms. Trace:
I20260709 12:24:10.271456 11130 rpcz_store.cc:276] 0709 12:24:09.206755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.378156 (+171401us) service_pool.cc:224] Handling call
0709 12:24:09.392826 (+ 14670us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:09.673945 (+281119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.270859 (+596914us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b5400066b54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:10.271029 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":545952000}
I20260709 12:24:10.272614 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:24:10.272377 13339 consensus_queue.cc:1175] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7518bdeb78f24e67a530754ae48547eb" responder_term: 5 status { last_received { term: 4 index: 3 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:10.246570 11129 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:10.205128 13239 raft_consensus.cc:697] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:10.274574 11059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52804 (request call id 304) took 1103 ms. Trace:
I20260709 12:24:10.274453 13239 consensus_queue.cc:237] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:10.239804 13394 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.274948 11059 rpcz_store.cc:276] 0709 12:24:09.170934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.172162 (+  1228us) service_pool.cc:224] Handling call
0709 12:24:10.274369 (+1102207us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b54003007d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:10.274512 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":333123456}
I20260709 12:24:10.275465 13394 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:10.276701 13164 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.277199 13164 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:10.277622 13394 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:10.203084 11057 raft_consensus.cc:1275] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:24:10.279472 11057 pending_rounds.cc:85] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting all ops after (but not including) 6
I20260709 12:24:10.279794 11057 pending_rounds.cc:107] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:24:10.247604 12992 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:10.265951 11025 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:10.282060 13346 raft_consensus.cc:2749] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:10.282274 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:10.279950 13374 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:10.283211 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 275) took 1036 ms. Trace:
I20260709 12:24:10.286661 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1755) took 2555 ms. Trace:
I20260709 12:24:10.287083 11133 rpcz_store.cc:276] 0709 12:24:07.731116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.492920 (+761804us) service_pool.cc:224] Handling call
0709 12:24:08.493227 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:09.489848 (+996621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.286388 (+796540us) spinlock_profiling.cc:243] Waited 940 ms on lock 0x7b5400068954. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:10.286586 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2162597120}
I20260709 12:24:10.288396 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:10.236887 13306 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:10.290776 13400 raft_consensus.cc:3055] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:10.291208 13400 raft_consensus.cc:740] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:10.292024 13400 consensus_queue.cc:260] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:10.292431 13306 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:10.235570 13406 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:10.293277 13400 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:10.239529 13412 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:10.264290 13100 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:10.270478 13335 consensus_queue.cc:1048] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:10.272874 13204 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:10.280032 11057 raft_consensus.cc:2889] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:10.283577 10981 rpcz_store.cc:276] 0709 12:24:09.246469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.453034 (+206565us) service_pool.cc:224] Handling call
0709 12:24:09.517841 (+ 64807us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:09.582046 (+ 64205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.283016 (+700970us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b54000da050. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:10.283145 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59062528}
I20260709 12:24:10.257544 13251 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:10.280364 11128 raft_consensus.cc:2393] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 6: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:10.295562 11130 raft_consensus.cc:2393] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 6: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:10.307462 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:10.167347 12961 consensus_queue.cc:1059] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
W20260709 12:24:10.296765 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.307708 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:10.310654 10949 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:10.311529 11055 raft_consensus.cc:1275] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:24:10.309814 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.289826 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:10.303272 13412 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:10.304311 13448 log.cc:927] Time spent T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:24:10.309835 10977 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:10.319243 11025 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:10.319308 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:10.320382 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:10.321285 13258 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:10.321813 13258 raft_consensus.cc:697] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:10.279379 13164 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:10.323405 11025 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:10.318574 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:10.322654 13258 consensus_queue.cc:237] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:10.323664 11057 raft_consensus.cc:1240] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:10.327135 11055 raft_consensus.cc:2393] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 6: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:10.264320 13405 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:10.323279 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:10.325950 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:10.331152 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:10.333410 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:10.331279 11059 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:24:10.334442 11130 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:10.315691 11129 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:10.329461 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:10.327639 13408 raft_consensus.cc:2749] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:10.337126 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:10.338050 11057 raft_consensus.cc:2410] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:10.338002 11059 raft_consensus.cc:1275] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:10.339146 13251 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:10.339875 13301 consensus_queue.cc:260] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:10.340484 11056 raft_consensus.cc:2410] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:10.341199 13407 raft_consensus.cc:3055] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:10.325522 13403 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.342175 13403 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:10.321319 13445 consensus_queue.cc:1048] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:24:10.343294 13445 consensus_queue.cc:1243] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer 7518bdeb78f24e67a530754ae48547eb log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:24:10.341615 13407 raft_consensus.cc:740] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:10.322639 11133 raft_consensus.cc:1240] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:10.324765 13204 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.345264 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:10.349382 10981 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:10.325716 13386 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.353981 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:10.341450 13301 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:10.351243 13445 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:10.356595 13445 raft_consensus.cc:697] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:10.356875 11133 raft_consensus.cc:1275] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:10.357461 13445 consensus_queue.cc:237] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:10.350464 13407 consensus_queue.cc:260] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:10.360666 13407 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:10.322988 13273 consensus_queue.cc:1059] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:24:10.364058 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:10.364320 13273 consensus_queue.cc:1243] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer 7518bdeb78f24e67a530754ae48547eb log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:10.364751 10978 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:10.364930 13273 raft_consensus.cc:3055] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:10.365348 13273 raft_consensus.cc:740] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:10.366264 13273 consensus_queue.cc:260] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:10.367527 13273 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:10.369129 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 293) took 1940 ms. Trace:
I20260709 12:24:10.369524 11125 rpcz_store.cc:276] 0709 12:24:08.429194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.151379 (+722185us) service_pool.cc:224] Handling call
0709 12:24:09.151660 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:09.371524 (+219864us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:09.400874 (+ 29350us) log.cc:844] Serialized 14 byte log entry
0709 12:24:09.550869 (+149995us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:09.551342 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 12:24:09.551490 (+   148us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:09.551521 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.368711 (+817190us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b5400032d54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:10.368759 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:10.368825 (+    66us) raft_consensus.cc:1685] finished
0709 12:24:10.368913 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:10.369065 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3374,"prepare.queue_time_us":30446,"raft.queue_time_us":19369,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":22774,"spinlock_wait_cycles":513557632,"thread_start_us":112485,"threads_started":1,"wal-append.queue_time_us":219038}
I20260709 12:24:10.371201 13412 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:10.372282 10978 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
I20260709 12:24:10.373409 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:10.375916 10978 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:10.375031 11681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 522) took 1198 ms. Trace:
I20260709 12:24:10.378039 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:10.374336 11680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 517) took 1839 ms. Trace:
W20260709 12:24:10.367693 11053 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1507) took 2668 ms (client timeout 2426 ms). Trace:
W20260709 12:24:10.379263 11053 rpcz_store.cc:269] 0709 12:24:07.699674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.935966 (+236292us) service_pool.cc:224] Handling call
0709 12:24:10.367471 (+2431505us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b54003138d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:10.367588 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4342470400}
I20260709 12:24:10.378554 11098 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:10.378403 11681 rpcz_store.cc:276] 0709 12:24:09.176432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.178523 (+  2091us) service_pool.cc:224] Handling call
0709 12:24:09.178846 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:09.414907 (+236061us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.374795 (+959888us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b540049ff54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:10.374972 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":408456576}
I20260709 12:24:10.379171 11680 rpcz_store.cc:276] 0709 12:24:08.534651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.534763 (+   112us) service_pool.cc:224] Handling call
0709 12:24:09.086707 (+551944us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:09.148988 (+ 62281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.374085 (+1225097us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b54000a4bd0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:10.374249 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1219638528}
I20260709 12:24:10.385468 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:10.388823 11130 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:10.390033 10978 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:10.391283 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:10.393945 11130 raft_consensus.cc:1275] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:24:10.394550 11130 pending_rounds.cc:85] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 3
I20260709 12:24:10.394879 11130 pending_rounds.cc:107] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:24:10.395177 11130 raft_consensus.cc:2889] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:10.403093 11098 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:10.404417 11098 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:10.406805 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 295) took 1919 ms. Trace:
I20260709 12:24:10.406996 11098 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:10.407241 11127 rpcz_store.cc:276] 0709 12:24:08.487283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.189802 (+702519us) service_pool.cc:224] Handling call
0709 12:24:09.325081 (+135279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:09.375867 (+ 50786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.406597 (+1030730us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54000eecd0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:10.406742 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246184704}
I20260709 12:24:10.408375 11098 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:10.417183 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.419488 11098 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:10.396724 13335 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.404500 13206 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:10.427748 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:10.354245 13386 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:10.351960 13204 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:10.401850 10981 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:10.443928 10981 raft_consensus.cc:1240] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:10.395998 13413 consensus_queue.cc:1048] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:24:10.403410 13412 consensus_queue.cc:1048] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:24:10.420651 13339 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.421927 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:10.430066 11127 raft_consensus.cc:1240] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
W20260709 12:24:10.464705 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.420712 13239 raft_consensus.cc:2749] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:10.424033 12675 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.435566 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:10.468312 10981 raft_consensus.cc:1240] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:10.468531 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:10.436415 13402 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.427560 13203 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:10.438853 12992 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:10.355326 13408 consensus_queue.cc:1048] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:24:10.412983 13306 raft_consensus.cc:2749] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:10.413125 13257 raft_consensus.cc:2749] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:10.410965 13406 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:10.416709 13431 raft_consensus.cc:2804] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:10.436601 13459 log.cc:927] Time spent T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:24:10.426796 11098 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:10.406383 13410 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:24:10.453379 11025 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:10.465755 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:10.470083 10981 raft_consensus.cc:1240] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 1. Current term is 2. Ops: []
W20260709 12:24:10.563094 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 109823us
I20260709 12:24:10.563910 11025 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:10.564465 10981 raft_consensus.cc:1240] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:24:10.470846 11130 raft_consensus.cc:1240] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:10.469138 11128 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:10.466612 13339 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:10.478648 10976 raft_consensus.cc:1240] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:10.479414 13386 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:10.480202 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.461455 13423 consensus_queue.cc:1059] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:24:10.416958 13433 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:10.482971 13402 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:10.484001 12675 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:10.576251 13241 raft_consensus.cc:2804] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:10.576699 13241 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.577060 13241 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:10.577463 12675 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:10.578075 12675 consensus_queue.cc:1048] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:10.481930 12992 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:10.581849 13402 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:10.582432 10982 raft_consensus.cc:2393] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 7: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
W20260709 12:24:10.582998 13347 consensus_meta.cc:287] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.511s	user 0.008s	sys 0.002s
I20260709 12:24:10.584338 13339 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:10.584846 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.586377 11025 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:10.575788 11127 raft_consensus.cc:1240] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 12:24:10.587509 13339 raft_consensus.cc:2804] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:10.587952 13339 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.588276 13339 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:10.479452 10978 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
W20260709 12:24:10.453497 13338 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.012s	user 0.010s	sys 0.012s
I20260709 12:24:10.554183 13431 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:10.566407 13296 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:10.429759 13149 consensus_queue.cc:1048] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 12:24:10.566174 11130 raft_consensus.cc:1275] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:10.448001 13375 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:10.566210 11128 pending_rounds.cc:85] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 2
I20260709 12:24:10.612360 11128 pending_rounds.cc:107] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 12:24:10.612706 11128 raft_consensus.cc:2889] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:10.570191 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 143489us
I20260709 12:24:10.583484 13343 raft_consensus.cc:3055] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:10.553627 13164 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.579737 13433 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:10.503276 11125 raft_consensus.cc:1275] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:24:10.625398 11125 pending_rounds.cc:85] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 3
I20260709 12:24:10.625751 11125 pending_rounds.cc:107] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:24:10.626113 11125 raft_consensus.cc:2889] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:10.584704 13347 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:10.568360 13438 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:10.604789 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.450362 13025 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:24:10.594805 13338 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.153s	user 0.010s	sys 0.013s
I20260709 12:24:10.445500 13335 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:24:10.574627 13406 raft_consensus.cc:2749] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:10.613900 13346 consensus_queue.cc:1048] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:24:10.623399 13403 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:10.587216 13228 consensus_queue.cc:1059] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:24:10.654526 10980 raft_consensus.cc:1240] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 4 LEADER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:10.608966 13431 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:10.633816 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:10.649844 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:10.659875 11053 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:24:10.619354 13343 raft_consensus.cc:740] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:10.605960 13423 consensus_queue.cc:1059] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:24:10.683624 11130 raft_consensus.cc:1240] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:10.606947 13445 consensus_queue.cc:1059] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:24:10.637203 13306 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.631975 13438 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.690737 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1606) took 1090 ms. Trace:
I20260709 12:24:10.691617 11131 rpcz_store.cc:276] 0709 12:24:09.600070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.673620 (+ 73550us) service_pool.cc:224] Handling call
0709 12:24:10.690541 (+1016921us) spinlock_profiling.cc:243] Waited 51.1 ms on lock 0x7b5400066154. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:10.690672 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117417344}
I20260709 12:24:10.690712 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:10.694497 13303 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:10.695243 13375 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:10.700158 11644 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.145.194:44483 timed out after 1.641s (SENT) [suppressed 12 similar messages]
I20260709 12:24:10.663149 11098 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:10.630309 13164 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:24:10.698979 13438 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:10.709285 13413 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:10.709568 13272 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.264s	user 0.009s	sys 0.006s
W20260709 12:24:10.709699 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 46659.3us
I20260709 12:24:10.705778 13204 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:10.652750 13025 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:10.716075 13321 consensus_queue.cc:1059] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:24:10.708384 13423 raft_consensus.cc:3055] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:10.714766 13445 consensus_queue.cc:1243] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer 7518bdeb78f24e67a530754ae48547eb log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:24:10.698855 13306 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:10.722411 13272 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.277s	user 0.010s	sys 0.007s
I20260709 12:24:10.730786 11098 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:10.731906 13464 log.cc:927] Time spent T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:24:10.735909 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 281) took 1366 ms. Trace:
I20260709 12:24:10.739737 13240 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:10.721068 13413 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.740841 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1603) took 1513 ms. Trace:
W20260709 12:24:10.762876 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.741393 13335 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:10.741634 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1817) took 1526 ms. Trace:
I20260709 12:24:10.767335 10983 rpcz_store.cc:276] 0709 12:24:09.215192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.215344 (+   152us) service_pool.cc:224] Handling call
0709 12:24:09.246470 (+ 31126us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:09.588383 (+341913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.741362 (+1152979us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b54001abdd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:10.741562 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":705538304}
W20260709 12:24:10.742442 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.768363 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:10.728124 13423 raft_consensus.cc:740] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:10.758729 10980 rpcz_store.cc:276] 0709 12:24:09.369268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.487680 (+118412us) service_pool.cc:224] Handling call
0709 12:24:09.496545 (+  8865us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:10.664150 (+1167605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.735634 (+ 71484us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400229054. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:10.735838 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2662637440}
W20260709 12:24:10.727629 13461 log.cc:927] Time spent T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:24:10.775693 11053 raft_consensus.cc:1275] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:24:10.776113 11053 pending_rounds.cc:85] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting all ops after (but not including) 2
I20260709 12:24:10.776330 11053 pending_rounds.cc:107] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:24:10.776552 11053 raft_consensus.cc:2889] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:10.777765 13447 log.cc:927] Time spent T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.615s	user 0.003s	sys 0.000s
I20260709 12:24:10.778131 13257 consensus_queue.cc:1048] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:10.779307 13149 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:10.779930 13149 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:10.782446 13149 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:10.784826 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.786945 13375 consensus_queue.cc:1059] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:10.788331 13251 raft_consensus.cc:3055] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:10.788730 13251 raft_consensus.cc:740] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:10.789551 13251 consensus_queue.cc:260] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:10.790844 13251 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:10.795346 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:10.796765 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:10.797405 11052 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:24:10.799161 10982 raft_consensus.cc:1275] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:10.801229 11098 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:10.802218 13257 raft_consensus.cc:2804] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:10.802596 13257 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:10.802980 13257 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:10.806170 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.808559 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:10.762492 11134 rpcz_store.cc:276] 0709 12:24:09.227132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.324042 (+ 96910us) service_pool.cc:224] Handling call
0709 12:24:10.740633 (+1416591us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b540023aad4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:10.740777 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":540936960}
I20260709 12:24:10.741190 13216 raft_consensus.cc:2749] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:10.763829 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.743086 13306 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:10.769191 11056 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
I20260709 12:24:10.810631 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:10.810915 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:10.811919 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:10.834489 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 148244us
I20260709 12:24:10.815090 11056 raft_consensus.cc:1275] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:24:10.773934 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 73818.6us
I20260709 12:24:10.837280 13433 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.822855 11060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 309) took 1599 ms. Trace:
I20260709 12:24:10.838549 11060 rpcz_store.cc:276] 0709 12:24:09.223627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.323073 (+ 99446us) service_pool.cc:224] Handling call
0709 12:24:09.323436 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:09.774813 (+451377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.822585 (+1047772us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b54001892d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:10.822789 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":858280704}
I20260709 12:24:10.823529 11128 raft_consensus.cc:1240] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:10.826622 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:24:10.827404 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.844746 11131 raft_consensus.cc:1275] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:10.846978 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:10.847864 11127 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:10.846042 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:10.850817 11131 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:10.820263 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:10.853575 11126 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:10.816411 11098 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:10.817196 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:10.855472 11134 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
I20260709 12:24:10.766777 13413 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:10.770476 13239 raft_consensus.cc:2749] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:10.831643 10949 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:10.829308 13423 consensus_queue.cc:260] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:10.866575 10949 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:10.867241 13423 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:10.724577 13343 consensus_queue.cc:260] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:10.868686 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:10.869007 13343 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:10.869472 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:10.810046 13310 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:10.870709 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:10.871387 10983 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:24:10.872221 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:10.814381 13277 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.873072 13277 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:10.864349 13149 consensus_queue.cc:1048] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:24:10.875141 13277 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:10.878062 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:10.859186 10978 raft_consensus.cc:1275] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:10.862205 13216 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:10.878368 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.884948 11680 raft_consensus.cc:2393] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 7: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:10.814009 10948 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:10.880439 10949 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:10.812772 13338 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.819388 13258 raft_consensus.cc:3055] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:10.823333 12675 raft_consensus.cc:3055] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:10.827847 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:10.894433 10978 raft_consensus.cc:1275] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:10.814143 12992 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:10.897756 11023 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
W20260709 12:24:10.902396 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 88486.3us
I20260709 12:24:10.903009 10949 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:10.863090 13433 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:10.903801 10948 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:10.904333 10949 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:10.865589 13403 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:10.905745 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:10.893678 13408 raft_consensus.cc:2749] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:10.898386 13258 raft_consensus.cc:740] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:10.918076 13407 raft_consensus.cc:2749] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:10.912717 13296 consensus_queue.cc:1048] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:24:10.898185 13347 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:10.918700 11023 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:10.908237 12961 raft_consensus.cc:2804] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:10.930230 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 288) took 2938 ms. Trace:
I20260709 12:24:10.931041 11126 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
I20260709 12:24:10.892169 13463 raft_consensus.cc:2749] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:10.924196 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:10.930681 11132 rpcz_store.cc:276] 0709 12:24:07.992278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.740718 (+748440us) service_pool.cc:224] Handling call
0709 12:24:08.741057 (+   339us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:08.741435 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:08.741462 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:09.360151 (+618689us) spinlock_profiling.cc:243] Waited 7.75 ms on lock 0x7b180037a500. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cc52a6 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8a6dda11 00007f8f8a6ed372 00007f8f8be1fa01 00007f8f8bde443a
0709 12:24:10.343320 (+983169us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b2c000b1d08. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8a6dda11 00007f8f8a6ed372 00007f8f8be1fa01 00007f8f8bde443a 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2
0709 12:24:10.343985 (+   665us) log.cc:844] Serialized 52 byte log entry
0709 12:24:10.450181 (+106196us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:10.450218 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.450499 (+   281us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:10.929986 (+479487us) raft_consensus.cc:1685] finished
0709 12:24:10.930006 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:10.930167 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5287,"raft.queue_time_us":2279,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":5595,"spinlock_wait_cycles":24972032,"thread_start_us":105749,"threads_started":1,"wal-append.queue_time_us":267803}
I20260709 12:24:10.932358 11680 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:24:10.896790 12675 raft_consensus.cc:740] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:10.906183 13233 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:10.929018 11023 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:10.904857 13100 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.904640 12992 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:10.940728 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 108415us
I20260709 12:24:10.898236 13216 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:10.917383 13277 raft_consensus.cc:2749] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:10.914508 13402 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:10.916601 13475 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:10.970770 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.914790 13310 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:10.913596 13403 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.973729 11680 raft_consensus.cc:1240] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:10.975157 13100 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:10.901819 13338 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:11.036029 13100 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:10.979646 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:11.036262 13338 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:11.037596 10980 raft_consensus.cc:1275] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:10.933961 13272 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:11.038937 13272 raft_consensus.cc:697] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:11.039917 13272 consensus_queue.cc:237] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:10.988078 13216 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:10.981431 13241 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:11.041646 12675 consensus_queue.cc:260] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:11.042876 12675 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:11.044013 13241 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:10.990192 13402 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:10.948110 13339 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:11.047894 13339 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:11.050797 13402 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:10.993088 13431 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:11.072353 13431 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:10.994282 13257 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:11.073601 11125 raft_consensus.cc:1240] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:11.074741 13257 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:10.994293 10983 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:24:10.995035 13258 consensus_queue.cc:260] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:11.076421 13258 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:10.996299 11676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41774 (request call id 409) took 2027 ms. Trace:
I20260709 12:24:11.085477 11676 rpcz_store.cc:276] 0709 12:24:08.969334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.975099 (+  5765us) service_pool.cc:224] Handling call
0709 12:24:09.032261 (+ 57162us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:09.101315 (+ 69054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:09.106660 (+  5345us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:10.732006 (+1625346us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b180039ac00. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cc52a6 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8a6dda11 00007f8f8a6ed372 00007f8f8be1fa01 00007f8f8bde443a
0709 12:24:10.815752 (+ 83746us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b2c0004b818. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8a6dda11 00007f8f8a6ed372 00007f8f8be1fa01 00007f8f8bde443a 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2
0709 12:24:10.816467 (+   715us) log.cc:844] Serialized 52 byte log entry
0709 12:24:10.900157 (+ 83690us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:10.908405 (+  8248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.914463 (+  6058us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:10.995954 (+ 81491us) raft_consensus.cc:1685] finished
0709 12:24:10.995982 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:10.996215 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10164,"raft.queue_time_us":10611,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":5865,"spinlock_wait_cycles":14129280,"thread_start_us":62842,"threads_started":1,"wal-append.queue_time_us":150625}
I20260709 12:24:11.088282 11676 raft_consensus.cc:1275] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:10.998776 13444 raft_consensus.cc:3055] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:11.089650 13444 raft_consensus.cc:740] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:24:10.999577 13400 consensus_meta.cc:287] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.706s	user 0.009s	sys 0.002s
I20260709 12:24:11.094216 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:11.103432 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:11.104053 10981 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:11.000988 13485 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.948030 13347 raft_consensus.cc:2804] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:11.026475 13434 raft_consensus.cc:3055] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:11.027002 11677 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 LEARNER]: Advancing to term 6
I20260709 12:24:11.028713 13277 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.031139 13433 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:11.033612 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:11.054661 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:11.125620 11678 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
W20260709 12:24:11.055088 13460 log.cc:927] Time spent T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.486s	user 0.003s	sys 0.000s
I20260709 12:24:11.056789 12992 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:11.057576 13479 log.cc:927] Time spent T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:24:11.058015 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:11.058555 13475 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:11.059466 13164 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:11.060544 13403 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:11.060971 13310 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:11.061461 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1218) took 1212 ms. Trace:
I20260709 12:24:11.139092 10979 rpcz_store.cc:276] 0709 12:24:09.849254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.869977 (+ 20723us) service_pool.cc:224] Handling call
0709 12:24:11.061218 (+1191241us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b54003bae54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:11.061368 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":550649728}
I20260709 12:24:11.139851 13473 raft_consensus.cc:2804] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:11.140426 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:11.063333 13445 raft_consensus.cc:3055] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:11.142287 13445 raft_consensus.cc:740] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:10.991892 13438 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:10.997877 13288 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:11.068387 13025 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:11.069819 11645 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
W20260709 12:24:11.144605 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 74888.3us
I20260709 12:24:11.145685 11645 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:11.083145 11679 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:11.089143 11051 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 5.
I20260709 12:24:11.092303 11098 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:11.095093 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:11.095224 10975 raft_consensus.cc:1240] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:11.149080 10982 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:11.099354 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:11.149756 10976 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
W20260709 12:24:11.101366 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.967342 12961 raft_consensus.cc:697] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 7 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:11.110503 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:11.111217 10983 raft_consensus.cc:1275] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:11.112599 10977 raft_consensus.cc:1240] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:11.113360 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:11.116552 11023 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:11.117972 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:11.118424 10980 raft_consensus.cc:1275] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:11.153486 11053 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 5: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:11.119004 10881 catalog_manager.cc:5697] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:11.120424 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:11.155707 11643 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:11.116672 13347 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.112443 13296 consensus_queue.cc:1048] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:24:11.118312 13416 consensus_queue.cc:1059] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:24:11.132798 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:11.133903 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:11.137363 10882 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41106 (request call id 280) took 13714 ms (client timeout 15000 ms). Trace:
I20260709 12:24:11.120296 13434 raft_consensus.cc:740] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
W20260709 12:24:11.153213 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 60970.2us
I20260709 12:24:11.156754 10981 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:11.136976 11676 raft_consensus.cc:1275] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:24:11.162412 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 45962.1us
I20260709 12:24:11.198271 11023 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:11.166865 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:11.148398 13273 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.117378 13413 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:11.177420 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 273134us
I20260709 12:24:11.130177 13277 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:11.160019 13400 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:11.199251 11679 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
W20260709 12:24:11.201305 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 45312.4us
I20260709 12:24:11.167945 13025 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:11.120826 13485 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:11.142673 13473 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:11.223675 11097 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:11.193372 11098 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:11.215809 11025 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:11.234876 10983 raft_consensus.cc:1275] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:11.154796 12992 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:11.169054 13347 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:11.236127 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:11.237417 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:11.238361 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:11.238265 11125 raft_consensus.cc:1275] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:11.316161 10980 raft_consensus.cc:2393] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 6: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:11.240470 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:11.242293 10979 raft_consensus.cc:1275] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:11.317373 10980 raft_consensus.cc:1275] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:11.239732 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:11.159693 13484 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:11.246906 10975 raft_consensus.cc:1275] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:24:11.247969 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 49841.4us
I20260709 12:24:11.249118 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:11.323421 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 106396us
I20260709 12:24:11.249753 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:11.169795 13310 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:11.250444 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:11.325178 11057 raft_consensus.cc:2368] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 5. Current term is 6.
I20260709 12:24:11.249511 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:11.326045 11060 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:11.255582 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:11.249480 13407 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:11.258400 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:11.259517 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 103898us
W20260709 12:24:11.261246 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 45531us
I20260709 12:24:11.259481 12992 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:11.277122 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 83826us
I20260709 12:24:11.308354 13272 raft_consensus.cc:2804] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:11.258410 13339 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:11.279338 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1818) took 1269 ms. Trace:
I20260709 12:24:11.337491 11677 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 LEARNER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:24:11.279976 10978 raft_consensus.cc:1275] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:11.341923 13407 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:11.348419 13296 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:11.346611 10984 rpcz_store.cc:276] 0709 12:24:10.010440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.212759 (+202319us) service_pool.cc:224] Handling call
0709 12:24:10.236982 (+ 24223us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:10.241406 (+  4424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:10.241439 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:10.734368 (+492929us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b2c00030d28. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8a6dda11 00007f8f8a6ed372 00007f8f8be1fa01 00007f8f8bde443a 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2
0709 12:24:10.734944 (+   576us) log.cc:844] Serialized 52 byte log entry
0709 12:24:10.831420 (+ 96476us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:10.831884 (+   464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.832513 (+   629us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:11.057010 (+224497us) spinlock_profiling.cc:243] Waited 4.58 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:11.264137 (+207127us) raft_consensus.cc:1685] finished
0709 12:24:11.264163 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:11.279262 (+ 15099us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4992,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":114,"spinlock_wait_cycles":14192640,"thread_start_us":91890,"threads_started":1,"wal-append.queue_time_us":178034}
I20260709 12:24:11.349012 13296 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:11.273603 13375 consensus_queue.cc:1059] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.002s
W20260709 12:24:11.192466 10882 rpcz_store.cc:269] 0709 12:23:57.417303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.419631 (+  2328us) service_pool.cc:224] Handling call
0709 12:24:11.131152 (+13711521us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:58.639985 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:58.930785 (+290800us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:58.941069 (+ 10284us) write_op.cc:435] Acquired schema lock
0709 12:23:58.941093 (+    24us) tablet.cc:662] Decoding operations
0709 12:23:59.545975 (+604882us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:59.553206 (+  7231us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:59.577085 (+ 23879us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:23:59.886934 (+309849us) tablet.cc:701] Row locks acquired
0709 12:23:59.886954 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:23:59.887112 (+   158us) write_op.cc:270] Start()
0709 12:23:59.887236 (+   124us) write_op.cc:276] Timestamp: P: 1783599839887063 usec, L: 0
0709 12:23:59.887257 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:23:59.894088 (+  6831us) log.cc:844] Serialized 5231 byte log entry
0709 12:24:01.635964 (+1741876us) op_driver.cc:464] REPLICATION: finished
0709 12:24:02.245486 (+609522us) spinlock_profiling.cc:243] Waited 6.08 ms on lock 0x7b54002e9854. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bddfe28 00007f8f8f81a581 00007f8f8f819d58 00007f8f8f81e9f1 00007f8f8f81e9a9 00007f8f8f81e939 00007f8f8f81e901 00007f8f8f81db2d 0000000000388634 0000000000388479
0709 12:24:02.934585 (+689099us) write_op.cc:301] APPLY: starting
0709 12:24:02.934715 (+   130us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:02.935115 (+   400us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:02.935156 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:03.171048 (+235892us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:03.171427 (+   379us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:24:03.171475 (+    48us) write_op.cc:312] APPLY: finished
0709 12:24:03.171960 (+   485us) log.cc:844] Serialized 95 byte log entry
0709 12:24:03.567906 (+395946us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:03.594880 (+ 26974us) write_op.cc:454] Released schema lock
0709 12:24:03.622266 (+ 27386us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:03.697476 (+ 75210us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:03.702454 (+  4978us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":25396,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":1298263,"apply.run_cpu_time_us":35428,"apply.run_wall_time_us":748269,"num_ops":13,"prepare.queue_time_us":304875,"prepare.run_cpu_time_us":92248,"prepare.run_wall_time_us":3638788,"raft.queue_time_us":44157,"raft.run_cpu_time_us":26988,"raft.run_wall_time_us":485240,"replication_time_us":1748574,"spinlock_wait_cycles":13992192,"thread_start_us":2534501,"threads_started":5,"wal-append.queue_time_us":1946727,"wal-append.run_cpu_time_us":17203,"wal-append.run_wall_time_us":2668666}]]}
I20260709 12:24:11.281008 13277 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:11.281376 13493 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.281689 13400 raft_consensus.cc:697] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:11.283015 11674 raft_consensus.cc:1275] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:11.284019 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:11.286082 12961 consensus_queue.cc:237] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:11.214982 13346 raft_consensus.cc:2749] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:11.258742 13473 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:11.288782 13436 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:11.154572 13405 consensus_queue.cc:1059] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 12:24:11.266734 10881 catalog_manager.cc:5697] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 1 to 2, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 2 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:11.250747 13402 consensus_queue.cc:1059] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:24:11.151113 13444 consensus_queue.cc:260] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:11.303967 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 80394.6us
I20260709 12:24:11.235749 13303 consensus_queue.cc:1048] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:24:11.253285 13476 raft_consensus.cc:2749] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:11.249519 13408 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:11.307152 13485 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:11.281178 13015 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.308394 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:11.310389 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 92137.2us
I20260709 12:24:11.315328 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:11.273375 11673 raft_consensus.cc:1275] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:11.333248 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:11.333503 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:11.326584 11023 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:11.336442 11025 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:11.308084 13406 raft_consensus.cc:2804] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:11.354385 13433 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.307832 13204 raft_consensus.cc:2804] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:11.280469 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:11.344839 11098 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:11.354091 11060 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:24:11.439730 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:11.440142 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:11.440761 11060 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 5.
I20260709 12:24:11.288704 13413 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:11.268759 13490 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 12:24:11.359506 11051 raft_consensus.cc:2393] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 8: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:11.343092 12992 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:11.347610 13272 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.348423 11677 pending_rounds.cc:85] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Aborting all ops after (but not including) 3
I20260709 12:24:11.427970 10981 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 5: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:11.435567 13406 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.434458 11057 raft_consensus.cc:2393] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 7: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:11.490428 13406 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:11.491335 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:24:11.433389 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 97028.4us
I20260709 12:24:11.492188 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:11.493024 10983 raft_consensus.cc:2393] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 5: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:11.423084 10881 catalog_manager.cc:5697] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 3 to 6, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 6 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:11.495127 10881 catalog_manager.cc:5697] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 2 to 5, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 5 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:11.496846 10881 catalog_manager.cc:5697] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 2 to 3, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 3 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:11.447598 13321 consensus_queue.cc:1048] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:24:11.233359 13273 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:11.465567 13412 raft_consensus.cc:2804] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:11.500058 11058 raft_consensus.cc:1275] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:11.501418 11133 raft_consensus.cc:1240] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:24:11.502750 11058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1217) took 1125 ms. Trace:
I20260709 12:24:11.436033 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:11.503165 11058 rpcz_store.cc:276] 0709 12:24:10.377163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.377681 (+   518us) service_pool.cc:224] Handling call
0709 12:24:11.246533 (+868852us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:11.500484 (+253951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.501601 (+  1117us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b54000b72d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:11.502560 (+   959us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b54000b72d0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:11.502686 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2579437696}
W20260709 12:24:11.436199 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 109679us
I20260709 12:24:11.492239 11057 raft_consensus.cc:2393] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 7: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:11.411759 13100 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.513844 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:11.441715 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:11.361017 13508 consensus_queue.cc:1048] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
W20260709 12:24:11.445506 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 100721us
I20260709 12:24:11.545693 10948 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
W20260709 12:24:11.432237 13500 log.cc:927] Time spent T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:24:11.372123 13407 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:11.360185 13475 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:11.410969 13277 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:11.341007 13484 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:11.500257 13412 raft_consensus.cc:697] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 7 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:11.449558 13204 raft_consensus.cc:697] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:11.452065 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:11.452710 13400 consensus_queue.cc:237] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:11.437620 13436 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:11.439222 13405 consensus_queue.cc:1048] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:24:11.360206 13493 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:11.434263 13408 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:11.436834 13015 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:11.410907 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:11.468425 11056 raft_consensus.cc:1275] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:11.480129 13296 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:11.438838 13310 raft_consensus.cc:2804] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:11.440958 13240 raft_consensus.cc:2804] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:11.483525 13434 consensus_queue.cc:260] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:11.486290 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:11.503103 11132 raft_consensus.cc:1240] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:11.504797 11058 raft_consensus.cc:1275] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:11.601055 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:11.601751 11058 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 4.
I20260709 12:24:11.602885 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:11.604152 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:11.536576 11060 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 4.
I20260709 12:24:11.537307 11057 raft_consensus.cc:1240] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:11.537930 10983 raft_consensus.cc:1240] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:11.540948 11133 raft_consensus.cc:1275] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:24:11.543205 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:11.547211 10948 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:11.611985 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 64845.1us
I20260709 12:24:11.613564 10948 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:11.547430 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:11.614450 10980 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:11.547685 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:11.615991 11125 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:11.548386 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:11.617218 11129 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:11.549188 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:11.550290 11131 raft_consensus.cc:1275] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:11.551430 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:11.553725 10975 raft_consensus.cc:1275] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:11.625085 10975 raft_consensus.cc:1275] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:11.545029 11098 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:11.555598 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:11.625962 10976 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:11.362540 13403 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:11.469336 11677 pending_rounds.cc:107] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:24:11.466742 13272 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:11.635398 10982 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:11.351215 13288 consensus_queue.cc:1059] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 12:24:11.445684 13433 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:11.526966 13273 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:11.556211 13164 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:11.557638 13418 raft_consensus.cc:2804] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:11.595371 13310 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.514354 13321 consensus_queue.cc:1048] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:24:11.515517 12675 consensus_queue.cc:1048] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:24:11.525470 13347 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:11.553561 13100 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:11.625988 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 81025.3us
I20260709 12:24:11.630003 10948 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:11.631100 11060 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:11.440492 11059 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
I20260709 12:24:11.640815 10977 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 4.
I20260709 12:24:11.641335 11126 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:24:11.641459 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:11.640697 11133 raft_consensus.cc:1240] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:24:11.565415 13277 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:11.651672 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 240977us
I20260709 12:24:11.513262 13258 consensus_queue.cc:1059] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 12:24:11.609498 13240 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.655738 10976 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:11.640128 11677 raft_consensus.cc:2889] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:11.639798 13257 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:11.635787 13296 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:11.664824 13488 consensus_queue.cc:1048] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:24:11.673115 10980 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:11.655591 13418 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.667441 13310 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:11.670135 11129 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:11.665946 13164 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:11.691170 13251 raft_consensus.cc:2749] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:11.691128 13257 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.673642 11125 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:11.684108 11133 raft_consensus.cc:1275] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:11.679800 11097 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:11.666927 13423 consensus_queue.cc:1048] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
W20260709 12:24:11.794159 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 158041us
I20260709 12:24:11.692750 13296 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.686630 13240 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:11.685431 13406 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:11.747443 13418 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:11.801936 13512 log.cc:927] Time spent T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:24:11.812125 13438 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:11.814954 13339 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
W20260709 12:24:11.817166 13502 log.cc:927] Time spent T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.506s	user 0.003s	sys 0.000s
I20260709 12:24:11.682016 13100 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:11.797420 13257 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:11.890265 11130 raft_consensus.cc:2393] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 6: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:11.750283 13476 consensus_queue.cc:1059] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 12:24:11.821924 13296 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:11.887528 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 212993us
I20260709 12:24:11.685218 13412 consensus_queue.cc:237] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:11.675913 13204 consensus_queue.cc:237] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:11.791493 13475 consensus_queue.cc:1059] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
I20260709 12:24:11.906507 13513 consensus_queue.cc:1059] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
W20260709 12:24:11.940858 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 310905us
W20260709 12:24:11.913973 11643 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.010s	sys 0.026s
W20260709 12:24:11.943064 11643 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.011s	sys 0.026s
W20260709 12:24:11.943416 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 607612us
I20260709 12:24:11.886724 13339 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:11.919517 13408 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:11.922653 13403 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:11.893033 13491 log.cc:927] Time spent T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:24:11.960448 13403 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:11.960631 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:11.961112 13403 raft_consensus.cc:697] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 8 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:11.961371 13505 raft_consensus.cc:3055] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:11.961807 13505 raft_consensus.cc:740] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:11.962203 13403 consensus_queue.cc:237] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:11.949944 13288 consensus_queue.cc:1048] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:24:11.951912 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 267119us
I20260709 12:24:11.954896 11643 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:11.959300 13408 raft_consensus.cc:2804] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:11.967139 11643 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:11.968600 11643 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:11.937436 13164 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:11.988057 11643 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:11.939100 13484 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:11.986248 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:11.990495 11643 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:11.971542 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:11.996197 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:11.998387 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:11.999315 10980 raft_consensus.cc:1240] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:12.000065 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:12.000514 10976 raft_consensus.cc:1240] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:12.001003 11025 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:12.001680 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:12.002542 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:12.004168 11025 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:11.968017 13493 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:11.931985 13272 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:24:11.963893 13375 consensus_queue.cc:1048] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.081s
W20260709 12:24:12.222610 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 542805us
I20260709 12:24:12.018460 10975 raft_consensus.cc:2393] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 7: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
W20260709 12:24:12.076063 10979 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.002s	sys 0.009s
I20260709 12:24:12.037613 11023 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:12.159337 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 261273us
I20260709 12:24:11.968485 13408 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.987967 13526 raft_consensus.cc:2749] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:12.018379 13273 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.236295 13408 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:12.176573 13479 log.cc:927] Time spent T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:24:11.997000 13516 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:12.237183 11057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1547) took 1073 ms. Trace:
I20260709 12:24:12.249682 11057 rpcz_store.cc:276] 0709 12:24:11.163264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.628424 (+465160us) service_pool.cc:224] Handling call
0709 12:24:11.628754 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:11.642131 (+ 13377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:11.642167 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:11.642686 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 12:24:11.834305 (+191619us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:11.834349 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.834420 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:11.916828 (+ 82408us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b48001f0158. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f90d0daa1 00007f8f90d04b37 00007f8f90d049ca 00007f8f90dfc26f 00007f8f90dfbf37 00007f8f90e1055c 00007f8f90e10508 00007f8f90e10488 00007f8f90e10443 00007f8f90e0f6ec 00007f8f8fd39a96
0709 12:24:12.226358 (+309530us) raft_consensus.cc:1685] finished
0709 12:24:12.226383 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:12.237101 (+ 10718us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12919,"raft.queue_time_us":36304,"raft.run_cpu_time_us":1905,"raft.run_wall_time_us":244467,"spinlock_wait_cycles":6291712,"thread_start_us":191218,"threads_started":1,"wal-append.queue_time_us":446869}
W20260709 12:24:12.095163 12992 consensus_meta.cc:287] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.626s	user 0.004s	sys 0.004s
W20260709 12:24:12.214502 13517 log.cc:927] Time spent T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 12:24:12.230731 13241 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:12.213371 13523 raft_consensus.cc:2749] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:11.992471 13508 raft_consensus.cc:2804] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:11.999231 13475 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.019804 13258 raft_consensus.cc:2804] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:11.999070 13433 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:12.043958 13303 consensus_queue.cc:1048] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.193s
I20260709 12:24:12.093389 13347 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:12.179574 13406 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:12.044545 13488 raft_consensus.cc:2804] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:12.044840 13525 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.178898 13277 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:12.237968 13518 raft_consensus.cc:2749] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:12.227540 13436 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:12.114362 13514 consensus_queue.cc:1048] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.134s
W20260709 12:24:12.295012 13537 log.cc:927] Time spent T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:24:12.290736 13258 raft_consensus.cc:697] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:12.256150 13241 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:12.051811 13438 consensus_queue.cc:1059] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.203s
I20260709 12:24:12.052088 13301 consensus_queue.cc:1048] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.206s
I20260709 12:24:12.241933 13541 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.244481 13273 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:12.273898 13516 raft_consensus.cc:697] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:12.256808 13410 consensus_queue.cc:1048] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
W20260709 12:24:12.239368 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 201824us
I20260709 12:24:12.254202 11097 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:12.290736 13347 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.620432 13347 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:12.622599 13321 consensus_queue.cc:1048] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:12.537158 11673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41784 (request call id 518) took 1511 ms. Trace:
W20260709 12:24:12.623562 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 369356us
I20260709 12:24:12.469589 11051 raft_consensus.cc:2393] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 6: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:12.631210 13346 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.631341 13272 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:12.632210 13346 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:12.636179 13346 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:12.638448 13346 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.639647 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:12.641045 11057 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:12.639817 13346 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:12.622946 13301 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:12.495858 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58414 (request call id 318) took 1187 ms. Trace:
I20260709 12:24:12.469869 11058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1549) took 1305 ms. Trace:
I20260709 12:24:12.540172 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:12.682806 13444 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:12.683034 11672 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 4.
W20260709 12:24:12.445904 10977 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 285) took 1206 ms (client timeout 1593 ms). Trace:
W20260709 12:24:12.354858 13473 consensus_meta.cc:287] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.917s	user 0.010s	sys 0.003s
I20260709 12:24:12.399991 13485 raft_consensus.cc:3055] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:12.684592 13485 raft_consensus.cc:740] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:12.659368 11130 rpcz_store.cc:276] 0709 12:24:11.307891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.308127 (+   236us) service_pool.cc:224] Handling call
0709 12:24:12.495278 (+1187151us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b5400107054. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:12.495598 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1062341504}
I20260709 12:24:12.275892 13508 raft_consensus.cc:697] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:12.266764 12992 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:12.546849 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:12.539131 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:12.685216 10977 rpcz_store.cc:269] 0709 12:24:11.239322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.239469 (+   147us) service_pool.cc:224] Handling call
0709 12:24:12.445199 (+1205730us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b540035f054. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:12.445542 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":740790144}
W20260709 12:24:12.401176 13499 log.cc:927] Time spent T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 1.091s	user 0.000s	sys 0.004s
I20260709 12:24:12.679270 11058 rpcz_store.cc:276] 0709 12:24:11.163729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.660801 (+497072us) service_pool.cc:224] Handling call
0709 12:24:11.661190 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:11.676576 (+ 15386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:11.676610 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:11.679464 (+  2854us) log.cc:844] Serialized 26 byte log entry
0709 12:24:11.891982 (+212518us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:11.898657 (+  6675us) log.cc:844] Serialized 14 byte log entry
0709 12:24:11.910078 (+ 11421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.910194 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:12.469160 (+558966us) raft_consensus.cc:1685] finished
0709 12:24:12.469204 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:12.469574 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20579,"prepare.queue_time_us":227,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":40798,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":49266,"thread_start_us":212176,"threads_started":1,"wal-append.queue_time_us":434171}
I20260709 12:24:12.690853 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:12.355547 13406 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.694427 13436 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.694598 13549 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:12.695873 13273 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:12.696631 13562 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:12.683760 13410 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:12.591193 13277 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:12.683334 11676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41784 (request call id 520) took 1385 ms. Trace:
I20260709 12:24:12.693836 12992 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:12.686655 13485 consensus_queue.cc:260] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:12.714138 13562 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:12.718551 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:12.719949 11675 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:12.394476 13547 log.cc:927] Time spent T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:24:12.725641 13277 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:12.744820 11058 raft_consensus.cc:1275] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:24:12.745371 11058 pending_rounds.cc:85] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting all ops after (but not including) 3
I20260709 12:24:12.745631 11058 pending_rounds.cc:107] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:24:12.727612 13335 raft_consensus.cc:3055] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:12.729002 13508 consensus_queue.cc:237] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:12.727820 13549 consensus_queue.cc:1243] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [LEADER]: Peer c979ef00e0ad4157b49ebbdc13ce7cd7 log is divergent from this leader: its last log entry 1.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:24:12.746124 13277 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:12.746930 13277 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.398362 13490 raft_consensus.cc:3055] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:12.747671 13277 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:12.748134 13490 raft_consensus.cc:740] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:12.707048 13301 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:12.749585 13490 consensus_queue.cc:260] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:12.751829 13301 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:12.738495 13473 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:12.742314 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1810) took 1189 ms. Trace:
I20260709 12:24:12.753549 13493 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:12.753863 11127 rpcz_store.cc:276] 0709 12:24:11.552719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.564122 (+ 11403us) service_pool.cc:224] Handling call
0709 12:24:11.564430 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:11.564790 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:11.820893 (+256103us) log.cc:844] Serialized 14 byte log entry
0709 12:24:12.165580 (+344687us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:12.220819 (+ 55239us) log.cc:844] Serialized 26 byte log entry
0709 12:24:12.221664 (+   845us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:12.221708 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.221914 (+   206us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:12.741706 (+519792us) raft_consensus.cc:1685] finished
0709 12:24:12.741753 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:12.742027 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76408,"prepare.queue_time_us":25009,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":118494,"raft.run_cpu_time_us":2174,"raft.run_wall_time_us":44080,"thread_start_us":575369,"threads_started":2,"wal-append.queue_time_us":450098}
I20260709 12:24:12.755486 13335 raft_consensus.cc:740] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:12.624073 11673 rpcz_store.cc:276] 0709 12:24:11.025465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.025580 (+   115us) service_pool.cc:224] Handling call
0709 12:24:11.025899 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:11.436260 (+410361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.536510 (+1100250us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b54005fffd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:12.536942 (+   432us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":568093568}
I20260709 12:24:12.682751 13241 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:12.826488 12675 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.763378 13541 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:12.397673 13505 consensus_queue.cc:260] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:12.752240 13490 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:12.274899 13475 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:12.327126 13418 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:12.326771 13525 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:12.773236 13436 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:12.332631 13488 raft_consensus.cc:697] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:24:12.825685 13310 consensus_meta.cc:287] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 1.033s	user 0.010s	sys 0.005s
I20260709 12:24:12.767783 13258 consensus_queue.cc:237] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:12.361876 13445 consensus_queue.cc:260] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:12.395406 13506 raft_consensus.cc:3055] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:12.758877 11681 raft_consensus.cc:2393] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 7: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:12.769692 13516 consensus_queue.cc:237] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:12.747586 13549 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
W20260709 12:24:12.727463 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:12.745914 11058 raft_consensus.cc:2889] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:12.735857 13346 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:12.760664 13406 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:12.826985 13438 consensus_queue.cc:1048] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:24:12.820583 13335 consensus_queue.cc:260] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:12.861832 10982 raft_consensus.cc:2393] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 6: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:12.849098 12675 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:12.853434 11057 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:12.716256 13410 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
W20260709 12:24:12.860435 13240 consensus_meta.cc:287] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.987s	user 0.010s	sys 0.014s
I20260709 12:24:12.863350 13488 consensus_queue.cc:237] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:12.864886 13506 raft_consensus.cc:740] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:12.865324 13525 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:12.859458 13535 log.cc:927] Time spent T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:24:12.866675 13310 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:12.869431 13410 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:12.866434 13549 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:12.861881 13436 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:12.887996 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:12.859091 13273 raft_consensus.cc:3055] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:24:12.887553 10984 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.899s	user 0.013s	sys 0.032s
W20260709 12:24:12.911708 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 198189us
I20260709 12:24:12.893831 13273 raft_consensus.cc:740] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:12.876199 13240 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:12.939496 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 231832us
I20260709 12:24:12.888051 13525 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:12.975121 10984 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.013s	sys 0.032s
W20260709 12:24:12.974844 11643 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.910s	user 0.008s	sys 0.053s
W20260709 12:24:12.977768 11643 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.009s	sys 0.053s
I20260709 12:24:12.978186 13485 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:12.979264 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 988755us
I20260709 12:24:12.980448 11643 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:12.981515 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:12.981989 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:12.982702 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:12.983327 10983 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.857s	user 0.015s	sys 0.045s
I20260709 12:24:12.983173 13438 consensus_queue.cc:1059] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:24:12.983734 10983 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.938s	user 0.016s	sys 0.045s
I20260709 12:24:12.972782 11058 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:12.983011 10980 raft_consensus.cc:2393] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 6: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:12.987779 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:12.988349 12675 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:12.989416 13493 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.980890 13015 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:12.990334 11131 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.017s	user 0.006s	sys 0.026s
I20260709 12:24:12.989349 12992 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:12.990758 11131 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.102s	user 0.006s	sys 0.026s
I20260709 12:24:12.988714 11054 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:12.991258 13406 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:12.990145 13493 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:12.992118 13403 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.030s	sys 0.077s
W20260709 12:24:12.989578 11126 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.868s	user 0.035s	sys 0.037s
I20260709 12:24:12.991791 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1813) took 1434 ms. Trace:
W20260709 12:24:12.992906 11126 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.035s	sys 0.037s
I20260709 12:24:12.988008 13273 consensus_queue.cc:260] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:12.901868 13436 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:12.992527 13403 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.030s	sys 0.077s
I20260709 12:24:12.989919 10977 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:13.007264 13560 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.008062 13560 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:12.993149 11131 rpcz_store.cc:276] 0709 12:24:11.557329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.622840 (+ 65511us) service_pool.cc:224] Handling call
0709 12:24:11.623182 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:11.623405 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:11.842767 (+219362us) log.cc:844] Serialized 14 byte log entry
0709 12:24:12.991237 (+1148470us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:12.991371 (+   134us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:12.991475 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.991577 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:12.991731 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67423,"prepare.queue_time_us":212785,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":398204,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":19971,"thread_start_us":1273650,"threads_started":2}
I20260709 12:24:13.010848 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:13.011744 10980 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
W20260709 12:24:13.012133 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:13.012704 13505 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:13.013424 10976 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.013s	sys 0.018s
I20260709 12:24:13.005378 13436 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:12.993393 13335 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:13.027557 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1844) took 1459 ms. Trace:
W20260709 12:24:13.014317 13257 consensus_meta.cc:287] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.978s	user 0.016s	sys 0.001s
W20260709 12:24:13.014271 10979 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.022s	sys 0.011s
W20260709 12:24:13.030228 10976 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.011s	user 0.013s	sys 0.018s
W20260709 12:24:13.030542 13412 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.002s	sys 0.043s
W20260709 12:24:13.011929 13306 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.019s	sys 0.022s
I20260709 12:24:13.003822 11057 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:24:13.032060 10981 rpcz_store.cc:276] 0709 12:24:11.539318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.539488 (+   170us) service_pool.cc:224] Handling call
0709 12:24:11.539786 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:11.540026 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:11.682728 (+142702us) log.cc:844] Serialized 14 byte log entry
0709 12:24:12.457068 (+774340us) log.cc:844] Serialized 14 byte log entry
0709 12:24:12.905841 (+448773us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:12.908719 (+  2878us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:12.908904 (+   185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.966498 (+ 57594us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:12.999053 (+ 32555us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":119998,"prepare.queue_time_us":387664,"prepare.run_cpu_time_us":213,"prepare.run_wall_time_us":24767,"raft.queue_time_us":795417,"raft.run_cpu_time_us":403,"raft.run_wall_time_us":7246,"thread_start_us":1302620,"threads_started":4,"wal-append.queue_time_us":590103}
I20260709 12:24:13.215682 11054 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
W20260709 12:24:13.275574 11098 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.003s	sys 0.018s
I20260709 12:24:13.074321 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:13.082322 10975 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:13.082847 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 102594us
I20260709 12:24:13.359478 11057 raft_consensus.cc:606] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:24:13.359953 11057 raft_consensus.cc:614] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:24:13.333703 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:13.091485 13408 consensus_meta.cc:287] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.835s	user 0.006s	sys 0.007s
I20260709 12:24:13.037292 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1852) took 1048 ms. Trace:
I20260709 12:24:13.031450 13541 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:13.029413 13347 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:13.366446 13339 consensus_meta.cc:287] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 1.400s	user 0.000s	sys 0.016s
I20260709 12:24:12.716351 11676 rpcz_store.cc:276] 0709 12:24:11.297607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.817642 (+520035us) service_pool.cc:224] Handling call
0709 12:24:11.818017 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:11.818496 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:11.818536 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:11.819101 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 12:24:12.229697 (+410596us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:12.233264 (+  3567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.237549 (+  4285us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:12.682810 (+445261us) raft_consensus.cc:1685] finished
0709 12:24:12.682868 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:12.683144 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22288,"raft.queue_time_us":52238,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":5009,"thread_start_us":338585,"threads_started":1,"wal-append.queue_time_us":436291}
W20260709 12:24:13.368827 11098 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.114s	user 0.010s	sys 0.021s
I20260709 12:24:13.307948 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:13.383488 11052 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
I20260709 12:24:13.383639 13560 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:13.084417 13164 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:13.377763 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 320) took 1379 ms. Trace:
I20260709 12:24:13.385649 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:13.385830 13335 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:13.385985 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:13.386740 11130 raft_consensus.cc:2410] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:13.386535 13335 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:13.387432 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:13.386755 11127 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:13.389640 11132 raft_consensus.cc:2393] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 6: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:13.081178 11023 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:13.084193 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1845) took 1543 ms. Trace:
W20260709 12:24:13.337539 13444 consensus_meta.cc:287] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.654s	user 0.011s	sys 0.004s
I20260709 12:24:13.100922 13241 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:13.398864 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:13.399358 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:13.399528 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:13.088683 11675 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
I20260709 12:24:13.083142 11097 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:13.400398 11125 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 4.
I20260709 12:24:13.101677 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:13.399884 11130 raft_consensus.cc:2393] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 6: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:24:13.074816 13296 consensus_meta.cc:287] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 1.138s	user 0.010s	sys 0.009s
I20260709 12:24:13.105366 13273 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:13.405153 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:13.382125 10979 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.157s	user 0.025s	sys 0.028s
I20260709 12:24:13.413195 10977 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 2.
I20260709 12:24:13.107029 13310 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:13.418089 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 336954us
I20260709 12:24:13.103983 13277 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:13.106163 13418 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:13.373238 13412 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.108s	user 0.010s	sys 0.055s
I20260709 12:24:13.099499 13549 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:13.308224 13542 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:13.394580 13403 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.103264 13473 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:13.370245 10978 rpcz_store.cc:276] 0709 12:24:11.979871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.980056 (+   185us) service_pool.cc:224] Handling call
0709 12:24:11.980405 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:11.980639 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:12.003631 (+ 22992us) log.cc:844] Serialized 14 byte log entry
0709 12:24:12.454563 (+450932us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b18003c2560. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88c71c0a 00007f8f923b1219 00007f8f88cf9a40 00007f8f88cf44e4 00007f8f88cf4455 00007f8f8f7dc3c7 00007f8f8bdee9a7 00007f8f8bdfe0bf 00007f8f8bdfe038
0709 12:24:12.455066 (+   503us) log.cc:844] Serialized 14 byte log entry
0709 12:24:12.898492 (+443426us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:12.928782 (+ 30290us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:12.972481 (+ 43699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.985273 (+ 12792us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:13.028527 (+ 43254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":579483,"prepare.queue_time_us":739570,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":103,"raft.queue_time_us":778571,"raft.run_cpu_time_us":413,"raft.run_wall_time_us":119772,"spinlock_wait_cycles":64123136,"thread_start_us":438409,"threads_started":1}
I20260709 12:24:13.389117 13568 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
W20260709 12:24:13.391636 13306 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.212s	user 0.019s	sys 0.030s
I20260709 12:24:13.385032 11126 rpcz_store.cc:276] 0709 12:24:11.989080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.989251 (+   171us) service_pool.cc:224] Handling call
0709 12:24:11.989580 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:11.998212 (+  8632us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:11.998242 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:11.998745 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 12:24:13.028414 (+1029669us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:13.083294 (+ 54880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:13.083431 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:13.368050 (+284619us) raft_consensus.cc:1685] finished
0709 12:24:13.368071 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:13.368319 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35351,"raft.queue_time_us":275460,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":21222,"thread_start_us":897327,"threads_started":1,"wal-append.queue_time_us":1313731}
I20260709 12:24:13.071250 13100 raft_consensus.cc:3055] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:13.090265 13525 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:13.445747 13335 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:13.391140 10984 rpcz_store.cc:276] 0709 12:24:11.541096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.541258 (+   162us) service_pool.cc:224] Handling call
0709 12:24:11.563955 (+ 22697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:11.564160 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:24:11.987844 (+423684us) log.cc:844] Serialized 14 byte log entry
0709 12:24:13.083527 (+1095683us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:13.083646 (+   119us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:13.083745 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:13.083860 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:13.084110 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8767,"prepare.queue_time_us":118236,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":27,"raft.queue_time_us":51935,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":61,"thread_start_us":1376141,"threads_started":2,"wal-append.queue_time_us":1376169}
I20260709 12:24:13.475281 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:13.375349 13257 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:13.522308 11643 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:13.414494 13321 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:13.469692 13100 raft_consensus.cc:740] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:13.085389 13506 consensus_queue.cc:260] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:13.540335 11057 raft_consensus.cc:1240] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:13.539176 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:13.525409 12992 consensus_meta.cc:287] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.534s	user 0.012s	sys 0.000s
I20260709 12:24:13.392210 13339 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:13.491557 13240 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:13.484059 13444 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:13.384925 13164 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:13.466394 13296 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:13.510669 13407 raft_consensus.cc:2804] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:24:13.552155 10948 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.002s	sys 0.031s
W20260709 12:24:13.564183 10948 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.002s	sys 0.031s
I20260709 12:24:13.535452 13436 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:13.560410 10981 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:13.561331 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 554891us
I20260709 12:24:13.525171 13493 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:13.544939 13562 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:13.510838 13475 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:13.569501 11134 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.137s	user 0.021s	sys 0.027s
I20260709 12:24:13.577103 10978 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
W20260709 12:24:13.581910 11134 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.327s	user 0.022s	sys 0.027s
I20260709 12:24:13.559604 13241 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:13.584200 10949 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.014s	sys 0.026s
I20260709 12:24:13.465885 13403 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:13.663147 11055 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.006s	sys 0.066s
I20260709 12:24:13.608093 13228 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:13.664942 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:13.921121 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:13.921784 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:13.922437 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:13.566800 13568 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:13.664090 13375 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:24:13.663477 11677 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.941s	user 0.032s	sys 0.126s
I20260709 12:24:13.635675 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:13.687295 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:13.799077 11645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.739s	user 0.032s	sys 0.051s
I20260709 12:24:13.673420 13100 consensus_queue.cc:260] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:13.664666 13400 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.031s	sys 0.092s
W20260709 12:24:13.568912 13204 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.798s	user 0.009s	sys 0.019s
W20260709 12:24:13.663803 11099 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.622s	user 0.011s	sys 0.036s
I20260709 12:24:13.665401 13538 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:13.664439 11678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.011s	sys 0.048s
I20260709 12:24:13.580698 13321 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:13.416656 13408 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:13.642745 13542 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:13.654748 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 219849us
I20260709 12:24:13.665120 13532 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:13.584503 13530 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.608047 11052 raft_consensus.cc:1275] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:24:13.614609 13444 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:13.547529 13438 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:24:13.558220 12992 raft_consensus.cc:2749] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:13.917299 11055 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.064s	user 0.006s	sys 0.091s
W20260709 12:24:13.865279 10983 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.031s	sys 0.025s
W20260709 12:24:13.916539 10949 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.292s	user 0.014s	sys 0.035s
W20260709 12:24:13.927779 13485 consensus_meta.cc:287] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.949s	user 0.008s	sys 0.015s
W20260709 12:24:13.969084 10983 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.938s	user 0.032s	sys 0.025s
W20260709 12:24:13.953809 13204 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.361s	user 0.015s	sys 0.022s
W20260709 12:24:13.945745 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:13.946377 11645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.886s	user 0.033s	sys 0.061s
W20260709 12:24:13.947708 10980 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.028s	sys 0.042s
I20260709 12:24:13.950671 11056 raft_consensus.cc:2393] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 7: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:24:13.930215 11677 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.381s	user 0.046s	sys 0.136s
W20260709 12:24:13.976754 10980 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.030s	sys 0.042s
W20260709 12:24:13.953187 11678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.246s	user 0.013s	sys 0.054s
I20260709 12:24:13.954154 13412 consensus_queue.cc:1048] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:13.924559 13228 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
W20260709 12:24:13.958679 11099 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.070s	user 0.011s	sys 0.043s
W20260709 12:24:13.945312 13400 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.301s	user 0.031s	sys 0.100s
W20260709 12:24:13.944620 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 482304us
I20260709 12:24:13.968215 11129 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 5.
I20260709 12:24:13.981208 11055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1238) took 1126 ms. Trace:
W20260709 12:24:13.981663 13338 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.200s	user 0.018s	sys 0.094s
I20260709 12:24:13.981978 13416 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.960809 11052 pending_rounds.cc:85] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting all ops after (but not including) 6
I20260709 12:24:13.962689 13560 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.993880 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:13.994525 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 446676us
I20260709 12:24:13.998803 13573 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.961352 13532 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:13.999315 11059 pending_rounds.cc:85] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting all ops after (but not including) 2
I20260709 12:24:14.000200 11097 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:14.006630 10975 consensus_meta.cc:287] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.628s	user 0.007s	sys 0.003s
I20260709 12:24:14.012099 10975 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
W20260709 12:24:14.012745 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:13.987154 13338 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.258s	user 0.018s	sys 0.094s
I20260709 12:24:14.018183 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1860) took 1031 ms. Trace:
I20260709 12:24:13.988070 13228 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:13.983318 13506 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:14.019090 11681 raft_consensus.cc:2393] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 6: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:13.984512 11055 rpcz_store.cc:276] 0709 12:24:12.849334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.849589 (+   255us) service_pool.cc:224] Handling call
0709 12:24:12.850045 (+   456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:12.850487 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:12.852373 (+  1886us) log.cc:844] Serialized 14 byte log entry
0709 12:24:13.971038 (+1118665us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:13.971106 (+    68us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:13.971162 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:13.971225 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:13.971361 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":225,"prepare.queue_time_us":3692,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":68,"raft.queue_time_us":3072,"thread_start_us":1115461,"threads_started":1}
I20260709 12:24:14.019515 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1812) took 2457 ms. Trace:
I20260709 12:24:14.008909 11052 pending_rounds.cc:107] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:24:14.024665 10975 rpcz_store.cc:276] 0709 12:24:12.980803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.982271 (+  1468us) service_pool.cc:224] Handling call
0709 12:24:14.012521 (+1030250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:14.028313 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:14.010565 11059 pending_rounds.cc:107] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 12:24:14.033082 11059 raft_consensus.cc:2917] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 12:24:14.033663 11059 raft_consensus.cc:2889] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:14.033965 13560 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:14.035409 13164 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:14.036410 13560 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:14.031051 11127 consensus_meta.cc:287] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.643s	user 0.009s	sys 0.002s
I20260709 12:24:14.038338 11127 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:14.024315 11645 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:14.003551 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:14.013955 13532 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:14.030731 13257 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:14.032416 11134 rpcz_store.cc:276] 0709 12:24:11.557088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.621040 (+ 63952us) service_pool.cc:224] Handling call
0709 12:24:11.621423 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:11.621667 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:11.925993 (+304326us) spinlock_profiling.cc:243] Waited 911 us on lock 0x7b1800300e80. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f8b98c4bc 00007f8f88cda48b 00007f8f91b349a9 00007f8f88cf669b 00007f8f88cf493f 00007f8f88cf4455 00007f8f8f7dc3c7 00007f8f8bdee9a7 00007f8f8bdfe0bf
0709 12:24:11.926168 (+   175us) log.cc:844] Serialized 14 byte log entry
0709 12:24:12.410848 (+484680us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b1800300e80. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cc52a6 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cf73f3 00007f8f88cf97c1
0709 12:24:13.924219 (+1513371us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:13.951604 (+ 27385us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:13.959886 (+  8282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:13.971515 (+ 11629us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:14.014343 (+ 42828us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17665,"prepare.queue_time_us":171997,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":119627,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":6864,"spinlock_wait_cycles":5819264,"thread_start_us":1777771,"threads_started":3,"wal-append.queue_time_us":452286,"wal-append.run_cpu_time_us":1274,"wal-append.run_wall_time_us":1071168}
I20260709 12:24:14.044724 13445 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:14.046723 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:14.047556 11060 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
I20260709 12:24:14.048645 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:14.049405 13565 raft_consensus.cc:2749] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:14.053450 10981 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:14.029135 13573 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:14.059973 10949 connection.cc:256] RPC call timeout handler was delayed by -1.2236179739998079s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
W20260709 12:24:14.060460 10949 connection.cc:256] RPC call timeout handler was delayed by -1.1776316869995753s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1593s for a response
W20260709 12:24:14.061035 10949 connection.cc:256] RPC call timeout handler was delayed by -1.0319179739999527s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19110000000000002s for a response
W20260709 12:24:14.061789 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 93855.1us
I20260709 12:24:14.038134 13339 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:14.062968 13257 consensus_queue.cc:1048] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:14.030439 13416 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:14.065424 13257 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:14.067087 13565 consensus_queue.cc:1048] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:14.067831 12992 consensus_queue.cc:1059] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:14.043048 13296 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:14.057982 13573 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:14.037503 11052 raft_consensus.cc:2889] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:14.074784 11643 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:14.075703 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:14.075899 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 75690.1us
I20260709 12:24:14.077580 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:14.049702 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:14.078007 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 53793.7us
I20260709 12:24:14.082401 13485 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:14.082916 13485 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:14.083284 13485 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:14.084424 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:14.079890 13410 consensus_meta.cc:287] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 1.171s	user 0.015s	sys 0.020s
I20260709 12:24:14.055755 11128 raft_consensus.cc:1240] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:14.079960 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.086615 13410 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:14.087981 13568 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:14.089263 13410 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:14.093950 11010 heartbeater.cc:646] Failed to heartbeat to 127.9.145.254:35687 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.9.145.254:35687 timed out after 15.000s (SENT)
I20260709 12:24:14.095727 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:14.096717 11055 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 2.
I20260709 12:24:14.098269 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:14.099606 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:24:14.099943 13490 consensus_meta.cc:287] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 1.245s	user 0.006s	sys 0.005s
I20260709 12:24:13.992534 13538 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:14.070178 11097 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:14.102576 13505 consensus_meta.cc:287] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 1.089s	user 0.013s	sys 0.000s
W20260709 12:24:14.077189 11058 consensus_meta.cc:287] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 1.062s	user 0.004s	sys 0.004s
I20260709 12:24:13.970520 13530 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:14.105751 11678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41774 (request call id 433) took 1564 ms. Trace:
I20260709 12:24:14.109894 11058 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
I20260709 12:24:14.117506 13375 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.080349 13573 raft_consensus.cc:2749] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:14.113716 13273 consensus_meta.cc:287] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.653s	user 0.009s	sys 0.002s
W20260709 12:24:14.115948 13306 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.027s	sys 0.037s
I20260709 12:24:14.119134 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:14.120265 11060 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:14.124818 11058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41294 (request call id 1239) took 1251 ms. Trace:
I20260709 12:24:14.109495 13164 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.104045 13100 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:14.117646 13403 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:14.128582 11058 rpcz_store.cc:276] 0709 12:24:12.869395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.869541 (+   146us) service_pool.cc:224] Handling call
0709 12:24:14.120311 (+1250770us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:14.118676 11678 rpcz_store.cc:276] 0709 12:24:12.541179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.546309 (+  5130us) service_pool.cc:224] Handling call
0709 12:24:12.620003 (+ 73694us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:12.626849 (+  6846us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:12.626886 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:12.707028 (+ 80142us) log.cc:844] Serialized 26 byte log entry
0709 12:24:13.986379 (+1279351us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:13.986422 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:13.986495 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:14.103999 (+117504us) raft_consensus.cc:1685] finished
0709 12:24:14.104023 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:14.105668 (+  1645us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17990,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":377,"thread_start_us":1269879,"threads_started":1,"wal-append.queue_time_us":1357615}
I20260709 12:24:14.125972 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:14.111726 13296 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.175355 11056 raft_consensus.cc:2410] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:14.172645 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:14.172315 11058 raft_consensus.cc:1240] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:14.126312 13418 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:24:14.170619 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 100587us
I20260709 12:24:14.164681 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:14.179826 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1849) took 2625 ms. Trace:
I20260709 12:24:14.188596 13416 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:14.188975 10948 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:24:14.168772 13533 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.014s	sys 0.047s
I20260709 12:24:14.170513 11052 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:14.197420 13542 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:14.174360 13493 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.168978 13338 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.189518 13485 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:14.127718 13375 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:14.217859 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:14.171164 13410 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:14.229737 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:14.228636 11674 raft_consensus.cc:2410] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:24:14.234438 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:14.229174 13444 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:14.192195 10979 rpcz_store.cc:276] 0709 12:24:11.549912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.550042 (+   130us) service_pool.cc:224] Handling call
0709 12:24:11.550397 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:11.550648 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:12.224750 (+674102us) log.cc:844] Serialized 14 byte log entry
0709 12:24:14.024194 (+1799444us) log.cc:844] Serialized 14 byte log entry
0709 12:24:14.042337 (+ 18143us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:14.104718 (+ 62381us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:14.115251 (+ 10533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:14.125999 (+ 10748us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:14.174819 (+ 48820us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44618,"prepare.queue_time_us":809000,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":70,"raft.queue_time_us":25914,"raft.run_cpu_time_us":481,"raft.run_wall_time_us":69804,"thread_start_us":2338721,"threads_started":3,"wal-append.queue_time_us":1141851}
W20260709 12:24:14.198961 13533 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.015s	sys 0.047s
I20260709 12:24:14.228502 13577 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.236340 13475 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.170404 13164 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:14.242396 11681 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:14.242985 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 54115.1us
I20260709 12:24:14.258229 13505 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:14.263440 13473 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.264008 13473 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:14.263470 13584 log.cc:927] Time spent T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:24:14.266574 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:14.267872 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1863) took 1285 ms. Trace:
I20260709 12:24:14.263188 13505 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:14.269590 11672 raft_consensus.cc:1240] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:14.268152 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:14.273092 11679 raft_consensus.cc:2410] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:14.229750 13408 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:14.258303 10948 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:14.268803 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:14.262658 13573 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.226505 13418 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:14.238678 13296 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:14.268323 10980 rpcz_store.cc:276] 0709 12:24:12.986917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.012498 (+ 25581us) service_pool.cc:224] Handling call
0709 12:24:13.012881 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:13.013308 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:13.013334 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:13.352687 (+339353us) log.cc:844] Serialized 26 byte log entry
0709 12:24:13.977259 (+624572us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:13.977303 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:13.977372 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:14.267595 (+290223us) raft_consensus.cc:1685] finished
0709 12:24:14.267618 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:14.267784 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":66365,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":75,"thread_start_us":624038,"threads_started":1,"wal-append.queue_time_us":772169}
I20260709 12:24:14.258085 13542 consensus_queue.cc:1048] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:24:14.260454 13339 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.257105 13538 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:14.301527 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 380316us
W20260709 12:24:14.303086 10982 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1853) took 2310 ms (client timeout 1541 ms). Trace:
I20260709 12:24:14.241848 13338 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:14.249830 13493 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:14.257853 13475 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:14.354215 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:14.311007 10982 rpcz_store.cc:269] 0709 12:24:11.985769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.985925 (+   156us) service_pool.cc:224] Handling call
0709 12:24:14.279326 (+2293401us) spinlock_profiling.cc:243] Waited 858 ms on lock 0x7b5400333e54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:14.296341 (+ 17015us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1973753216}
W20260709 12:24:14.362067 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 57388.4us
W20260709 12:24:14.367738 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 64103.4us
I20260709 12:24:14.286279 13577 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:14.377882 11097 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
W20260709 12:24:14.379298 13587 log.cc:927] Time spent T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:24:14.382368 13403 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:14.383527 13570 log.cc:927] Time spent T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.736s	user 0.010s	sys 0.017s
I20260709 12:24:14.384471 13339 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:14.375075 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.352061 13473 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:14.353680 13538 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:14.301580 13560 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:14.386993 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 320402us
I20260709 12:24:14.291303 13410 consensus_queue.cc:1048] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.083s
W20260709 12:24:14.389942 11051 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1551) took 3202 ms (client timeout 3022 ms). Trace:
I20260709 12:24:14.368572 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:14.397670 11051 rpcz_store.cc:269] 0709 12:24:11.164196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.451760 (+287564us) service_pool.cc:224] Handling call
0709 12:24:14.352631 (+2900871us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b54002cd654. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:14.366733 (+ 14102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1549119872}
I20260709 12:24:14.353062 13573 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:14.402184 11681 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:14.367528 13257 consensus_queue.cc:1048] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:24:14.393031 13530 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:14.415251 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:14.416129 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:14.423560 13508 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.017s	sys 0.011s
I20260709 12:24:14.414336 11674 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:14.402869 13538 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:14.442494 13508 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.017s	sys 0.011s
I20260709 12:24:14.466840 13475 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:14.467028 13485 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:14.436630 13575 raft_consensus.cc:2804] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:14.445322 13488 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:14.471894 11681 raft_consensus.cc:1275] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:14.439061 13530 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:14.471158 13575 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
W20260709 12:24:14.482182 11024 leader_election.cc:336] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Timed out: RequestConsensusVote RPC to 127.9.145.196:42197 timed out after 1.718s (SENT)
I20260709 12:24:14.485092 13204 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:14.486760 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.494679 11676 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:14.496078 11680 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:14.498298 13228 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:14.499106 13532 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:14.507504 13475 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.508288 13272 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.509789 11051 raft_consensus.cc:1240] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:14.509918 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:14.510082 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:24:14.512188 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 272748us
I20260709 12:24:14.517014 11060 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
I20260709 12:24:14.457038 13568 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.496235 13296 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:14.466899 13164 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:14.511650 13475 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:14.530843 11058 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2205be6a7c94913a366d683de188a31"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:24:14.473071 13306 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:14.512349 13339 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:14.536594 11056 raft_consensus.cc:2393] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 7: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:14.537827 11055 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:14.537510 11058 raft_consensus.cc:606] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
W20260709 12:24:14.550190 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.517613 13575 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:14.516384 11052 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:14.485903 13204 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:14.560642 13577 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:14.562767 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1868) took 1467 ms. Trace:
I20260709 12:24:14.563186 10984 rpcz_store.cc:276] 0709 12:24:13.095201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.488821 (+393620us) service_pool.cc:224] Handling call
0709 12:24:13.530161 (+ 41340us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:13.546895 (+ 16734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:13.546924 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:13.584117 (+ 37193us) log.cc:844] Serialized 52 byte log entry
0709 12:24:14.413174 (+829057us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:14.413210 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:14.413283 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:14.562525 (+149242us) raft_consensus.cc:1685] finished
0709 12:24:14.562544 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:14.562706 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":175,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":6622,"thread_start_us":464278,"threads_started":1,"wal-append.queue_time_us":595674}
I20260709 12:24:14.523518 13488 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:14.550984 13410 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.570451 13403 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:14.536106 13530 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:14.581974 13403 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:14.582670 13403 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:14.583040 13538 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:14.583532 13530 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:14.584437 13257 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:14.570122 13306 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:14.570282 13592 log.cc:927] Time spent T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:24:14.571749 13434 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:14.524928 13272 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:14.576095 13506 consensus_meta.cc:287] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.537s	user 0.005s	sys 0.005s
I20260709 12:24:14.576488 13338 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:14.577551 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.578557 13573 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:14.539716 12675 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.538187 13565 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:14.559929 13228 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:14.556144 13568 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:14.585106 13403 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:14.598551 13565 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:14.602180 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:14.602984 10984 raft_consensus.cc:2393] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 6: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:14.603017 13565 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:14.603988 13204 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:14.606734 13407 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:14.607352 13407 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:14.599339 12675 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:14.610536 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:14.612128 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:14.612332 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:14.612897 11672 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:14.617055 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:14.618448 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:14.610456 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:14.612502 13488 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:14.602922 13568 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:14.623566 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:14.624573 10975 raft_consensus.cc:2410] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:14.625516 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:14.627728 10975 raft_consensus.cc:2410] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:24:14.585119 13257 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:14.634480 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.636749 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:14.637502 10984 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
I20260709 12:24:14.642927 13306 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:14.644908 13272 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:14.645778 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:14.646700 11678 raft_consensus.cc:2410] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:24:14.650949 10979 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:14.653087 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:14.653257 13532 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:14.659914 11058 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:24:14.658215 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:14.660851 13606 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:14.661376 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:14.652951 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:14.664332 13505 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:14.665586 13407 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:14.667135 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.668321 13572 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.619748 13410 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:14.647501 13257 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:14.670890 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:14.716840 11058 raft_consensus.cc:606] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:14.722962 11058 raft_consensus.cc:614] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:14.722270 13321 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:14.729089 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.732367 12675 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:14.733150 11051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:24:14.733909 11130 raft_consensus.cc:1240] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:24:14.733950 11051 raft_consensus.cc:606] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:24:14.734743 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1624) took 1333 ms. Trace:
I20260709 12:24:14.735140 11130 rpcz_store.cc:276] 0709 12:24:13.422511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.733189 (+1310678us) service_pool.cc:224] Handling call
0709 12:24:14.733586 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:14.734432 (+   846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:14.734650 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:14.738888 11134 raft_consensus.cc:1240] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:24:14.740551 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:14.741187 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:14.741933 11130 raft_consensus.cc:2393] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 4: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:14.744104 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:14.712169 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:14.861610 11057 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:24:14.862478 11057 raft_consensus.cc:606] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:24:14.862949 11057 raft_consensus.cc:614] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:24:14.864291 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 80860.8us
I20260709 12:24:14.834913 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:14.834147 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:14.837720 11132 raft_consensus.cc:1240] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 8 LEADER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:14.834553 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:14.782335 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:14.817569 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:14.782934 13572 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:14.869558 11127 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:14.871119 11024 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:14.872423 13272 raft_consensus.cc:2804] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:14.872330 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:14.718205 11678 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:14.873237 13272 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:14.871851 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:14.873486 11127 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
W20260709 12:24:14.873843 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.734380 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:14.874547 13272 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:14.683377 13607 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.868566 10975 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:14.875316 13607 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:14.875033 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:14.877535 13607 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:14.837911 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 56666us
I20260709 12:24:14.879132 13228 consensus_queue.cc:1048] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:14.874717 11131 raft_consensus.cc:2393] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 7: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:14.881783 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:14.882467 11134 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:24:14.884380 11131 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:14.882938 11134 pending_rounds.cc:85] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 3
I20260709 12:24:14.886050 11134 pending_rounds.cc:107] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:24:14.886341 11134 raft_consensus.cc:2889] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:14.887820 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:14.888329 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.745114 11126 raft_consensus.cc:2410] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:14.889195 11024 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:14.745020 13575 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:14.890370 10975 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
W20260709 12:24:14.745565 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 305039us
I20260709 12:24:14.893790 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:14.836323 13407 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:14.894457 11127 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:14.864579 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:14.895819 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1625) took 1409 ms. Trace:
I20260709 12:24:14.896684 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:14.894928 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:14.898501 11132 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 5.
I20260709 12:24:14.899708 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:14.898862 11126 rpcz_store.cc:276] 0709 12:24:13.510485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.743784 (+1233299us) service_pool.cc:224] Handling call
0709 12:24:14.895752 (+151968us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:14.898981 11129 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:24:14.902696 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:14.894752  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:14.904364 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:14.905483 11125 raft_consensus.cc:2410] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:24:14.906215 11673 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:14.906406 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:14.907595 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:14.908223 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1620) took 1519 ms. Trace:
I20260709 12:24:14.908656 11133 rpcz_store.cc:276] 0709 12:24:13.388799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.389017 (+   218us) service_pool.cc:224] Handling call
0709 12:24:13.389436 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:13.966619 (+577183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:13.966655 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:14.017149 (+ 50494us) log.cc:844] Serialized 26 byte log entry
0709 12:24:14.305207 (+288058us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:14.305242 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:14.907751 (+602509us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b540012c854. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:14.907803 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:14.907846 (+    43us) raft_consensus.cc:1685] finished
0709 12:24:14.907858 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:14.908067 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1307182336,"thread_start_us":272034,"threads_started":1,"wal-append.queue_time_us":510382}
I20260709 12:24:14.911164 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1864) took 1898 ms. Trace:
W20260709 12:24:14.911816 11643 connection.cc:256] RPC call timeout handler was delayed by -2.3755536359999496s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1593s for a response
I20260709 12:24:14.912614 11643 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:14.907663 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:14.908273 11132 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:14.915643 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:14.916350 11129 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:14.739254 11677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41774 (request call id 430) took 2199 ms. Trace:
I20260709 12:24:14.911384  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:14.911636 10977 rpcz_store.cc:276] 0709 12:24:13.012529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.513500 (+500971us) service_pool.cc:224] Handling call
0709 12:24:13.551936 (+ 38436us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:13.961170 (+409234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:13.961323 (+   153us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:13.992844 (+ 31521us) log.cc:844] Serialized 52 byte log entry
0709 12:24:14.395348 (+402504us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:14.406387 (+ 11039us) log.cc:844] Serialized 14 byte log entry
0709 12:24:14.910570 (+504183us) log.cc:844] Serialized 14 byte log entry
0709 12:24:14.910806 (+   236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:14.910900 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:14.910946 (+    46us) raft_consensus.cc:1685] finished
0709 12:24:14.910958 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:14.911102 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":807282,"prepare.queue_time_us":14963,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":327841,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":30606,"thread_start_us":352679,"threads_started":1,"wal-append.queue_time_us":458456}
I20260709 12:24:14.920647 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:14.921080 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:14.921957 10977 raft_consensus.cc:2393] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 8: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:14.922849 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:14.923105 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:14.923763 11055 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:24:14.921300 11130 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:14.924469 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:14.925098 11133 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:24:14.925944 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:14.926503 11133 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:14.927338 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:14.928407 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:14.929090 11133 raft_consensus.cc:2393] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 6: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:14.931218 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:14.931809 11023 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:14.932058 11130 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:14.932483 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:14.933214 13613 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:14.934873 13228 raft_consensus.cc:2804] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:14.935458 13228 raft_consensus.cc:697] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:14.935684 13613 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:14.938257 13573 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.938382 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:14.938810 13613 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
I20260709 12:24:14.939145 10978 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:24:14.906301 13408 consensus_queue.cc:1048] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:24:14.940110 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:14.919900 11677 rpcz_store.cc:276] 0709 12:24:12.539918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.546386 (+  6468us) service_pool.cc:224] Handling call
0709 12:24:12.547568 (+  1182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:12.548845 (+  1277us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:13.981139 (+1432294us) log.cc:844] Serialized 14 byte log entry
0709 12:24:14.422999 (+441860us) log.cc:844] Serialized 14 byte log entry
0709 12:24:14.738538 (+315539us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b1800117280. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88c71c0a 00007f8f923b1219 00007f8f88cf9a40 00007f8f88cf44e4 00007f8f88cf4455 00007f8f8bddc060 00007f8f8bdee716 00007f8f8bdff287 00007f8f8bdff208
0709 12:24:14.738727 (+   189us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:14.738795 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:14.738866 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:14.738966 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:14.739135 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1433,"prepare.queue_time_us":1492005,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":5562,"raft.queue_time_us":313440,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":9179,"spinlock_wait_cycles":4588416,"thread_start_us":1839437,"threads_started":2,"wal-append.queue_time_us":470873}
I20260709 12:24:14.941387 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:14.939440 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:14.955747 10975 raft_consensus.cc:2410] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:14.943707 13575 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:14.902305 13258 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:14.856395 13606 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:14.921908 11097 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:14.939031 13410 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:14.947503 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.946838 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:14.933552 10982 raft_consensus.cc:1240] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:14.948819 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:14.966370 10977 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
I20260709 12:24:14.949764 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:14.929880 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:14.953706 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 51196.3us
I20260709 12:24:14.933333 10980 raft_consensus.cc:2393] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 6: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:14.966849 11130 raft_consensus.cc:2393] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 4: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:14.966861 11125 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:14.964598 11097 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:14.967226 11133 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:14.946869 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:14.952915 13530 raft_consensus.cc:993] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7: : Instructing follower bc01179655564f29b83babe396377cbb to start an election
I20260709 12:24:14.960147 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1806) took 3412 ms. Trace:
W20260709 12:24:14.957088 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.969960 11097 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:14.968020 11644 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:14.973199 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:14.959679 13258 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:14.973861 10978 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
I20260709 12:24:14.970566 11128 rpcz_store.cc:276] 0709 12:24:11.547883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.548007 (+   124us) service_pool.cc:224] Handling call
0709 12:24:11.548303 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:14.086813 (+2538510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:14.946526 (+859713us) spinlock_profiling.cc:243] Waited 2.51 s on lock 0x7b5400066654. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:14.960094 (+ 13568us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5765668608}
I20260709 12:24:14.959285 13613 raft_consensus.cc:2804] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:14.976670 11132 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:14.974570 13542 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:14.974282 13434 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.980170 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:14.938977 13573 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:14.980823 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:14.981555 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:14.982620 10977 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:14.985513 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:14.974627 13258 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:15.016665 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:15.008095 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.972545 13575 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.017364 11132 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:14.994697 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:15.018010 10980 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:14.973038 13607 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:15.019119 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:15.019773 11130 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
W20260709 12:24:15.019881 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 633546us
I20260709 12:24:14.977123 13321 raft_consensus.cc:1081] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Signalling peer bc01179655564f29b83babe396377cbb to start an election
I20260709 12:24:14.976670 13410 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:14.959888 13593 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:24:15.026021 11644 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:14.983659 13613 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:14.987838 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:14.979370 13525 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:15.028894 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:15.040014 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 127546us
W20260709 12:24:15.043556 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:15.029417 10981 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1865) took 2016 ms (client timeout 2116 ms). Trace:
W20260709 12:24:15.055478 10981 rpcz_store.cc:269] 0709 12:24:13.012945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.461128 (+448183us) service_pool.cc:224] Handling call
0709 12:24:15.029214 (+1568086us) spinlock_profiling.cc:243] Waited 57.7 ms on lock 0x7b54000daf54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:15.029342 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132731776}
I20260709 12:24:15.056945 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:15.069449 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:15.019078 13607 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:15.020577 13506 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:15.077200 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:15.077757 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:15.079041 11127 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:15.080032 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:14.977803 13272 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:15.016163 13542 raft_consensus.cc:697] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:15.083405 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:15.088304 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:15.088652 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1857) took 3087 ms. Trace:
I20260709 12:24:15.089051 11127 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:15.052273 13613 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:15.090803 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:15.096627 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.097162 11024 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:15.097731 10984 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:15.069623 13508 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:15.094388 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1858) took 3092 ms. Trace:
I20260709 12:24:15.051208 13410 raft_consensus.cc:697] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 7 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:15.026564 12992 consensus_queue.cc:1059] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:24:15.099211 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:15.101357 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:15.019209 13434 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:15.104259 11130 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:15.104496 11097 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:15.106498 12992 consensus_queue.cc:1243] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer c979ef00e0ad4157b49ebbdc13ce7cd7 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:15.081072 13607 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:14.974653 13228 consensus_queue.cc:237] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
W20260709 12:24:15.130798 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 57888.4us
I20260709 12:24:15.132128 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:15.133620 13434 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:15.134361 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:15.099431 10976 rpcz_store.cc:276] 0709 12:24:12.001511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.004551 (+  3040us) service_pool.cc:224] Handling call
0709 12:24:12.004892 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:13.485891 (+1480999us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:13.510779 (+ 24888us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:13.576512 (+ 65733us) log.cc:844] Serialized 26 byte log entry
0709 12:24:14.353375 (+776863us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:14.365355 (+ 11980us) log.cc:844] Serialized 14 byte log entry
0709 12:24:14.905449 (+540094us) spinlock_profiling.cc:243] Waited 6.62 ms on lock 0x7b18003c2380. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88c71c0a 00007f8f923b1219 00007f8f88cf9a40 00007f8f88cf44e4 00007f8f88cf4455 00007f8f8bddc060 00007f8f8bdee716 00007f8f8bdff287 00007f8f8bdff208
0709 12:24:15.027907 (+122458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:15.050353 (+ 22446us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:15.050413 (+    60us) raft_consensus.cc:1685] finished
0709 12:24:15.084407 (+ 33994us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:15.094317 (+  9910us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16009,"prepare.queue_time_us":14245,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":818816,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":6726,"spinlock_wait_cycles":15215360,"thread_start_us":1864401,"threads_started":3,"wal-append.queue_time_us":794025}
I20260709 12:24:15.135079 11127 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:15.135717 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:15.136014 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:15.136596 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:15.137899 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:15.138228 13407 raft_consensus.cc:1064] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
W20260709 12:24:15.138742 13407 raft_consensus.cc:1068] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb: Unable to promote non-voter 0f3b1ccd8aa5412393aa7eb90f2bef95: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:24:15.143343 13610 log.cc:927] Time spent T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:24:15.144248 13375 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:15.080942 13506 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:15.107115 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:15.029616 13575 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:15.136821 11127 raft_consensus.cc:2393] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 6: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:15.130887 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:15.146481 10976 raft_consensus.cc:2393] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 5: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:15.154137 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:15.155439 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:15.156073 11130 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 4.
I20260709 12:24:15.128019 13505 raft_consensus.cc:3055] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:15.099363 13508 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:15.108326 11024 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:15.147573 10948 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:15.106604 13606 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:15.147846 13410 consensus_queue.cc:237] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:15.108628 12675 raft_consensus.cc:2749] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:15.149453 11125 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:15.162308 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:15.161114 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 52877.3us
I20260709 12:24:15.145835 13565 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:15.176892 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:15.177662 10981 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:24:15.110867 11097 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:15.180490 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:15.152710 13506 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:15.172037 13508 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:15.182711 11132 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:15.183573 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:24:15.191953 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 81154.3us
I20260709 12:24:15.186826 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:24:15.174532 13608 log.cc:927] Time spent T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 12:24:15.189301 11643 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:15.193230 11024 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:15.194028 11125 raft_consensus.cc:2393] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 7: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:15.194296 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:15.159116 13505 raft_consensus.cc:740] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:24:15.201705 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 54231.6us
I20260709 12:24:15.203171 12675 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:15.203624 12675 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:15.203969 12675 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:15.144928 13542 consensus_queue.cc:237] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:15.206284 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:15.210573 11130 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:15.175599 13488 raft_consensus.cc:2804] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:15.207878 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:15.211565 10976 raft_consensus.cc:2393] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 6: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:15.215920 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:15.182415 13565 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:15.216872 11127 raft_consensus.cc:2410] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:15.218540 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:15.218850 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:15.251806 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:15.274139 11125 raft_consensus.cc:2393] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 6: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:15.222806 13565 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:15.262746 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:15.263018 10948 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:15.213058 13488 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:15.281646 10948 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:15.209632 13339 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:24:15.194871 13606 raft_consensus.cc:2764] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:24:15.257748 11132 raft_consensus.cc:2410] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:15.275790 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:15.282248 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 69580.1us
I20260709 12:24:15.270274 11130 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 5.
I20260709 12:24:15.265409 13593 raft_consensus.cc:2749] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:15.265064 13538 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.309005 13538 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:15.263671 13164 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.311786 13164 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:15.279002 13505 consensus_queue.cc:260] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:15.314345 13573 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:15.316506 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 136855us
I20260709 12:24:15.317327 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:15.317539 10977 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:15.280652 13488 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:15.299109 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:15.291167 10976 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
W20260709 12:24:15.318559 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.307760 11129 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:15.319024 11643 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:15.305310 13338 raft_consensus.cc:2804] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:15.319509 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:15.321513 11134 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:24:15.322975 12675 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:15.351318 11130 raft_consensus.cc:2410] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:15.353018 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:15.318025 11125 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:15.353832 11129 raft_consensus.cc:2393] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 6: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:15.331318 11025 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:15.319095 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.318608 11132 raft_consensus.cc:2376] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bc01179655564f29b83babe396377cbb in term 7. Re-sending same reply.
I20260709 12:24:15.357914 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:15.358953 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 77387us
I20260709 12:24:15.360224 10948 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:15.361272 11055 raft_consensus.cc:1240] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:15.355104 11645 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:15.280280 13485 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.365139 12675 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:15.371125 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:15.371956 11134 raft_consensus.cc:2393] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 4: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:15.373150 11134 raft_consensus.cc:1275] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:24:15.374747 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.379101 13418 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:15.380085 13525 raft_consensus.cc:2804] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:15.380654 13525 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:15.381042 13525 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:15.381577 11057 raft_consensus.cc:1275] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:15.382598 13573 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:15.383184 13573 raft_consensus.cc:697] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:15.383551 13630 raft_consensus.cc:2804] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:15.384044 13630 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:15.384415 13630 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:15.384517 13516 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:24:15.385978 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 67061.6us
I20260709 12:24:15.387547 13593 raft_consensus.cc:2749] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:15.388123 13616 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:15.388648 13616 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:15.388796 13619 log.cc:927] Time spent T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 12:24:15.389274 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:15.384131 13573 consensus_queue.cc:237] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:15.390442 13618 log.cc:927] Time spent T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:24:15.390605 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:15.391249 10976 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:24:15.392145 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:15.392674 10976 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:15.393452 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:15.365998 13258 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:15.275321 13296 consensus_queue.cc:1048] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.091s
I20260709 12:24:15.396216 13258 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:15.397862 13485 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:15.398813 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:15.399978 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:15.357486 13623 log.cc:927] Time spent T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:24:15.410257 13616 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:15.410681 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:15.416316 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:15.351781 13505 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:15.420292 13272 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:15.421277 13627 consensus_queue.cc:1059] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:15.401854 13338 raft_consensus.cc:697] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:15.423269 13338 consensus_queue.cc:237] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:15.427977 13572 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:15.429440 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:15.351246 13473 consensus_queue.cc:1059] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:24:15.430752 13473 raft_consensus.cc:3055] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:15.431159 13473 raft_consensus.cc:740] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:15.432003 13473 consensus_queue.cc:260] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:15.433320 13473 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:15.434792 10948 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:15.430298 11131 raft_consensus.cc:2393] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:15.435985 13296 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:15.436221 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:15.436903 13538 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:15.437737 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:15.438951 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:15.442481 11131 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:24:15.442981 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:15.443743 11131 raft_consensus.cc:1240] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:15.410442 11644 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:15.411255 11134 raft_consensus.cc:1275] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:15.401002 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:15.411146 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:15.413976 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:15.444218 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.446002 10948 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:15.446609 11134 raft_consensus.cc:1240] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:24:15.393954 10976 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:24:15.447966 11134 raft_consensus.cc:1240] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:15.448885 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.457450 11126 raft_consensus.cc:2393] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 7: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:15.457737 11127 raft_consensus.cc:2410] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:15.461609 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:15.462898 10948 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:15.436406 13296 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:15.470644 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:15.473548 10976 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:15.470074 10979 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:15.476853 11127 raft_consensus.cc:2410] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:24:15.479889 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.480587 11645 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:15.483485 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:15.484200 11127 raft_consensus.cc:2376] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bc01179655564f29b83babe396377cbb in term 6. Re-sending same reply.
I20260709 12:24:15.465291 13572 raft_consensus.cc:2804] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:15.493678 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:15.498934 11025 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:15.509199 12675 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:15.509644 12675 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:15.509969 12675 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:15.475654 13560 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:15.511849 11025 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:15.485955 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:15.518185 10979 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:15.478515 13296 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:15.520351 10980 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:15.521661 11025 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:15.525087 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:15.525738 10976 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:15.526289 11025 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:15.471457 13629 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:15.527511 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:15.443670 13258 consensus_queue.cc:1175] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" responder_term: 5 status { last_received { term: 5 index: 7 } last_committed_idx: 6 last_received_current_leader { term: 5 index: 7 } }
I20260709 12:24:15.530223 13614 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.533542 13614 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:15.536145 13614 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:15.539574 13508 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:15.544792 13525 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:15.546505 11677 raft_consensus.cc:2393] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 8: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:15.521068 13560 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:15.550483 13560 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:15.554981 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:15.559767 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:15.560956 11127 raft_consensus.cc:1275] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:15.565846 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:15.566013 11025 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:15.566926 11025 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:15.553239 11672 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:15.519902 13375 raft_consensus.cc:2749] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:15.529626 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:15.585575 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.599043 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:15.527288 13272 raft_consensus.cc:2804] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:15.606261 10979 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
I20260709 12:24:15.612074 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:15.613044 10976 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 5.
I20260709 12:24:15.562989 13475 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:15.618403 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:15.622990 11057 raft_consensus.cc:2393] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 6: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:15.619107 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:15.623984 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:15.557006 13538 raft_consensus.cc:2804] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:15.620124 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:15.620165 12675 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:15.621654 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:15.505410 13628 consensus_queue.cc:1048] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.128s
I20260709 12:24:15.602293 13339 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:15.634819 10979 raft_consensus.cc:1240] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:24:15.631771 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:15.632814 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:15.639554 12675 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:15.639977 11051 raft_consensus.cc:2393] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 6: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:15.641438 11057 raft_consensus.cc:1240] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:15.615025 13272 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:15.632999 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:15.614503 13616 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:15.645862 10979 raft_consensus.cc:1240] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:24:15.672386 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1265) took 1005 ms. Trace:
I20260709 12:24:15.625841 13572 raft_consensus.cc:697] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:15.646775 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:24:15.672961 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 94530.3us
I20260709 12:24:15.650314 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:15.656762 13164 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:15.658190 13400 raft_consensus.cc:3055] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:15.659682 13575 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:15.659970 11643 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:15.176892  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:15.663975 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:15.627538 13538 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:15.665562 13488 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:15.666425 13506 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:15.629280 13631 raft_consensus.cc:2749] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:15.698645 10948 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:15.638972 13339 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:15.670215 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:15.670588 13508 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:15.676872 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:15.672760 10979 rpcz_store.cc:276] 0709 12:24:14.666994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.645456 (+978462us) service_pool.cc:224] Handling call
0709 12:24:15.645705 (+   249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:15.672114 (+ 26409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:15.672321 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:15.680567 11126 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:15.601672 13607 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:15.681989 11643 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:15.682371 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:15.667780 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:15.616706 13613 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:15.708405 11643 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:15.709594 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:15.699476 10984 consensus_meta.cc:287] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.594s	user 0.007s	sys 0.004s
I20260709 12:24:15.710930 11129 raft_consensus.cc:1240] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:15.669488 13525 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:15.679400 13272 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:15.715979 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:15.716889 11057 raft_consensus.cc:2393] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 8: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:15.684800 13538 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:15.724457 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:15.724668 13506 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:15.724879 13488 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:15.725370 13506 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:15.649605 13565 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:15.710290 11059 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:15.684288 11672 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:15.707120 13164 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:15.708768 13616 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:15.718696 13493 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:15.741696 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.683813 13400 raft_consensus.cc:740] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:15.719519 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:15.711026 10984 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:15.722966 11025 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:15.710651 10979 raft_consensus.cc:1240] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:24:15.729951 11644 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:15.733963 11098 leader_election.cc:400] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 5. Current term is 6.
I20260709 12:24:15.743739 11098 leader_election.cc:403] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:24:15.692317 11052 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:15.733966 11128 raft_consensus.cc:2368] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 6. Current term is 7.
I20260709 12:24:15.715200 11680 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:15.707195 13339 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:15.725770 13506 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:15.735265 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:15.756960 11057 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:15.736521 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:15.757647 11126 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:15.689600 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:15.719398 13505 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:15.744645 10948 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:15.743865 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1266) took 1076 ms. Trace:
I20260709 12:24:15.760505 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:15.760900 10979 rpcz_store.cc:276] 0709 12:24:14.667308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.710050 (+1042742us) service_pool.cc:224] Handling call
0709 12:24:15.710432 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:15.743593 (+ 33161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:15.743809 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:15.762343 10979 raft_consensus.cc:1240] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:24:15.736416 13164 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:15.750862 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:15.756851 11054 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 5.
I20260709 12:24:15.720247 11674 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:15.734539 13485 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:15.756538 13228 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:15.773443 13228 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:15.744021 13407 raft_consensus.cc:2749] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:15.774271 13228 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:15.744352 13572 consensus_queue.cc:237] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:15.764894 11059 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:15.753090 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:15.766518 13493 consensus_queue.cc:1059] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:15.770771 13607 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:15.744172 13508 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:15.766039 10948 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:15.780763 10984 raft_consensus.cc:2393] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 8: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:15.783825 10979 raft_consensus.cc:1240] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 4. Current term is 5. Ops: [2.4-4.5]
I20260709 12:24:15.754787 13204 raft_consensus.cc:2749] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 5. Current term is 6.
I20260709 12:24:15.787919 11126 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:15.789499 11680 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:15.759507 13506 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:15.763769 13505 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:15.796978 11098 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:15.782153 13164 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:15.791757 13616 raft_consensus.cc:2749] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:15.789659 13640 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:15.818130 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:24:15.834494 13633 log.cc:927] Time spent T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:24:15.811076 13508 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:15.819953 13400 consensus_queue.cc:260] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:15.837028 10984 raft_consensus.cc:1240] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:24:15.852629 13508 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:15.838977 13613 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:15.840368 13565 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:15.813977 13505 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:15.814500 13493 raft_consensus.cc:2749] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:15.847157 13516 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:15.858991 13516 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:15.860793 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:15.848982 11672 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 5.
I20260709 12:24:15.791448 13473 consensus_queue.cc:1048] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:24:15.935624 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:15.999796 11057 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
I20260709 12:24:16.082985 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1247) took 1482 ms. Trace:
I20260709 12:24:16.076078 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 333) took 1132 ms. Trace:
I20260709 12:24:16.078474 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:15.913455 10978 raft_consensus.cc:1275] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:15.913827 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:15.897408 10976 raft_consensus.cc:1240] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:15.865408 11678 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:16.071437 13638 log.cc:927] Time spent T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:24:16.098500 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 293) took 1132 ms. Trace:
I20260709 12:24:16.099592 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1819) took 1284 ms. Trace:
I20260709 12:24:16.099792 10984 rpcz_store.cc:276] 0709 12:24:14.965899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.811600 (+845701us) service_pool.cc:224] Handling call
0709 12:24:15.834447 (+ 22847us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:16.098231 (+263784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.098443 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:16.101051 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:16.100028 11130 rpcz_store.cc:276] 0709 12:24:14.815337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.366875 (+551538us) service_pool.cc:224] Handling call
0709 12:24:15.367202 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:15.412897 (+ 45695us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:15.412927 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:15.476367 (+ 63440us) log.cc:844] Serialized 26 byte log entry
0709 12:24:15.810496 (+334129us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:15.810544 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:15.810613 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:16.099378 (+288765us) raft_consensus.cc:1685] finished
0709 12:24:16.099398 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:16.099531 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18498,"raft.queue_time_us":80471,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":5638,"thread_start_us":249653,"threads_started":1,"wal-append.queue_time_us":475101}
I20260709 12:24:16.102291 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:15.905231 13630 consensus_meta.cc:287] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.000s
I20260709 12:24:15.914202 11643 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:16.110136 11678 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:16.110584 13485 raft_consensus.cc:2804] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:16.111106 13485 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:16.111474 13485 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:16.114746 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 200639us
I20260709 12:24:15.917387 13525 raft_consensus.cc:3055] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:24:15.952903 10949 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 1.982s (SENT) [suppressed 38 similar messages]
I20260709 12:24:16.126307 13525 raft_consensus.cc:740] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
W20260709 12:24:16.126672 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 173807us
I20260709 12:24:16.127648 13525 consensus_queue.cc:260] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:16.128710 13525 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:16.103670 10984 raft_consensus.cc:1240] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:16.130582 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1871) took 1158 ms. Trace:
I20260709 12:24:16.130909 10984 rpcz_store.cc:276] 0709 12:24:14.971782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.103222 (+1131440us) service_pool.cc:224] Handling call
0709 12:24:16.103506 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:16.130306 (+ 26800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.130524 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:16.132179 10984 raft_consensus.cc:1240] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:24:16.132784 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 294) took 1157 ms. Trace:
I20260709 12:24:16.133070 10984 rpcz_store.cc:276] 0709 12:24:14.975298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.131610 (+1156312us) service_pool.cc:224] Handling call
0709 12:24:16.131962 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:16.132517 (+   555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.132732 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:16.134305 13593 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.134860 13593 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:16.135025 13556 consensus_queue.cc:1059] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:16.096575 10982 rpcz_store.cc:276] 0709 12:24:14.600667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.601451 (+   784us) service_pool.cc:224] Handling call
0709 12:24:14.601798 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:14.966690 (+364892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.082681 (+1115991us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b5400228b54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:16.082906 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":721335552}
I20260709 12:24:16.136458 13630 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:16.137200 13593 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:16.103724 11059 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 3.
I20260709 12:24:16.137633 11058 raft_consensus.cc:2393] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:15.916560 11673 raft_consensus.cc:2410] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:24:15.894361 13607 raft_consensus.cc:2804] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:16.140815 13607 raft_consensus.cc:697] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:16.143106 10984 raft_consensus.cc:1240] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:15.926250 13632 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:16.106895 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 309985us
I20260709 12:24:16.095715 11129 rpcz_store.cc:276] 0709 12:24:14.943578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.452522 (+508944us) service_pool.cc:224] Handling call
0709 12:24:15.460897 (+  8375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:15.711419 (+250522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.075801 (+364382us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b5400033ed4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:16.076007 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":574570752}
W20260709 12:24:15.877314 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 43531.2us
I20260709 12:24:15.763330 13573 raft_consensus.cc:2749] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:16.125425 13485 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:16.186386 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 295) took 1165 ms. Trace:
I20260709 12:24:16.186877 10984 rpcz_store.cc:276] 0709 12:24:14.978643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.133741 (+1155098us) service_pool.cc:224] Handling call
0709 12:24:16.134042 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:16.143474 (+  9432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.143644 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:15.877410 13629 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:15.089097 10983 rpcz_store.cc:276] 0709 12:24:12.000869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.045191 (+ 44322us) service_pool.cc:224] Handling call
0709 12:24:12.045631 (+   440us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:24:12.984216 (+938585us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:12.984260 (+    44us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:24:13.030681 (+ 46421us) log.cc:844] Serialized 78 byte log entry
0709 12:24:13.083036 (+ 52355us) spinlock_profiling.cc:243] Waited 6.96 ms on lock 0x7b4800002dd8. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f90d0daa1 00007f8f90d04b37 00007f8f90d049ca 00007f8f90dfc26f 00007f8f90dfbf37 00007f8f90e1055c 00007f8f90e10508 00007f8f90e10488 00007f8f90e10443 00007f8f90e0f6ec 00007f8f8fd39a96
0709 12:24:13.969768 (+886732us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:14.389011 (+419243us) log.cc:844] Serialized 14 byte log entry
0709 12:24:15.027272 (+638261us) log.cc:844] Serialized 14 byte log entry
0709 12:24:15.027551 (+   279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:15.057691 (+ 30140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:15.088421 (+ 30730us) raft_consensus.cc:1685] finished
0709 12:24:15.088445 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:15.088591 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":553002,"prepare.queue_time_us":226859,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":84,"raft.queue_time_us":795650,"raft.run_cpu_time_us":3524,"raft.run_wall_time_us":796774,"spinlock_wait_cycles":16013696,"thread_start_us":2362110,"threads_started":4,"wal-append.queue_time_us":1080421}
I20260709 12:24:15.926535 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:15.912366 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:16.207425 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:15.861269 13516 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:15.919582 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:16.205026 11025 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:16.169543 13375 raft_consensus.cc:2749] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:16.217012 11672 raft_consensus.cc:1240] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:16.221045 12675 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:16.224992 12675 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:16.225375 12675 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:16.221475 11025 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:16.219977 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:16.227705 11130 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 4.
I20260709 12:24:16.213887 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:16.228591 11129 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 5.
I20260709 12:24:16.223254 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:16.229560 10983 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:16.082233 13542 consensus_queue.cc:1059] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.133s
I20260709 12:24:16.230515 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:16.081960 13410 consensus_queue.cc:1059] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.136s
I20260709 12:24:16.189054 13257 consensus_queue.cc:1059] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:24:16.186980 13593 consensus_queue.cc:1059] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:24:16.003755 13296 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:15.875782 13228 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:15.901189 13272 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:16.233911 10981 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:16.231421 13562 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.969s	user 0.015s	sys 0.022s
I20260709 12:24:16.243263 11681 raft_consensus.cc:1240] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:24:16.252135 11059 raft_consensus.cc:1275] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:24:16.244361 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 57681.4us
I20260709 12:24:16.219941 11676 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:15.899330 13640 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:24:16.250803 11057 raft_consensus.cc:1240] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:16.256299 11052 raft_consensus.cc:1275] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:16.256906 13228 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:16.186805 13607 consensus_queue.cc:237] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:16.258612 13272 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:16.259547 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:16.261726 10948 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:16.266772 11060 raft_consensus.cc:2393] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 6: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:16.262403 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:16.262850 11056 raft_consensus.cc:2368] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 4. Current term is 5.
I20260709 12:24:16.263018 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:16.248027 13631 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:24:16.252300 13562 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.990s	user 0.016s	sys 0.022s
I20260709 12:24:16.256812 13485 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:16.267856 10948 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:16.370332 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 183174us
I20260709 12:24:16.264268 11674 raft_consensus.cc:2393] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 8: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
W20260709 12:24:16.287375 10949 leader_election.cc:336] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 1.593s (SENT)
I20260709 12:24:16.268262 11129 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
W20260709 12:24:16.276821 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.322784 12675 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:16.396270 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 190625us
W20260709 12:24:16.385654 11023 connection.cc:256] RPC call timeout handler was delayed by -1.2576241739998295s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
W20260709 12:24:16.457919 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.369858 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1874) took 1325 ms. Trace:
I20260709 12:24:16.387243 10981 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:16.652599 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:16.653208 10981 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 5.
W20260709 12:24:16.641541 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 373740us
W20260709 12:24:16.648376 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 301409us
I20260709 12:24:16.655964 10948 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:16.657131 11023 connection.cc:256] RPC call timeout handler was delayed by -1.2306241739997859s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
W20260709 12:24:16.643405 10975 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.004s	sys 0.022s
W20260709 12:24:16.643711 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:16.411098 13560 consensus_meta.cc:287] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.860s	user 0.008s	sys 0.003s
W20260709 12:24:16.318128 13648 log.cc:927] Time spent T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:24:16.656989 10948 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:16.343763 13538 consensus_meta.cc:287] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.583s	user 0.005s	sys 0.000s
W20260709 12:24:16.315011 13339 consensus_meta.cc:287] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.550s	user 0.007s	sys 0.003s
I20260709 12:24:16.654605 11645 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:16.323915 13400 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:16.681895 11645 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:16.676565 11098 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:16.683022 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:16.678907 10975 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.004s	sys 0.023s
I20260709 12:24:16.683876 10981 raft_consensus.cc:2393] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 7: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:16.685668 12675 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:16.683069 11645 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:16.633980 13296 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:16.257053 13164 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:16.315037 13578 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:16.264462 13542 consensus_queue.cc:1048] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.397s
I20260709 12:24:16.258555 13505 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:16.655306 13408 raft_consensus.cc:2804] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:16.259069 13653 consensus_queue.cc:1048] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.422s
I20260709 12:24:16.651109 10982 rpcz_store.cc:276] 0709 12:24:15.044242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.136986 (+1092744us) service_pool.cc:224] Handling call
0709 12:24:16.137295 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:16.137636 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:24:16.212436 (+ 74800us) log.cc:844] Serialized 14 byte log entry
0709 12:24:16.369443 (+157007us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:16.369496 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:16.369546 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.369616 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:16.369758 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23286,"prepare.queue_time_us":112021,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":3968,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":8291,"thread_start_us":195902,"threads_started":2}
I20260709 12:24:16.316010 13630 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:16.655522 13568 raft_consensus.cc:3055] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:16.644711 13640 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:16.263160 13506 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:16.677289 13434 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:16.696839 13562 raft_consensus.cc:2804] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:16.657570 13631 raft_consensus.cc:697] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:16.657315 13410 consensus_queue.cc:1048] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.100s
I20260709 12:24:16.714073 11098 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:16.303119 13257 consensus_queue.cc:1059] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.396s
I20260709 12:24:16.687395 13508 raft_consensus.cc:2749] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:16.706570 13542 consensus_queue.cc:1243] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer c979ef00e0ad4157b49ebbdc13ce7cd7 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:16.659976 13556 consensus_queue.cc:1059] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
W20260709 12:24:16.756068 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 468705us
I20260709 12:24:16.791910 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:16.815869 11056 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1582) took 1196 ms. Trace:
I20260709 12:24:16.710024 13578 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:16.684336 13560 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:16.782207 11023 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:16.833655 10982 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:16.693346 13339 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:16.718892 13408 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:16.705624 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:16.687263 13538 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:16.840574 10981 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:16.827605 11054 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.008s	sys 0.016s
I20260709 12:24:16.827561 13613 raft_consensus.cc:2804] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:16.828732 13525 consensus_meta.cc:287] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.666s	user 0.011s	sys 0.002s
I20260709 12:24:16.769250 13568 raft_consensus.cc:740] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
W20260709 12:24:16.842015 11054 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.008s	sys 0.016s
I20260709 12:24:16.834283 11056 rpcz_store.cc:276] 0709 12:24:15.619782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.619891 (+   109us) service_pool.cc:224] Handling call
0709 12:24:16.815570 (+1195679us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b54003142d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:16.815782 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1454800768}
I20260709 12:24:16.793987 13434 raft_consensus.cc:697] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 9 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:16.854023 10980 raft_consensus.cc:2393] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 7: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:16.831998 13562 raft_consensus.cc:697] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
W20260709 12:24:16.849788 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 67679us
I20260709 12:24:16.860479 11051 raft_consensus.cc:1240] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:24:16.836228 13578 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:16.835446 13669 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.843806 13556 consensus_queue.cc:1243] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer 7518bdeb78f24e67a530754ae48547eb log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:16.843075 13408 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:16.885636 10983 consensus_meta.cc:287] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.652s	user 0.009s	sys 0.000s
I20260709 12:24:16.842015 13663 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:16.847024 13272 raft_consensus.cc:2749] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:16.847843 13613 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:16.908269 10983 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:16.882386 11677 raft_consensus.cc:2393] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 9: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
W20260709 12:24:16.918125 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 83783.1us
W20260709 12:24:16.917270 13664 log.cc:927] Time spent T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 12:24:16.960868 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 49994us
W20260709 12:24:16.937515 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 254491us
I20260709 12:24:17.074801 11645 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:16.963848 10981 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:17.068184 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:17.070780 10949 leader_election.cc:336] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 1.698s (SENT)
I20260709 12:24:16.859261 13506 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:16.908886 13663 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.093190 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:17.088675 10949 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:17.089187 10983 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:16.963888 13613 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:17.066087 13653 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:17.102993 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 389003us
I20260709 12:24:17.067629 13556 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.104104 11129 raft_consensus.cc:1275] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:24:17.069347 13410 raft_consensus.cc:2749] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:16.903884 13669 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:17.114411 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:17.121266 10983 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
I20260709 12:24:17.127575 10981 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:17.128656 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:17.129482 10983 raft_consensus.cc:2393] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 5: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:17.092497 13542 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:17.099805 13593 raft_consensus.cc:2804] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:17.097486 13663 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:17.143922 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:24:17.147130 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 490176us
I20260709 12:24:17.105158 13572 raft_consensus.cc:2749] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:17.095888 13204 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.022s	sys 0.039s
I20260709 12:24:17.150133 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:17.151402 11098 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:17.154757 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:17.162212 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 91451.7us
I20260709 12:24:17.164603 13505 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:17.073212 13631 consensus_queue.cc:237] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:17.170815 13538 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:17.171406 13339 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:17.172318 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:17.172968 11131 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:17.175675 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:17.176402 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:17.176939 13668 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:17.177052 11056 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:17.177716 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:17.160394 13542 raft_consensus.cc:697] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 7 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:17.178226 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:17.175834 11678 raft_consensus.cc:1240] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:17.178843 11126 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:17.179107 13542 consensus_queue.cc:237] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:17.177145 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:17.182349 13674 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:24:17.182788 13667 log.cc:927] Time spent T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:24:17.183050 13674 raft_consensus.cc:697] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:17.133976 13653 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:24:17.184161 13674 consensus_queue.cc:237] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:17.140677 13593 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.177624 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:17.217293 11134 raft_consensus.cc:2393] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 5: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:17.200306 11126 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:17.206394 11131 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:17.208571 13653 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:17.209591 11672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41784 (request call id 537) took 1649 ms. Trace:
W20260709 12:24:17.210224 13665 log.cc:927] Time spent T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.367s	user 0.001s	sys 0.000s
I20260709 12:24:17.210773 10983 raft_consensus.cc:1275] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:17.177541 13668 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:17.169828 13669 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:17.211814 13572 consensus_queue.cc:1048] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:17.213958 10977 raft_consensus.cc:1240] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:17.246445 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1891) took 2104 ms. Trace:
W20260709 12:24:17.218542 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.245970 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:17.228917 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 65932.6us
I20260709 12:24:17.246723 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:17.247234 11060 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
I20260709 12:24:17.220072 11672 rpcz_store.cc:276] 0709 12:24:15.560526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.187562 (+627036us) service_pool.cc:224] Handling call
0709 12:24:16.187910 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:16.224703 (+ 36793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.209345 (+984642us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b54000a4bd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:17.209521 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66458368}
I20260709 12:24:17.247406 11129 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:17.248354 10977 rpcz_store.cc:276] 0709 12:24:15.142056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.213461 (+2071405us) service_pool.cc:224] Handling call
0709 12:24:17.213774 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:17.246171 (+ 32397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.246386 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:17.249596 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:17.250309 11056 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:24:17.103078 13568 consensus_queue.cc:260] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:17.234081 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 97728.5us
W20260709 12:24:17.163170 13204 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.022s	sys 0.040s
I20260709 12:24:17.244174 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1884) took 2090 ms. Trace:
I20260709 12:24:17.227953 13593 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:17.111898 13556 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:17.248085 10949 leader_election.cc:336] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 1.859s (SENT)
I20260709 12:24:17.274961 10949 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:17.161973 13164 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:17.257962 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:17.258845 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:17.259308 10983 rpcz_store.cc:276] 0709 12:24:15.140274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.163587 (+2023313us) service_pool.cc:224] Handling call
0709 12:24:17.210457 (+ 46870us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:17.230138 (+ 19681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.230375 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:17.259786 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:17.260015 13668 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:17.260923 13508 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.262411 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:17.263852 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:17.265093 13506 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:17.266175 13658 log.cc:927] Time spent T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.430s	user 0.000s	sys 0.001s
I20260709 12:24:17.135141 13434 consensus_queue.cc:237] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:17.223517 10948 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:24:17.286998 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 63562.9us
I20260709 12:24:17.131582 13562 consensus_queue.cc:237] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:17.262411 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:17.239403 13375 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:17.276358 11056 raft_consensus.cc:2393] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 5: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:17.267202 13680 raft_consensus.cc:3055] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:17.154237 13678 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.109s
I20260709 12:24:17.280414 11057 raft_consensus.cc:2393] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 6: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
W20260709 12:24:17.285066 10949 leader_election.cc:336] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 1.883s (SENT)
I20260709 12:24:17.276391 10982 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:17.288726 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:17.240888 13525 consensus_queue.cc:1048] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:24:17.298090 10948 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:17.303063 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1892) took 2154 ms. Trace:
I20260709 12:24:17.277686 13676 raft_consensus.cc:2749] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:17.302186 13164 raft_consensus.cc:2804] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:17.306535 11052 raft_consensus.cc:2410] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:17.308308 10977 rpcz_store.cc:276] 0709 12:24:15.148307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.253616 (+2105309us) service_pool.cc:224] Handling call
0709 12:24:17.253938 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:17.254166 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:17.282374 (+ 28208us) log.cc:844] Serialized 14 byte log entry
0709 12:24:17.302717 (+ 20343us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:17.302768 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:17.302826 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.302895 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:17.303007 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":899,"prepare.queue_time_us":30021,"raft.queue_time_us":7962,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":115,"thread_start_us":12103,"threads_started":1}
I20260709 12:24:17.305768 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:17.286185 13560 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:17.323778 10949 leader_election.cc:336] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 1.911s (SENT)
I20260709 12:24:17.320749 11060 raft_consensus.cc:2393] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 5: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:17.319023 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:17.324330 10949 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:17.324928 11059 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:24:17.320029 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 301) took 1915 ms. Trace:
I20260709 12:24:17.325798 10982 rpcz_store.cc:276] 0709 12:24:15.404303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.301423 (+1897120us) service_pool.cc:224] Handling call
0709 12:24:17.301732 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:17.310659 (+  8927us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:17.310690 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:17.319708 (+  9018us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:17.319772 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.319846 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:17.319971 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:17.297293 13680 raft_consensus.cc:740] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:17.283995 13508 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:17.337339 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1257) took 2728 ms. Trace:
I20260709 12:24:17.287386 13506 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:17.340376 10975 rpcz_store.cc:276] 0709 12:24:14.608914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.959536 (+350622us) service_pool.cc:224] Handling call
0709 12:24:14.973704 (+ 14168us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:15.029431 (+ 55727us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:15.915656 (+886225us) spinlock_profiling.cc:243] Waited 4.94 ms on lock 0x7b18000a38a0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cd9e07 00007f8f91b349a9 00007f8f88cf669b 00007f8f88cf493f 00007f8f88cf4455 00007f8f8f7dc3c7 00007f8f8bdee9a7 00007f8f8bdfe0bf 00007f8f8bdfe038
0709 12:24:16.008560 (+ 92904us) log.cc:844] Serialized 14 byte log entry
0709 12:24:17.072341 (+1063781us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:17.098789 (+ 26448us) log.cc:844] Serialized 26 byte log entry
0709 12:24:17.098975 (+   186us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:17.099011 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.099083 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:17.331704 (+232621us) raft_consensus.cc:1685] finished
0709 12:24:17.337105 (+  5401us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:17.337270 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9799,"prepare.queue_time_us":64747,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":56873,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":64108,"spinlock_wait_cycles":11368832,"thread_start_us":1095637,"threads_started":3,"wal-append.queue_time_us":779620}
I20260709 12:24:17.345443 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1276) took 1215 ms. Trace:
I20260709 12:24:17.345919 10982 rpcz_store.cc:276] 0709 12:24:16.129893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.332994 (+1203101us) service_pool.cc:224] Handling call
0709 12:24:17.344926 (+ 11932us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:17.345111 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:17.345137 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:17.345178 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:17.345215 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.345269 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:17.345379 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:17.311036 13375 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:17.348837 10949 leader_election.cc:336] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 1.980s (SENT)
I20260709 12:24:17.351425 10949 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:17.352986 13677 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:17.354717 13685 log.cc:927] Time spent T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 12:24:17.356546 13684 log.cc:927] Time spent T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:24:17.357554 13560 raft_consensus.cc:2749] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:17.358160 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.359911 13375 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:17.360702 13506 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:17.371064 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:17.371472 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:17.372103 11126 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
W20260709 12:24:17.377131 10949 leader_election.cc:336] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 2.152s (SENT)
I20260709 12:24:17.379722 10949 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:17.382711 11126 raft_consensus.cc:1217] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Deduplicated request from leader. Original: 3.5->[5.6-5.6]   Dedup: 5.6->[]
I20260709 12:24:17.383385 11126 raft_consensus.cc:1240] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:24:17.378732 13408 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:17.394678 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1280) took 1253 ms. Trace:
I20260709 12:24:17.395164 10982 rpcz_store.cc:276] 0709 12:24:16.140865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.346902 (+1206037us) service_pool.cc:224] Handling call
0709 12:24:17.394164 (+ 47262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:17.394349 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:17.394373 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:17.394414 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:17.394453 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.394504 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:17.394614 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:17.358163 13679 log.cc:927] Time spent T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:24:17.347957 13676 raft_consensus.cc:2749] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:17.388927 13400 consensus_meta.cc:287] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.663s	user 0.009s	sys 0.001s
I20260709 12:24:17.383432 13508 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:17.418045 10949 leader_election.cc:336] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 2.166s (SENT)
I20260709 12:24:17.388471 13556 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:17.422309 10949 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:17.425181 10949 leader_election.cc:336] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 2.368s (SENT)
I20260709 12:24:17.386044 13408 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:17.426616 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 111175us
I20260709 12:24:17.418674 13525 raft_consensus.cc:2749] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:24:17.432528 11098 connection.cc:256] RPC call timeout handler was delayed by -2.7895204309998007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23929999999999998s for a response
W20260709 12:24:17.432979 11098 connection.cc:256] RPC call timeout handler was delayed by -2.6311204309995446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2569s for a response
I20260709 12:24:17.445432 10977 raft_consensus.cc:1240] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 9 LEADER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:17.426354 13164 raft_consensus.cc:697] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 5 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:17.452567 11098 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:17.428375 13296 raft_consensus.cc:2749] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:17.462284 13659 log.cc:927] Time spent T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 1.343s	user 0.010s	sys 0.011s
W20260709 12:24:17.463603 11676 consensus_meta.cc:287] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 1.205s	user 0.012s	sys 0.001s
I20260709 12:24:17.464023 11676 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
W20260709 12:24:17.464627 11676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41762 (request call id 552) took 2011 ms (client timeout 1507 ms). Trace:
W20260709 12:24:17.464963 11676 rpcz_store.cc:269] 0709 12:24:15.453378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.458228 (+  4850us) service_pool.cc:224] Handling call
0709 12:24:15.926332 (+468104us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b5800004598. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90daa0a0 00007f8f90da9984 00007f8f8a3246d4 00007f8f8a324662
0709 12:24:17.464525 (+1538193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3651328}
I20260709 12:24:17.466303 11673 raft_consensus.cc:1240] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 12:24:17.429368 13680 consensus_queue.cc:260] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:17.467490 13680 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:17.470785 13578 consensus_meta.cc:287] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.000s
I20260709 12:24:17.471262 13578 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:17.483966 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1875) took 2401 ms. Trace:
I20260709 12:24:17.487394 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:17.488894 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:17.429517 13560 consensus_queue.cc:1059] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:24:17.503062 11098 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:17.492357 13632 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:17.494236 13677 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:17.495687 13578 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:17.496827 10980 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1275) took 2421 ms (client timeout 2185 ms). Trace:
W20260709 12:24:17.517912 10980 rpcz_store.cc:269] 0709 12:24:15.074994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.554683 (+479689us) service_pool.cc:224] Handling call
0709 12:24:17.496609 (+1941926us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b540009a454. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:17.496744 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2975365376}
I20260709 12:24:17.519860 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1894) took 1137 ms. Trace:
I20260709 12:24:17.520251 10980 rpcz_store.cc:276] 0709 12:24:16.382427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.518942 (+1136515us) service_pool.cc:224] Handling call
0709 12:24:17.519302 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:17.519499 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:17.519524 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:17.519566 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:17.519601 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.519653 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:17.519764 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:17.498481 13662 raft_consensus.cc:3055] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:17.499495 11677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41784 (request call id 542) took 1787 ms. Trace:
I20260709 12:24:17.521291 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:17.522056 11126 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:17.523074 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:17.524220 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:17.524789 11126 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:17.525594 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:17.491182 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:17.504684 10949 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:17.507494 11098 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:17.486053 10981 rpcz_store.cc:276] 0709 12:24:15.083063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.164288 (+2081225us) service_pool.cc:224] Handling call
0709 12:24:17.227570 (+ 63282us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:17.244562 (+ 16992us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:17.244594 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:17.252610 (+  8016us) log.cc:844] Serialized 52 byte log entry
0709 12:24:17.428217 (+175607us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:17.428265 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.428343 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:17.483672 (+ 55329us) raft_consensus.cc:1685] finished
0709 12:24:17.483696 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:17.483889 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13792,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":9892,"thread_start_us":143919,"threads_started":1,"wal-append.queue_time_us":189175}
W20260709 12:24:17.533046 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.536685 11134 raft_consensus.cc:2393] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 7: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:17.537549 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:17.538367 11134 raft_consensus.cc:2410] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:17.536415 10980 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0"
dest_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:52828
I20260709 12:24:17.541110 10980 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:17.541530 10980 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:17.544569 13434 raft_consensus.cc:2749] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:17.545895 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1893) took 2397 ms. Trace:
I20260709 12:24:17.546280 10983 rpcz_store.cc:276] 0709 12:24:15.148612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.284494 (+2135882us) service_pool.cc:224] Handling call
0709 12:24:17.302080 (+ 17586us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:17.302349 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:17.427678 (+125329us) log.cc:844] Serialized 14 byte log entry
0709 12:24:17.540192 (+112514us) log.cc:844] Serialized 14 byte log entry
0709 12:24:17.545521 (+  5329us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:17.545572 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:17.545617 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.545698 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:17.545834 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28701,"prepare.queue_time_us":18960,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":33772,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":163,"thread_start_us":196383,"threads_started":2,"wal-append.queue_time_us":88018}
I20260709 12:24:17.549011 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1899) took 1146 ms. Trace:
I20260709 12:24:17.549453 10981 rpcz_store.cc:276] 0709 12:24:16.403017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.548147 (+1145130us) service_pool.cc:224] Handling call
0709 12:24:17.548500 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:17.548691 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:17.548717 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:17.548756 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:17.548793 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.548842 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:17.548956 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:17.551081 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:17.551157 11098 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:17.556730 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 54398.7us
I20260709 12:24:17.557083 11645 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:17.557571 10949 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:17.557791 11098 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:17.559101 11098 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:17.559535 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:17.560678 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:17.561614 13668 raft_consensus.cc:2749] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:17.514330 13632 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:17.499368 13593 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:17.564160 11134 raft_consensus.cc:1275] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:17.564695 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:17.521629 11677 rpcz_store.cc:276] 0709 12:24:15.711734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.919269 (+207535us) service_pool.cc:224] Handling call
0709 12:24:17.499276 (+1580007us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b540021e3d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:17.499430 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1404705536}
I20260709 12:24:17.535398 13565 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:17.546200 13683 raft_consensus.cc:2804] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:17.590222 13683 raft_consensus.cc:697] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:17.566180 13672 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:17.590497 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:17.591342 11675 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
W20260709 12:24:17.591957 11675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41762 (request call id 553) took 2138 ms (client timeout 1684 ms). Trace:
W20260709 12:24:17.592372 11675 rpcz_store.cc:269] 0709 12:24:15.453678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.458265 (+  4587us) service_pool.cc:224] Handling call
0709 12:24:17.590296 (+2132031us) spinlock_profiling.cc:243] Waited 5.84 ms on lock 0x7b5800004598. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90daa0a0 00007f8f90da9984 00007f8f8a3246d4 00007f8f8a324662
0709 12:24:17.591856 (+  1560us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13442432}
I20260709 12:24:17.571506 13400 raft_consensus.cc:2804] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:17.594348 13400 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.594794 13400 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:17.595871 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:17.596802 11053 raft_consensus.cc:2393] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
W20260709 12:24:17.597288 11053 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1579) took 1978 ms (client timeout 1665 ms). Trace:
I20260709 12:24:17.571892 13556 consensus_queue.cc:1059] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 5.6, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:17.598611 13556 consensus_queue.cc:1243] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer 7518bdeb78f24e67a530754ae48547eb log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:17.566403 13674 raft_consensus.cc:2804] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:17.599270 13674 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:17.599736 13674 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:17.600152 13671 log.cc:927] Time spent T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.527s	user 0.001s	sys 0.000s
I20260709 12:24:17.530201 13662 raft_consensus.cc:740] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:17.608461 13662 consensus_queue.cc:260] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:17.609611 13662 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:17.610530 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1858) took 1344 ms. Trace:
I20260709 12:24:17.610982 11125 rpcz_store.cc:276] 0709 12:24:16.265952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.266148 (+   196us) service_pool.cc:224] Handling call
0709 12:24:16.311342 (+ 45194us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:16.311645 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:24:16.311672 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:16.373921 (+ 62249us) log.cc:844] Serialized 26 byte log entry
0709 12:24:16.689416 (+315495us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:16.689454 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.689522 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:17.599486 (+909964us) spinlock_profiling.cc:243] Waited 5.09 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:17.610183 (+ 10697us) raft_consensus.cc:1685] finished
0709 12:24:17.610204 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:17.610463 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11708800,"thread_start_us":308187,"threads_started":1,"wal-append.queue_time_us":471212}
W20260709 12:24:17.613673 13692 log.cc:927] Time spent T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 12:24:17.616102 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 305) took 1834 ms. Trace:
I20260709 12:24:17.616539 10977 rpcz_store.cc:276] 0709 12:24:15.781828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.327685 (+1545857us) service_pool.cc:224] Handling call
0709 12:24:17.328009 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:17.445911 (+117902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.615834 (+169923us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54001ab3d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:17.616032 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269605760}
W20260709 12:24:17.618575 13646 log.cc:927] Time spent T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 1.513s	user 0.003s	sys 0.013s
I20260709 12:24:17.620395 13516 raft_consensus.cc:3055] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:17.620851 13516 raft_consensus.cc:740] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:17.625075 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:17.626124 11677 raft_consensus.cc:2410] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:17.567147 13613 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:17.628475 13613 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:17.569070 10980 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:17.630434 11679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 533) took 3365 ms. Trace:
I20260709 12:24:17.631656 10980 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:17.630848 11679 rpcz_store.cc:276] 0709 12:24:14.264833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.736740 (+471907us) service_pool.cc:224] Handling call
0709 12:24:14.737153 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:14.887681 (+150528us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:14.887713 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:15.683415 (+795702us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b2c0004b818. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8a6dda11 00007f8f8a6ed372 00007f8f8be1fa01 00007f8f8bde443a 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2
0709 12:24:15.707517 (+ 24102us) log.cc:844] Serialized 26 byte log entry
0709 12:24:15.887610 (+180093us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:16.008801 (+121191us) log.cc:844] Serialized 14 byte log entry
0709 12:24:16.009633 (+   832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.009734 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:17.617823 (+1608089us) spinlock_profiling.cc:243] Waited 85.5 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:17.630171 (+ 12348us) raft_consensus.cc:1685] finished
0709 12:24:17.630205 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:17.630366 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":185405,"prepare.queue_time_us":219842,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":42,"raft.queue_time_us":212854,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":3189,"spinlock_wait_cycles":203746560,"thread_start_us":254638,"threads_started":2,"wal-append.queue_time_us":378914}
I20260709 12:24:17.633131 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:17.633903 11673 raft_consensus.cc:2368] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 7. Current term is 8.
I20260709 12:24:17.635887 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:17.636554 11129 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:17.562425 13607 raft_consensus.cc:2749] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:17.626678 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:17.639225 13593 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:17.588105 13565 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:17.640344 13565 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:17.642010 13408 raft_consensus.cc:1064] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:24:17.644307 13408 consensus_queue.cc:237] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 3, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:17.645459 11129 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 5.
I20260709 12:24:17.589053 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1281) took 1448 ms. Trace:
I20260709 12:24:17.632182 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:52828 (request call id 1895) took 1249 ms. Trace:
I20260709 12:24:17.646596 10980 rpcz_store.cc:276] 0709 12:24:16.387858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.530552 (+1142694us) service_pool.cc:224] Handling call
0709 12:24:17.632071 (+101519us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:17.587764 13560 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:17.647848 10982 rpcz_store.cc:276] 0709 12:24:16.141124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.396093 (+1254969us) service_pool.cc:224] Handling call
0709 12:24:17.396383 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:17.396586 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:17.425979 (+ 29393us) log.cc:844] Serialized 14 byte log entry
0709 12:24:17.565894 (+139915us) log.cc:844] Serialized 14 byte log entry
0709 12:24:17.588683 (+ 22789us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:17.588737 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:17.588788 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.588862 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:17.588988 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22364,"prepare.queue_time_us":46213,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":92,"raft.queue_time_us":24793,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"spinlock_wait_cycles":31729408,"thread_start_us":139269,"threads_started":1}
I20260709 12:24:17.574424 13164 consensus_queue.cc:237] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:17.653533 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 96016.8us
I20260709 12:24:17.659760 10949 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:17.625926 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:17.626616 11128 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1658) took 2658 ms (client timeout 2152 ms). Trace:
W20260709 12:24:17.663322 11128 rpcz_store.cc:269] 0709 12:24:14.973275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.098917 (+125642us) service_pool.cc:224] Handling call
0709 12:24:17.626355 (+2527438us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b5400373054. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:17.626517 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1382130560}
W20260709 12:24:17.597651 11053 rpcz_store.cc:269] 0709 12:24:15.618920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.619562 (+   642us) service_pool.cc:224] Handling call
0709 12:24:17.595674 (+1976112us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b58001a5e98. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90daa0a0 00007f8f90da9984 00007f8f8a3246d4 00007f8f8a324662
0709 12:24:17.597206 (+  1532us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2596224}
I20260709 12:24:17.656611 11645 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:17.675009 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1277) took 1544 ms. Trace:
I20260709 12:24:17.675733 10975 rpcz_store.cc:276] 0709 12:24:16.140020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.344758 (+1204738us) service_pool.cc:224] Handling call
0709 12:24:17.363227 (+ 18469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:17.363442 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:17.431964 (+ 68522us) log.cc:844] Serialized 14 byte log entry
0709 12:24:17.674563 (+242599us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:17.674632 (+    69us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:17.674691 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.674774 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:17.674925 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26383,"prepare.queue_time_us":71341,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"thread_start_us":223437,"threads_started":1}
I20260709 12:24:17.678939 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:17.679354 11673 raft_consensus.cc:1240] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:17.681756 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:17.682009 10949 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:17.683053 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:17.683641 11130 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:17.686435 11673 raft_consensus.cc:1240] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:17.690743 11673 raft_consensus.cc:1240] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:17.588796 13698 consensus_queue.cc:1059] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.124s
W20260709 12:24:17.707828 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.694331 13699 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:17.692018 13525 raft_consensus.cc:2804] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:17.717657 13525 raft_consensus.cc:697] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 5 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:17.718686 13525 consensus_queue.cc:237] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:17.722872 11672 raft_consensus.cc:1240] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:17.621798 13516 consensus_queue.cc:260] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:17.704650 10949 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:17.664587 13204 consensus_queue.cc:1059] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:24:17.719314 11674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41784 (request call id 543) took 1999 ms. Trace:
W20260709 12:24:17.741398 13647 log.cc:927] Time spent T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 1.632s	user 0.006s	sys 0.003s
I20260709 12:24:17.743005 13683 consensus_queue.cc:237] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:17.697909 13593 raft_consensus.cc:2804] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:17.761113 13593 raft_consensus.cc:697] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:17.762363 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:17.762907 13699 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:17.711449 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:17.747004 13706 log.cc:927] Time spent T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 12:24:17.736265 11130 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:24:17.766861 11676 raft_consensus.cc:2393] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 8: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:17.769256 11645 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:17.772935 13699 raft_consensus.cc:697] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 7 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
W20260709 12:24:17.766136 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 136630us
W20260709 12:24:17.773663 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.774070 13674 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:17.749652 11674 rpcz_store.cc:276] 0709 12:24:15.720096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.911974 (+191878us) service_pool.cc:224] Handling call
0709 12:24:17.719057 (+1807083us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b5400563e54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:17.719240 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26018688}
I20260709 12:24:17.775315 11131 raft_consensus.cc:1240] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:17.773962 13699 consensus_queue.cc:237] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:17.781759 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:17.782537 11676 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:17.775646 13530 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.186s	user 0.019s	sys 0.004s
W20260709 12:24:17.788080 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 83509.3us
I20260709 12:24:17.766533 13516 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:17.797780 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 93125.3us
I20260709 12:24:17.799079 10949 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:17.788021 13530 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.202s	user 0.019s	sys 0.005s
I20260709 12:24:17.804750 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1264) took 3138 ms. Trace:
I20260709 12:24:17.805119 10976 rpcz_store.cc:276] 0709 12:24:14.666666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.641581 (+974915us) service_pool.cc:224] Handling call
0709 12:24:15.641886 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:16.097642 (+455756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.804475 (+1706833us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b5400333e54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:17.804684 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":587004160}
I20260709 12:24:17.806531 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1273) took 2888 ms. Trace:
I20260709 12:24:17.806944 10978 rpcz_store.cc:276] 0709 12:24:14.918436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.726360 (+807924us) service_pool.cc:224] Handling call
0709 12:24:15.913105 (+186745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:16.096801 (+183696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.806320 (+1709519us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54000da050. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:17.806464 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":395009408}
I20260709 12:24:17.809420 11098 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:17.787761 13485 raft_consensus.cc:2804] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:24:17.803802 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.804282 10949 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:17.810794 11098 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:17.814033 11098 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:17.816347 11098 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:17.802544 13400 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:17.820611 11676 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
W20260709 12:24:17.803468 13663 consensus_meta.cc:287] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.642s	user 0.003s	sys 0.008s
I20260709 12:24:17.822628 10949 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:17.823283 11055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 335) took 2453 ms. Trace:
I20260709 12:24:17.821482 13408 raft_consensus.cc:2749] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:17.803022 13666 raft_consensus.cc:3055] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:17.803840 13560 raft_consensus.cc:2749] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:17.827869 10949 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:17.824651 11055 rpcz_store.cc:276] 0709 12:24:15.366052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.367355 (+  1303us) service_pool.cc:224] Handling call
0709 12:24:15.382050 (+ 14695us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:15.518931 (+136881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:15.518967 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:15.568245 (+ 49278us) log.cc:844] Serialized 26 byte log entry
0709 12:24:15.881506 (+313261us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:15.881568 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:15.881646 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:17.740752 (+1859106us) spinlock_profiling.cc:243] Waited 82.2 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:17.819279 (+ 78527us) raft_consensus.cc:1685] finished
0709 12:24:17.819300 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:17.819504 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20607,"raft.queue_time_us":32179,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":84,"spinlock_wait_cycles":189138304,"thread_start_us":428142,"threads_started":2,"wal-append.queue_time_us":540201}
I20260709 12:24:17.830821 11098 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:17.834717 11025 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:17.837085 13565 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:17.839037 13674 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:17.839409 13565 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:17.840212 11126 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:17.814448 13204 raft_consensus.cc:2749] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:17.833662 10948 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:17.821966 13669 raft_consensus.cc:2749] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:17.832657 11676 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 LEARNER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:24:17.850443 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.820834 13485 raft_consensus.cc:697] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:17.880378 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:17.881426 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:17.842609 10949 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:17.868222 11098 leader_election.cc:400] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 7. Current term is 8.
I20260709 12:24:17.882979 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:17.883157 10949 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:17.883567 10980 raft_consensus.cc:2376] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8. Re-sending same reply.
I20260709 12:24:17.884433 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:17.884872 10977 raft_consensus.cc:2376] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6. Re-sending same reply.
I20260709 12:24:17.885654 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:17.885875 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:17.821671 13607 raft_consensus.cc:2804] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:17.822168 13680 raft_consensus.cc:2749] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:17.871580 13525 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:17.873232 11054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1595) took 1622 ms. Trace:
I20260709 12:24:17.873819 13676 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:17.874584 11051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1586) took 2230 ms. Trace:
I20260709 12:24:17.895291 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:17.897313 11098 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:24:17.869378 13565 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:17.869823 13434 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:17.893390 11054 rpcz_store.cc:276] 0709 12:24:16.250537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.251039 (+   502us) service_pool.cc:224] Handling call
0709 12:24:16.262688 (+ 11649us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:16.266228 (+  3540us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:16.854607 (+588379us) log.cc:844] Serialized 14 byte log entry
0709 12:24:17.091838 (+237231us) log.cc:844] Serialized 14 byte log entry
0709 12:24:17.871912 (+780074us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b1800434320. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88c71c0a 00007f8f923b1219 00007f8f88cf9a40 00007f8f88cf44e4 00007f8f88cf4455 00007f8f8bddc060 00007f8f8bdee716 00007f8f8bdff287 00007f8f8bdff208
0709 12:24:17.872064 (+   152us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:17.872116 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:17.872164 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.872982 (+   818us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b54003719d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:17.873024 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:17.873165 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":768335,"prepare.queue_time_us":650095,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":95,"raft.queue_time_us":786795,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":6586,"spinlock_wait_cycles":12201984,"thread_start_us":776077,"threads_started":2,"wal-append.queue_time_us":421969}
I20260709 12:24:17.829180 13666 raft_consensus.cc:740] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:17.812995 13698 consensus_queue.cc:1048] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:24:17.886329 10981 raft_consensus.cc:2376] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5. Re-sending same reply.
I20260709 12:24:17.888774 13677 raft_consensus.cc:2804] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:17.833899 13408 raft_consensus.cc:2749] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:17.882351 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:17.918589 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:17.919226 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:17.919819 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:17.889979 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:17.921137 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:17.921950 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:17.891160 10949 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:17.922585 11681 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 LEARNER]: Advancing to term 6
I20260709 12:24:17.893015 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:17.923346 10976 raft_consensus.cc:2376] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5. Re-sending same reply.
W20260709 12:24:17.897621 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 62961.8us
I20260709 12:24:17.924983 11025 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:17.893265 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:17.901261 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:17.926636 10975 raft_consensus.cc:2393] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 7: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:17.892248 13560 raft_consensus.cc:2749] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:24:17.904939 13704 log.cc:927] Time spent T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:24:17.907600 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:17.886897 13228 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.886498 10977 raft_consensus.cc:2376] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5. Re-sending same reply.
I20260709 12:24:17.944809 10982 raft_consensus.cc:2393] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 7: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
W20260709 12:24:17.915599 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:17.945606 11024 connection.cc:256] RPC call timeout handler was delayed by -1.0936459660001674s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1507s for a response
I20260709 12:24:17.945734 13538 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.946406 13538 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:17.870146 13593 consensus_queue.cc:237] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:17.889561 13607 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:17.947916 13607 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:17.948736 13538 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:17.912302 13674 consensus_queue.cc:1059] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:24:17.950619 13674 raft_consensus.cc:3055] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:17.950978 13674 raft_consensus.cc:740] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:17.951503 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:17.920075 10979 raft_consensus.cc:2393] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 7: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:17.952353 11058 raft_consensus.cc:2368] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 8. Current term is 9.
I20260709 12:24:17.951920 13674 consensus_queue.cc:260] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:17.953879 13674 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:17.954785 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:17.955560 11060 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
I20260709 12:24:17.902043 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:17.895581 11051 rpcz_store.cc:276] 0709 12:24:15.643968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.644155 (+   187us) service_pool.cc:224] Handling call
0709 12:24:15.661109 (+ 16954us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:16.876850 (+1215741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.874311 (+997461us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400188dd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:17.874499 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2757659904}
I20260709 12:24:17.925859 10983 raft_consensus.cc:2376] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5. Re-sending same reply.
I20260709 12:24:17.922706 11056 raft_consensus.cc:2393] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 8: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:17.932653 11681 raft_consensus.cc:1275] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 LEARNER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:17.950892 11057 raft_consensus.cc:1240] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:24:17.935969 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:17.979211 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:17.895956 10978 raft_consensus.cc:2376] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6. Re-sending same reply.
W20260709 12:24:17.940361 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 49245.6us
I20260709 12:24:17.829766 13663 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:17.942965 11054 raft_consensus.cc:1240] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:17.984181 10949 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:17.908274 13631 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:17.999177 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.955869 13607 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:17.941654 11025 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:17.912842 13542 raft_consensus.cc:2749] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:17.926972 13677 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:17.997483 10949 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:18.009375 10949 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:17.926507 11674 raft_consensus.cc:1240] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 5. Current term is 7. Ops: [5.7-5.7]
I20260709 12:24:17.904856 13669 consensus_queue.cc:1059] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 12:24:17.912547 13640 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:18.003422 11059 raft_consensus.cc:1240] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:18.020853 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:17.912683 13683 consensus_queue.cc:1059] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 12:24:17.935638 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:18.004776 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:18.026961 11053 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:18.012494 11676 raft_consensus.cc:1240] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:18.012730 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 110932us
I20260709 12:24:17.942304 13339 raft_consensus.cc:2804] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:17.984777 13562 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:18.015873 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:17.939851 13434 raft_consensus.cc:697] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:18.020823 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:18.037365 11057 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:24:18.021139 11051 raft_consensus.cc:1240] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:18.003844 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 65723.6us
I20260709 12:24:18.027559 11056 raft_consensus.cc:1275] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:24:18.038698 11057 raft_consensus.cc:1240] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:24:18.004256 13408 raft_consensus.cc:2749] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:18.011086 13538 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:18.014631 13677 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:18.006484 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:18.017215 13338 raft_consensus.cc:2749] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:18.057487 13607 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:18.016518 13204 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:18.063313 13204 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:18.065570 13204 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:17.995976 13228 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:18.043233 11058 raft_consensus.cc:1240] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:18.045403 10949 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
W20260709 12:24:18.067355 13687 log.cc:927] Time spent T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.709s	user 0.003s	sys 0.000s
I20260709 12:24:18.067538 11098 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:18.068038 13228 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:18.068434 10949 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:18.048971 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:18.070385 13400 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:18.021643 13699 raft_consensus.cc:2749] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:18.071204 13578 raft_consensus.cc:2749] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:18.071369 13699 consensus_queue.cc:1048] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:18.072414 13663 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:18.072642 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:18.072886 13699 raft_consensus.cc:2749] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:18.046993 13538 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:18.073839 13538 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:18.050516 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:18.075484 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:18.007329 13631 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:18.030378 13640 raft_consensus.cc:697] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:18.032995 11675 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:18.062450 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:18.079207 13296 raft_consensus.cc:3055] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:18.079344 11677 raft_consensus.cc:2368] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8.
I20260709 12:24:18.040731 13339 raft_consensus.cc:697] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:24:18.041934 13716 log.cc:927] Time spent T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 12:24:18.115500 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:18.116325 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:18.116737 11129 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:18.117060 11131 raft_consensus.cc:2393] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 7: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:18.117851 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:18.080514 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:18.121577 11133 raft_consensus.cc:2393] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:18.078722 10976 raft_consensus.cc:1240] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:18.123737 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:18.124408 10976 raft_consensus.cc:2376] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7. Re-sending same reply.
I20260709 12:24:18.036381 13681 raft_consensus.cc:3055] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:18.081331 13568 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:18.184944 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:18.186189 11052 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
I20260709 12:24:18.186932 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:18.081430 13434 consensus_queue.cc:237] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:18.014847 13632 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:18.083169 10975 raft_consensus.cc:1240] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:24:18.188969 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:18.189469 13632 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:18.189642 10975 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
I20260709 12:24:18.190675 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:18.033113 13666 consensus_queue.cc:260] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:18.192641 13666 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:18.194437 13607 consensus_queue.cc:1059] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:18.195209 13607 consensus_queue.cc:1243] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer bc01179655564f29b83babe396377cbb log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:24:18.080004 13717 log.cc:927] Time spent T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:24:18.087000 10981 raft_consensus.cc:1240] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 12:24:18.052861 13657 log.cc:927] Time spent T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 1.946s	user 0.009s	sys 0.019s
I20260709 12:24:18.033948 13562 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:18.091969 11643 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:18.197597 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:18.198330 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 106474us
I20260709 12:24:18.011225 13485 consensus_queue.cc:237] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:18.094463 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:18.085525 13560 consensus_queue.cc:1059] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:18.049835 11057 raft_consensus.cc:1240] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 12:24:18.203150 11129 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
W20260709 12:24:18.204790 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.205160 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:18.205884 10981 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 5.
I20260709 12:24:18.206174 13562 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:18.206871 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:18.207751 13538 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:24:18.119002 11126 raft_consensus.cc:3055] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:18.209450 11126 raft_consensus.cc:740] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:18.210026 13663 raft_consensus.cc:2804] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:18.210292 11126 consensus_queue.cc:260] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:18.211577 11126 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:18.120324 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:18.213943 13629 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.214577 13629 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:18.215229 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:18.216220 11128 raft_consensus.cc:2410] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:18.120954 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:18.121106 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:18.219110 13663 raft_consensus.cc:697] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:18.219409 11130 raft_consensus.cc:2410] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:24:18.123761 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:18.220368 11054 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 5.
I20260709 12:24:18.220077 13663 consensus_queue.cc:237] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:18.221555 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:24:18.101356 13257 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.266s	user 0.009s	sys 0.020s
W20260709 12:24:18.222319 13257 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.387s	user 0.009s	sys 0.021s
I20260709 12:24:18.128290 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:18.223232 11058 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:18.130443 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:18.210038 13538 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:18.226233 13410 consensus_queue.cc:1059] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:18.132156 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:18.135125 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:18.096987 13296 raft_consensus.cc:740] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:18.228583 10982 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
I20260709 12:24:18.136631 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:18.104034 13635 consensus_queue.cc:1059] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.132s
I20260709 12:24:18.119915 13578 consensus_queue.cc:1059] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.110s
I20260709 12:24:18.138707 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:18.230728 11680 raft_consensus.cc:2410] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:18.139866 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:18.231623 11056 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:18.140882 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:18.234005 11051 raft_consensus.cc:2393] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:18.148581 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:18.235015 10983 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:18.152179 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:18.163070 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:18.164613 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:18.172612 11024 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:18.237625 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 65218.5us
I20260709 12:24:18.174144 10880 catalog_manager.cc:5697] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:18.178882 10881 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41098 (request call id 283) took 19892 ms (client timeout 15000 ms). Trace:
W20260709 12:24:18.180145 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 58818.7us
I20260709 12:24:18.093034 13662 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:18.187420 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:18.191788 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:18.225925 10978 raft_consensus.cc:2376] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7. Re-sending same reply.
I20260709 12:24:18.239265 10975 raft_consensus.cc:2393] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 7: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:18.235896 11676 raft_consensus.cc:2368] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6.
I20260709 12:24:18.240617 10975 raft_consensus.cc:1275] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:18.180368 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:18.199371 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1820) took 3364 ms. Trace:
I20260709 12:24:18.241995 10975 raft_consensus.cc:1240] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:24:18.243474 10977 raft_consensus.cc:1240] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:18.208139 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:18.218519 13629 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:18.242558 11024 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:18.246354 10981 raft_consensus.cc:2393] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 8: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:18.253042 11679 raft_consensus.cc:1240] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:18.106986 11053 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:18.259745 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:18.257524 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:18.261121 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:18.261457 11024 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:18.263051 11057 raft_consensus.cc:2410] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:24:18.264075 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:18.264760 11059 raft_consensus.cc:3055] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:18.265116 11059 raft_consensus.cc:740] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:18.184860 13631 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:18.244450 11132 rpcz_store.cc:276] 0709 12:24:14.834772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.363769 (+528997us) service_pool.cc:224] Handling call
0709 12:24:15.364116 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:15.920714 (+556598us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b1800038740. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cd9e07 00007f8f91b349a9 00007f8f88cf669b 00007f8f88cf493f 00007f8f88cf4455 00007f8f8bddc060 00007f8f8bddcbfb 00007f8f8bde764b 00007f8f8bde3d8f
0709 12:24:16.068870 (+148156us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:24:16.068907 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:16.102785 (+ 33878us) log.cc:844] Serialized 26 byte log entry
0709 12:24:16.107571 (+  4786us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:16.107611 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.107680 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:17.891719 (+1784039us) spinlock_profiling.cc:243] Waited 81.1 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:18.199117 (+307398us) raft_consensus.cc:1685] finished
0709 12:24:18.199139 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:18.199308 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85986,"raft.queue_time_us":100648,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":6605,"spinlock_wait_cycles":193554688,"thread_start_us":94167,"threads_started":2,"wal-append.queue_time_us":4026}
I20260709 12:24:18.259595 13272 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:18.097271 13400 consensus_queue.cc:1059] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.150s
I20260709 12:24:18.275169 11126 raft_consensus.cc:1275] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:24:18.276053 11126 pending_rounds.cc:85] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 3
I20260709 12:24:18.276463 11126 pending_rounds.cc:107] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:24:18.277205 11126 raft_consensus.cc:2889] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:18.270076 10978 raft_consensus.cc:1275] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:24:18.270794 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 229722us
I20260709 12:24:18.270042 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:18.182176 13681 raft_consensus.cc:740] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:18.272439 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:18.263130 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:18.273494 11058 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
I20260709 12:24:18.115723 13627 consensus_queue.cc:1059] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.146s
I20260709 12:24:18.269274 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:18.284122 11053 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:18.276940 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:18.279618 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:18.284368 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.278151 11131 raft_consensus.cc:2368] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 4. Current term is 5.
I20260709 12:24:18.284529 11132 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:18.287097 11054 raft_consensus.cc:2393] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 7: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
W20260709 12:24:18.290288 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 55209.7us
I20260709 12:24:18.258471 13525 raft_consensus.cc:2749] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:18.292742 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:18.260432 11052 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:18.298662 10949 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:18.304877 10949 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:18.306162 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.302387 11097 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:18.272915 13572 raft_consensus.cc:3055] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:18.312794 10949 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:18.308823 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:18.314146 11131 raft_consensus.cc:2393] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 7: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:18.308949 11097 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:24:18.291189 10880 catalog_manager.cc:5697] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 2 to 3, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 3 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:18.310680 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:18.308025 11059 consensus_queue.cc:260] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:18.316584 11129 raft_consensus.cc:2393] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 7: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:18.316696 11059 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:18.296494 13607 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:24:18.321259 10949 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:18.325522 13683 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:18.333390 10979 raft_consensus.cc:1240] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:18.228919 13640 consensus_queue.cc:237] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:18.334990 11097 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:18.264422 13721 consensus_queue.cc:1059] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:24:18.335749 10949 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:18.343849 10949 leader_election.cc:400] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 election: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 4. Current term is 5.
I20260709 12:24:18.344238 10949 leader_election.cc:403] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:24:18.320410 13669 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:18.400377 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:18.312433 13572 raft_consensus.cc:740] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:18.377082 11059 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:18.379940 11053 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:18.424031 11054 raft_consensus.cc:1240] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:18.374524 10983 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
I20260709 12:24:18.406419 11126 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:18.295284 13674 consensus_queue.cc:1048] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:24:18.320010 13560 raft_consensus.cc:2749] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:18.412446 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:18.438776 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:18.439527 11131 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
I20260709 12:24:18.329679 13508 raft_consensus.cc:3055] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:18.440636 13508 raft_consensus.cc:740] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:18.441679 13508 consensus_queue.cc:260] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:18.410668 13723 raft_consensus.cc:2804] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:18.443033 13508 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:18.411054 13400 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:18.447374 13400 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:18.450533 13400 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:18.238453 10881 rpcz_store.cc:269] 0709 12:23:58.286483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.293316 (+  6833us) service_pool.cc:224] Handling call
0709 12:24:18.178585 (+19885269us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:12.213271 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:12.219322 (+  6051us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:12.219382 (+    60us) write_op.cc:435] Acquired schema lock
0709 12:24:12.219405 (+    23us) tablet.cc:662] Decoding operations
0709 12:24:12.309779 (+ 90374us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:12.355815 (+ 46036us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:12.362012 (+  6197us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:24:12.867805 (+505793us) tablet.cc:701] Row locks acquired
0709 12:24:12.880124 (+ 12319us) write_op.cc:260] PREPARE: finished
0709 12:24:12.998882 (+118758us) write_op.cc:270] Start()
0709 12:24:13.045148 (+ 46266us) write_op.cc:276] Timestamp: P: 1783599852969232 usec, L: 0
0709 12:24:13.157632 (+112484us) op_driver.cc:348] REPLICATION: starting
0709 12:24:13.542281 (+384649us) log.cc:844] Serialized 2089 byte log entry
0709 12:24:14.632070 (+1089789us) op_driver.cc:464] REPLICATION: finished
0709 12:24:14.963567 (+331497us) write_op.cc:301] APPLY: starting
0709 12:24:14.972751 (+  9184us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:14.979183 (+  6432us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:15.039816 (+ 60633us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:15.132097 (+ 92281us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:15.132438 (+   341us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:24:15.132483 (+    45us) write_op.cc:312] APPLY: finished
0709 12:24:15.132791 (+   308us) log.cc:844] Serialized 47 byte log entry
0709 12:24:15.132999 (+   208us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:15.133107 (+   108us) write_op.cc:454] Released schema lock
0709 12:24:15.133170 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:15.133704 (+   534us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:15.133734 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4071438,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":302570,"apply.run_cpu_time_us":3906,"apply.run_wall_time_us":175738,"num_ops":5,"prepare.queue_time_us":456960,"prepare.run_cpu_time_us":79542,"prepare.run_wall_time_us":2169199,"raft.queue_time_us":212755,"raft.run_cpu_time_us":96615,"raft.run_wall_time_us":300315,"replication_time_us":1361659,"thread_start_us":1338476,"threads_started":4,"wal-append.queue_time_us":634314,"wal-append.run_cpu_time_us":75453,"wal-append.run_wall_time_us":1952970}]]}
I20260709 12:24:18.308180 13542 consensus_queue.cc:1059] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 12:24:18.332152 13699 raft_consensus.cc:2749] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:18.443955 11645 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:18.346661 13525 raft_consensus.cc:2749] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:18.329216 13578 raft_consensus.cc:2749] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:18.416191 11675 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:18.455271 11131 raft_consensus.cc:1240] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:18.371328 13164 raft_consensus.cc:2749] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:18.481436 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:18.484643 10880 catalog_manager.cc:5697] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 2 to 3, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 3 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:24:18.434219 13721 consensus_queue.cc:1243] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [LEADER]: Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 log is divergent from this leader: its last log entry 5.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:24:18.418493 13338 raft_consensus.cc:2749] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 4. Current term is 5.
I20260709 12:24:18.371551 13722 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:18.313342 13339 consensus_queue.cc:237] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:18.456147 13674 consensus_queue.cc:1243] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer bc01179655564f29b83babe396377cbb log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:18.487190 13400 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:18.401242 13681 consensus_queue.cc:260] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:18.488214 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:18.489081 11681 raft_consensus.cc:1240] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:18.597487 11060 raft_consensus.cc:1240] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:18.492669 11056 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
W20260709 12:24:18.584888 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 241175us
W20260709 12:24:18.638124 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:18.613188 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 272854us
I20260709 12:24:18.533033 10880 catalog_manager.cc:5697] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:24:18.652272 11097 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:18.648298 10880 catalog_manager.cc:5697] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 1 to 3, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 3 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
W20260709 12:24:18.658753 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 397350us
I20260709 12:24:18.673198 11056 raft_consensus.cc:1240] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:18.487496 13272 raft_consensus.cc:697] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:18.545699 13400 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:18.507176 13728 raft_consensus.cc:2804] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:18.691640 11059 raft_consensus.cc:1240] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:18.689785 10880 catalog_manager.cc:5697] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 1 to 3, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 3 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
W20260709 12:24:18.693245 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 413858us
I20260709 12:24:18.700901 11023 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:18.533872 13635 consensus_queue.cc:1059] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.148s
I20260709 12:24:18.708035 10880 catalog_manager.cc:5697] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:18.709002 11058 raft_consensus.cc:1240] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:18.713541 11024 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:24:18.652817 13676 consensus_queue.cc:1048] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:24:18.681945 13400 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:18.686945 13681 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:18.720377 11023 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:18.721386 11058 raft_consensus.cc:1275] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:18.723704 11059 raft_consensus.cc:1275] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:18.727728 11056 raft_consensus.cc:1275] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:24:18.711807 13562 consensus_meta.cc:287] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.500s	user 0.006s	sys 0.003s
W20260709 12:24:18.729861 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 77689.3us
I20260709 12:24:18.731962 10880 catalog_manager.cc:5697] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:18.609232 13572 consensus_queue.cc:260] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:18.745296 11132 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:18.724828 13728 raft_consensus.cc:697] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:18.729017 13722 raft_consensus.cc:697] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 7 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:18.766045 11679 raft_consensus.cc:1275] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:18.767282 11058 raft_consensus.cc:1275] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:18.725884 13737 consensus_queue.cc:1048] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:24:18.764885 13627 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:18.786144 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 72787.1us
I20260709 12:24:18.806284 11644 leader_election.cc:400] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 8. Current term is 9.
I20260709 12:24:18.806641 11644 leader_election.cc:403] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:24:18.753736 13669 raft_consensus.cc:697] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 7 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:18.765905 13726 raft_consensus.cc:2749] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:24:18.790916 13724 log.cc:927] Time spent T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 12:24:18.740929 13735 consensus_queue.cc:1048] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:24:18.762950 13272 consensus_queue.cc:237] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:18.789613 13733 consensus_queue.cc:1048] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:18.786952 13722 consensus_queue.cc:237] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:18.799326 13572 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:18.786433 13728 consensus_queue.cc:237] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:18.738250 13562 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:18.778740 11680 raft_consensus.cc:1240] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 5. Current term is 7. Ops: [5.7-5.7]
W20260709 12:24:18.804163 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 162165us
I20260709 12:24:18.807911 11644 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:18.778283 13258 raft_consensus.cc:2749] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:18.809659 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:18.776598 13485 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:18.811962 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:18.842828 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:18.843156 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.810005 13593 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 8. Current term is 9.
I20260709 12:24:18.777885 13743 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:24:18.804354 13729 log.cc:927] Time spent T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:24:18.795280 10948 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:18.809636 13736 log.cc:927] Time spent T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 12:24:18.833127 13666 consensus_meta.cc:287] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.640s	user 0.006s	sys 0.002s
W20260709 12:24:18.838218 13677 consensus_meta.cc:287] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.764s	user 0.010s	sys 0.002s
I20260709 12:24:18.800791 11052 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
I20260709 12:24:18.872787 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:18.844555 10949 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:18.776443 13542 raft_consensus.cc:3055] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:18.876849 13542 raft_consensus.cc:740] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:18.841812 11058 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
I20260709 12:24:18.776751 13631 consensus_queue.cc:1059] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:24:18.879279 13631 raft_consensus.cc:3055] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:18.879649 13631 raft_consensus.cc:740] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:24:18.857883 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 62709us
I20260709 12:24:18.880730 13593 raft_consensus.cc:2804] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:18.881209 13593 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:18.881590 13593 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:18.885639 13532 raft_consensus.cc:3055] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:18.886078 13532 raft_consensus.cc:740] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
W20260709 12:24:18.887296 13568 consensus_meta.cc:287] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.703s	user 0.010s	sys 0.000s
I20260709 12:24:18.887006 13532 consensus_queue.cc:260] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:18.888978 11127 raft_consensus.cc:2410] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:18.868021 13669 consensus_queue.cc:237] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:18.830147 13754 raft_consensus.cc:2804] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:18.841292 13676 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:18.888851 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 44388.5us
I20260709 12:24:18.914803 10949 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:18.854780 13485 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:18.880751 10948 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:18.891991 13739 raft_consensus.cc:2749] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:24:18.918063 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 178403us
I20260709 12:24:18.895087 13562 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:18.877791 13542 consensus_queue.cc:260] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:18.895105 13631 consensus_queue.cc:260] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:18.888242 13532 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:18.928323 13593 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:18.885489 13746 consensus_queue.cc:1059] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:24:18.930229 13631 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:18.900550 13699 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:18.932210 13699 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:18.934525 13738 raft_consensus.cc:2749] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:18.934712 13542 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:18.936643 13485 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:18.937386 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 56722.4us
I20260709 12:24:18.938915 13746 raft_consensus.cc:3055] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:18.811075 13627 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:18.899310 13745 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:18.939313 13746 raft_consensus.cc:740] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:18.939682 13745 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:18.888814 13677 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:18.940205 13746 consensus_queue.cc:260] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:18.941437 13746 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:18.891677 13666 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.942215 13677 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:18.942715 13572 raft_consensus.cc:2804] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:18.942874 13677 consensus_queue.cc:1059] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:18.943322 13572 raft_consensus.cc:697] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 7 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:18.944021 13739 raft_consensus.cc:3055] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:18.944404 13739 raft_consensus.cc:740] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
W20260709 12:24:18.893019 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 138557us
W20260709 12:24:18.922188 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.943895 10976 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:18.888140 13568 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.869845 13578 raft_consensus.cc:2804] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:18.924029 13747 consensus_queue.cc:1048] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:18.870965 13743 raft_consensus.cc:697] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:24:18.953387 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.900379 13754 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:18.966125 11023 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:24:18.981426 11098 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:18.982268 11023 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:18.945238 13739 consensus_queue.cc:260] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:18.971692 13593 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:18.972267 13578 raft_consensus.cc:697] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
W20260709 12:24:18.985496 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 177653us
I20260709 12:24:18.974375 13721 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.900851 13525 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:18.979480 10976 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:24:18.985574 11023 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:18.964471 13738 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:18.988238 11644 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:18.989820 11644 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:18.991238 13516 consensus_meta.cc:287] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 1.197s	user 0.005s	sys 0.006s
I20260709 12:24:18.985340 13754 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:19.078895 13719 log.cc:927] Time spent T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.679s	user 0.004s	sys 0.000s
I20260709 12:24:19.080506 11126 raft_consensus.cc:1240] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 3. Current term is 4. Ops: []
W20260709 12:24:19.083076 13730 log.cc:927] Time spent T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.636s	user 0.000s	sys 0.007s
I20260709 12:24:18.964905 13666 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:19.095715 13666 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:19.099138 11054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1269) took 1039 ms. Trace:
I20260709 12:24:19.099576 11054 rpcz_store.cc:276] 0709 12:24:18.059734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.307256 (+247522us) service_pool.cc:224] Handling call
0709 12:24:18.423820 (+116564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:18.438058 (+ 14238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:19.098886 (+660828us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400187ed0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:19.099051 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":232903424}
I20260709 12:24:19.102419 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1678) took 1619 ms. Trace:
I20260709 12:24:19.102674 11133 raft_consensus.cc:1275] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:24:19.103027 11133 pending_rounds.cc:85] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 1
I20260709 12:24:19.103260 11133 pending_rounds.cc:107] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:24:19.103502 11133 raft_consensus.cc:2889] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:19.103837 11126 raft_consensus.cc:1275] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:19.029170 13759 raft_consensus.cc:2804] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:19.029668 13752 raft_consensus.cc:2764] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:24:19.191954 13725 log.cc:927] Time spent T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.688s	user 0.001s	sys 0.000s
I20260709 12:24:19.031064 13627 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:19.031538 13757 raft_consensus.cc:2749] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:24:19.032963 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.036828 13296 consensus_queue.cc:260] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:19.039395 13698 raft_consensus.cc:3055] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:18.944285 13572 consensus_queue.cc:237] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:19.048938 13400 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:18.921906 13676 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:18.991925 13508 consensus_queue.cc:1059] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:24:19.056452 13743 consensus_queue.cc:237] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:18.991806 13485 consensus_queue.cc:1059] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:24:18.991777 13738 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:18.990993 13721 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:19.060494 13745 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:19.061051 13699 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:18.992079 13525 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:18.975152 13568 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:24:19.102876 11127 rpcz_store.cc:276] 0709 12:24:17.482926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.550803 (+ 67877us) service_pool.cc:224] Handling call
0709 12:24:19.102196 (+1551393us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b5400068e54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:19.102358 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3074548096}
I20260709 12:24:18.986406 13742 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:19.115901 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 318) took 1035 ms. Trace:
I20260709 12:24:19.137880 13578 consensus_queue.cc:237] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:19.140692 13257 raft_consensus.cc:3055] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:19.142661 11129 raft_consensus.cc:3055] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:19.057881 13593 raft_consensus.cc:2804] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:19.143383 13629 raft_consensus.cc:3055] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:19.146037 11678 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
I20260709 12:24:19.002463 13726 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:24:19.136118 13662 consensus_meta.cc:287] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.872s	user 0.012s	sys 0.000s
W20260709 12:24:19.181318 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.188920 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:19.227752 11133 raft_consensus.cc:1240] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:19.414506 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:19.456702 10948 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.014s	sys 0.008s
W20260709 12:24:19.607362 10948 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.018s	sys 0.011s
W20260709 12:24:19.607637 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 669503us
I20260709 12:24:19.608044 11129 raft_consensus.cc:740] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
W20260709 12:24:19.603771 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 622356us
W20260709 12:24:19.443579 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 389152us
W20260709 12:24:19.603765 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 687614us
I20260709 12:24:19.609727 10976 rpcz_store.cc:276] 0709 12:24:18.080961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.186634 (+105673us) service_pool.cc:224] Handling call
0709 12:24:19.115696 (+929062us) spinlock_profiling.cc:243] Waited 756 ms on lock 0x7b540033ca54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:19.115836 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1738650368}
W20260709 12:24:19.449229 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 459440us
I20260709 12:24:19.610728 11098 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:19.604480 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1705) took 1407 ms. Trace:
W20260709 12:24:19.604969 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 619409us
I20260709 12:24:19.348691  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:19.443884 11681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41774 (request call id 454) took 1145 ms. Trace:
I20260709 12:24:19.611531 11134 rpcz_store.cc:276] 0709 12:24:18.197406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.783027 (+585621us) service_pool.cc:224] Handling call
0709 12:24:18.795589 (+ 12562us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:18.800333 (+  4744us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:18.800364 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:18.807870 (+  7506us) log.cc:844] Serialized 52 byte log entry
0709 12:24:18.986877 (+179007us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:19.001120 (+ 14243us) log.cc:844] Serialized 14 byte log entry
0709 12:24:19.604107 (+602987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:19.604208 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:19.604251 (+    43us) raft_consensus.cc:1685] finished
0709 12:24:19.604264 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:19.604421 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14061,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":91953,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"thread_start_us":129359,"threads_started":1,"wal-append.queue_time_us":291884}
I20260709 12:24:19.613416 11023 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:19.615340 11644 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:19.382653 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:19.287299 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.232307 13698 raft_consensus.cc:740] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:19.231910 13759 raft_consensus.cc:697] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:24:19.630577 13681 consensus_meta.cc:287] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.890s	user 0.010s	sys 0.000s
I20260709 12:24:19.631419 13752 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:19.389662 13668 raft_consensus.cc:3055] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:19.631942 13662 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:19.632103 13752 raft_consensus.cc:697] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:19.633530 13508 consensus_queue.cc:1059] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:19.631026 13759 consensus_queue.cc:237] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:19.633285 13752 consensus_queue.cc:237] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:19.627154 13762 consensus_queue.cc:1059] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:24:19.642468 13699 consensus_queue.cc:1059] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:19.632078 13668 raft_consensus.cc:740] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:19.643196 13607 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.643693 13607 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:19.643800 13668 consensus_queue.cc:260] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:19.644820 13668 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:19.638669 13726 raft_consensus.cc:697] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:19.646950 13726 consensus_queue.cc:237] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:19.649662 13754 consensus_meta.cc:287] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.575s	user 0.003s	sys 0.002s
I20260709 12:24:19.642772 13674 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.646278 13666 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:19.647456 13746 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:19.650497 13674 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:19.650910 13746 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:19.652181 13631 consensus_meta.cc:287] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.721s	user 0.004s	sys 0.004s
W20260709 12:24:19.634280 13740 log.cc:927] Time spent T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.839s	user 0.003s	sys 0.000s
I20260709 12:24:19.614269 11681 rpcz_store.cc:276] 0709 12:24:18.298343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.298529 (+   186us) service_pool.cc:224] Handling call
0709 12:24:18.488870 (+190341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:18.631595 (+142725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:19.443597 (+812002us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b5400592c50. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:19.443804 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":387668864}
I20260709 12:24:19.305094 13296 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:19.347334 13627 raft_consensus.cc:3055] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:19.611020 13593 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:19.649714 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.606920 13257 raft_consensus.cc:740] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:19.619046 13629 raft_consensus.cc:740] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:19.656044 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:19.649844 13722 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.679675 11059 raft_consensus.cc:1240] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:19.655213 11129 consensus_queue.cc:260] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:19.675166 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 61817.9us
I20260709 12:24:19.681775 11023 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:19.654904 13508 consensus_queue.cc:1243] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer bc01179655564f29b83babe396377cbb log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:24:19.677459 13738 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:19.678821 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:19.645880 13607 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:19.657502 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:19.685173 11023 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
W20260709 12:24:19.683866 13272 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.017s	sys 0.008s
I20260709 12:24:19.644768 13676 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:19.686883 11060 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:19.675467 13627 raft_consensus.cc:740] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:19.678225 13228 raft_consensus.cc:2749] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:19.671379 13746 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:19.682009 13669 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.013s	sys 0.047s
I20260709 12:24:19.680799 13593 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:19.695693 13763 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.684772 13745 raft_consensus.cc:2749] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:19.681275 13699 consensus_queue.cc:1048] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:24:19.710505 13629 consensus_queue.cc:260] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:19.650599 13666 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:19.682861 13400 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:19.689673 13772 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.689491 11023 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
W20260709 12:24:19.719336 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 108685us
I20260709 12:24:19.750147 11098 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:19.751580 11098 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:19.655859 13754 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:19.692670 13272 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.018s	sys 0.008s
I20260709 12:24:19.735298 13629 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:19.738643 11057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1600) took 1689 ms. Trace:
I20260709 12:24:19.694226 13762 raft_consensus.cc:3055] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:19.763002 13762 raft_consensus.cc:740] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:19.764184 13762 consensus_queue.cc:260] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:19.765604 13762 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:19.695758 13525 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:19.766352 13627 consensus_queue.cc:260] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:19.767153 10975 raft_consensus.cc:1240] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 7. Current term is 8. Ops: [4.6-7.8]
I20260709 12:24:19.766515 11054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:24:19.769590 11054 raft_consensus.cc:606] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:24:19.756744 13745 raft_consensus.cc:2749] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:19.770710 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:19.771381 10975 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
I20260709 12:24:19.773319 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:19.774668 10975 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:24:19.777336 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:19.686836 13722 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:19.779583 10975 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:24:19.712759 13742 raft_consensus.cc:2749] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:24:19.724614 13669 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.013s	sys 0.048s
W20260709 12:24:19.781673 11678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41774 (request call id 442) took 2155 ms (client timeout 1543 ms). Trace:
I20260709 12:24:19.706972 13676 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:19.713120 13434 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:19.782081 11678 rpcz_store.cc:269] 0709 12:24:17.626059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.662783 (+ 36724us) service_pool.cc:224] Handling call
0709 12:24:19.781486 (+2118703us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5400455454. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:19.781604 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3339710720}
I20260709 12:24:19.782441 13434 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:19.784634 13434 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:19.763055 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1706) took 1565 ms. Trace:
I20260709 12:24:19.785079 11673 raft_consensus.cc:1275] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:19.785151 11125 rpcz_store.cc:276] 0709 12:24:18.197666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.883194 (+685528us) service_pool.cc:224] Handling call
0709 12:24:18.883586 (+   392us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:18.883955 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:18.883981 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:18.884563 (+   582us) log.cc:844] Serialized 52 byte log entry
0709 12:24:19.236527 (+351964us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:19.236569 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:19.236647 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:19.762790 (+526143us) raft_consensus.cc:1685] finished
0709 12:24:19.762838 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:19.762991 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38981,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":151,"thread_start_us":351540,"threads_started":1,"wal-append.queue_time_us":876450}
I20260709 12:24:19.787056 11673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41774 (request call id 449) took 2085 ms. Trace:
I20260709 12:24:19.785039 11130 raft_consensus.cc:1240] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:19.691691 13738 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.690675 13631 raft_consensus.cc:2749] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:19.757467 11057 rpcz_store.cc:276] 0709 12:24:18.049137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.273444 (+224307us) service_pool.cc:224] Handling call
0709 12:24:18.273841 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:18.281045 (+  7204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:18.281081 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:18.315601 (+ 34520us) log.cc:844] Serialized 26 byte log entry
0709 12:24:18.666717 (+351116us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:18.666835 (+   118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:18.666970 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:19.629776 (+962806us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b24002b7f48. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88b7d9c4 00007f8f88b7bacb 00007f8f88d36dc9 00007f8f88d36a55 00007f8f88d3609d 00007f8f8b96810e 00007f8f8b97f88c 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221
0709 12:24:19.719556 (+ 89780us) raft_consensus.cc:1685] finished
0709 12:24:19.719578 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:19.738571 (+ 18993us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18772,"raft.queue_time_us":262574,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":59360,"spinlock_wait_cycles":8698752,"thread_start_us":250103,"threads_started":1,"wal-append.queue_time_us":395768}
I20260709 12:24:19.793534 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:19.793046 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:19.794250 10982 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
I20260709 12:24:19.787480 11673 rpcz_store.cc:276] 0709 12:24:17.701537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.701667 (+   130us) service_pool.cc:224] Handling call
0709 12:24:18.137724 (+436057us) spinlock_profiling.cc:243] Waited 9.83 ms on lock 0x7b5800004598. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90dbdfc0 00007f8f90da8929 00007f8f90da83d2 00007f8f8a31fbd4
0709 12:24:19.784745 (+1647021us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:19.785848 (+  1103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:19.786801 (+   953us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b5400455450. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:19.786977 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3809764992}
I20260709 12:24:19.780629 13722 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:19.792609 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 103179us
I20260709 12:24:19.797508 11023 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:19.801692 11060 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:24:19.715952 13763 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:19.805828 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 49503.8us
I20260709 12:24:19.817248 13525 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.807039 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:19.848376 10982 raft_consensus.cc:2410] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 7 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:19.708247 13769 consensus_queue.cc:1059] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:24:19.819788 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:19.815974 11023 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:19.744504 13721 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:19.821815 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:19.794250 13666 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:19.854596 11098 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:19.785539 13676 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:19.842247 11097 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:19.787163 13408 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:19.857218 11097 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:19.849042 10981 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:24:19.822997 13733 raft_consensus.cc:2749] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:19.815346 13228 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:24:19.873706 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 57807.1us
W20260709 12:24:19.866437 13723 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.423s	user 0.005s	sys 0.009s
W20260709 12:24:19.866812 13572 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.001s	sys 0.011s
W20260709 12:24:19.868631 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.817775 13738 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:19.866500 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 248941us
W20260709 12:24:19.871206 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 249141us
W20260709 12:24:19.898056 11025 leader_election.cc:336] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 1.659s (SENT)
W20260709 12:24:19.871774 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 236158us
W20260709 12:24:19.872080 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.874509 11023 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:19.875331 11097 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:19.742767 13257 consensus_queue.cc:260] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:19.875994 13751 raft_consensus.cc:2804] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:19.878700 13681 consensus_queue.cc:1059] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:19.879237 13400 consensus_queue.cc:1059] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:19.883083 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:19.884790 13763 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:19.876509 13723 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.433s	user 0.006s	sys 0.010s
I20260709 12:24:19.886988 13674 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:19.942982 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:19.946928 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:19.947165 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:19.947592 11681 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:19.888062 13485 raft_consensus.cc:3055] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:24:19.889050 11055 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41294 (request call id 1255) took 1992 ms (client timeout 2185 ms). Trace:
W20260709 12:24:19.877030 13572 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.001s	sys 0.012s
I20260709 12:24:19.946487 13578 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:19.963336 13572 consensus_queue.cc:1048] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:19.963418 13578 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:19.965633 13578 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:19.945879 13723 raft_consensus.cc:697] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:19.893180 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 364) took 1679 ms. Trace:
I20260709 12:24:19.968146 11130 rpcz_store.cc:276] 0709 12:24:18.213489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.062645 (+849156us) service_pool.cc:224] Handling call
0709 12:24:19.063007 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:19.789189 (+726182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:19.892913 (+103724us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b54000eabd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:19.893113 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1659985152}
I20260709 12:24:19.900842 11643 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:19.787883 13772 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:19.945343 13751 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:19.912463 11676 raft_consensus.cc:1240] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:19.847702 13680 consensus_queue.cc:1059] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:24:19.930068 11125 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:19.946277 13434 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.873128 13516 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.886207 13676 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:19.935983 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:19.936964 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:19.894979 13759 raft_consensus.cc:2804] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:24:19.939903 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 65435.3us
I20260709 12:24:19.942540 11060 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:19.980237 11680 raft_consensus.cc:2410] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:19.943262 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:19.943930 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:19.926311 13677 consensus_queue.cc:1048] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:24:19.895532 13666 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:19.981421 11023 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:19.858634 13525 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:19.952490 11055 rpcz_store.cc:269] 0709 12:24:17.896973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.908521 (+ 11548us) service_pool.cc:224] Handling call
0709 12:24:19.888813 (+1980292us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b54001888d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:19.888982 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3889277184}
I20260709 12:24:19.967051 13754 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:19.958825 11057 raft_consensus.cc:1275] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:19.952232 13485 raft_consensus.cc:740] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:19.929647 13779 consensus_queue.cc:1048] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:24:19.870687 13777 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:19.967051 13723 consensus_queue.cc:237] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:19.970055 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:24:19.971663 11024 leader_election.cc:336] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Timed out: RequestConsensusVote RPC to 127.9.145.196:42197 timed out after 2.070s (SENT)
I20260709 12:24:19.934947 13257 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:19.873047 13669 raft_consensus.cc:2804] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:19.975353 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 74569.4us
I20260709 12:24:19.935568 13228 raft_consensus.cc:697] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:20.006042 11643 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
W20260709 12:24:19.932019 13722 consensus_queue.cc:1175] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bc01179655564f29b83babe396377cbb" responder_term: 4 status { last_received { term: 4 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 4 index: 3 } }
I20260709 12:24:19.859783 13568 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:19.949066 13733 raft_consensus.cc:2749] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:19.904163 13769 consensus_queue.cc:1048] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 12:24:19.947739 11056 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:20.006671 13777 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:19.977869 13751 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:19.990350 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:19.990597 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:19.991405 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:19.873679 13408 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:20.042572 13629 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:19.995338 11024 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:24:20.043166 13629 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:19.977262 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:20.043766 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 75516us
I20260709 12:24:20.047164 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:20.047807 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:20.043619 13629 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:20.042814 13774 log.cc:927] Time spent T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:24:20.048504 11058 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:20.047221 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:20.049086 11024 leader_election.cc:336] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Timed out: RequestConsensusVote RPC to 127.9.145.196:42197 timed out after 2.125s (SENT)
I20260709 12:24:20.008477 11643 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:20.035015 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:20.050134 10982 raft_consensus.cc:1275] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:20.062039 11125 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:24:20.052505 13777 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:20.053486 13627 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:19.986368 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:20.011727 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.058409 10978 raft_consensus.cc:1275] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:24:20.091142 10978 pending_rounds.cc:85] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 6
W20260709 12:24:20.035861 13775 log.cc:927] Time spent T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:24:19.979884 13778 raft_consensus.cc:2749] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:20.048307 11644 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:19.984838 13663 consensus_queue.cc:1059] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:24:20.060043 11060 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
W20260709 12:24:20.069587 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:20.069845 11025 leader_election.cc:336] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 1.725s (SENT)
I20260709 12:24:19.999255 13752 raft_consensus.cc:3055] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:20.098614 11025 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
W20260709 12:24:20.100915 11025 leader_election.cc:336] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 1.891s (SENT)
I20260709 12:24:20.059347 13726 raft_consensus.cc:2749] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:19.994766 13759 raft_consensus.cc:697] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:19.995616 13782 raft_consensus.cc:2804] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:20.036353 13768 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
W20260709 12:24:20.091284 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.092214 10978 pending_rounds.cc:107] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 5.7
W20260709 12:24:20.093122 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 44071.2us
I20260709 12:24:20.102837 10981 raft_consensus.cc:1275] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:20.043831 13408 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:20.096446 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 88044.2us
I20260709 12:24:20.102797 13769 raft_consensus.cc:2749] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:20.134292 11643 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:20.135440 13525 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:19.986572 13434 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:24:20.136747 11023 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:19.986083 13516 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:20.127578 10978 raft_consensus.cc:2889] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:19.998714 13781 log.cc:927] Time spent T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.135s	user 0.003s	sys 0.000s
I20260709 12:24:20.127287 10948 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:20.127931 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.002337 13669 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.138429 10979 raft_consensus.cc:1275] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:24:20.156883 11025 leader_election.cc:336] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 2.045s (SENT)
I20260709 12:24:20.102573 13752 raft_consensus.cc:740] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:24:20.140439 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.188985 10981 raft_consensus.cc:1240] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:20.124531 13777 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:24:20.217908 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.131592 13733 raft_consensus.cc:2749] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:20.138270 13761 log.cc:927] Time spent T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:24:20.220927 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 172687us
I20260709 12:24:20.146461 10948 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:20.221503 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 64691us
I20260709 12:24:20.185860 11052 raft_consensus.cc:2393] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:20.138919 13768 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:20.137679 13434 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:20.191395 13669 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:20.185974 13631 raft_consensus.cc:2749] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:20.142774 13782 raft_consensus.cc:697] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:20.146167 13778 raft_consensus.cc:2749] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:20.219527 13525 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:20.186223 13228 consensus_queue.cc:237] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:20.256531 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 110159us
I20260709 12:24:20.257453 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:20.258965 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:20.259740 10976 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 5.
I20260709 12:24:20.260764 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:20.264465 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:20.257308 10948 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:20.187943 13400 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.127576 13721 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 12:24:20.142372 13296 consensus_queue.cc:1048] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 12:24:20.233670 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:20.242746 11024 leader_election.cc:400] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6.
I20260709 12:24:20.289036 11024 leader_election.cc:403] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:24:20.255772 13738 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:20.268218 10976 raft_consensus.cc:1275] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:24:20.294625 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.300995 10976 raft_consensus.cc:1275] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:20.301137 10948 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:20.266904 13676 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:20.272897 13739 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:20.282061 13792 log.cc:927] Time spent T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 12:24:20.285344 10983 raft_consensus.cc:1275] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:20.220721 13726 consensus_queue.cc:1048] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:24:20.219874 13742 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:24:20.254366 13525 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.294225 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:20.244444 13743 consensus_queue.cc:1059] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:24:20.327920 13516 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:20.328699 13743 raft_consensus.cc:3055] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:20.329144 13743 raft_consensus.cc:740] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:20.329571 13525 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:20.329998 13743 consensus_queue.cc:260] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:20.331416 13743 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:20.304569 11053 raft_consensus.cc:1240] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:20.299201 13721 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.313272 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:20.318014 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1702) took 2121 ms. Trace:
W20260709 12:24:20.319003 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 443711us
I20260709 12:24:20.320585 10948 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:20.336668 11097 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:20.308005 13676 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.318670 13607 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.324393 13801 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.325453 11674 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:20.318992 13793 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.351333 13768 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:20.325532 13782 consensus_queue.cc:237] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:20.354266 13674 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.354699 11125 raft_consensus.cc:1240] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:20.355072 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.355727 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:20.356845 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:20.358703 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:20.359280 11127 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
I20260709 12:24:20.359892 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:20.327293 13742 consensus_queue.cc:1048] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:24:20.307379 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 431525us
I20260709 12:24:20.298405 13796 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:20.335994 11678 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 4.
I20260709 12:24:20.267131 13733 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.312742 13777 raft_consensus.cc:697] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:20.317480 13746 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:20.339996 11025 leader_election.cc:336] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 2.117s (SENT)
I20260709 12:24:20.335927 11131 rpcz_store.cc:276] 0709 12:24:18.196638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.498619 (+301981us) service_pool.cc:224] Handling call
0709 12:24:18.498967 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:18.692885 (+193918us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:18.834508 (+141623us) log.cc:844] Serialized 14 byte log entry
0709 12:24:19.613909 (+779401us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:19.614434 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 12:24:19.614579 (+   145us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:19.869470 (+254891us) log.cc:844] Serialized 14 byte log entry
0709 12:24:20.307148 (+437678us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b1800426b20. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88c71c0a 00007f8f923b1219 00007f8f88cf9a40 00007f8f88cf44e4 00007f8f88cf4455 00007f8f8bddc060 00007f8f8bdee716 00007f8f8bdff287 00007f8f8bdff208
0709 12:24:20.307329 (+   181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.307407 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:20.317828 (+ 10421us) raft_consensus.cc:1685] finished
0709 12:24:20.317845 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:20.317963 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":500175,"prepare.queue_time_us":460741,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":76,"raft.queue_time_us":1222564,"raft.run_cpu_time_us":384,"raft.run_wall_time_us":23037,"spinlock_wait_cycles":36879232,"thread_start_us":859564,"threads_started":4,"wal-append.queue_time_us":1038330}
I20260709 12:24:20.337704 10948 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:20.341961 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 109843us
I20260709 12:24:20.319267 13772 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
I20260709 12:24:20.286795 13752 consensus_queue.cc:260] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:20.270558 13759 consensus_queue.cc:237] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:20.346707 13666 raft_consensus.cc:697] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 8 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:20.333914 13434 consensus_queue.cc:1059] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:24:20.355237 11133 raft_consensus.cc:1240] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:20.361294 11098 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:20.372648 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 66532.3us
I20260709 12:24:20.369395 13778 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:20.415352 11097 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:20.286821 13400 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:20.339192 13763 raft_consensus.cc:2804] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:20.378672 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:20.379032 11128 raft_consensus.cc:1240] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 7 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:20.343066 13676 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:20.342316 13572 raft_consensus.cc:2749] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:20.380987 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 43696.2us
I20260709 12:24:20.332602 13751 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:20.351172 13793 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:20.385527 11024 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:24:20.346262 13680 consensus_queue.cc:1243] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Peer bc01179655564f29b83babe396377cbb log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:20.381875 11025 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:20.332690 13745 consensus_queue.cc:1048] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:24:20.416357 13746 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:20.350004 13662 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:20.455408 13662 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:20.457719 13662 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:20.316277 13631 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6.
I20260709 12:24:20.458741 11127 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:20.458356 13666 consensus_queue.cc:237] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:20.461360 13751 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:20.462920 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 77443.5us
I20260709 12:24:20.381086 13785 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:20.466424 13785 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:20.467401 13485 consensus_queue.cc:260] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:20.468357 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 128378us
I20260709 12:24:20.410436 13758 raft_consensus.cc:2804] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:20.468999 13758 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:20.469472 13758 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:20.471031 13782 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:20.471352 13790 log.cc:927] Time spent T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.601s	user 0.003s	sys 0.000s
I20260709 12:24:20.471889 13782 raft_consensus.cc:2749] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:20.373833 13674 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:20.474877 13780 log.cc:927] Time spent T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.607s	user 0.002s	sys 0.000s
I20260709 12:24:20.475903 13674 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:20.476289 11132 raft_consensus.cc:1240] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:20.368211 13801 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:20.355553 13607 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:20.368129 13796 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:20.466511 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:20.416733 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 55541.6us
I20260709 12:24:20.481122 10983 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:24:20.485203 11125 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
W20260709 12:24:20.418537 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.486618 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:20.487432 11125 raft_consensus.cc:2368] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6.
I20260709 12:24:20.487623 11060 raft_consensus.cc:1240] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:20.488912 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:20.422798 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:20.384956 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:20.431458 10948 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:20.490973 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:20.491547 11056 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:24:20.492306 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:20.434341 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:20.434396 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:20.439925 11134 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:20.380290 13733 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:20.440774 13296 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:20.444051 13525 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:20.446133 13629 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:20.502362 11679 raft_consensus.cc:1240] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:20.503288 13629 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:20.451510 13593 consensus_meta.cc:287] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.736s	user 0.009s	sys 0.001s
I20260709 12:24:20.422013 13763 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:20.465761 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:20.505582 11052 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
I20260709 12:24:20.505271 13763 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:20.507232 11678 raft_consensus.cc:2393] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 6: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
W20260709 12:24:20.507467 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 76089us
I20260709 12:24:20.508446 11644 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:20.509459 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:20.499605 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:20.511961 11058 raft_consensus.cc:1275] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:20.478412 11127 raft_consensus.cc:2410] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:20.478555 11059 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:24:20.513070 11059 raft_consensus.cc:606] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:20.513447 11059 raft_consensus.cc:614] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:24:20.478715 11025 leader_election.cc:336] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 2.227s (SENT)
W20260709 12:24:20.455514 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 392013us
I20260709 12:24:20.479728 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:20.514379 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:20.514739 11025 leader_election.cc:336] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 2.278s (SENT)
I20260709 12:24:20.515190 11025 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:20.430842 13434 consensus_queue.cc:1243] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [LEADER]: Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 log is divergent from this leader: its last log entry 5.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:24:20.477766 11676 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
I20260709 12:24:20.340096 13721 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:20.530685 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:20.421630 13565 raft_consensus.cc:2804] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:20.419711 13754 raft_consensus.cc:2749] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:20.414402 13794 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:20.498863 13607 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:20.501231 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:20.501389 13525 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:20.505240 13593 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:20.477833 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:20.515574 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.493767 13796 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:20.516788 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:20.479888 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:20.514886 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:20.526185 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:20.566999 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:20.567119 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:20.528327 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:20.567673 10983 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:20.498714 11674 raft_consensus.cc:1240] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:20.530331 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:20.568130 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:20.529619 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:20.554284 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:20.568516 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:20.468896 13485 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:20.568836 11128 raft_consensus.cc:2376] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6. Re-sending same reply.
I20260709 12:24:20.525915 13408 raft_consensus.cc:2804] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:20.423149 13778 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:20.490372 11133 raft_consensus.cc:2376] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8. Re-sending same reply.
W20260709 12:24:20.552688 13762 consensus_meta.cc:287] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.787s	user 0.007s	sys 0.006s
I20260709 12:24:20.569687 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:20.614841 10983 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:20.529237 13769 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:20.563367 11057 raft_consensus.cc:2393] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 7: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:20.567334 11097 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:20.568774 10981 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:20.583025 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:20.616616 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:20.586624 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:20.617596 11125 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 5.
I20260709 12:24:20.549446 13565 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:20.533507 13674 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.549217 13785 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:20.587525 13793 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:20.590799 13733 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:20.592540 13627 consensus_meta.cc:287] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.500s	user 0.007s	sys 0.003s
I20260709 12:24:20.553143 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:20.526237 13777 consensus_queue.cc:237] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:20.505007 13801 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:20.596889 13400 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:20.597165 13669 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:20.622375 13812 raft_consensus.cc:2749] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:20.570253 13802 log.cc:927] Time spent T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 12:24:20.598430 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:20.533931 13752 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:20.601351 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.501646 13789 consensus_queue.cc:1048] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 12:24:20.610234 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:20.537240 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:20.720180 11679 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:20.610374 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:20.526594 13745 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.619071 10976 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75"
dest_uuid: "bc01179655564f29b83babe396377cbb"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:41958
I20260709 12:24:20.722225 10976 raft_consensus.cc:606] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:20.722662 10976 raft_consensus.cc:614] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:24:20.620757 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 53500.7us
I20260709 12:24:20.564033 13747 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.617463 10983 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
W20260709 12:24:20.627067 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 130856us
I20260709 12:24:20.627470 10948 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:24:20.728044 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 100655us
I20260709 12:24:20.648411 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:20.730247 11054 raft_consensus.cc:2393] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 8: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:20.653982 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:20.734920 11125 raft_consensus.cc:2393] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 7: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:20.608584 13408 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:20.667883 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:20.738631 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:20.535694 13805 consensus_queue.cc:1048] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 12:24:20.671413 11673 raft_consensus.cc:1275] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:24:20.616245 13769 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.624987 13565 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:20.649833 13607 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:20.691635 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:20.728938 13791 log.cc:927] Time spent T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:24:20.656041 13674 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:20.701467 11025 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:20.710493 10981 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
I20260709 12:24:20.738870 11128 raft_consensus.cc:2410] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:24:20.668650 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:20.744307 11673 pending_rounds.cc:85] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Aborting all ops after (but not including) 7
W20260709 12:24:20.744868 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.745540 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:20.745669 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:20.623894 13272 consensus_queue.cc:1059] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 12:24:20.723843 11097 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:20.746968 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:20.751730 11643 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:20.752705 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:20.754469 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:20.755769 11134 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:20.692138 10975 raft_consensus.cc:2410] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:24:20.757509 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:20.759385 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:20.878469 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:20.743914 13793 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:24:20.840864 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 76217.9us
I20260709 12:24:20.881400 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:20.882397 10976 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:20.744622 13408 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:20.883787 11055 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:20.727260 13738 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:20.905434 10981 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
W20260709 12:24:20.980475 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 228825us
I20260709 12:24:20.735651 13676 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:20.981307 11643 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:20.747931 13785 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:20.883375 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:20.904868 11673 pending_rounds.cc:107] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:24:20.986821 11673 raft_consensus.cc:2889] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:20.987401 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:20.744434 13747 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:20.751592 13769 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:20.970973 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 269596us
W20260709 12:24:20.799664 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:21.014587 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.751026 13751 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.980516 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:20.882869 13434 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.984066 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:21.019897 11128 raft_consensus.cc:2393] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 7: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:20.835377 13627 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.756346 13754 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.758651 13607 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.885941 13662 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.007074 11643 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:21.043591 11643 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:20.988054 11125 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:20.924294 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:20.885767 13680 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:20.745193 13745 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:21.037400 11134 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:21.039480 11676 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:21.046295 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:20.981645 13793 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:21.041720 10976 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
I20260709 12:24:20.987962 13400 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:24:21.046591 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 165286us
I20260709 12:24:20.990921 10982 raft_consensus.cc:1275] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:21.053278 11643 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:21.020166 13801 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:21.053913 11128 raft_consensus.cc:1275] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:21.019388 13762 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.058825 11676 raft_consensus.cc:2376] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7. Re-sending same reply.
I20260709 12:24:21.060166 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:21.015439 13785 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:21.033702 13751 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:21.042747 13607 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:21.171463 10949 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 1.501s (SENT) [suppressed 47 similar messages]
I20260709 12:24:21.354354 11676 raft_consensus.cc:2376] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8. Re-sending same reply.
I20260709 12:24:21.130614 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1305) took 1365 ms. Trace:
I20260709 12:24:21.361347 10978 rpcz_store.cc:276] 0709 12:24:19.765058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.766700 (+  1642us) service_pool.cc:224] Handling call
0709 12:24:19.767004 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:20.185696 (+418692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.130228 (+944532us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b5400333454. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:21.130535 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":665923968}
I20260709 12:24:21.048647 13793 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:21.339574 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 286365us
I20260709 12:24:21.341212 11129 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:21.338660 13832 log.cc:927] Time spent T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:24:21.133358 11128 raft_consensus.cc:1275] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:21.051506 13789 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.367374 11676 raft_consensus.cc:1275] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:21.054749 13721 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:21.097529 13816 log.cc:927] Time spent T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:24:21.126294 13593 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:21.043655 13627 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:21.047694 13754 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:21.184722 13783 log.cc:927] Time spent T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 1.246s	user 0.000s	sys 0.007s
W20260709 12:24:21.372562 13830 log.cc:927] Time spent T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:24:21.347222 13669 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:21.398818 11059 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.001s	sys 0.013s
I20260709 12:24:21.378468 13817 consensus_queue.cc:1048] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:21.056665 13629 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:21.056545 13772 raft_consensus.cc:2749] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:21.131016 13815 log.cc:927] Time spent T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 12:24:21.382221 11129 raft_consensus.cc:1275] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:24:21.403507 11129 pending_rounds.cc:85] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 7
I20260709 12:24:21.403843 11129 pending_rounds.cc:107] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:24:21.404140 11129 raft_consensus.cc:2889] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:21.057251 13801 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:21.130998 11681 raft_consensus.cc:1240] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:21.383491 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1888) took 1019 ms. Trace:
I20260709 12:24:21.384670 11133 raft_consensus.cc:2410] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 12:24:21.363878 13758 consensus_meta.cc:287] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.894s	user 0.012s	sys 0.000s
W20260709 12:24:21.396425 13763 consensus_meta.cc:287] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.871s	user 0.006s	sys 0.004s
I20260709 12:24:21.258618 13722 raft_consensus.cc:2764] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:24:21.360618 13762 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:21.052070 13680 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:21.367060 13674 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:21.374300 13747 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:21.348526 13666 consensus_queue.cc:1048] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:24:21.051831 13662 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:21.400329 11059 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.001s	sys 0.013s
W20260709 12:24:21.401448 11097 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.000s	sys 0.014s
I20260709 12:24:21.033025 13434 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:21.411446 11128 rpcz_store.cc:276] 0709 12:24:20.364040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.062689 (+698649us) service_pool.cc:224] Handling call
0709 12:24:21.110477 (+ 47788us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.381350 (+270873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.383437 (+  2087us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:21.465626 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1938) took 1048 ms. Trace:
I20260709 12:24:21.282738 13833 consensus_queue.cc:1059] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.141s
I20260709 12:24:21.418308 10978 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e"
dest_uuid: "bc01179655564f29b83babe396377cbb"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:52810
I20260709 12:24:21.422191 11055 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
W20260709 12:24:21.424223 10947 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.010s	sys 0.007s
W20260709 12:24:21.436277 11097 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.000s	sys 0.014s
I20260709 12:24:21.412685 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 370) took 2277 ms. Trace:
I20260709 12:24:21.401479 13593 consensus_queue.cc:1048] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:24:21.466192 10980 rpcz_store.cc:276] 0709 12:24:20.417586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.417728 (+   142us) service_pool.cc:224] Handling call
0709 12:24:20.418065 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:20.420339 (+  2274us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:20.420371 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:20.425522 (+  5151us) log.cc:844] Serialized 26 byte log entry
0709 12:24:20.609832 (+184310us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:20.609875 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.609944 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.437081 (+827137us) raft_consensus.cc:1685] finished
0709 12:24:21.437105 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.465525 (+ 28420us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1786,"raft.queue_time_us":1934,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":7618,"thread_start_us":175829,"threads_started":1,"wal-append.queue_time_us":309549}
W20260709 12:24:21.486300 10947 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.010s	sys 0.008s
W20260709 12:24:21.486685 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 762850us
W20260709 12:24:21.417829 13821 log.cc:927] Time spent T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 12:24:21.416939 13801 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:21.488571 11129 rpcz_store.cc:276] 0709 12:24:19.135298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.135746 (+   448us) service_pool.cc:224] Handling call
0709 12:24:19.142516 (+  6770us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:20.452762 (+1310246us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b58004ef5d0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bd400aa 00007f8f8bdc2447 00007f8f8bddafe7 00007f8f8bddc7de 00007f8f8bde6b49 00007f8f8bde7416 00007f8f8bde3d8f 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4
0709 12:24:21.132444 (+679682us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b54002326a0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bd59a1d 00007f8f8bd401a4 00007f8f8bdc2447 00007f8f8bddafe7 00007f8f8bddc7de 00007f8f8bde6b49 00007f8f8bde7416 00007f8f8bde3d8f 00007f8f8bde383e 00007f8f90da8419
0709 12:24:21.412327 (+279883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.412616 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237971968}
I20260709 12:24:21.398277 13789 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:21.540923 11055 raft_consensus.cc:1275] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:24:21.538750 13830 log.cc:927] Time spent T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 12:24:21.423182 13737 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:24:21.428453 13745 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:21.571915 10978 raft_consensus.cc:606] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Received request to transfer leadership
I20260709 12:24:21.578166 10978 raft_consensus.cc:614] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:21.578323 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:21.579692 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 408276us
I20260709 12:24:21.580065 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1889) took 1212 ms. Trace:
I20260709 12:24:21.580932 11128 rpcz_store.cc:276] 0709 12:24:20.367304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.487790 (+1120486us) service_pool.cc:224] Handling call
0709 12:24:21.555801 (+ 68011us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.579722 (+ 23921us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:21.579753 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:21.579792 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:21.579830 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.579890 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.580011 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23548,"spinlock_wait_cycles":47488}
I20260709 12:24:21.420042 13758 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:21.540362 13829 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:21.576697 13485 consensus_meta.cc:287] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 1.007s	user 0.012s	sys 0.000s
W20260709 12:24:21.573256 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 80975.1us
I20260709 12:24:21.555253 13593 consensus_queue.cc:1243] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer bc01179655564f29b83babe396377cbb log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:21.588905 11097 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:21.424125 13763 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:21.585609 10976 raft_consensus.cc:1275] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:21.582715 11128 raft_consensus.cc:1275] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:24:21.587481 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 219300us
I20260709 12:24:21.594453 11643 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:21.572145 13759 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:21.580514 13578 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:21.572525 13794 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:21.569134 13677 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:21.592628 11097 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:21.594060 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1891) took 1213 ms. Trace:
I20260709 12:24:21.595413 11643 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:21.598975 11125 raft_consensus.cc:1240] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:21.606837 11126 raft_consensus.cc:1240] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:21.584239 13804 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.045s	sys 0.055s
I20260709 12:24:21.606283 11128 rpcz_store.cc:276] 0709 12:24:20.380787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.582044 (+1201257us) service_pool.cc:224] Handling call
0709 12:24:21.582383 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.593829 (+ 11446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.594006 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:21.608660 11097 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:21.612987 11128 raft_consensus.cc:1275] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 12:24:21.623605 11098 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.001s	sys 0.013s
I20260709 12:24:21.629019 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 376) took 1088 ms. Trace:
I20260709 12:24:21.600667 13772 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:24:21.620224 13804 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.045s	sys 0.056s
W20260709 12:24:21.587076 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:21.629424 11098 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.001s	sys 0.013s
I20260709 12:24:21.597806 13840 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:21.627152 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1890) took 1253 ms. Trace:
I20260709 12:24:21.629452 11128 rpcz_store.cc:276] 0709 12:24:20.525782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.610892 (+1085110us) service_pool.cc:224] Handling call
0709 12:24:21.611247 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.613695 (+  2448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.613892 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:21.611191 13833 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:21.627272 13272 raft_consensus.cc:2749] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:21.610913 13629 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:24:21.627854 13565 consensus_meta.cc:287] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.746s	user 0.010s	sys 0.000s
W20260709 12:24:21.631397 13819 log.cc:927] Time spent T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 12:24:21.640046 11128 raft_consensus.cc:1275] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:21.656927 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 378) took 1096 ms. Trace:
I20260709 12:24:21.657352 11128 rpcz_store.cc:276] 0709 12:24:20.560604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.637896 (+1077292us) service_pool.cc:224] Handling call
0709 12:24:21.638300 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.656592 (+ 18292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.656855 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:21.602504 13759 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:21.638931 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 587132us
I20260709 12:24:21.624655 13785 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:21.642553 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 53116.3us
I20260709 12:24:21.629058 13674 raft_consensus.cc:2804] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:21.627902 13568 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.628279 13747 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.640483 13840 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:21.628077 13669 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:21.637423 13627 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:21.644369 13833 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:21.611003 13607 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:21.593894 13829 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:21.636427 13680 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:21.613341 13677 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:21.716440 13752 consensus_meta.cc:287] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.992s	user 0.011s	sys 0.000s
I20260709 12:24:21.649945 13848 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.629776 13745 consensus_queue.cc:1048] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:24:21.732086 10980 raft_consensus.cc:1275] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:21.707077 13840 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:21.606266 13578 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:21.691684 13743 consensus_meta.cc:287] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 1.360s	user 0.008s	sys 0.006s
W20260709 12:24:21.709146 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.703689 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1930) took 1711 ms. Trace:
I20260709 12:24:21.744035 10979 rpcz_store.cc:276] 0709 12:24:19.992367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.055379 (+ 63012us) service_pool.cc:224] Handling call
0709 12:24:20.055606 (+   227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:20.188750 (+133144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.703386 (+1514636us) spinlock_profiling.cc:243] Waited 82.4 ms on lock 0x7b54000d9154. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:21.703617 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":189626240}
I20260709 12:24:21.721709 13762 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:21.637305 13485 consensus_queue.cc:1048] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:24:21.691938 13785 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.609354 13794 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:21.712649 13568 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:21.720479 11054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1631) took 1107 ms. Trace:
I20260709 12:24:21.632882 13772 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:21.715468 13669 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:21.726773 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1933) took 1633 ms. Trace:
I20260709 12:24:21.712858 13747 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:21.733026 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 380) took 1136 ms. Trace:
I20260709 12:24:21.715593 13674 raft_consensus.cc:697] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:21.734211 13662 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:21.762437 13853 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:21.762068 13789 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:21.736238 13698 consensus_queue.cc:260] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:21.722235 13836 log.cc:927] Time spent T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:24:21.722975 13434 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:21.738313 13855 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.688019 13565 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:21.718415 13833 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:21.741990 13828 log.cc:927] Time spent T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 12:24:21.715381 11058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1627) took 1155 ms. Trace:
I20260709 12:24:21.684757 13754 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:21.752558 11054 rpcz_store.cc:276] 0709 12:24:20.613548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.061200 (+447652us) service_pool.cc:224] Handling call
0709 12:24:21.340217 (+279017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.340454 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:21.586313 (+245859us) log.cc:844] Serialized 14 byte log entry
0709 12:24:21.720171 (+133858us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:21.720224 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:21.720276 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.720340 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.720431 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":231156,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":2124,"raft.queue_time_us":92823,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":66,"thread_start_us":360159,"threads_started":3}
I20260709 12:24:21.757362 10984 rpcz_store.cc:276] 0709 12:24:20.093698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.104011 (+ 10313us) service_pool.cc:224] Handling call
0709 12:24:20.143349 (+ 39338us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:20.185840 (+ 42491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.185873 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:20.186600 (+   727us) log.cc:844] Serialized 52 byte log entry
0709 12:24:20.473717 (+287117us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b1800361fc0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cd9e07 00007f8f91b349a9 00007f8f88cf669b 00007f8f88cf493f 00007f8f88cf6c02 00007f8f8b97e20b 00007f8f8b983d23 00007f8f8b9840d1 00007f8f8bd9fa0f
0709 12:24:20.670332 (+196615us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:20.719145 (+ 48813us) log.cc:844] Serialized 14 byte log entry
0709 12:24:20.736318 (+ 17173us) log.cc:844] Serialized 14 byte log entry
0709 12:24:21.030440 (+294122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.030518 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.726476 (+695958us) raft_consensus.cc:1685] finished
0709 12:24:21.726512 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.726697 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22475,"prepare.queue_time_us":314153,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":2783,"raft.queue_time_us":57227,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":48022,"spinlock_wait_cycles":27664640,"thread_start_us":490161,"threads_started":2,"wal-append.queue_time_us":818226}
I20260709 12:24:21.735152 13677 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:21.763062 13853 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:21.743633 13680 consensus_queue.cc:1059] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:24:21.763621 13747 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:21.858076 13835 log.cc:927] Time spent T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 12:24:21.858928 11058 rpcz_store.cc:276] 0709 12:24:20.560112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.880229 (+320117us) service_pool.cc:224] Handling call
0709 12:24:20.980249 (+100020us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:20.983284 (+  3035us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:21.396857 (+413573us) log.cc:844] Serialized 14 byte log entry
0709 12:24:21.715019 (+318162us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:21.715071 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:21.715126 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.715193 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.715320 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":571249,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":116635,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":4661504,"thread_start_us":691220,"threads_started":3,"wal-append.queue_time_us":314385}
I20260709 12:24:21.858354 11060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1632) took 1238 ms. Trace:
I20260709 12:24:21.758961 11128 rpcz_store.cc:276] 0709 12:24:20.596766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.658180 (+1061414us) service_pool.cc:224] Handling call
0709 12:24:21.658530 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.658764 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:24:21.692724 (+ 33960us) log.cc:844] Serialized 14 byte log entry
0709 12:24:21.731068 (+ 38344us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:21.731121 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:21.731170 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.731238 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.732964 (+  1726us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":34135,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":35,"thread_start_us":38008,"threads_started":1}
I20260709 12:24:21.879967 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:21.762178 13839 log.cc:927] Time spent T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 12:24:21.880923 11128 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 5.
W20260709 12:24:21.761981 13831 log.cc:927] Time spent T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
I20260709 12:24:21.876998 11060 rpcz_store.cc:276] 0709 12:24:20.620098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.466752 (+846654us) service_pool.cc:224] Handling call
0709 12:24:21.467159 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:21.495361 (+ 28202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:21.543579 (+ 48218us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:21.574305 (+ 30726us) log.cc:844] Serialized 26 byte log entry
0709 12:24:21.633369 (+ 59064us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:21.633403 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.633467 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.857983 (+224516us) raft_consensus.cc:1685] finished
0709 12:24:21.858003 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.858285 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":124,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":54229,"spinlock_wait_cycles":572288,"thread_start_us":35236,"threads_started":1,"wal-append.queue_time_us":145859}
W20260709 12:24:21.835072 13796 consensus_meta.cc:287] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 1.226s	user 0.011s	sys 0.000s
I20260709 12:24:21.763266 13568 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:21.755049 13785 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:21.740850 13848 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:21.886482 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:21.945576 11128 raft_consensus.cc:2393] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 6: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:21.946681 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:21.947340 13793 consensus_meta.cc:287] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.000s
I20260709 12:24:21.947858 13793 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:21.951586 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:21.757642 13772 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:21.929219 13801 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:21.950363 13796 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:21.950683 11053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1270) took 3890 ms. Trace:
I20260709 12:24:21.969915 11053 rpcz_store.cc:276] 0709 12:24:18.060001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.508857 (+448856us) service_pool.cc:224] Handling call
0709 12:24:18.533150 (+ 24293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:20.332666 (+1799516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.950423 (+1617757us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b54003011d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:21.950615 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4073328512}
I20260709 12:24:21.971323 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:21.972487 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:21.973187 11053 raft_consensus.cc:2393] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 7: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
W20260709 12:24:21.956478 13854 log.cc:927] Time spent T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 12:24:21.917838 11134 raft_consensus.cc:1240] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:21.933044 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:21.929498 13674 consensus_queue.cc:237] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:21.953414 11051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1625) took 1393 ms. Trace:
I20260709 12:24:21.835304 13763 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:21.878363 13669 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:21.819680 13572 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:21.954557 13785 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:21.947974 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:24:21.836220 13408 consensus_meta.cc:287] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.856s	user 0.009s	sys 0.002s
I20260709 12:24:21.918089 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:21.888502 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.886191 13629 raft_consensus.cc:697] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:21.948324 13410 raft_consensus.cc:3055] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:21.847792 13752 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.950620 13698 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:21.764380 13758 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:21.977926 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:21.978432 11051 rpcz_store.cc:276] 0709 12:24:20.559637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.570204 (+ 10567us) service_pool.cc:224] Handling call
0709 12:24:20.570556 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:20.661368 (+ 90812us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.661407 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:20.687427 (+ 26020us) log.cc:844] Serialized 26 byte log entry
0709 12:24:21.021660 (+334233us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:21.021701 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.021770 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.953165 (+931395us) raft_consensus.cc:1685] finished
0709 12:24:21.953215 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.953353 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92717,"raft.queue_time_us":80342,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":15724,"thread_start_us":272100,"threads_started":1,"wal-append.queue_time_us":639977}
I20260709 12:24:21.994889 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:21.995293 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:21.989339 13572 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:21.980500 13794 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:21.980573 13805 raft_consensus.cc:2749] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:21.981244 11677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 565) took 1235 ms. Trace:
I20260709 12:24:21.975804 13840 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:21.886580 13759 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:21.985544 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 320210us
I20260709 12:24:21.985504 11676 raft_consensus.cc:1240] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:21.987131 13861 log.cc:927] Time spent T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:24:21.989804 13485 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.988651 11056 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1626) took 1428 ms. Trace:
I20260709 12:24:21.990007 13607 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:21.993803 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:21.990039 13410 raft_consensus.cc:740] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:21.979933 11059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1292) took 1424 ms. Trace:
I20260709 12:24:21.993479 13829 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:21.997452 11098 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:21.988596 11675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41784 (request call id 567) took 1377 ms. Trace:
I20260709 12:24:21.987664 13578 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:22.003223 11060 raft_consensus.cc:1240] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:22.002812 11056 rpcz_store.cc:276] 0709 12:24:20.559883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.878159 (+318276us) service_pool.cc:224] Handling call
0709 12:24:20.878569 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:20.880538 (+  1969us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.880569 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:20.881066 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 12:24:21.342812 (+461746us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:21.342856 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.342932 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.988453 (+645521us) raft_consensus.cc:1685] finished
0709 12:24:21.988470 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.988597 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1546,"raft.queue_time_us":6820,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":65030,"thread_start_us":338034,"threads_started":1,"wal-append.queue_time_us":446784}
I20260709 12:24:21.979619 13751 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:22.006856 11059 rpcz_store.cc:276] 0709 12:24:20.555160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.555351 (+   191us) service_pool.cc:224] Handling call
0709 12:24:20.555693 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:21.466425 (+910732us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:21.466458 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:21.574204 (+107746us) log.cc:844] Serialized 26 byte log entry
0709 12:24:21.626933 (+ 52729us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:21.627004 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.627581 (+   577us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.979715 (+352134us) raft_consensus.cc:1685] finished
0709 12:24:21.979736 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.979872 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61282,"raft.queue_time_us":95094,"spinlock_wait_cycles":47070976,"thread_start_us":850646,"threads_started":2,"wal-append.queue_time_us":71516}
I20260709 12:24:22.012676 11675 rpcz_store.cc:276] 0709 12:24:20.611270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.611396 (+   126us) service_pool.cc:224] Handling call
0709 12:24:20.624562 (+ 13166us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:20.652714 (+ 28152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.652752 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:20.672118 (+ 19366us) log.cc:844] Serialized 26 byte log entry
0709 12:24:21.048298 (+376180us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:21.048338 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.048406 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.988369 (+939963us) raft_consensus.cc:1685] finished
0709 12:24:21.988390 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.988535 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2578,"raft.queue_time_us":2087,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":12592,"thread_start_us":301941,"threads_started":1,"wal-append.queue_time_us":709379}
I20260709 12:24:22.014662 13796 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:22.015262 11673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41784 (request call id 556) took 2109 ms. Trace:
I20260709 12:24:22.016032 13843 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.016602 13843 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:22.015707 11673 rpcz_store.cc:276] 0709 12:24:19.906309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.906476 (+   167us) service_pool.cc:224] Handling call
0709 12:24:19.906847 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:20.987375 (+1080528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.015031 (+1027656us) spinlock_profiling.cc:243] Waited 764 ms on lock 0x7b5400408154. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:22.015204 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1757295488}
I20260709 12:24:22.018671 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:21.990890 13408 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:22.020370 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:22.021831 11098 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:21.944479 13855 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:22.017784 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:22.026283 13865 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:22.028208 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:22.028792 11098 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:22.034399 11128 raft_consensus.cc:2393] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 4: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:21.996995 13752 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:22.009102 13410 consensus_queue.cc:260] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:22.037632 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:24:22.026337 13850 log.cc:927] Time spent T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
I20260709 12:24:22.039955 11098 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:22.025177 13751 raft_consensus.cc:2804] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:22.040318 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:22.044281 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:22.035019 13769 consensus_meta.cc:287] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 1.001s	user 0.008s	sys 0.005s
I20260709 12:24:22.045220 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:22.026973 13865 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:22.028776 13758 raft_consensus.cc:2749] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:22.009398 13485 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:22.031524 13408 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:22.043102 13669 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:22.048915 11128 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 5.
I20260709 12:24:22.042816 13410 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:22.053403 11098 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:22.053725 13735 raft_consensus.cc:993] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7: : Instructing follower bc01179655564f29b83babe396377cbb to start an election
I20260709 12:24:22.055385 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:22.049624 11674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41762 (request call id 563) took 1304 ms. Trace:
I20260709 12:24:22.045146 13751 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.061090 13669 raft_consensus.cc:2749] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:22.062880 13751 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:22.063241 13738 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:22.063704 13738 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:22.064178 13568 consensus_queue.cc:1059] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:22.064345 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:22.062343 11674 rpcz_store.cc:276] 0709 12:24:20.744789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.747513 (+  2724us) service_pool.cc:224] Handling call
0709 12:24:22.017665 (+1270152us) spinlock_profiling.cc:243] Waited 7.88 ms on lock 0x7b5800004598. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfeee 000000000036eb39 00007f8f90d331e0 00007f8f90dfc0c4 00007f8f90dfc131 00007f8f90daa0a0 00007f8f90da9984 00007f8f8a3246d4 00007f8f8a324662
0709 12:24:22.049549 (+ 31884us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18116864}
I20260709 12:24:22.066653 11060 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 3.
I20260709 12:24:22.068104 13485 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:22.068339 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1883) took 1705 ms. Trace:
I20260709 12:24:22.069049 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:22.069730 13853 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:22.070670 13568 raft_consensus.cc:3055] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:22.071115 13568 raft_consensus.cc:740] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:22.071416 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:22.072027 11060 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:24:22.071884 13568 consensus_queue.cc:260] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:22.072979 13568 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:22.046166 13769 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:22.074296 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:22.074932 11059 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:22.075090 11676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 571) took 1326 ms. Trace:
I20260709 12:24:22.075453 11676 rpcz_store.cc:276] 0709 12:24:20.748827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.382966 (+634139us) service_pool.cc:224] Handling call
0709 12:24:21.383233 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:22.000031 (+616798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.074847 (+ 74816us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b540064fad4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:22.075030 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1384590080}
I20260709 12:24:22.076784 13769 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:22.076943 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:22.077610 13747 raft_consensus.cc:3055] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:24:22.077893 13867 log.cc:927] Time spent T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:24:22.079213 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:22.068759 11125 rpcz_store.cc:276] 0709 12:24:20.363292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.045541 (+682249us) service_pool.cc:224] Handling call
0709 12:24:21.045801 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.609434 (+563633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.068119 (+458685us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b5400106654. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:22.068279 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1271763328}
I20260709 12:24:22.081753 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:22.081840 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:22.082548 11059 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
I20260709 12:24:22.082759 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:22.085168 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:22.085739 11098 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:22.085757 11125 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:22.041800 13759 consensus_queue.cc:1048] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:24:22.086699 11098 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:22.087186 13680 raft_consensus.cc:2804] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:22.062340 13859 raft_consensus.cc:1081] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Signalling peer bc01179655564f29b83babe396377cbb to start an election
I20260709 12:24:22.084064 13747 raft_consensus.cc:740] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:22.088692 13865 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:22.089268 13801 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:22.027235 13629 consensus_queue.cc:237] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:22.094722 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:22.060465 13758 raft_consensus.cc:2749] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:22.053921 13843 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:22.117216 11055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1634) took 1470 ms. Trace:
I20260709 12:24:22.117619 11055 rpcz_store.cc:276] 0709 12:24:20.646887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.574453 (+927566us) service_pool.cc:224] Handling call
0709 12:24:21.587839 (+ 13386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:21.630532 (+ 42693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:21.630686 (+   154us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:21.641108 (+ 10422us) log.cc:844] Serialized 26 byte log entry
0709 12:24:21.918166 (+277058us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:21.918203 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.918279 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:22.117012 (+198733us) raft_consensus.cc:1685] finished
0709 12:24:22.117030 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:22.117155 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":133152,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":8682,"thread_start_us":270103,"threads_started":2,"wal-append.queue_time_us":337464}
I20260709 12:24:22.096103 13769 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.111768 13669 raft_consensus.cc:2804] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:22.087424 13572 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:22.095597 13680 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:22.116672 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.042064 13870 consensus_queue.cc:1048] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:24:22.094259 13848 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:22.139552 11059 raft_consensus.cc:1275] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:24:22.140623 10983 raft_consensus.cc:1275] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:24:22.111780 11125 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:22.141227 13778 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:22.141634 13843 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:24:22.112915 13872 log.cc:927] Time spent T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:24:22.136976 13680 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:22.136577 13738 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:22.145095 10975 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 1925) took 2154 ms (client timeout 2127 ms). Trace:
I20260709 12:24:22.145562 13738 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:22.145992 11127 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 1871) took 1793 ms (client timeout 1855 ms). Trace:
I20260709 12:24:22.142534 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:22.112896 13742 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
W20260709 12:24:22.146417 11127 rpcz_store.cc:269] 0709 12:24:20.353042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.359729 (+  6687us) service_pool.cc:224] Handling call
0709 12:24:22.145791 (+1786062us) spinlock_profiling.cc:243] Waited 98.4 ms on lock 0x7b540012eb54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:22.145928 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":226306944}
I20260709 12:24:22.151649 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:22.145568 10975 rpcz_store.cc:269] 0709 12:24:19.990982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.991138 (+   156us) service_pool.cc:224] Handling call
0709 12:24:22.144844 (+2153706us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b54003bae54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:22.145008 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1493743872}
I20260709 12:24:22.147733 11125 raft_consensus.cc:2393] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 4: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:22.142931 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 330) took 1389 ms. Trace:
I20260709 12:24:22.108503 13833 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:22.156988 11125 raft_consensus.cc:1275] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:22.155167 10983 rpcz_store.cc:276] 0709 12:24:20.753807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.753950 (+   143us) service_pool.cc:224] Handling call
0709 12:24:20.881159 (+127209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:22.141082 (+1259923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.142713 (+  1631us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400229054. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:22.142874 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2895602432}
I20260709 12:24:22.118788 13869 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.146601 13669 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.165899 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:22.171923 10948 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:22.174576 13408 consensus_queue.cc:1048] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:22.176064 13296 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:22.176661 13296 raft_consensus.cc:697] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:22.177587 13296 consensus_queue.cc:237] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:22.181217 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.142839 13747 consensus_queue.cc:260] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:22.154317 13742 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:22.185050 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 68995.9us
I20260709 12:24:22.135682 13769 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:22.187783 11676 raft_consensus.cc:1275] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:24:22.188968 11024 connection.cc:256] RPC call timeout handler was delayed by -1.4405110799998511s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21509999999999999s for a response
I20260709 12:24:22.189760 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1704) took 3992 ms. Trace:
I20260709 12:24:22.194635 11132 rpcz_store.cc:276] 0709 12:24:18.197147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.753056 (+555909us) service_pool.cc:224] Handling call
0709 12:24:20.318013 (+1564957us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:20.476715 (+158702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.719686 (+242971us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b540023aad4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:22.188574 (+1468888us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b540023aad0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:22.189680 (+  1106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3961651328}
W20260709 12:24:22.196354 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.189649 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:22.197031 11673 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:22.196545 11132 raft_consensus.cc:1275] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:22.170632 13669 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:22.219182 13723 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:22.223101 11132 raft_consensus.cc:1275] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:22.231329 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:22.231992 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:22.232609 11060 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:22.234150 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:22.234827 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:22.238736 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.241509 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:22.243873 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 116462us
I20260709 12:24:22.187357 13840 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:22.251149 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:22.211066 13752 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:22.254590 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:22.210625 13874 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.256196 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:22.257704 11056 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:22.186146 13869 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:21.998571 11677 rpcz_store.cc:276] 0709 12:24:20.746250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.755562 (+  9312us) service_pool.cc:224] Handling call
0709 12:24:21.043816 (+288254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.061675 (+ 17859us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:21.717823 (+656148us) log.cc:844] Serialized 14 byte log entry
0709 12:24:21.979513 (+261690us) log.cc:844] Serialized 14 byte log entry
0709 12:24:21.980155 (+   642us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:21.980341 (+   186us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:21.980397 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.981025 (+   628us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.981179 (+   154us) inbound_call.cc:177] Queueing success response
0709 12:24:21.981668 (+   489us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b18004565e0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cf73f3 00007f8f88cf97c1 00007f8f88cf9779 00007f8f88cf9709 00007f8f88cf96d1 00007f8f88cf89cd 0000000000388634 0000000000388479 00007f8f88cda83a
Metrics: {"prepare.queue_time_us":279922,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":85,"raft.queue_time_us":8398,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"spinlock_wait_cycles":7883392,"thread_start_us":724973,"threads_started":2,"wal-append.queue_time_us":271435}
I20260709 12:24:22.261266 13869 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:22.266826 11025 leader_election.cc:336] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 1.516s (SENT)
I20260709 12:24:22.267408 11025 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:22.246695 13738 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.269987 13738 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:22.271307 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:22.271893 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1867) took 1919 ms. Trace:
I20260709 12:24:22.272614 13823 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:22.277562 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:22.278606 13855 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:22.279011 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:22.279726 10975 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 3.
W20260709 12:24:22.281329 13820 log.cc:927] Time spent T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 1.248s	user 0.000s	sys 0.002s
I20260709 12:24:22.278716 10981 raft_consensus.cc:1240] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:22.283442 11680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41784 (request call id 562) took 1992 ms. Trace:
I20260709 12:24:22.290877 10975 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2"
dest_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:52828
I20260709 12:24:22.291599 10975 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:22.291960 10975 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:22.272320 11126 rpcz_store.cc:276] 0709 12:24:20.351965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.357348 (+  5383us) service_pool.cc:224] Handling call
0709 12:24:20.357605 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.607268 (+1249663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.271620 (+664352us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54000eb0d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:22.271820 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2872521600}
I20260709 12:24:22.294304 10976 raft_consensus.cc:1240] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:22.299439 11126 raft_consensus.cc:1240] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:22.318415 13794 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:22.319021 13794 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:22.272264 13738 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:22.320990 13738 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:22.321168 13794 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:22.283846 11680 rpcz_store.cc:276] 0709 12:24:20.290610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.291566 (+   956us) service_pool.cc:224] Handling call
0709 12:24:20.298887 (+  7321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:20.321741 (+ 22854us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.321773 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:20.336158 (+ 14385us) log.cc:844] Serialized 26 byte log entry
0709 12:24:20.690291 (+354133us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:20.690352 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.690420 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:22.280672 (+1590252us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:22.283130 (+  2458us) raft_consensus.cc:1685] finished
0709 12:24:22.283155 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:22.283374 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22406,"raft.queue_time_us":74837,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":19802,"spinlock_wait_cycles":24449920,"thread_start_us":323678,"threads_started":1,"wal-append.queue_time_us":546938}
I20260709 12:24:22.309226 10983 raft_consensus.cc:1275] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:24:22.329826 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.266587 13874 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:22.340479 13874 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:22.341585 13842 log.cc:927] Time spent T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.762s	user 0.002s	sys 0.000s
I20260709 12:24:22.243284 13723 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:22.343429 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:22.348238 11056 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
I20260709 12:24:22.349093 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:22.344100 10984 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
W20260709 12:24:22.353648 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 132995us
I20260709 12:24:22.299198 11674 raft_consensus.cc:1240] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:22.355182 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:22.356782 10975 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:22.321801 13769 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:22.342981 13228 raft_consensus.cc:3055] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:22.350564 13833 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:22.372897 10975 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:22.358192 13796 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.366745 13228 raft_consensus.cc:740] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:24:22.388037 13837 log.cc:927] Time spent T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.810s	user 0.003s	sys 0.001s
W20260709 12:24:22.403373 11025 leader_election.cc:336] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 1.855s (SENT)
I20260709 12:24:22.410631 11025 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:22.368065 13834 consensus_queue.cc:1059] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:24:22.321549 13738 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:22.368698 13874 consensus_queue.cc:1059] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:24:22.368472 13823 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:24:22.395427 13742 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:22.486608 13826 log.cc:927] Time spent T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 1.089s	user 0.000s	sys 0.003s
I20260709 12:24:22.390403 13796 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:22.493682 13832 log.cc:927] Time spent T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:24:22.516628 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:22.518991 13680 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:22.521309 13680 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:22.494369 13629 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:22.525552 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 124063us
W20260709 12:24:22.519609 13879 log.cc:927] Time spent T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:24:22.528157 11672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 566) took 1781 ms. Trace:
I20260709 12:24:22.545756 13629 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:22.509233 13228 consensus_queue.cc:260] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:22.501204 13723 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:22.553198 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 196070us
I20260709 12:24:22.739812 13823 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.731009 11024 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
W20260709 12:24:22.665518 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.530582 11672 rpcz_store.cc:276] 0709 12:24:20.746589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.746697 (+   108us) service_pool.cc:224] Handling call
0709 12:24:20.747009 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:20.886833 (+139824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.886867 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:20.975053 (+ 88186us) log.cc:844] Serialized 26 byte log entry
0709 12:24:21.340656 (+365603us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:21.340698 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.340768 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:22.303577 (+962809us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:22.524172 (+220595us) raft_consensus.cc:1685] finished
0709 12:24:22.524199 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:22.528073 (+  3874us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4075,"raft.queue_time_us":55829,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":64401,"spinlock_wait_cycles":7504768,"thread_start_us":282466,"threads_started":1,"wal-append.queue_time_us":416228}
I20260709 12:24:22.746483 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:22.747148 10975 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:22.750867 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:22.752180 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:22.752183 10983 raft_consensus.cc:2410] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:24:22.765583 11024 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:22.743091 13823 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:22.767675 11023 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:22.782184 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:22.783917 10975 raft_consensus.cc:2393] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 8: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
W20260709 12:24:22.565830 13751 consensus_meta.cc:287] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.002s
W20260709 12:24:22.775776 13669 consensus_meta.cc:287] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.547s	user 0.007s	sys 0.003s
I20260709 12:24:22.790163 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:22.739511 13891 raft_consensus.cc:3055] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:22.744283 13796 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:22.558139 13738 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:22.738476 13742 raft_consensus.cc:2749] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:22.664995 13698 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:22.782740 13883 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:22.796361 13525 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.810596 13870 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:22.797887 13891 raft_consensus.cc:740] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:21.637312 11129 rpcz_store.cc:276] 0709 12:24:20.371185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.555459 (+1184274us) service_pool.cc:224] Handling call
0709 12:24:21.555801 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.556331 (+   530us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:21.578686 (+ 22355us) log.cc:844] Serialized 14 byte log entry
0709 12:24:21.612391 (+ 33705us) log.cc:844] Serialized 14 byte log entry
0709 12:24:21.624505 (+ 12114us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:21.624558 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:21.624616 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.624679 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.624803 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11879,"prepare.queue_time_us":23737,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":1875,"raft.queue_time_us":13425,"raft.run_wall_time_us":5079,"spinlock_wait_cycles":34300160,"thread_start_us":33148,"threads_started":1}
I20260709 12:24:22.842540 13525 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:22.851781 11129 raft_consensus.cc:1240] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:22.852607 13525 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:22.854310 13631 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:22.854785 13631 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:22.855161 13631 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:22.863149 13747 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:22.868062 13565 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:22.844869 13870 raft_consensus.cc:697] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:22.793346 13751 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:22.849112 13849 log.cc:927] Time spent T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 1.108s	user 0.002s	sys 0.015s
I20260709 12:24:22.839123 13883 raft_consensus.cc:697] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:22.833540 13698 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:22.845628 13726 consensus_queue.cc:1059] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 12:24:22.894443 13893 log.cc:927] Time spent T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:24:22.877851 13870 consensus_queue.cc:237] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:22.917797 13823 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:22.895468 13891 consensus_queue.cc:260] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:22.919308 13793 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:22.926154 13891 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:22.903525 13883 consensus_queue.cc:237] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:22.932929 13852 consensus_queue.cc:1048] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:24:22.993258 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 211186us
W20260709 12:24:22.903105 13772 consensus_meta.cc:287] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.934s	user 0.002s	sys 0.013s
I20260709 12:24:23.035492 13772 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:22.821017 13669 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:23.062234 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1882) took 2698 ms. Trace:
W20260709 12:24:23.072057 11133 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 1876) took 2717 ms (client timeout 2227 ms). Trace:
W20260709 12:24:23.072778 11133 rpcz_store.cc:269] 0709 12:24:20.361922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.745448 (+383526us) service_pool.cc:224] Handling call
0709 12:24:23.023745 (+2278297us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b540012d254. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:23.071754 (+ 48009us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1155184512}
W20260709 12:24:23.074185 13910 log.cc:927] Time spent T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.129s	user 0.002s	sys 0.000s
I20260709 12:24:23.078318 13669 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:23.078591 11681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41774 (request call id 456) took 2596 ms. Trace:
I20260709 12:24:23.073614 13751 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:23.065497 11134 rpcz_store.cc:276] 0709 12:24:20.363146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.045150 (+682004us) service_pool.cc:224] Handling call
0709 12:24:21.045406 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.978005 (+932599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.027481 (+1049476us) spinlock_profiling.cc:243] Waited 872 ms on lock 0x7b540023f0d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:23.061947 (+ 34466us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2005906816}
I20260709 12:24:23.088086 11128 raft_consensus.cc:2368] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4.
I20260709 12:24:23.089293 11127 raft_consensus.cc:2393] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 8: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:23.090900 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:52810 (request call id 77) took 1684 ms. Trace:
I20260709 12:24:23.091463 10978 rpcz_store.cc:276] 0709 12:24:21.398642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.398818 (+   176us) service_pool.cc:224] Handling call
0709 12:24:22.983750 (+1584932us) spinlock_profiling.cc:243] Waited 83.5 ms on lock 0x7b54003bae54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bdde853 00007f8f90dac60a 00007f8f8a3327d4 00007f8f8a332762 00007f8f8a332691 00007f8f8a33260c 00007f8f8a3318c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:23.079865 (+ 96115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192009088}
I20260709 12:24:23.096939 13805 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:23.097944 13739 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.087801 13793 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:23.106961 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1726) took 1397 ms. Trace:
I20260709 12:24:23.107620 11126 rpcz_store.cc:276] 0709 12:24:21.709744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.319257 (+609513us) service_pool.cc:224] Handling call
0709 12:24:22.319561 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:22.319788 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:22.320117 (+   329us) log.cc:844] Serialized 14 byte log entry
0709 12:24:22.394472 (+ 74355us) log.cc:844] Serialized 14 byte log entry
0709 12:24:22.910373 (+515901us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b1800443080. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cf73f3 00007f8f88cf97c1 00007f8f88cf9779 00007f8f88cf9709 00007f8f88cf96d1 00007f8f88cf89cd 0000000000388634 0000000000388479 00007f8f88cda83a
0709 12:24:23.064482 (+154109us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b1800443080. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88c71c0a 00007f8f923b1219 00007f8f88cf9a40 00007f8f88cf44e4 00007f8f88cf4455 00007f8f8bddc060 00007f8f8bdee716 00007f8f8bdff287 00007f8f8bdff208
0709 12:24:23.105947 (+ 41465us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:23.106085 (+   138us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:23.106258 (+   173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.106423 (+   165us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:23.106690 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":882,"prepare.queue_time_us":1423,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":87,"raft.queue_time_us":715323,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":121,"spinlock_wait_cycles":66119936,"thread_start_us":73300,"threads_started":1,"wal-append.queue_time_us":194023}
I20260709 12:24:23.110670 13676 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:23.111881 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.107652 13743 raft_consensus.cc:3055] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:23.112751 13743 raft_consensus.cc:740] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:23.114974 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:23.116179 11059 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:24:23.116783 13410 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:23.117336 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1939) took 2699 ms. Trace:
I20260709 12:24:23.117851 10977 rpcz_store.cc:276] 0709 12:24:20.417896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.418041 (+   145us) service_pool.cc:224] Handling call
0709 12:24:20.418358 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:20.564286 (+145928us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.564316 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:20.600790 (+ 36474us) log.cc:844] Serialized 26 byte log entry
0709 12:24:21.037999 (+437209us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:21.038046 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.984720 (+1946674us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54001a0754. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:23.069401 (+ 84681us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:23.082154 (+ 12753us) raft_consensus.cc:1685] finished
0709 12:24:23.082216 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:23.117080 (+ 34864us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":945,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":37842,"spinlock_wait_cycles":334741760,"thread_start_us":436861,"threads_started":1,"wal-append.queue_time_us":520590,"wal-append.run_cpu_time_us":1756,"wal-append.run_wall_time_us":1001773}
I20260709 12:24:23.098930 13739 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:23.122287 13629 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:23.079226 11681 rpcz_store.cc:276] 0709 12:24:20.482333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.482442 (+   109us) service_pool.cc:224] Handling call
0709 12:24:21.130800 (+648358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.410585 (+279785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.031190 (+1620605us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b54004bee50. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:23.078265 (+ 47075us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1456142720}
I20260709 12:24:23.123214 13629 consensus_queue.cc:1048] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:23.123925 13739 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:23.098423 11054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1296) took 1341 ms. Trace:
W20260709 12:24:23.125177 13909 log.cc:927] Time spent T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.129s	user 0.001s	sys 0.001s
I20260709 12:24:23.125527 13669 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:23.127996 11054 rpcz_store.cc:276] 0709 12:24:21.756924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.001464 (+244540us) service_pool.cc:224] Handling call
0709 12:24:22.001774 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:22.053232 (+ 51458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:22.053263 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:22.053314 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:22.053353 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.015934 (+962581us) spinlock_profiling.cc:243] Waited 51.2 ms on lock 0x7b54003dde54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:23.067127 (+ 51193us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:23.098217 (+ 31090us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117867264}
W20260709 12:24:23.132287 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 67992.1us
I20260709 12:24:23.117739 13410 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:23.097899 13805 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:23.154911 13903 consensus_queue.cc:1048] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
W20260709 12:24:23.160529 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.161105 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1943) took 1545 ms. Trace:
I20260709 12:24:23.162124 13762 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.165468 13698 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:23.166229 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:23.171027 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 767514us
I20260709 12:24:23.176940 13812 raft_consensus.cc:3055] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:23.178967 13739 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.193222 13669 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:23.198427 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:23.205135 13772 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:23.208829 10980 rpcz_store.cc:276] 0709 12:24:21.583480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.583637 (+   157us) service_pool.cc:224] Handling call
0709 12:24:21.585203 (+  1566us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.732494 (+147291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.981887 (+1249393us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b540009a454. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:23.128429 (+146542us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":337017728}
I20260709 12:24:23.217542 11059 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:23.213999 13812 raft_consensus.cc:740] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:23.222064 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:23.222862 13812 consensus_queue.cc:260] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:23.224812 13812 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:23.144363 13793 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:23.125775 13743 consensus_queue.cc:260] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:23.239480 13829 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:24:23.234273 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 73537us
I20260709 12:24:23.224858 13739 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:23.259526 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:23.250612 11024 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:23.263535 10982 raft_consensus.cc:1275] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:23.264370 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1944) took 1680 ms. Trace:
I20260709 12:24:23.264783 13410 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:23.233352 13762 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:23.264750 10982 rpcz_store.cc:276] 0709 12:24:21.583821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.583927 (+   106us) service_pool.cc:224] Handling call
0709 12:24:22.993082 (+1409155us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b5800003698. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90dbdfc0 00007f8f90da8929 00007f8f90da83d2 00007f8f8a31fbd4
0709 12:24:23.144510 (+151428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:23.264060 (+119550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.264309 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4539648}
I20260709 12:24:23.267714 13762 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:23.268285 13762 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:23.269061 11098 leader_election.cc:336] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Timed out: RequestConsensusVote RPC to 127.9.145.196:42197 timed out after 1.543s (SENT)
I20260709 12:24:23.268855 13762 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:23.271929 13739 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:23.271824 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 481007us
W20260709 12:24:23.278575 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 119392us
I20260709 12:24:23.262786 13772 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.289624 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:23.292538 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:23.292865 11056 raft_consensus.cc:3055] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:23.294898 11051 raft_consensus.cc:1275] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:24:23.279214 13833 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.292315 13913 raft_consensus.cc:2804] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:23.293298 11056 raft_consensus.cc:740] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:23.292888 11681 raft_consensus.cc:1240] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:23.298570 11679 raft_consensus.cc:2393] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 7: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:23.292671 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:23.299511 13743 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:23.282830 13829 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:23.301219 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:23.302019 11126 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 5.
I20260709 12:24:23.302927 13829 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:23.304143 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:23.304467 13833 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:23.305130 11672 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:23.295327 11051 pending_rounds.cc:85] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting all ops after (but not including) 2
I20260709 12:24:23.306412 11051 pending_rounds.cc:107] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:24:23.306797 11051 raft_consensus.cc:2889] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:23.307389 13833 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:23.297753 13913 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:23.308487 13913 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:23.311013 11056 consensus_queue.cc:260] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:23.313143 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:23.327276 11134 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 4.
I20260709 12:24:23.328533 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:23.329488 11134 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 5.
I20260709 12:24:23.313633 11125 raft_consensus.cc:1240] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 5. Current term is 7. Ops: [5.7-5.7]
I20260709 12:24:23.330447 11051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:24:23.304042 11058 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:23.330291 13772 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:23.332511 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:23.332943 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1709) took 1633 ms. Trace:
W20260709 12:24:23.333750 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.315603 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:23.336020 11679 raft_consensus.cc:1275] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:23.317682 13793 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:23.320807 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:23.337486 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:23.338699 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:23.322482 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:23.323546 13669 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:23.324504 13853 raft_consensus.cc:1064] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
W20260709 12:24:23.340960 13853 raft_consensus.cc:1068] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7: Unable to promote non-voter 0f3b1ccd8aa5412393aa7eb90f2bef95: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:24:23.322374 13903 consensus_queue.cc:1059] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:24:23.341761 13903 consensus_queue.cc:1243] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:23.314903 11126 raft_consensus.cc:1275] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:23.325140 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:23.325788 10930 auto_rebalancer.cc:893] Removing replace marker failed: Replica bc01179655564f29b83babe396377cbb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
W20260709 12:24:23.344408 10930 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:24:23.344756 10930 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:24:23.346952 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:23.348410 11128 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1711) took 1648 ms (client timeout 2189 ms). Trace:
I20260709 12:24:23.342901 13903 raft_consensus.cc:3055] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:23.349359 13903 raft_consensus.cc:740] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:23.350028 11132 raft_consensus.cc:1240] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:23.350623 13903 consensus_queue.cc:260] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:23.351783 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1721) took 1647 ms. Trace:
I20260709 12:24:23.314803 13805 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:23.331380 11023 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:23.352537 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 1901) took 1237 ms. Trace:
W20260709 12:24:23.351830 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.353052 11127 rpcz_store.cc:276] 0709 12:24:22.115164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.152768 (+ 37604us) service_pool.cc:224] Handling call
0709 12:24:23.349411 (+1196643us) spinlock_profiling.cc:243] Waited 881 ms on lock 0x7b5400066654. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:23.352460 (+  3049us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2026896128}
I20260709 12:24:23.317083 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:23.348735 11130 raft_consensus.cc:1240] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:24:23.354014 13903 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:23.352015 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:23.358428 11679 raft_consensus.cc:2393] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 7: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:23.358419 11129 raft_consensus.cc:1275] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:24:23.359157 11129 pending_rounds.cc:85] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 5
I20260709 12:24:23.359402 11129 pending_rounds.cc:107] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:24:23.359628 11129 raft_consensus.cc:2889] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:23.348908 11128 rpcz_store.cc:269] 0709 12:24:21.700016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.053475 (+353459us) service_pool.cc:224] Handling call
0709 12:24:23.348111 (+1294636us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b5400068e54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:23.348318 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2209950080}
I20260709 12:24:23.354904 13853 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:23.352599 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:23.362001 13853 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:23.334013 13772 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:23.333330 11125 rpcz_store.cc:276] 0709 12:24:21.699528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.166527 (+466999us) service_pool.cc:224] Handling call
0709 12:24:22.166853 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:23.330431 (+1163578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.332641 (+  2210us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400107054. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:23.332882 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2635896704}
I20260709 12:24:23.362582 13853 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:23.354846 11681 raft_consensus.cc:1240] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:24:23.339919 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:23.362800 11133 raft_consensus.cc:2393] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 10: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:23.341735 11056 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:24:23.352283 11132 rpcz_store.cc:276] 0709 12:24:21.704316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.248057 (+543741us) service_pool.cc:224] Handling call
0709 12:24:23.349635 (+1101578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:23.350573 (+   938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.351510 (+   937us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400066650. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:23.351713 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2532407552}
I20260709 12:24:23.331389 11051 raft_consensus.cc:606] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
W20260709 12:24:23.376012 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 96855.6us
W20260709 12:24:23.316548 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 179550us
I20260709 12:24:23.380311 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:23.380388 11059 raft_consensus.cc:1240] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:23.382493 11057 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
I20260709 12:24:23.315667 13762 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:23.391438 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 87556.9us
I20260709 12:24:23.391009 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:23.393724 11060 raft_consensus.cc:2410] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:23.395591 11679 raft_consensus.cc:2393] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:23.397380 11681 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:23.398119 10949 connection.cc:256] RPC call timeout handler was delayed by -1.574464044999786s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2189s for a response
W20260709 12:24:23.398841 10949 connection.cc:256] RPC call timeout handler was delayed by -1.4647360359999766s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
I20260709 12:24:23.399641 13793 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:23.400456 13793 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:23.404011 13793 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:23.397598 13738 consensus_queue.cc:1048] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:24:23.408463 11681 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 5.
W20260709 12:24:23.410503 13631 consensus_meta.cc:287] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.555s	user 0.012s	sys 0.008s
I20260709 12:24:23.411089 13631 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:23.413352 10948 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:23.413652 13738 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.414332 13738 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:23.417552 13738 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:23.393973 11134 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
I20260709 12:24:23.432040 13228 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:23.434628 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1729) took 1724 ms. Trace:
I20260709 12:24:23.435257 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:23.435909 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:23.436587 11128 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
W20260709 12:24:23.437000 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 49879.1us
I20260709 12:24:23.437476 11125 raft_consensus.cc:1275] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:24:23.437934 11125 pending_rounds.cc:85] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 6
I20260709 12:24:23.438247 11125 pending_rounds.cc:107] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:24:23.438515 11125 raft_consensus.cc:2889] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:23.439150 11024 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:24:23.440683 13857 consensus_queue.cc:1048] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:23.442374 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:23.442566 13857 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:23.446027 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:23.446853 11127 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 5.
I20260709 12:24:23.447207 11644 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:23.447908 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:23.448246 13805 consensus_queue.cc:1048] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:23.448513 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:23.435127 11130 rpcz_store.cc:276] 0709 12:24:21.710555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.770354 (+1059799us) service_pool.cc:224] Handling call
0709 12:24:23.348323 (+577969us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:23.357001 (+  8678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.434375 (+ 77374us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b5400068e50. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:23.434561 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1328133504}
I20260709 12:24:23.449572 11126 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:23.449908 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:23.450800 11130 raft_consensus.cc:2410] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 8 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:23.450654 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:23.451403 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:23.453122 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:23.453670 11051 raft_consensus.cc:2393] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 7: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:23.453881 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:23.455493 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:23.455875 11127 raft_consensus.cc:2393] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 7: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:23.456988 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:23.457649 11680 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:23.452170 13772 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.452345 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:23.448153 13629 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.457115 10882 catalog_manager.cc:5697] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 4 to 8, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 8 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:23.455741 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:23.459133 13629 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:23.451623 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:23.410524 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:23.437785 11132 raft_consensus.cc:1240] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:23.460786 11130 raft_consensus.cc:2410] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:24:23.460156 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 46972.7us
I20260709 12:24:23.458261 13772 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:23.437112 11134 raft_consensus.cc:1240] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:23.461714 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 71946.7us
I20260709 12:24:23.451360 11126 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
I20260709 12:24:23.473191 11056 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:23.474772 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:23.476168 11129 raft_consensus.cc:2410] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:23.481760 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:23.482966 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 90109.6us
I20260709 12:24:23.413659 13631 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:23.491583 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:23.492853 11133 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:23.488869 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:23.495105 11679 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:23.503113 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:23.504122 11060 raft_consensus.cc:2410] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:23.506067 11681 raft_consensus.cc:2393] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 7: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:23.506709 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:23.479570 13762 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:24:23.510275 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 104945us
I20260709 12:24:23.516059 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:23.521549 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:23.523650 11057 raft_consensus.cc:2368] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 5. Current term is 6.
I20260709 12:24:23.514818 13762 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:23.510691 13793 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:23.541437 11056 raft_consensus.cc:1275] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:23.518251 10882 catalog_manager.cc:5697] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 1 to 6, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 6 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:24:23.545883 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:23.551187 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:23.532131 13762 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:23.554790 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:23.555668 11673 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:23.554795 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:23.571005 11056 raft_consensus.cc:1275] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:24:23.572974 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:23.573753 11675 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
I20260709 12:24:23.577883 11133 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 5.
I20260709 12:24:23.578166 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:23.547330 13793 raft_consensus.cc:697] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:23.582924 11679 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:23.583494 11680 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:23.590420 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:24:23.595216 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 51488.7us
I20260709 12:24:23.599133 11058 raft_consensus.cc:2410] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:24:23.600019 11681 raft_consensus.cc:2393] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 6: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:23.592257 11673 raft_consensus.cc:2376] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6. Re-sending same reply.
I20260709 12:24:23.605078 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:23.607942 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:23.610064 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:23.610280 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:23.610989 11678 raft_consensus.cc:2393] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 9: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:23.612727 11130 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:23.614338 11056 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "702d64a1236147a784daa11e58563721"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:24:23.614956 11056 raft_consensus.cc:606] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:23.615281 11056 raft_consensus.cc:614] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:23.611003 11673 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
I20260709 12:24:23.625285 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:23.626396 10949 connection.cc:256] RPC call timeout handler was delayed by -1.3379843039997468s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
I20260709 12:24:23.618364 10882 catalog_manager.cc:5697] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 4 to 7, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 7 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:23.627113 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:23.624505 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:23.637897 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:23.640246 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:23.640378 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:23.641580 11675 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:23.643394 13914 log.cc:927] Time spent T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:24:23.643702 13853 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:23.645857 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:23.646704 11126 raft_consensus.cc:1275] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:24:23.629874 13895 consensus_queue.cc:1048] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:24:23.650642 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:23.650367 13793 consensus_queue.cc:237] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:23.653219 13853 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:23.653661 11129 raft_consensus.cc:1275] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:23.647143 11126 pending_rounds.cc:85] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 3
I20260709 12:24:23.655187 11059 raft_consensus.cc:2410] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:24:23.647145 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 49396.9us
I20260709 12:24:23.658535 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:23.659358 11134 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 5.
I20260709 12:24:23.661616 10977 raft_consensus.cc:1240] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:23.662565 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:23.662787 13805 consensus_queue.cc:1048] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:23.663324 10982 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:23.664817 13629 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:23.666002 13772 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:23.666589 13918 consensus_queue.cc:1048] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.126s
I20260709 12:24:23.668708 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:23.669426 11130 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
W20260709 12:24:23.669849 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:23.671293 10880 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39956 (request call id 177) took 23307 ms (client timeout 15000 ms). Trace:
I20260709 12:24:23.675313 10882 catalog_manager.cc:5697] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 2 to 5, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 5 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:23.677688 11677 raft_consensus.cc:1240] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:23.643216 11645 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:23.679768 11645 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:23.680825 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:23.681416 13772 raft_consensus.cc:2804] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:23.681885 13772 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:23.621567 13916 consensus_queue.cc:1048] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.179s
I20260709 12:24:23.682539 13903 consensus_queue.cc:1059] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:23.683687 13853 raft_consensus.cc:3055] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:23.684083 13853 raft_consensus.cc:740] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:23.685300 13853 consensus_queue.cc:260] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:23.682319 13772 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:23.655270 11126 pending_rounds.cc:107] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:24:23.698092 11126 raft_consensus.cc:2889] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:23.639102 11679 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:24:23.677300 10882 catalog_manager.cc:5697] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:24:23.696615 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:23.701301 10949 connection.cc:256] RPC call timeout handler was delayed by -1.1651843039999221s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
W20260709 12:24:23.701763 10949 connection.cc:256] RPC call timeout handler was delayed by -1.0836947729999338s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1761s for a response
W20260709 12:24:23.702050 10949 connection.cc:256] RPC call timeout handler was delayed by -1.0600615519997518s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1688s for a response
W20260709 12:24:23.702364 10949 connection.cc:256] RPC call timeout handler was delayed by -1.027443958999811s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2636s for a response
I20260709 12:24:23.712500 13853 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:23.713192 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:23.701140 13629 raft_consensus.cc:2749] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:24:23.671748 10880 rpcz_store.cc:269] 0709 12:24:00.363685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.396828 (+ 33143us) service_pool.cc:224] Handling call
0709 12:24:01.798865 (+1402037us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b54002e9854. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4e090 00007f8f8bdecf3a 00007f8f91ba2e9c 00007f8f91ca104e 00007f8f901622a4 00007f8f90162232 00007f8f90162161 00007f8f901620dc 00007f8f90161392 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:23.671033 (+21872168us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:19.753648 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:19.982196 (+228548us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:19.987078 (+  4882us) write_op.cc:435] Acquired schema lock
0709 12:24:19.994175 (+  7097us) tablet.cc:662] Decoding operations
0709 12:24:20.046445 (+ 52270us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:20.046523 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:20.046555 (+    32us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:24:20.047223 (+   668us) tablet.cc:701] Row locks acquired
0709 12:24:20.047241 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:24:20.047397 (+   156us) write_op.cc:270] Start()
0709 12:24:20.047524 (+   127us) write_op.cc:276] Timestamp: P: 1783599860047345 usec, L: 0
0709 12:24:20.047548 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:24:20.051839 (+  4291us) log.cc:844] Serialized 3344 byte log entry
0709 12:24:20.285974 (+234135us) op_driver.cc:464] REPLICATION: finished
0709 12:24:20.442470 (+156496us) write_op.cc:301] APPLY: starting
0709 12:24:20.442555 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:20.442748 (+   193us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:20.442877 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:20.443910 (+  1033us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:20.444149 (+   239us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:24:20.444193 (+    44us) write_op.cc:312] APPLY: finished
0709 12:24:20.444484 (+   291us) log.cc:844] Serialized 65 byte log entry
0709 12:24:20.481208 (+ 36724us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:20.506802 (+ 25594us) write_op.cc:454] Released schema lock
0709 12:24:20.526067 (+ 19265us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:20.595394 (+ 69327us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:20.595426 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":103468,"reported_tablets":21,"spinlock_wait_cycles":1618065664,"child_traces":[["op",{"apply.queue_time_us":156221,"apply.run_cpu_time_us":3135,"apply.run_wall_time_us":123035,"num_ops":8,"prepare.queue_time_us":907844,"prepare.run_cpu_time_us":15573,"prepare.run_wall_time_us":365359,"raft.queue_time_us":200670,"raft.run_cpu_time_us":11889,"raft.run_wall_time_us":60058,"replication_time_us":238265,"thread_start_us":539391,"threads_started":4,"wal-append.queue_time_us":31233,"wal-append.run_cpu_time_us":9763,"wal-append.run_wall_time_us":1382374}]]}
W20260709 12:24:23.718729 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.718010 11023 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:23.719303 10977 raft_consensus.cc:1240] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 6. Ops: []
I20260709 12:24:23.727458 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:23.731769 11680 raft_consensus.cc:2393] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 7: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:23.722491 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:23.723284 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:23.723028 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:23.727541 11677 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:24:23.694577 13857 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:23.734570 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:23.720106 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 80525.2us
I20260709 12:24:23.737849 11678 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 4.
W20260709 12:24:23.720284 13920 log.cc:927] Time spent T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.085s	user 0.000s	sys 0.002s
W20260709 12:24:23.718433 13917 log.cc:927] Time spent T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.245s	user 0.001s	sys 0.001s
I20260709 12:24:23.728341 13903 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
W20260709 12:24:23.751816 13923 log.cc:927] Time spent T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 12:24:23.718320 13919 log.cc:927] Time spent T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.107s	user 0.002s	sys 0.000s
I20260709 12:24:23.752045 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1707) took 2053 ms. Trace:
I20260709 12:24:23.752619 11131 rpcz_store.cc:276] 0709 12:24:21.698982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.091701 (+392719us) service_pool.cc:224] Handling call
0709 12:24:22.814518 (+722817us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b5800117398. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90dbdfc0 00007f8f90da8929 00007f8f90da83d2 00007f8f8a31fbd4
0709 12:24:22.814746 (+   228us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:23.110757 (+296011us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:24:23.110815 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:23.111621 (+   806us) log.cc:844] Serialized 26 byte log entry
0709 12:24:23.247807 (+136186us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:23.247845 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.251796 (+  3951us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:23.751573 (+499777us) raft_consensus.cc:1685] finished
0709 12:24:23.751594 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:23.751850 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":295157,"raft.queue_time_us":301066,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":215,"spinlock_wait_cycles":5850496,"thread_start_us":135576,"threads_started":1,"wal-append.queue_time_us":186322}
I20260709 12:24:23.754438 11645 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:23.755856 11645 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:23.742925 10882 catalog_manager.cc:5697] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:24:23.752480 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:23.757746 11645 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:23.770754 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 52870.3us
I20260709 12:24:23.772010 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:23.772197 11675 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:24:23.773553 11645 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:23.752804 13927 log.cc:927] Time spent T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 12:24:23.782267 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.784046 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:23.728271 13829 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.786913 11053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1637) took 1506 ms. Trace:
I20260709 12:24:23.787159 13410 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.790840 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:23.791554 11680 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:23.792898 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:23.752139 13903 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:23.798775 13410 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:23.801589 13410 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:23.789829 11053 rpcz_store.cc:276] 0709 12:24:22.230604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.230768 (+   164us) service_pool.cc:224] Handling call
0709 12:24:22.253740 (+ 22972us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:22.254020 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:22.254048 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:23.022884 (+768836us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b2c00000de8. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8a6dda11 00007f8f8a6ed372 00007f8f8be1fa01 00007f8f8bde443a 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2
0709 12:24:23.076325 (+ 53441us) log.cc:844] Serialized 26 byte log entry
0709 12:24:23.283708 (+207383us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:23.285537 (+  1829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.291587 (+  6050us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:23.726633 (+435046us) raft_consensus.cc:1685] finished
0709 12:24:23.726652 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:23.736583 (+  9931us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2889600,"thread_start_us":205325,"threads_started":1,"wal-append.queue_time_us":307683}
I20260709 12:24:23.802311  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:23.802717 10882 catalog_manager.cc:5697] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 1 to 4, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 4 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:23.804638 10882 catalog_manager.cc:5697] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:23.805857 11126 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:23.791831 10949 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:23.810232 13924 log.cc:927] Time spent T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:24:23.810580 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:23.811267 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.811331 10981 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:23.798868 11134 raft_consensus.cc:2393] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 9: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:23.812950 13572 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:23.814045 13903 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:23.814566 13228 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:23.815037 13228 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:23.815507 13228 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:23.816560 10982 raft_consensus.cc:1275] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:23.819536 11681 raft_consensus.cc:1275] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:24:23.777935 13629 raft_consensus.cc:2804] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:23.820333 13629 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:23.820789 13629 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:23.732929 13918 consensus_queue.cc:1048] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:24:23.797751 13829 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:23.822487 13891 consensus_queue.cc:1048] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:23.799206 11098 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:23.832202 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:23.832904 10975 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:23.806229 13922 log.cc:927] Time spent T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:24:23.834647 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:23.835379 10984 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:23.805338  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:24:23.810343 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 51710.1us
W20260709 12:24:23.832926 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.849714  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:23.850482 10882 catalog_manager.cc:5697] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:23.852566 10882 catalog_manager.cc:5697] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:24:23.854091 10882 catalog_manager.cc:5697] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:23.856489 10882 catalog_manager.cc:5697] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 1 to 5, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 5 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:24:23.857910 10882 catalog_manager.cc:5697] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 1 to 3, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 3 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:24:23.859115 13829 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:23.859602 10882 catalog_manager.cc:5697] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:24:23.861271 13681 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.861901 13681 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:23.861671 10882 catalog_manager.cc:5697] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 1 to 3, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 3 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:24:23.864279 13681 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:23.864828 10882 catalog_manager.cc:5697] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 2 to 3, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 3 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:24:23.878737 10981 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:23.900254 11680 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
W20260709 12:24:23.848241 13913 consensus_meta.cc:287] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.539s	user 0.014s	sys 0.000s
I20260709 12:24:23.900646 11023 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:23.904426 13631 consensus_queue.cc:1048] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:23.907265 13903 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:23.907879 13903 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:23.870584 13772 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:23.910079 13903 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:23.910456 13759 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:23.919145 13759 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:23.919523 13759 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:23.921258 10949 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:23.910687 13681 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.922761 13681 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:23.925055 11023 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:23.926216 13853 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:23.926739 13853 raft_consensus.cc:697] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:24:23.928823 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.927963 13853 consensus_queue.cc:237] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:23.913480 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:23.924974 13681 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:23.911772 13669 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:23.938539 13681 raft_consensus.cc:2804] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:23.939077 13681 raft_consensus.cc:697] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 7 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:23.938946 13669 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:23.940145 13681 consensus_queue.cc:237] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:23.941275 13669 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:23.910809 13410 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.928984 13698 consensus_queue.cc:1059] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:24:23.901592 13916 raft_consensus.cc:2749] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:23.916827 13772 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
I20260709 12:24:23.931185 13918 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:23.947883 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 82259.6us
I20260709 12:24:23.936297 13572 raft_consensus.cc:2749] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:23.921927 13629 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:23.953464 10949 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:23.946143 10948 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:23.931401 13762 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:23.932883 13913 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:23.949064 13829 raft_consensus.cc:2749] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:23.966784 10978 raft_consensus.cc:1240] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:23.952436 11674 raft_consensus.cc:2393] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 9: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:23.949368 13918 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:23.954440 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 412891us
I20260709 12:24:23.970274 10975 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:23.972293 11054 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 4.
I20260709 12:24:23.974958 10948 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:23.978613 11680 raft_consensus.cc:1240] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:23.975658 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:23.948493 13410 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:23.993842 10983 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:23.994866 13629 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:23.995388 13410 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:23.993302 13572 raft_consensus.cc:2764] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:24:23.998965 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:23.973941 13913 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:24.004917 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 51568.9us
I20260709 12:24:24.008358 11025 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:24.015630 10983 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
W20260709 12:24:24.014231 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 240751us
I20260709 12:24:23.989778 13738 raft_consensus.cc:2749] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:23.976589 13918 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:24.019068 11023 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:24.007939 10949 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:23.992919 13698 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:24.027758 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 404628us
I20260709 12:24:24.024420 13698 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:24.047922 11025 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:24.052286 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:24.031358 13895 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:24.052172 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:24.034754 13743 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:24.083112 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 75271us
W20260709 12:24:24.093854 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.052066 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:24.054062 13698 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:24.105854 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 66437.9us
I20260709 12:24:24.083401 13903 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:24.122000 11674 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:24.123267 11024 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:24.128302 11644 leader_election.cc:400] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 5. Current term is 6.
I20260709 12:24:24.128727 11644 leader_election.cc:403] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:24.095180 13895 raft_consensus.cc:697] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:24.133109 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:24.133832 11133 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:24.133847 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:24.135739 11129 raft_consensus.cc:3055] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:24.135874 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:24.136489 11131 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:24.137425 11134 raft_consensus.cc:2410] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:24:24.136173 11129 raft_consensus.cc:740] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:24.125735 11052 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:24:24.142783 13930 raft_consensus.cc:2749] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:24.144043 11129 consensus_queue.cc:260] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:24.144064 11644 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:24.144757 13228 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:24.134264 13913 raft_consensus.cc:2804] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:24.146495 13913 raft_consensus.cc:697] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:24.147022 11129 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:24.147523 13913 consensus_queue.cc:237] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:24.154512 11131 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
I20260709 12:24:24.137517 13903 raft_consensus.cc:697] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:24.170696 13759 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:24.174384 13759 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:24.174531 13916 raft_consensus.cc:2804] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:24.177580 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:24.217003 10978 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:24.140697 13629 raft_consensus.cc:2749] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 5. Current term is 6.
W20260709 12:24:24.189735 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.179315 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:24.220278 11053 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:24.217983 13812 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:24:24.228096 10978 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:24.229442 11023 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:24.230412 13812 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:24.232528 13812 raft_consensus.cc:697] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:24.233414 13812 consensus_queue.cc:237] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:24.239156 13857 consensus_queue.cc:1048] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:24.234015 11053 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:24:24.240454 13891 consensus_queue.cc:1059] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:24.240778 13857 consensus_queue.cc:1059] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:24.241964 13640 raft_consensus.cc:3055] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:24.242360 13640 raft_consensus.cc:740] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:24.243345 13640 consensus_queue.cc:260] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:24.244688 13640 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:24.136967 13743 consensus_queue.cc:1048] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:24:24.147104 13739 raft_consensus.cc:3055] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:24.147162 13228 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:24.197485 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.156543 13762 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:24.256619 13739 raft_consensus.cc:740] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
W20260709 12:24:24.251307 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:24.255797 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 147715us
I20260709 12:24:24.261078 11129 raft_consensus.cc:1275] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:24.217787 13916 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:24.279791 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.280710 11644 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:24.283238 10949 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:24.265309 13916 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:24.287402 11645 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:24.291222 11674 raft_consensus.cc:1240] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:24.292757 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:24.293430 11131 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:24.266525 13739 consensus_queue.cc:260] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:24.303620 11644 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:24.303531 11645 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:24.304880 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:24.305228 13629 raft_consensus.cc:2749] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:24.308758 10979 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 6
W20260709 12:24:24.312130 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 46897.1us
I20260709 12:24:24.266510 13723 consensus_queue.cc:1059] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:24:24.311033 13937 raft_consensus.cc:2804] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:24.320767 13743 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:24.316890 13805 raft_consensus.cc:2804] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:24.317129 13629 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:24:24.281494 13895 consensus_queue.cc:237] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:24.358754 10949 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:24.361135 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 561972us
I20260709 12:24:24.354203 13937 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:24.393020 13793 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.010s	sys 0.028s
I20260709 12:24:24.317883 13739 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:24.327521 13228 consensus_queue.cc:1059] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:24:24.418087 11131 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:24:24.361665 13723 raft_consensus.cc:3055] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:24:24.408368 13793 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.010s	sys 0.028s
I20260709 12:24:24.393977 13805 raft_consensus.cc:697] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:24.421411 13228 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.422947 13938 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:24.407289 13937 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:24.435428 11133 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
I20260709 12:24:24.438115 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:24.320475 13903 consensus_queue.cc:237] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:24:24.413327 13738 raft_consensus.cc:2804] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:24.450158 13228 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:24.450790 13738 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:24.451220 13738 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:24.454376 13938 raft_consensus.cc:697] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:24.455426 13938 consensus_queue.cc:237] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:24.457996 13934 log.cc:927] Time spent T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.455s	user 0.000s	sys 0.005s
I20260709 12:24:24.463996 11645 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:24.460379 13721 raft_consensus.cc:2804] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:24.409413 13743 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:24.445711 13723 raft_consensus.cc:740] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:24.476927 11098 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:24.473480 13721 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:24:24.517719 10982 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.025s	sys 0.026s
W20260709 12:24:24.518880 10982 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.025s	sys 0.026s
I20260709 12:24:24.473863 13772 raft_consensus.cc:2804] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:24:24.525715 10948 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.010s	sys 0.044s
I20260709 12:24:24.446671 13410 consensus_queue.cc:1048] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
W20260709 12:24:24.535434 10948 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.011s	sys 0.044s
W20260709 12:24:24.536363 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.521519 13721 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:24.521791 13572 raft_consensus.cc:2804] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:24.523489 13681 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:24.562435 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:24.562781 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:24.564150 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:24.566663 11680 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:24.572208 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 597183us
I20260709 12:24:24.575524 13572 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:24.576952 13805 consensus_queue.cc:237] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:24.577498 13572 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:24.579536 13936 log.cc:927] Time spent T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.134s	user 0.001s	sys 0.001s
I20260709 12:24:24.540221 13772 raft_consensus.cc:697] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:24:24.605351 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 246664us
I20260709 12:24:24.605584 10948 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:24.534758 13669 consensus_queue.cc:1059] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:24:24.582154 13681 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:24:24.607683 10981 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.004s	sys 0.010s
W20260709 12:24:24.612179 10981 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.004s	sys 0.010s
I20260709 12:24:24.614516 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:24.610342 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 370398us
I20260709 12:24:24.631966 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:24.633069 11058 raft_consensus.cc:2410] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:24:24.638578 11098 connection.cc:256] RPC call timeout handler was delayed by -1.2538612400003331s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1733s for a response
W20260709 12:24:24.616408 13853 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.002s	sys 0.064s
I20260709 12:24:24.671694 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:24.672257 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.613374 13681 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:24.673655 11130 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.018s	sys 0.046s
W20260709 12:24:24.674386 11130 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.018s	sys 0.046s
I20260709 12:24:24.675937 11054 raft_consensus.cc:1240] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:24.678723 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:24.681190 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 75695.2us
W20260709 12:24:24.672135 13853 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.002s	sys 0.064s
I20260709 12:24:24.604470 13698 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:24.688398 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:24.694289 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 62539.3us
I20260709 12:24:24.694908 11056 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:24.690196 10948 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:24.691018 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:24.674921 13812 raft_consensus.cc:3055] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:24.628090 13793 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:24.709589 11059 raft_consensus.cc:1240] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:24.710486 11676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 582) took 1102 ms. Trace:
W20260709 12:24:24.713797 13942 log.cc:927] Time spent T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 12:24:24.715142 13759 raft_consensus.cc:3055] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:24.715680 13759 raft_consensus.cc:740] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:24.716609 13759 consensus_queue.cc:260] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:24.707391 11058 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:24.721019 13759 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:24.755820 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 312522us
I20260709 12:24:24.720152 13812 raft_consensus.cc:740] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:24.679963 13738 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
W20260709 12:24:24.771311 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.734853 13228 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:24.710983 11676 rpcz_store.cc:276] 0709 12:24:23.495094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.529333 (+ 34239us) service_pool.cc:224] Handling call
0709 12:24:23.552005 (+ 22672us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:23.748310 (+196305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:23.748443 (+   133us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:23.754429 (+  5986us) log.cc:844] Serialized 52 byte log entry
0709 12:24:24.135111 (+380682us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:24.135150 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:24.135264 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:24.578897 (+443633us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:24.581599 (+  2702us) raft_consensus.cc:1685] finished
0709 12:24:24.581621 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:24.597614 (+ 15993us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18243,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":142,"spinlock_wait_cycles":5627776,"thread_start_us":540235,"threads_started":2,"wal-append.queue_time_us":623207}
I20260709 12:24:24.749508 13743 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:24.803234 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:24.807897 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 228739us
I20260709 12:24:24.804117 11025 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:24.785372 13857 raft_consensus.cc:1064] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
W20260709 12:24:24.828388 10979 consensus_meta.cc:287] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.513s	user 0.010s	sys 0.000s
I20260709 12:24:24.828907 10979 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
W20260709 12:24:24.830535 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:24.831214 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:24.847072 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:24.847635 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.724995 13772 consensus_queue.cc:237] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:24.858035 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.814283 13228 consensus_queue.cc:1059] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.043s
W20260709 12:24:24.873230 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 162504us
W20260709 12:24:24.869920 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 179837us
I20260709 12:24:24.881892 10948 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:24:24.865207 13918 consensus_meta.cc:287] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.834s	user 0.013s	sys 0.000s
W20260709 12:24:24.889873 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 112235us
I20260709 12:24:24.881880 13913 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
W20260709 12:24:24.909608 11643 leader_election.cc:336] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.630s (SENT)
I20260709 12:24:24.914057 11643 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:24.857015 13812 consensus_queue.cc:260] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:24.914906 13947 log.cc:927] Time spent T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 12:24:24.911713 13669 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.885815 13950 consensus_queue.cc:1048] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.210s
I20260709 12:24:24.895550 13918 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:24.938256 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 58228.4us
I20260709 12:24:24.940624 10948 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:24.922663 13629 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:24.917069 13965 consensus_queue.cc:1048] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.122s
I20260709 12:24:24.915529 13913 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:24.968170 13949 log.cc:927] Time spent T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:24:24.939368 13967 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:24.971253 13945 log.cc:927] Time spent T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.395s	user 0.001s	sys 0.003s
W20260709 12:24:24.971246 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 63050us
I20260709 12:24:24.974817 13977 consensus_queue.cc:1048] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:24.995036 11678 raft_consensus.cc:1240] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:24.933501 13963 consensus_queue.cc:1048] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:24:24.976032 13948 raft_consensus.cc:3055] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:24.982483 13738 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:24.996358 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 48879us
I20260709 12:24:24.944034 13976 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:24.937191 13669 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:25.005760 13984 log.cc:927] Time spent T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.064s	user 0.000s	sys 0.005s
I20260709 12:24:25.015268 11098 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:25.009799 13957 log.cc:927] Time spent T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.123s	user 0.001s	sys 0.002s
I20260709 12:24:25.002226 13793 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:25.003405 13948 raft_consensus.cc:740] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
W20260709 12:24:25.024645 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.018787 13738 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:25.026831 13738 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.027257 13738 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:25.031904 13948 consensus_queue.cc:260] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:25.033221 13948 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:25.010918 13976 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
W20260709 12:24:25.039335 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.016718 13698 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:25.031999 13969 log.cc:927] Time spent T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.067s	user 0.000s	sys 0.002s
I20260709 12:24:25.043790 10949 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:25.047070 13918 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:25.037583 13759 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:25.049474 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:25.050179 11133 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:24:25.054189 13973 raft_consensus.cc:2749] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:25.055498 13972 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.056089 13972 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:25.056850 13739 consensus_meta.cc:287] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.636s	user 0.009s	sys 0.002s
I20260709 12:24:25.038908 13985 raft_consensus.cc:2749] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:25.056520 13681 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:25.058414 13983 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.058956 13983 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:25.061120 13983 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:25.041167 13976 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:25.063591 13961 log.cc:927] Time spent T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.127s	user 0.002s	sys 0.000s
I20260709 12:24:25.066296 13857 consensus_queue.cc:237] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:25.070948 13937 consensus_meta.cc:287] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.620s	user 0.004s	sys 0.007s
I20260709 12:24:25.071556 13937 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:25.078269 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 187541us
I20260709 12:24:25.071484 11673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41784 (request call id 583) took 1513 ms. Trace:
I20260709 12:24:25.079073 11025 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:25.077942 11133 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
W20260709 12:24:25.084017 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 81698.8us
I20260709 12:24:25.086757 11058 raft_consensus.cc:1275] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:25.081050 11645 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:25.091563 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:25.079533 11673 rpcz_store.cc:276] 0709 12:24:23.558367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.778650 (+220283us) service_pool.cc:224] Handling call
0709 12:24:23.835790 (+ 57140us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:24.265502 (+429712us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:24.270198 (+  4696us) log.cc:844] Serialized 14 byte log entry
0709 12:24:24.869333 (+599135us) log.cc:844] Serialized 14 byte log entry
0709 12:24:24.869510 (+   177us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:24.892986 (+ 23476us) log.cc:844] Serialized 26 byte log entry
0709 12:24:24.893152 (+   166us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:24.893407 (+   255us) log.cc:844] Serialized 14 byte log entry
0709 12:24:24.900484 (+  7077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:24.900576 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:24.970016 (+ 69440us) spinlock_profiling.cc:243] Waited 3.57 ms on lock 0x7b180042b9e0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cf73f3 00007f8f88cf97c1 00007f8f88cf9779 00007f8f88cf9709 00007f8f88cf96d1 00007f8f88cf89cd 0000000000388634 0000000000388479 00007f8f88cda83a
0709 12:24:25.062900 (+ 92884us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:25.071279 (+  8379us) raft_consensus.cc:1685] finished
0709 12:24:25.071299 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:25.071425 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74170,"prepare.queue_time_us":91484,"prepare.run_cpu_time_us":152,"prepare.run_wall_time_us":155,"raft.queue_time_us":224726,"raft.run_cpu_time_us":535,"raft.run_wall_time_us":30985,"spinlock_wait_cycles":13164672,"thread_start_us":950164,"threads_started":3,"wal-append.queue_time_us":623696}
I20260709 12:24:25.097821 11023 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:25.101890 13937 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:25.102998 13812 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:25.110656 13972 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:25.111752 13968 log.cc:927] Time spent T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.098s	user 0.001s	sys 0.002s
I20260709 12:24:25.112278 13962 raft_consensus.cc:993] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7: : Instructing follower bc01179655564f29b83babe396377cbb to start an election
W20260709 12:24:25.112833 13979 log.cc:927] Time spent T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:24:25.092523 13967 raft_consensus.cc:2749] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:25.109846 13951 log.cc:927] Time spent T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.384s	user 0.002s	sys 0.000s
I20260709 12:24:25.086213 13739 raft_consensus.cc:2764] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:24:25.133989 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 1983) took 1207 ms. Trace:
I20260709 12:24:25.137521 11675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41774 (request call id 467) took 1568 ms. Trace:
I20260709 12:24:25.137713 10981 rpcz_store.cc:276] 0709 12:24:23.926601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.926771 (+   170us) service_pool.cc:224] Handling call
0709 12:24:23.927146 (+   375us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:23.927601 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:23.927631 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:23.928233 (+   602us) log.cc:844] Serialized 52 byte log entry
0709 12:24:24.612853 (+684620us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:24.612896 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:24.612968 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:25.133672 (+520704us) raft_consensus.cc:1685] finished
0709 12:24:25.133698 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:25.133913 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2245,"raft.queue_time_us":1247,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":2692,"thread_start_us":684184,"threads_started":1,"wal-append.queue_time_us":989016}
I20260709 12:24:25.138171 11675 rpcz_store.cc:276] 0709 12:24:23.568988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.774887 (+205899us) service_pool.cc:224] Handling call
0709 12:24:23.775437 (+   550us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:24.119492 (+344055us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:24.119528 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:24.138021 (+ 18493us) log.cc:844] Serialized 26 byte log entry
0709 12:24:24.613194 (+475173us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:24.680411 (+ 67217us) log.cc:844] Serialized 14 byte log entry
0709 12:24:24.691797 (+ 11386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:24.691877 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:25.137302 (+445425us) raft_consensus.cc:1685] finished
0709 12:24:25.137327 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:25.137455 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":66925,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":198520,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":1244,"spinlock_wait_cycles":6394240,"thread_start_us":676757,"threads_started":2,"wal-append.queue_time_us":811608}
W20260709 12:24:25.141952 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 102564us
I20260709 12:24:25.081494 13759 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:25.143725 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 49478.3us
W20260709 12:24:25.145800 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 48777.8us
I20260709 12:24:25.153474 10949 leader_election.cc:400] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 3 election: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 3. Current term is 4.
I20260709 12:24:25.155774 11133 raft_consensus.cc:1275] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:25.141741 13681 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:25.154371 13987 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:25.158705 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:25.159320 13980 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:25.159710 10977 raft_consensus.cc:2410] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:24:25.160898 13955 log.cc:927] Time spent T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.265s	user 0.002s	sys 0.002s
I20260709 12:24:25.162693 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 398) took 1043 ms. Trace:
I20260709 12:24:25.163153 11126 rpcz_store.cc:276] 0709 12:24:24.118788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:24.118929 (+   141us) service_pool.cc:224] Handling call
0709 12:24:24.131662 (+ 12733us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:24.171740 (+ 40078us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:24.171778 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:24.172389 (+   611us) log.cc:844] Serialized 26 byte log entry
0709 12:24:24.632464 (+460075us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:24.632767 (+   303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:24.632859 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:25.110544 (+477685us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:25.162292 (+ 51748us) raft_consensus.cc:1685] finished
0709 12:24:25.162317 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:25.162564 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11985,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"spinlock_wait_cycles":8757120,"thread_start_us":458434,"threads_started":1,"wal-append.queue_time_us":640997}
I20260709 12:24:25.154481 11098 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:25.171428 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 92443.9us
W20260709 12:24:25.174291 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 233730us
W20260709 12:24:25.166265 13572 consensus_meta.cc:287] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.555s	user 0.002s	sys 0.010s
I20260709 12:24:25.180374 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:25.172817 13972 raft_consensus.cc:1081] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Signalling peer bc01179655564f29b83babe396377cbb to start an election
I20260709 12:24:25.165661 13903 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:25.184433 10948 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:25.172828 13963 raft_consensus.cc:2749] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:25.173441 13980 raft_consensus.cc:697] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:25.187513 11098 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:25.187680 10982 raft_consensus.cc:1275] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:24:25.190671 10979 raft_consensus.cc:1275] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:25.196039 11126 raft_consensus.cc:1275] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:25.196625 11025 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
W20260709 12:24:25.197116 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 97878.2us
I20260709 12:24:25.254462 10981 raft_consensus.cc:1240] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:25.176128 13681 raft_consensus.cc:2749] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:25.254982 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 87486.4us
I20260709 12:24:25.179420 13913 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:25.254698 11097 leader_election.cc:336] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.531s (SENT)
I20260709 12:24:25.272506 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:25.284708 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 97342.6us
W20260709 12:24:25.286391 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 105245us
I20260709 12:24:25.287410 11098 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:25.287766 10948 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:25.288022 13983 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:25.288605 13983 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:25.289137 13918 consensus_queue.cc:1048] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:24:25.290267 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.290793 10949 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:25.292076 10949 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:25.292846 13985 consensus_queue.cc:1059] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:25.293257 10949 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:25.293635 13985 consensus_queue.cc:1243] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [LEADER]: Peer 7518bdeb78f24e67a530754ae48547eb log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:24:25.294252 13985 consensus_queue.cc:1059] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:25.295125 13985 raft_consensus.cc:2749] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:25.296062 13958 raft_consensus.cc:3055] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:25.296518 13985 raft_consensus.cc:2804] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:25.297006 13985 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:25.297438 13985 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:25.296530 13958 raft_consensus.cc:740] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:25.294457 13698 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:25.177042 13738 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:25.197587 13805 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.295617 13977 raft_consensus.cc:3055] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:25.282501 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:25.179867 13572 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:25.181766 13938 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 12:24:25.314749 10977 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:25.275007 13903 raft_consensus.cc:697] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:25.310645 10975 raft_consensus.cc:1240] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:25.315541 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 118998us
I20260709 12:24:25.306813 10981 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:25.319804 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:25.320694 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:25.287885 13895 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:25.296715 13793 raft_consensus.cc:3055] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:25.336669 10979 raft_consensus.cc:1240] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:25.323331 10948 connection.cc:256] RPC call timeout handler was delayed by -1.3362451190000684s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
I20260709 12:24:25.283468 13669 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:25.326434 11676 raft_consensus.cc:1240] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 6. Current term is 8. Ops: []
I20260709 12:24:25.328477 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:25.303438 11097 leader_election.cc:336] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.567s (SENT)
I20260709 12:24:25.328905 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:25.338838 13891 consensus_queue.cc:1048] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:25.339174 11674 raft_consensus.cc:1275] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 LEARNER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:25.339653 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:25.305480 13948 raft_consensus.cc:2804] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:25.171154 13987 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:25.342509 11052 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:25.339695 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:25.353574 11677 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:24:25.341434 11673 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:25.300823 13996 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:25.172396 13723 consensus_queue.cc:260] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:25.313472 13829 raft_consensus.cc:2804] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:25.305557 13857 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:25.283219 13743 consensus_queue.cc:1048] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:24:25.341389 11097 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:25.349128 10984 raft_consensus.cc:1275] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:25.299152 13958 consensus_queue.cc:260] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:25.319394 13977 raft_consensus.cc:740] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
W20260709 12:24:25.342566 13721 consensus_meta.cc:287] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.742s	user 0.012s	sys 0.000s
I20260709 12:24:25.372871 10949 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:25.382784 10948 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:25.335165 13973 raft_consensus.cc:2804] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:25.341347 13793 raft_consensus.cc:740] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
W20260709 12:24:25.384598 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 97287.9us
I20260709 12:24:25.328210 13913 consensus_queue.cc:1059] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:24:25.377435 11677 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
I20260709 12:24:25.350416 13948 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.325691 13739 consensus_queue.cc:1059] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:24:25.327143 13805 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:25.390353 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 86969.3us
W20260709 12:24:25.391593 11097 leader_election.cc:336] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.627s (SENT)
I20260709 12:24:25.380700 13743 consensus_queue.cc:1243] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer 7518bdeb78f24e67a530754ae48547eb log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:25.412201 11097 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:25.376573 13857 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:25.384656 13973 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.345727 13895 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:25.414536 13988 consensus_queue.cc:1059] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 12:24:25.381444 13829 raft_consensus.cc:697] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
W20260709 12:24:25.414455 14000 log.cc:927] Time spent T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:24:25.375525 13963 consensus_queue.cc:1059] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:24:25.430439 13990 consensus_queue.cc:1048] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 12:24:25.391621 13948 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:25.413120 11098 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:25.446475 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.470542 13739 raft_consensus.cc:3055] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:25.417328 13983 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:25.421697 13857 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:25.479024 11023 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:25.439563 13965 raft_consensus.cc:2749] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:25.386696 13721 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:25.424082 13973 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:25.474504 13950 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:25.431807 13829 consensus_queue.cc:237] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:25.481312 13739 raft_consensus.cc:740] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:25.507812 11023 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:25.506307 13932 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:25.499008 13991 log.cc:927] Time spent T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
I20260709 12:24:25.377035 13980 consensus_queue.cc:237] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:25.493386 13983 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:25.525440 13913 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.525990 13913 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:25.529273 13992 raft_consensus.cc:3055] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:25.531042 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:25.531837 11055 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:25.533419 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:25.533634 13913 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:25.484477 13988 consensus_queue.cc:1059] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:24:25.424517 13903 consensus_queue.cc:237] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:25.734567 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 383175us
W20260709 12:24:25.534713 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 152076us
I20260709 12:24:25.534682 11054 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:25.574189 14005 raft_consensus.cc:2749] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:25.571847 13994 log.cc:927] Time spent T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
I20260709 12:24:25.568073 13999 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.195s
I20260709 12:24:25.566716 13738 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:25.495548 13793 consensus_queue.cc:260] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:25.739346 11052 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
I20260709 12:24:25.520859 13983 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:25.664903 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 157156us
I20260709 12:24:25.484476 13977 consensus_queue.cc:260] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:25.499533 13891 consensus_queue.cc:1059] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:24:25.523618 13932 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:25.533759 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:25.591167 13739 consensus_queue.cc:260] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:25.549371 13916 consensus_meta.cc:287] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 1.242s	user 0.015s	sys 0.000s
I20260709 12:24:25.524983 13976 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:25.743355 13410 raft_consensus.cc:2749] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:25.744321 13958 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:25.745110 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:25.748765 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 335607us
I20260709 12:24:25.602068 13572 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:25.831751 13983 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:25.848888 11098 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:25.796376 13857 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:25.797216 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 441645us
I20260709 12:24:25.749109 13759 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:25.816370 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:25.525005 13853 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.754590 13631 raft_consensus.cc:2804] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:25.831918 11057 raft_consensus.cc:1240] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 6. Current term is 8. Ops: []
W20260709 12:24:25.834934 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 98323.3us
I20260709 12:24:25.813699 13950 raft_consensus.cc:2749] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:25.837276 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:25.814810 13669 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:25.811244 13990 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:25.839905 10948 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:25.844705 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 453101us
I20260709 12:24:25.529848 13992 raft_consensus.cc:740] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:25.736034 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:25.833487 13805 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:25.886353 11643 leader_election.cc:336] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.830s (SENT)
I20260709 12:24:25.885972 11060 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:25.847484 13977 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:25.889411 10949 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:25.980284 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:25.910661 13976 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:25.890008 13853 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:25.961062 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:25.915532 13932 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:25.936156 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.981324 11130 raft_consensus.cc:1240] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:25.887629 13739 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:25.981915 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:25.892509 13631 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.997836 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:25.908721 14019 consensus_queue.cc:1048] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:24:25.916417 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:25.948328  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:26.038368 13669 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.855054 13916 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:25.904744 11097 leader_election.cc:336] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.661s (SENT)
I20260709 12:24:26.126739 11097 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:25.904263 13990 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:26.000607 11132 raft_consensus.cc:1275] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:24:26.127408 11132 pending_rounds.cc:85] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 6
I20260709 12:24:26.127672 11132 pending_rounds.cc:107] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 7.7
W20260709 12:24:25.984045 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.937686 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:26.128664 11127 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:25.914871 14012 raft_consensus.cc:2749] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:24:25.938865 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 99052.1us
I20260709 12:24:25.975793 13721 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:25.905119 11058 raft_consensus.cc:1240] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:25.914615 13992 consensus_queue.cc:260] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:25.909235 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:26.019734 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:25.979727 13995 log.cc:927] Time spent T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.485s	user 0.000s	sys 0.008s
W20260709 12:24:25.942577 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 56257.8us
I20260709 12:24:25.893849 14005 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:26.035939 11126 raft_consensus.cc:1240] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:26.045733 14003 log.cc:927] Time spent T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7: Append to log took a long time: real 0.266s	user 0.005s	sys 0.003s
W20260709 12:24:26.046058 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 156765us
I20260709 12:24:26.046168 14021 consensus_queue.cc:1059] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.129s
I20260709 12:24:26.150395 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:26.151374 11643 leader_election.cc:336] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 2.041s (SENT)
I20260709 12:24:26.151618 10949 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:26.151911 11134 raft_consensus.cc:2393] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 4: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:24:26.046053 14001 log.cc:927] Time spent T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.291s	user 0.004s	sys 0.004s
W20260709 12:24:26.057559 13998 log.cc:927] Time spent T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.624s	user 0.006s	sys 0.000s
W20260709 12:24:26.061200 13985 consensus_meta.cc:287] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.763s	user 0.015s	sys 0.000s
W20260709 12:24:26.074126 14007 log.cc:927] Time spent T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:24:26.078931 13987 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:26.088311 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.090956 13410 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.091464 13572 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.197223 13572 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:26.199440 13572 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:26.091102 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.200774 10983 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8"
dest_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:52828
I20260709 12:24:26.201393 10983 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:26.201759 10983 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:26.092063 13698 consensus_meta.cc:287] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.777s	user 0.010s	sys 0.005s
W20260709 12:24:26.093061 13973 consensus_meta.cc:287] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.000s
I20260709 12:24:26.204161 13973 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:26.204644 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:26.205307 10975 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:26.206382 13973 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:26.093907 13948 consensus_meta.cc:287] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.608s	user 0.009s	sys 0.000s
I20260709 12:24:26.207486 10980 raft_consensus.cc:1240] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:26.207172 13948 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:26.207873 10976 raft_consensus.cc:1275] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:24:26.208389 11128 raft_consensus.cc:2368] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5.
I20260709 12:24:26.210247 13948 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:26.002804 14006 log.cc:927] Time spent T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.225s	user 0.000s	sys 0.024s
I20260709 12:24:26.210611 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:26.211311 10977 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:26.148775 13980 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.213557 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:26.214236 10978 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:25.875763 13996 raft_consensus.cc:697] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 7 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:26.122056 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:26.127921 11132 raft_consensus.cc:2889] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:26.129784 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:26.216295 11127 raft_consensus.cc:2410] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:26.133313 11055 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
W20260709 12:24:26.141345 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.144200 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:24:26.131623 13812 consensus_meta.cc:287] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 1.028s	user 0.006s	sys 0.010s
I20260709 12:24:26.163780 13992 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:26.204026 13698 raft_consensus.cc:2749] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:26.046761 13950 raft_consensus.cc:2749] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:26.151899 11643 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:26.167418 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:26.167418 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:26.174342 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:26.150466 10948 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:26.168486 13721 consensus_queue.cc:1048] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:24:26.194409 10949 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:26.194901 14012 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:26.206704 10984 raft_consensus.cc:1240] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:26.114197 11129 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:26.123947 13631 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:26.164726 14011 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.215140 10983 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:26.206283 13853 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:26.129930 13669 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:26.421739 11127 raft_consensus.cc:1240] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:26.317562 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.326351 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:26.421728 11023 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:26.237421 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:26.350728 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:26.319170 11098 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:26.317266 11132 raft_consensus.cc:1275] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:24:26.457355 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 138269us
W20260709 12:24:26.451992 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 301595us
I20260709 12:24:26.454872 10977 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
W20260709 12:24:26.250593 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.421633 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:26.499893 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 43931.2us
I20260709 12:24:26.450883 11674 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
W20260709 12:24:26.374630 14024 log.cc:927] Time spent T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 12:24:26.461983 11672 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:26.471158 10948 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:26.536335 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 65286.2us
I20260709 12:24:26.461329 11098 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:26.537849 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 76624.8us
W20260709 12:24:26.539405 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 388023us
I20260709 12:24:26.324265 14014 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.423051 14018 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.316748 13681 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.541725 11131 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:26.461911 13918 raft_consensus.cc:2749] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:26.538590 11098 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:26.285818 13938 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.318611 13629 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:26.551221 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 129575us
I20260709 12:24:26.317154 13973 raft_consensus.cc:2749] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:26.540171 11643 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 2.714s (SENT) [suppressed 44 similar messages]
I20260709 12:24:26.543702 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:26.348181 13987 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:26.357558 13986 raft_consensus.cc:3055] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:26.562858 11129 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:26.456807 14012 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:26.364904 13990 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:26.347225 13857 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:26.500092 13976 raft_consensus.cc:2764] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:24:26.375276 13895 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:26.461786 13977 raft_consensus.cc:2804] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:26.567723 13640 raft_consensus.cc:2804] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:26.575805 14030 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:26.285221 14025 consensus_queue.cc:1048] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.406s
I20260709 12:24:26.361233 13723 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:26.285398 13983 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:26.191473 13985 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:26.237268 13980 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:26.315979 13996 consensus_queue.cc:237] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:26.238381 13410 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:24:26.573028 11098 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:26.462165 14011 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:26.991892 11131 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
W20260709 12:24:26.726648 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.900862 11060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1670) took 1058 ms. Trace:
W20260709 12:24:27.208273 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 1.01389e+06us
W20260709 12:24:27.003330 11097 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.012s	sys 0.027s
W20260709 12:24:27.217170 11097 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.080s	user 0.014s	sys 0.028s
W20260709 12:24:27.218457 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 645466us
I20260709 12:24:26.552075 14019 raft_consensus.cc:2804] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:27.209589 11024 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:24:26.587292 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:27.226583 11056 raft_consensus.cc:2410] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
W20260709 12:24:27.214401 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.218336 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 1916) took 1284 ms. Trace:
I20260709 12:24:26.839685 11055 raft_consensus.cc:1275] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:27.208608 11060 rpcz_store.cc:276] 0709 12:24:25.741479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.741590 (+   111us) service_pool.cc:224] Handling call
0709 12:24:26.799643 (+1058053us) spinlock_profiling.cc:243] Waited 42.2 ms on lock 0x7b54003138d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:26.799815 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96952064}
W20260709 12:24:26.688221 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:27.003921 11130 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.014s	sys 0.009s
W20260709 12:24:27.237103 11130 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.014s	sys 0.013s
W20260709 12:24:27.046166 11134 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.851s	user 0.024s	sys 0.022s
W20260709 12:24:27.141847 10979 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.011s	sys 0.015s
W20260709 12:24:26.931437 11133 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.004s	sys 0.019s
W20260709 12:24:26.900599 11125 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.002s	sys 0.039s
W20260709 12:24:27.220611 11128 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.902s	user 0.015s	sys 0.027s
W20260709 12:24:27.237892 11134 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.043s	user 0.029s	sys 0.026s
I20260709 12:24:27.291150 10949 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
W20260709 12:24:27.215193 11645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.003s	sys 0.007s
W20260709 12:24:27.417402 11133 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.006s	sys 0.025s
I20260709 12:24:26.577775 13989 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:26.550870 13853 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.551581 13962 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.551891 13891 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
W20260709 12:24:27.003804 10982 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.016s	sys 0.021s
I20260709 12:24:26.536206 13963 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
W20260709 12:24:27.422453 11125 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.229s	user 0.007s	sys 0.044s
W20260709 12:24:26.992899 14016 log.cc:927] Time spent T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.745s	user 0.000s	sys 0.001s
W20260709 12:24:26.900419 13903 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.010s	sys 0.010s
W20260709 12:24:27.460881 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 1.56933e+06us
I20260709 12:24:27.234476 11129 rpcz_store.cc:276] 0709 12:24:25.935799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.960716 (+ 24917us) service_pool.cc:224] Handling call
0709 12:24:27.218261 (+1257545us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:27.418035 11645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.003s	sys 0.007s
W20260709 12:24:27.287544 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 49127.7us
I20260709 12:24:26.572270 14018 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:26.718201 14020 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.617057 13999 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:24:27.003510 14005 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.016s	sys 0.026s
W20260709 12:24:26.798703 14010 log.cc:927] Time spent T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.399s	user 0.000s	sys 0.001s
W20260709 12:24:27.417861 11128 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.099s	user 0.015s	sys 0.027s
I20260709 12:24:26.626899 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:27.419312 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 128262us
W20260709 12:24:27.238032 10979 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.012s	sys 0.016s
I20260709 12:24:27.288472 11025 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:27.226143 14019 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:27.206900 13986 raft_consensus.cc:740] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:27.293293 13973 raft_consensus.cc:2804] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:27.291666 13895 consensus_queue.cc:1059] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.158s
W20260709 12:24:26.911160 13829 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.007s	sys 0.011s
W20260709 12:24:27.215463 14003 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.005s	sys 0.005s
W20260709 12:24:27.213328 13992 consensus_meta.cc:287] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.892s	user 0.007s	sys 0.004s
W20260709 12:24:27.459149 10982 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.241s	user 0.023s	sys 0.028s
I20260709 12:24:27.288604 13916 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:27.461771 10948 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.924s	user 0.006s	sys 0.026s
W20260709 12:24:27.510561 10948 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.007s	sys 0.026s
W20260709 12:24:27.510973 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 973854us
I20260709 12:24:26.576069 14026 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:27.225366 13640 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:27.621382 13640 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:27.463882 11097 connection.cc:256] RPC call timeout handler was delayed by -2.0693725569999515s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1886s for a response
W20260709 12:24:27.626392 11097 connection.cc:256] RPC call timeout handler was delayed by -1.9910016429998905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
I20260709 12:24:27.224321 14012 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:27.463791 11132 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.014s	sys 0.015s
W20260709 12:24:27.630472 11132 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.051s	user 0.015s	sys 0.015s
I20260709 12:24:27.462579 11023 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:26.984750 14021 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.008s	sys 0.036s
I20260709 12:24:27.632045 13895 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:26.936164 13739 consensus_meta.cc:287] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.812s	user 0.010s	sys 0.000s
I20260709 12:24:26.628759 13681 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:27.632774 13895 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:27.633173 13631 consensus_meta.cc:287] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 1.124s	user 0.011s	sys 0.000s
I20260709 12:24:27.633215 13895 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:27.461761 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 960976us
I20260709 12:24:27.634979 13681 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:26.943056 13918 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:27.635807 13918 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:27.631866 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 169362us
I20260709 12:24:27.449873 13853 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:27.638147 13918 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:26.570071 14014 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:27.638626 11023 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:27.425791 13721 raft_consensus.cc:2749] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:27.291512 14035 raft_consensus.cc:2749] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:27.639191 13853 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:27.484681 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:27.291949 13980 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:27.223901 13977 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:27.640159 13977 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:27.640595 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:27.641212 14014 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:27.449561 13772 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.641969 13772 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:27.643600 14018 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:27.645051 13772 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:27.296373 14011 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:26.616179 13938 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:27.645929 13895 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:27.647370 13938 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:27.420713 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:27.648137 11127 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:27.649092 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:27.649672 11127 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:27.650554 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:27.651127 11127 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:27.652025 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:27.652592 11127 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:27.495779 10949 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:27.654779 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 159098us
I20260709 12:24:27.467538 14038 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:27.656716 14038 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.657222 14038 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:27.657357 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:27.657612 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:27.290398 13976 consensus_queue.cc:1048] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.180s
I20260709 12:24:27.289201 13982 consensus_queue.cc:1059] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.196s
W20260709 12:24:27.504715 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 265055us
I20260709 12:24:27.680537 11025 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:27.484735 13669 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:27.467087 13983 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:27.495501 14005 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.282s	user 0.022s	sys 0.033s
I20260709 12:24:27.287788 14030 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:27.639140 14025 consensus_queue.cc:1059] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 12:24:27.512205 10948 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:27.707172 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:27.707808 10980 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:27.707858 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 195707us
I20260709 12:24:27.708905 10948 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:27.499843 13973 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.464891 13962 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:27.710356 13698 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:27.711457 13698 raft_consensus.cc:2804] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:27.711892 13698 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:27.461089 13963 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:27.495769 13999 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:27.712416 13698 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:27.712976 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:27.713572 11674 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:27.714233 13999 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:27.711673 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:27.505326 13903 raft_consensus.cc:2804] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:27.710353 13973 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:27.715008 14018 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:27.715570 14018 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:27.716391 13976 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:27.715219 13903 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:27.717483 13903 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:27.714932 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:27.719271 11680 raft_consensus.cc:2393] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 8: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:27.719545 13982 raft_consensus.cc:3055] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:27.486429 14020 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:27.719954 13982 raft_consensus.cc:740] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:24:27.632375 14021 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.429s	user 0.015s	sys 0.048s
I20260709 12:24:27.288854 13857 raft_consensus.cc:2749] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:27.637356 13916 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.293391 13985 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:27.720882 13982 consensus_queue.cc:260] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:27.641208 11129 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:27.241196 13629 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:27.469686 13967 consensus_queue.cc:1048] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:24:27.500530 13410 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:27.662982 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2010) took 1461 ms. Trace:
I20260709 12:24:27.239807 13987 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:26.718519 14023 consensus_queue.cc:1048] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.833s
I20260709 12:24:27.500433 14019 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:27.707024 14005 raft_consensus.cc:697] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 9 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
W20260709 12:24:27.504992 13829 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.298s	user 0.009s	sys 0.014s
I20260709 12:24:27.711983 13962 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:27.723759 14040 raft_consensus.cc:2804] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:27.813493 14040 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.814612 14005 consensus_queue.cc:237] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:27.817878 10980 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:24:27.720820 10981 raft_consensus.cc:2410] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:24:27.620810 14026 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.721725 13916 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:27.723480 11051 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:24:27.653970 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 424) took 1199 ms. Trace:
I20260709 12:24:27.825111 11127 rpcz_store.cc:276] 0709 12:24:26.454685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.653167 (+1198482us) service_pool.cc:224] Handling call
0709 12:24:27.653465 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:27.653640 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:27.653665 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:27.653708 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:27.653743 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:27.653794 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:27.653894 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:27.632253 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1925) took 1632 ms. Trace:
I20260709 12:24:27.715445 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:27.513548 14003 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.133s	user 0.015s	sys 0.015s
I20260709 12:24:27.449291 13891 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:27.730983 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:27.744500 11024 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.014s	sys 0.065s
W20260709 12:24:27.734534 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:27.829556 11024 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.015s	sys 0.065s
W20260709 12:24:27.795343 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 114904us
W20260709 12:24:27.701012 14044 log.cc:927] Time spent T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260709 12:24:27.752709 10975 pending_rounds.cc:85] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 5
I20260709 12:24:27.833117 10975 pending_rounds.cc:107] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:24:27.656558 13895 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:27.748159 10982 rpcz_store.cc:276] 0709 12:24:26.201391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.208668 (+  7277us) service_pool.cc:224] Handling call
0709 12:24:26.209005 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:26.209360 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:26.209387 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:26.209883 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 12:24:27.510475 (+1300592us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:27.510521 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:27.510598 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:27.662716 (+152118us) raft_consensus.cc:1685] finished
0709 12:24:27.662741 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:27.662913 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3544,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":86,"thread_start_us":1300148,"threads_started":1,"wal-append.queue_time_us":1444335}
I20260709 12:24:27.441120 13989 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:27.810567 11672 raft_consensus.cc:2393] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 9: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:27.700292 13739 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:27.813872 14040 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:27.746403 13972 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.826503 11134 rpcz_store.cc:276] 0709 12:24:25.999887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.173956 (+174069us) service_pool.cc:224] Handling call
0709 12:24:26.193859 (+ 19903us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:26.194114 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:26.194142 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:26.194638 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 12:24:27.417334 (+1222696us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:27.417375 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:27.417449 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:27.632044 (+214595us) raft_consensus.cc:1685] finished
0709 12:24:27.632062 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:27.632193 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1222277,"threads_started":1,"wal-append.queue_time_us":1435475}
I20260709 12:24:27.803045 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:27.935354 11680 raft_consensus.cc:2393] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:27.794642 13983 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:27.934859 11643 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.013s	sys 0.038s
W20260709 12:24:27.829694 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.831293 11025 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:27.833454 10975 raft_consensus.cc:2889] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:27.943320 11643 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.014s	sys 0.038s
W20260709 12:24:27.943797 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 1.40355e+06us
W20260709 12:24:27.946198 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.832523 11129 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
W20260709 12:24:27.843041 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.843822 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:27.948050 14023 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.948400 10980 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:27.950278 14053 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:27.953456 13983 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:27.955745 13983 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:27.832875 14026 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:27.808449 14011 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:27.958331 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 127124us
I20260709 12:24:27.959312 11025 leader_election.cc:400] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 4 election: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5.
I20260709 12:24:27.960950 11025 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:27.751775 13986 consensus_queue.cc:260] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:27.824354 13963 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:27.703534 13631 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:27.855417 13987 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:27.856789 10983 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:27.857468 13977 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:27.716951 13976 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:27.859184 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:27.861567 13891 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:27.704465 13640 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:27.820029 14016 log.cc:927] Time spent T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 12:24:27.863125 11131 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 1922) took 1915 ms (client timeout 1630 ms). Trace:
W20260709 12:24:27.985903 11131 rpcz_store.cc:269] 0709 12:24:25.947371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.045186 (+ 97815us) service_pool.cc:224] Handling call
0709 12:24:27.862889 (+1817703us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b54000334d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:27.863032 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":749662080}
I20260709 12:24:27.985838 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:27.867022 11099 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.000s	sys 0.062s
W20260709 12:24:27.987815 11099 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.000s	sys 0.062s
I20260709 12:24:27.868379 11674 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:27.868718 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 425) took 1413 ms. Trace:
I20260709 12:24:27.989420 11126 rpcz_store.cc:276] 0709 12:24:26.454971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.828843 (+1373872us) service_pool.cc:224] Handling call
0709 12:24:27.868165 (+ 39322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:27.868382 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:27.868412 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:27.868455 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:27.868493 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:27.868545 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:27.868652 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:27.879367 11127 raft_consensus.cc:1275] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:24:27.990656 11052 raft_consensus.cc:1240] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:24:27.832342 13982 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:27.886163 14030 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:27.890373 14018 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:27.894853 13629 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:27.900061 14041 log.cc:927] Time spent T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 12:24:27.920856 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 423) took 1720 ms. Trace:
W20260709 12:24:27.830295 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 620754us
I20260709 12:24:27.957768 14053 raft_consensus.cc:2749] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:27.963845 11098 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.012s	sys 0.012s
I20260709 12:24:27.965193 10980 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
W20260709 12:24:28.008086 11098 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.013s	sys 0.012s
I20260709 12:24:27.943730 13972 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:27.973960 14046 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.975059 11134 raft_consensus.cc:1240] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:27.983556 13698 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:27.976817 11023 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:27.977120 11643 connection.cc:256] RPC call timeout handler was delayed by -1.7607341269999779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20630000000000004s for a response
I20260709 12:24:27.978873 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:52828 (request call id 2007) took 1770 ms. Trace:
W20260709 12:24:28.017014 11643 connection.cc:256] RPC call timeout handler was delayed by -1.6215010139999322s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21330000000000002s for a response
W20260709 12:24:27.980005 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 352906us
W20260709 12:24:28.017488 11643 connection.cc:256] RPC call timeout handler was delayed by -1.6013478330000908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
I20260709 12:24:27.983263 13723 raft_consensus.cc:2749] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:27.934546 13739 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:27.934639 14020 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:27.987183 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:28.019359 10948 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:28.016831 10983 rpcz_store.cc:276] 0709 12:24:26.200497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.200636 (+   139us) service_pool.cc:224] Handling call
0709 12:24:27.856205 (+1655569us) spinlock_profiling.cc:243] Waited 32.9 ms on lock 0x7b4c001126c0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8a0b0a20 00007f8f8a0c1a29 00007f8f8a0c213f 00007f8f8a0862ab 00007f8f8a0b3f3c 00007f8f8a0b43fe 00007f8f8a34188b 00007f8f8bd40495 00007f8f8bd9130f 00007f8f8bddba55 00007f8f90dabcd0
0709 12:24:27.971263 (+115058us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75741056}
I20260709 12:24:27.880236 14045 consensus_queue.cc:1048] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 12:24:27.962285 13916 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:27.990885 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1932) took 1455 ms. Trace:
I20260709 12:24:27.971257 14013 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:28.000658 11057 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.000s	sys 0.012s
I20260709 12:24:28.002439 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:28.003405 11024 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:27.984877 13987 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.992586 13962 consensus_queue.cc:1048] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 12:24:28.008424 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 788845us
I20260709 12:24:27.983913 13983 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:28.009133 11129 raft_consensus.cc:1275] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:28.013996 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1933) took 1387 ms. Trace:
W20260709 12:24:27.975112 11644 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.024s	sys 0.072s
I20260709 12:24:28.002554 11132 rpcz_store.cc:276] 0709 12:24:26.200092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.557539 (+357447us) service_pool.cc:224] Handling call
0709 12:24:26.578620 (+ 21081us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:26.578886 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:24:27.631032 (+1052146us) log.cc:844] Serialized 14 byte log entry
0709 12:24:27.920279 (+289247us) log.cc:844] Serialized 14 byte log entry
0709 12:24:27.920482 (+   203us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:27.920527 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:27.920579 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:27.920650 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:27.920791 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13064,"prepare.queue_time_us":1138339,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":4000,"raft.queue_time_us":183,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":17795,"spinlock_wait_cycles":54540032,"thread_start_us":1340310,"threads_started":2,"wal-append.queue_time_us":361612}
I20260709 12:24:27.982743 13963 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:28.018429 11097 leader_election.cc:336] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.788s (SENT)
I20260709 12:24:28.019613 11131 raft_consensus.cc:2393] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 5: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:27.804636 13992 raft_consensus.cc:3055] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:28.023077 11023 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:28.108261 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 88165.3us
W20260709 12:24:28.031389 11643 connection.cc:256] RPC call timeout handler was delayed by -1.4948983849999422s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22410000000000002s for a response
W20260709 12:24:28.110356 11643 connection.cc:256] RPC call timeout handler was delayed by -1.4170053170000756s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25070000000000003s for a response
W20260709 12:24:28.033416 11057 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.000s	sys 0.013s
I20260709 12:24:28.033561 11127 rpcz_store.cc:276] 0709 12:24:26.535104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.826320 (+1291216us) service_pool.cc:224] Handling call
0709 12:24:27.866807 (+ 40487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:27.990614 (+123807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:27.990828 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:28.035807 14053 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:28.036669 11680 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:28.036923 13698 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:28.037325 14013 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:28.019411 13739 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:28.038640 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:28.023279 13967 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:28.032552 13721 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:28.019043 14046 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:28.019162 13829 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.042358 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:28.042136 14038 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:28.043862 13976 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:28.008972 14026 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:27.977398 14023 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:28.055068 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:28.059033 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:28.059520 14040 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:28.008335 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1927) took 1971 ms. Trace:
I20260709 12:24:28.059567 13913 raft_consensus.cc:3055] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:28.106717 13410 consensus_queue.cc:1059] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:24:28.111502 11644 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.029s	sys 0.076s
I20260709 12:24:28.111804 11134 rpcz_store.cc:276] 0709 12:24:26.626886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.935040 (+1308154us) service_pool.cc:224] Handling call
0709 12:24:27.974879 (+ 39839us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:28.013706 (+ 38827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:28.013928 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:28.114996 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:28.157089 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:28.143908 11643 leader_election.cc:336] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.587s (SENT)
I20260709 12:24:28.106900 13983 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:28.453310 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:28.306768 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:28.235327 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 422) took 2089 ms. Trace:
W20260709 12:24:28.444725 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 426273us
I20260709 12:24:28.489128 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:28.454339 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:28.604669 11131 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:24:28.486425 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:28.187269 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:28.601251 11132 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
I20260709 12:24:28.601495 11643 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:28.610354 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 466439us
W20260709 12:24:28.610965 11053 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.001s	sys 0.027s
W20260709 12:24:28.611428 11053 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.001s	sys 0.027s
I20260709 12:24:28.611855 10984 raft_consensus.cc:2410] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:24:28.450963 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 415424us
I20260709 12:24:28.600834 11126 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
W20260709 12:24:28.454236 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:28.615375 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.616127 11644 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:28.617817 11644 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:28.611152 11643 leader_election.cc:336] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 2.063s (SENT)
I20260709 12:24:28.638077 11643 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:28.661770 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:28.603109 11130 rpcz_store.cc:276] 0709 12:24:26.145628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.349120 (+203492us) service_pool.cc:224] Handling call
0709 12:24:26.349537 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:26.349937 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:26.349964 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:26.351377 (+  1413us) log.cc:844] Serialized 26 byte log entry
0709 12:24:27.237550 (+886173us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:27.237599 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:27.237674 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:28.235057 (+997383us) raft_consensus.cc:1685] finished
0709 12:24:28.235084 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:28.235254 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":218250,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":5677,"thread_start_us":885729,"threads_started":1,"wal-append.queue_time_us":1136184}
I20260709 12:24:28.143118 14053 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
W20260709 12:24:28.397074 14039 log.cc:927] Time spent T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
W20260709 12:24:28.402969 13903 consensus_meta.cc:287] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.685s	user 0.015s	sys 0.003s
W20260709 12:24:28.489576 14062 log.cc:927] Time spent T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.466s	user 0.000s	sys 0.002s
W20260709 12:24:28.238240 14012 consensus_meta.cc:287] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.610s	user 0.013s	sys 0.000s
I20260709 12:24:28.688113 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1943) took 1493 ms. Trace:
I20260709 12:24:28.679383 13932 raft_consensus.cc:2749] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:28.156764 13895 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:28.555891 11128 rpcz_store.cc:276] 0709 12:24:26.037291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.210689 (+173398us) service_pool.cc:224] Handling call
0709 12:24:26.211075 (+   386us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:26.317676 (+106601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:26.317712 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:26.318362 (+   650us) log.cc:844] Serialized 52 byte log entry
0709 12:24:27.494881 (+1176519us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:27.987904 (+493023us) log.cc:844] Serialized 14 byte log entry
0709 12:24:27.988300 (+   396us) log.cc:844] Serialized 14 byte log entry
0709 12:24:28.007975 (+ 19675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:28.008057 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:28.008099 (+    42us) raft_consensus.cc:1685] finished
0709 12:24:28.008110 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:28.008262 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":127320,"prepare.queue_time_us":274640,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":74,"raft.queue_time_us":310797,"raft.run_cpu_time_us":425,"raft.run_wall_time_us":23581,"thread_start_us":1513555,"threads_started":2,"wal-append.queue_time_us":1316970}
I20260709 12:24:28.690776 11055 raft_consensus.cc:2393] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 8: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:28.690919 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:28.704264 10982 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
W20260709 12:24:28.560036 14011 consensus_meta.cc:287] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.597s	user 0.007s	sys 0.003s
I20260709 12:24:28.690266 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:28.144593 14052 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:28.693270 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:28.107892 13992 raft_consensus.cc:740] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:28.159053 13973 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:28.696388 11127 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:28.553203 13989 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:28.527311 13977 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:28.555438 13913 raft_consensus.cc:740] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:28.698416 11130 rpcz_store.cc:276] 0709 12:24:27.194665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.687244 (+1492579us) service_pool.cc:224] Handling call
0709 12:24:28.687589 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:28.687786 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:28.687811 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:28.687852 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:28.687888 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:28.687939 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:28.688052 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:28.700201 11134 raft_consensus.cc:1240] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:24:28.685494 13629 raft_consensus.cc:2804] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:28.684399 14045 raft_consensus.cc:2749] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:28.685321 14055 consensus_queue.cc:1048] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:24:28.724300 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:28.724787 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1936) took 1796 ms. Trace:
I20260709 12:24:28.725212 11134 rpcz_store.cc:276] 0709 12:24:26.928014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.680551 (+1752537us) service_pool.cc:224] Handling call
0709 12:24:28.699954 (+ 19403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:28.724476 (+ 24522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:28.724724 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:28.726330 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:28.726951 11134 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:28.690537 14053 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:28.695514 11674 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:28.164459 14059 consensus_queue.cc:1059] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.542s
I20260709 12:24:28.710328 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1941) took 1634 ms. Trace:
W20260709 12:24:28.710369 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 255030us
I20260709 12:24:28.689520 13762 raft_consensus.cc:2749] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:28.711179 11057 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.005s	sys 0.010s
I20260709 12:24:28.693727 13410 consensus_queue.cc:1243] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer c979ef00e0ad4157b49ebbdc13ce7cd7 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:24:28.075871 13987 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:28.712921 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1945) took 1517 ms. Trace:
I20260709 12:24:28.716389 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:28.700595 13903 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:28.165192 13963 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:28.714255 13988 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.013s	sys 0.006s
I20260709 12:24:28.699227 13967 raft_consensus.cc:697] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:28.722085 13989 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.732559 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:28.731554 14069 log.cc:927] Time spent T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 12:24:28.715204 14052 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:24:28.742247 11674 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
I20260709 12:24:28.744076 13973 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:28.710150 14011 raft_consensus.cc:2749] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:28.710669 14025 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.706923 13962 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:28.705868 14012 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:28.694168 13721 raft_consensus.cc:697] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 7 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:28.680320 13829 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:28.769152 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 164343us
I20260709 12:24:28.754555 11130 pending_rounds.cc:85] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 5
I20260709 12:24:28.761583 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:28.762858 11126 rpcz_store.cc:276] 0709 12:24:27.076019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.681065 (+1605046us) service_pool.cc:224] Handling call
0709 12:24:28.696297 (+ 15232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:28.709824 (+ 13527us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:28.709852 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:28.709993 (+   141us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:28.710032 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:28.710091 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:28.710238 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:28.767073 11057 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.006s	sys 0.010s
I20260709 12:24:28.768592 11127 rpcz_store.cc:276] 0709 12:24:27.195301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.685195 (+1489894us) service_pool.cc:224] Handling call
0709 12:24:28.696052 (+ 10857us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:28.712615 (+ 16563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:28.712855 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:28.845275 14059 consensus_queue.cc:1243] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer c979ef00e0ad4157b49ebbdc13ce7cd7 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:24:28.873970 13913 consensus_queue.cc:260] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:28.978899 11130 pending_rounds.cc:107] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:24:28.756338 14046 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:28.841679 14066 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:24:28.976378 11097 connection.cc:256] RPC call timeout handler was delayed by -1.7635746850000942s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2041s for a response
W20260709 12:24:28.848665 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 237535us
I20260709 12:24:28.981431 13829 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:28.766781 14055 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:28.884548 14034 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:28.982246 14055 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:28.982596 14034 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:28.983767 14012 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:28.801854 13988 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.013s	sys 0.006s
W20260709 12:24:28.749116 14019 consensus_meta.cc:287] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.919s	user 0.010s	sys 0.002s
I20260709 12:24:28.777417 13895 raft_consensus.cc:697] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:28.985630 14034 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:28.769074 13629 raft_consensus.cc:697] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:24:28.753044 13982 consensus_meta.cc:287] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.755s	user 0.009s	sys 0.000s
W20260709 12:24:28.755004 14065 log.cc:927] Time spent T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.271s	user 0.000s	sys 0.000s
I20260709 12:24:28.842617 13989 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:28.876839 13967 consensus_queue.cc:237] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:28.977100 11134 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:29.000336 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:28.979416 13913 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:28.891443 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 434424us
W20260709 12:24:28.860210 14071 log.cc:927] Time spent T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.334s	user 0.000s	sys 0.001s
W20260709 12:24:28.859377 14073 log.cc:927] Time spent T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 12:24:28.981213 11097 connection.cc:256] RPC call timeout handler was delayed by -1.7014405670001906s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20379999999999998s for a response
W20260709 12:24:29.010819 11097 connection.cc:256] RPC call timeout handler was delayed by -1.6751836779999394s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1795s for a response
I20260709 12:24:29.010850 11054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 393) took 2439 ms. Trace:
I20260709 12:24:28.979478 11130 raft_consensus.cc:2889] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:28.758004 14053 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:28.981864 11643 leader_election.cc:336] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 2.133s (SENT)
I20260709 12:24:28.981190 14066 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:28.988595 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.955572 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:28.933892 10984 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
I20260709 12:24:29.012557 11054 rpcz_store.cc:276] 0709 12:24:26.571399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.571521 (+   122us) service_pool.cc:224] Handling call
0709 12:24:27.287757 (+716236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:27.819093 (+531336us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:24:27.840697 (+ 21604us) log.cc:844] Serialized 14 byte log entry
0709 12:24:28.020786 (+180089us) log.cc:844] Serialized 14 byte log entry
0709 12:24:28.020999 (+   213us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:28.021049 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:28.021100 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:29.004982 (+983882us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b18003a0420. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cc52a6 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419
0709 12:24:29.010621 (+  5639us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b54001879d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:29.010662 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:29.010803 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":475,"prepare.queue_time_us":26200,"prepare.run_cpu_time_us":132,"prepare.run_wall_time_us":18397,"raft.queue_time_us":103,"spinlock_wait_cycles":1580766720,"thread_start_us":152140,"threads_started":1,"wal-append.queue_time_us":661933}
I20260709 12:24:28.993489 11056 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:28.995142 13948 raft_consensus.cc:3055] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:28.997148 13739 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:28.905149 13903 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:28.908917 13985 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.889077 14023 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:28.903858 13987 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:29.029031 13989 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:28.999809 11057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 391) took 2429 ms. Trace:
I20260709 12:24:29.029793 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:29.003353 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:29.003973 13629 consensus_queue.cc:237] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:28.955984 13793 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:28.968967 14038 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:29.009263 13963 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:28.935492 13983 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:29.011121 11097 connection.cc:256] RPC call timeout handler was delayed by -1.6346836779998739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18400000000000002s for a response
I20260709 12:24:28.999024 13972 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:29.014309 11643 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:28.986300 13895 consensus_queue.cc:237] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:28.985034 14055 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:29.019829 13948 raft_consensus.cc:740] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:29.021713 11053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 395) took 2438 ms. Trace:
I20260709 12:24:29.021260 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:29.050014 13640 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:29.050416 14086 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:24:29.050814 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:29.068311 11680 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:29.052042 11131 raft_consensus.cc:3055] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:29.069640 11131 raft_consensus.cc:740] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:29.053365 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1934) took 2335 ms. Trace:
I20260709 12:24:29.070668 11129 rpcz_store.cc:276] 0709 12:24:26.717900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.964616 (+1246716us) service_pool.cc:224] Handling call
0709 12:24:28.008810 (+ 44194us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:28.113276 (+104466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:29.053110 (+939834us) spinlock_profiling.cc:243] Waited 43.8 ms on lock 0x7b540012cd50. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:29.053287 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100788608}
I20260709 12:24:29.071712 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:29.072150 11129 raft_consensus.cc:2376] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6. Re-sending same reply.
I20260709 12:24:29.072898 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:29.073542 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:28.992619 13962 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:29.074198 11130 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:29.077252 11131 consensus_queue.cc:260] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:29.056051 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 74272.1us
W20260709 12:24:29.078899 11643 leader_election.cc:336] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 2.241s (SENT)
W20260709 12:24:29.079784 11643 leader_election.cc:336] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 2.507s (SENT)
I20260709 12:24:29.080154 11643 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:29.080462 14013 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:29.080680 13962 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:29.080927 14055 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:29.081931 11680 raft_consensus.cc:1275] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:29.056639 13631 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:29.057531 14015 raft_consensus.cc:2749] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:29.083873 11131 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:29.085768 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.078583 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:29.086722 11677 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
I20260709 12:24:29.088189 11645 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:29.088663 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:29.088936 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:29.089148 11645 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:29.089453 11673 raft_consensus.cc:2393] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 5: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:29.089764 11677 raft_consensus.cc:2410] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 10 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:29.090994 13631 consensus_queue.cc:1048] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:29.091100 11678 raft_consensus.cc:1275] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:29.094306 14055 raft_consensus.cc:2804] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:29.094764 14055 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:29.095180 14055 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:29.012287 13829 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.099421 13829 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:29.026537 14066 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:29.104228 13990 consensus_queue.cc:1059] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:29.104488 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:29.105280 13962 raft_consensus.cc:3055] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:29.105481 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:29.105705 13962 raft_consensus.cc:740] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:29.027073 13985 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:29.106401 11673 raft_consensus.cc:1240] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:29.106633 13962 consensus_queue.cc:260] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:29.107769 13985 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:29.108119 11677 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 12:24:29.109283 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:29.013790 14012 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:29.109995 14012 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:29.112059 14012 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:28.991704 14025 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:29.113157 11127 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:29.022023 13739 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:29.028083 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:29.114218 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:29.114673 11054 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:29.114804 11127 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:29.115600 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:29.116410 11054 raft_consensus.cc:2410] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:24:29.116971 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2021) took 2708 ms. Trace:
I20260709 12:24:29.117210 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:29.029639 11057 rpcz_store.cc:276] 0709 12:24:26.570459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.570629 (+   170us) service_pool.cc:224] Handling call
0709 12:24:26.728092 (+157463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:26.728364 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:27.222175 (+493811us) log.cc:844] Serialized 14 byte log entry
0709 12:24:28.976637 (+1754462us) log.cc:844] Serialized 14 byte log entry
0709 12:24:28.990320 (+ 13683us) log.cc:844] Serialized 14 byte log entry
0709 12:24:28.994007 (+  3687us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:28.994065 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:28.994135 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:28.999551 (+  5416us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:28.999705 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46705,"prepare.queue_time_us":1284632,"prepare.run_cpu_time_us":139,"prepare.run_wall_time_us":987,"raft.queue_time_us":63895,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":52366,"thread_start_us":1998215,"threads_started":3,"wal-append.queue_time_us":820763}
I20260709 12:24:29.118732 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:29.119311 11057 raft_consensus.cc:3055] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:29.119616 11057 raft_consensus.cc:740] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:29.120364 11057 consensus_queue.cc:260] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:29.121258 11057 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:28.985529 14019 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:29.123874 14019 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:29.039556 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:29.040055 11060 raft_consensus.cc:2368] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8.
I20260709 12:24:29.045264 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:29.046285 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:28.986423 13721 consensus_queue.cc:237] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:29.102679 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:29.027639 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 336) took 1371 ms. Trace:
I20260709 12:24:29.213199 11055 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:29.213626 13772 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:24:29.055190 11097 connection.cc:256] RPC call timeout handler was delayed by -1.5819816870002796s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20450000000000002s for a response
I20260709 12:24:29.214636 13772 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:29.118983 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 339) took 1404 ms. Trace:
I20260709 12:24:29.111928 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:24:29.215286 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 48638.4us
I20260709 12:24:29.215098 13772 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:29.063835 13948 consensus_queue.cc:260] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:29.217083 13948 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:29.132865 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1926) took 3110 ms. Trace:
I20260709 12:24:29.141297 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.217726 11133 rpcz_store.cc:276] 0709 12:24:26.022021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.195847 (+173826us) service_pool.cc:224] Handling call
0709 12:24:26.196221 (+   374us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:26.317095 (+120874us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:26.317137 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:26.322078 (+  4941us) log.cc:844] Serialized 52 byte log entry
0709 12:24:27.423169 (+1101091us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:27.921633 (+498464us) log.cc:844] Serialized 14 byte log entry
0709 12:24:27.922025 (+   392us) log.cc:844] Serialized 14 byte log entry
0709 12:24:27.963582 (+ 41557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:27.963666 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:29.053858 (+1090192us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b1800064f00. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cf73f3 00007f8f88cf97c1 00007f8f88cf9779 00007f8f88cf9709 00007f8f88cf96d1 00007f8f88cf89cd 0000000000388634 0000000000388479 00007f8f88cda83a
0709 12:24:29.130849 (+ 76991us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b24001f2188. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88b7d9c4 00007f8f88b7bacb 00007f8f88d36dc9 00007f8f88d36a55 00007f8f88d35fb0 00007f8f8b9ac488 00007f8f8b9acbe8 00007f8f8b984398 00007f8f8b97f76a 00007f8f8b97ebb6
0709 12:24:29.132597 (+  1748us) raft_consensus.cc:1685] finished
0709 12:24:29.132621 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:29.132778 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133596,"prepare.queue_time_us":377379,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":2587,"raft.queue_time_us":280769,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":47219,"spinlock_wait_cycles":31815296,"thread_start_us":1473790,"threads_started":2,"wal-append.queue_time_us":868864}
I20260709 12:24:29.220011 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:29.220165 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 352) took 1181 ms. Trace:
I20260709 12:24:29.178133 11132 raft_consensus.cc:3055] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:29.115617 14052 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:29.124099 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:24:29.119624 11051 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52804 (request call id 394) took 2537 ms (client timeout 3158 ms). Trace:
I20260709 12:24:29.142554 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.130801 14025 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:29.149077 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:29.162420 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:29.213109 11128 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:29.223644 11132 raft_consensus.cc:740] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:29.156378 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.225545 10981 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:29.225775 11132 consensus_queue.cc:260] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:29.224454 11058 raft_consensus.cc:2393] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 8: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:29.225989 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:29.064388 10984 raft_consensus.cc:2368] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 6. Current term is 7.
I20260709 12:24:29.214798 11126 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:29.227325 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 341) took 1381 ms. Trace:
W20260709 12:24:29.158720 14067 log.cc:927] Time spent T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.650s	user 0.003s	sys 0.006s
I20260709 12:24:29.227641 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:29.212363 10976 rpcz_store.cc:276] 0709 12:24:26.408586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.408731 (+   145us) service_pool.cc:224] Handling call
0709 12:24:26.423908 (+ 15177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:26.451471 (+ 27563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:26.451501 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:26.451544 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:26.451571 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:29.116732 (+2665161us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x7b5400099f54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:29.116788 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:29.116910 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62919040}
I20260709 12:24:29.215229 10975 rpcz_store.cc:276] 0709 12:24:27.714403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.714632 (+   229us) service_pool.cc:224] Handling call
0709 12:24:27.714978 (+   346us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:24:27.948545 (+233567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:27.948574 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:24:27.949217 (+   643us) log.cc:844] Serialized 78 byte log entry
0709 12:24:28.007545 (+ 58328us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:28.284036 (+276491us) log.cc:844] Serialized 14 byte log entry
0709 12:24:28.284516 (+   480us) log.cc:844] Serialized 14 byte log entry
0709 12:24:28.306568 (+ 22052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:29.118590 (+812022us) spinlock_profiling.cc:243] Waited 8.36 ms on lock 0x7b54000da054. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:29.118640 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:29.118769 (+   129us) raft_consensus.cc:1685] finished
0709 12:24:29.118782 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:29.118931 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23627,"prepare.queue_time_us":1104143,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":2617,"raft.queue_time_us":1528,"raft.run_cpu_time_us":395,"raft.run_wall_time_us":48716,"spinlock_wait_cycles":19216768,"thread_start_us":279578,"threads_started":2,"wal-append.queue_time_us":88936}
I20260709 12:24:29.229110 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:29.229633 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.062355 13977 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.134284 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:29.064131 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.196576 10948 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:24:29.222898 11051 rpcz_store.cc:269] 0709 12:24:26.582654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.582823 (+   169us) service_pool.cc:224] Handling call
0709 12:24:29.119440 (+2536617us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54003e0654. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:29.119536 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":524512000}
I20260709 12:24:29.167109 14040 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:29.231880 13739 raft_consensus.cc:2804] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:29.220930 11678 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:29.232335 13739 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:29.213956 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:29.232782 13739 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:29.233291 11060 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:29.234329 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1924) took 3256 ms. Trace:
I20260709 12:24:29.234146 14031 consensus_queue.cc:1048] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:29.146620 13992 consensus_queue.cc:260] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:29.235726 14031 consensus_queue.cc:1059] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:29.234725 11125 rpcz_store.cc:276] 0709 12:24:25.977876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.136099 (+158223us) service_pool.cc:224] Handling call
0709 12:24:26.149778 (+ 13679us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:27.465912 (+1316134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:27.465954 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:27.506730 (+ 40776us) log.cc:844] Serialized 52 byte log entry
0709 12:24:27.999695 (+492965us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:28.489916 (+490221us) log.cc:844] Serialized 14 byte log entry
0709 12:24:29.074828 (+584912us) spinlock_profiling.cc:243] Waited 6.69 ms on lock 0x7b1800086a40. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88c71c0a 00007f8f923b1219 00007f8f88cf9a40 00007f8f88cf44e4 00007f8f88cf4455 00007f8f8f7dc3c7 00007f8f8bdee9a7 00007f8f8bdfe0bf 00007f8f8bdfe038
0709 12:24:29.075034 (+   206us) log.cc:844] Serialized 14 byte log entry
0709 12:24:29.075244 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:29.075309 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:29.158070 (+ 82761us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:29.234138 (+ 76068us) raft_consensus.cc:1685] finished
0709 12:24:29.234158 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:29.234275 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35961,"prepare.queue_time_us":625217,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":256039,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":4380,"spinlock_wait_cycles":19423872,"thread_start_us":1919037,"threads_started":3,"wal-append.queue_time_us":532191}
I20260709 12:24:29.236739 14038 raft_consensus.cc:3055] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:29.237120 14038 raft_consensus.cc:740] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:29.234297 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:29.238296 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 2032) took 1226 ms. Trace:
I20260709 12:24:29.237968 14038 consensus_queue.cc:260] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:29.238480 11060 raft_consensus.cc:2393] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 7: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:29.238833 14012 consensus_queue.cc:1048] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:29.237004 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:29.239902 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:29.240401 11125 raft_consensus.cc:2393] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 6: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:29.240916 10948 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:29.241562 14038 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:29.224412 10977 rpcz_store.cc:276] 0709 12:24:27.656606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.658227 (+  1621us) service_pool.cc:224] Handling call
0709 12:24:27.658560 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:27.658987 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:27.659013 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:27.659534 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 12:24:27.986632 (+327098us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:28.117900 (+131268us) log.cc:844] Serialized 14 byte log entry
0709 12:24:28.145443 (+ 27543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:28.145522 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:29.027448 (+881926us) raft_consensus.cc:1685] finished
0709 12:24:29.027470 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:29.027582 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27241,"prepare.queue_time_us":540144,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":683,"raft.queue_time_us":88084,"raft.run_cpu_time_us":408,"raft.run_wall_time_us":36173,"thread_start_us":434092,"threads_started":2,"wal-append.queue_time_us":505264}
I20260709 12:24:29.243153 11644 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:29.243377 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.235757 13992 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:29.244581 14012 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:29.244961 14012 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:29.245316 14012 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:29.239516 11126 raft_consensus.cc:1275] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:29.238736 10981 rpcz_store.cc:276] 0709 12:24:28.011416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.156053 (+1144637us) service_pool.cc:224] Handling call
0709 12:24:29.238233 (+ 82180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:29.141906 11672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41784 (request call id 589) took 1430 ms. Trace:
I20260709 12:24:29.246634 11672 rpcz_store.cc:276] 0709 12:24:27.711248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.711407 (+   159us) service_pool.cc:224] Handling call
0709 12:24:29.141648 (+1430241us) spinlock_profiling.cc:243] Waited 93.8 ms on lock 0x7b54005631d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:29.141806 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":215654784}
I20260709 12:24:29.247290 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.139072 14053 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:29.115613 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:29.248453 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.248973 11127 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:29.180707 11674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41774 (request call id 479) took 1066 ms. Trace:
W20260709 12:24:29.164944 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.250764 11132 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:29.060413 10949 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:52820 dropped due to backpressure: service queue is full with 50 items [suppressed 2 similar messages]
I20260709 12:24:29.073959 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:29.232839 13962 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:29.251665 11129 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:29.211031 13829 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:29.140187 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.253726 11128 raft_consensus.cc:2393] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 9: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:24:29.253968 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:29.215112 11097 connection.cc:256] RPC call timeout handler was delayed by -1.3531932350001625s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21520000000000003s for a response
I20260709 12:24:29.138571 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2012) took 2936 ms. Trace:
I20260709 12:24:29.255010 14031 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.143664 11052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1339) took 3272 ms. Trace:
I20260709 12:24:29.255542 14031 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:29.229769 14019 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.256793 14019 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:29.241508 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:29.258910 11134 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:29.259229 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:29.259370 14019 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:29.242553 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:29.259812 11055 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:29.260191 11051 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:24:29.258011 14031 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:29.063974 11053 rpcz_store.cc:276] 0709 12:24:26.583048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.626867 (+ 43819us) service_pool.cc:224] Handling call
0709 12:24:26.717287 (+ 90420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:26.717758 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:26.717790 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:27.484873 (+767083us) spinlock_profiling.cc:243] Waited 69.2 ms on lock 0x7b180024dd80. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cc52a6 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8a6dda11 00007f8f8a6ed372 00007f8f8be1fa01 00007f8f8bde443a
0709 12:24:28.050652 (+565779us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b2c00000de8. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8a6dda11 00007f8f8a6ed372 00007f8f8be1fa01 00007f8f8bde443a 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2
0709 12:24:28.051165 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 12:24:28.611898 (+560733us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:28.611942 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:28.612014 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:29.021474 (+409460us) raft_consensus.cc:1685] finished
0709 12:24:29.021495 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:29.021637 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12146,"raft.queue_time_us":9003,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":52738,"spinlock_wait_cycles":215387776,"thread_start_us":560309,"threads_started":1,"wal-append.queue_time_us":661598}
I20260709 12:24:29.155023 13986 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:29.263484 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:29.261797 11644 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:29.264900 14046 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:29.243983 10977 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
I20260709 12:24:29.265300 14046 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:29.265718 14046 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:29.265906 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:29.266716 10977 raft_consensus.cc:2393] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 7: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:29.268236 11060 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
W20260709 12:24:29.215628 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 126537us
I20260709 12:24:29.230537 13977 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:29.227746 10984 rpcz_store.cc:276] 0709 12:24:27.846383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.020873 (+1174490us) service_pool.cc:224] Handling call
0709 12:24:29.227268 (+206395us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:29.250350 11674 rpcz_store.cc:276] 0709 12:24:28.114163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.115470 (+  1307us) service_pool.cc:224] Handling call
0709 12:24:29.180448 (+1064978us) spinlock_profiling.cc:243] Waited 88.1 ms on lock 0x7b5400591854. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:29.180630 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202550528}
I20260709 12:24:29.258456 11052 rpcz_store.cc:276] 0709 12:24:25.870925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.871086 (+   161us) service_pool.cc:224] Handling call
0709 12:24:26.799823 (+928737us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:27.993681 (+1193858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:28.813336 (+819655us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54003138d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:29.143440 (+330104us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b54003138d0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:29.143589 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4827391616}
I20260709 12:24:29.278076 11057 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
I20260709 12:24:29.269629 11644 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:29.255775 11097 connection.cc:256] RPC call timeout handler was delayed by -1.127172992999931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28130000000000005s for a response
W20260709 12:24:29.280002 11097 connection.cc:256] RPC call timeout handler was delayed by -1.0335171189999528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
I20260709 12:24:29.230875 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 353) took 1191 ms. Trace:
I20260709 12:24:29.280702 10978 raft_consensus.cc:2393] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 8: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
W20260709 12:24:29.280905 11097 connection.cc:256] RPC call timeout handler was delayed by -1.0255932350000876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2516s for a response
I20260709 12:24:29.277151 14053 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.251243 10949 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:52820 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 365)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1337)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 357)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1331)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 358)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 366)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1327)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1339)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 355)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1340)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 370)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 345)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1343)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 372)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1329)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 371)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 368)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 361)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1333)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 363)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1335)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 364)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1328)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1341)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 348)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1332)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2024)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 340)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2030)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2031)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 350)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2033)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 356)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 362)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1323)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1324)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1325)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1326)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1336)
I20260709 12:24:29.281666 14053 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:29.280601 10983 rpcz_store.cc:276] 0709 12:24:28.039307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.133943 (+1094636us) service_pool.cc:224] Handling call
0709 12:24:29.230817 (+ 96874us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:29.230836 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.284233 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:29.284709 10976 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:24:29.284912 10983 raft_consensus.cc:2376] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6. Re-sending same reply.
I20260709 12:24:29.285342 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 351) took 1246 ms. Trace:
I20260709 12:24:29.220589 11133 raft_consensus.cc:2376] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9. Re-sending same reply.
I20260709 12:24:29.229426 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.286765 11678 raft_consensus.cc:1275] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:29.287115 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 344) took 1342 ms. Trace:
I20260709 12:24:29.287510 10975 rpcz_store.cc:276] 0709 12:24:27.944871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.229179 (+1284308us) service_pool.cc:224] Handling call
0709 12:24:29.287052 (+ 57873us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:29.288527 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.273017 10980 rpcz_store.cc:276] 0709 12:24:28.039012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.140982 (+1101970us) service_pool.cc:224] Handling call
0709 12:24:29.220097 (+ 79115us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:29.254396 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.299027 11058 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
W20260709 12:24:29.299604 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:29.300129 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.269796 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.279557 14082 raft_consensus.cc:2804] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:29.224813 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:29.285948 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.314186 11058 raft_consensus.cc:1240] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:29.314399 10983 raft_consensus.cc:2410] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:24:29.244268 13739 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:29.290381 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 2029) took 1303 ms. Trace:
I20260709 12:24:29.325889 10978 rpcz_store.cc:276] 0709 12:24:27.986797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.142303 (+1155506us) service_pool.cc:224] Handling call
0709 12:24:29.290297 (+147994us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:29.255244 10979 rpcz_store.cc:276] 0709 12:24:26.201949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.212130 (+ 10181us) service_pool.cc:224] Handling call
0709 12:24:26.212447 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:26.212833 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:26.212862 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:26.319187 (+106325us) log.cc:844] Serialized 26 byte log entry
0709 12:24:27.496835 (+1177648us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:27.496875 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:27.496944 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:29.135521 (+1638577us) spinlock_profiling.cc:243] Waited 32.6 ms on lock 0x7b2400182c18. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88b7d9c4 00007f8f88b7bacb 00007f8f88d36dc9 00007f8f88d36a55 00007f8f88d35fb0 00007f8f8b9ac488 00007f8f8b9acbe8 00007f8f8b984398 00007f8f8b97f76a 00007f8f8b97ebb6
0709 12:24:29.138212 (+  2691us) raft_consensus.cc:1685] finished
0709 12:24:29.138236 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:29.138497 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":369,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":51,"spinlock_wait_cycles":74907520,"thread_start_us":1177243,"threads_started":1,"wal-append.queue_time_us":1147911}
I20260709 12:24:29.292747 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:29.326633 11097 connection.cc:256] RPC call timeout handler was delayed by -1.7679979380000077s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2882s for a response
I20260709 12:24:29.327419 10984 raft_consensus.cc:2368] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 9. Current term is 10.
I20260709 12:24:29.328002 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 346) took 1327 ms. Trace:
I20260709 12:24:29.328244 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:29.328562 10984 rpcz_store.cc:276] 0709 12:24:28.000367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.277722 (+1277355us) service_pool.cc:224] Handling call
0709 12:24:29.327939 (+ 50217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:29.293057 14012 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:29.293574 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 189589us
I20260709 12:24:29.329568 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:29.327512 11097 leader_election.cc:336] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.570s (SENT)
I20260709 12:24:29.330477 11097 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:29.332437 11058 raft_consensus.cc:1240] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:29.338680 11025 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:29.293912 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:29.261268 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:29.340461 11051 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:29.340485 11060 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:24:29.295522 11131 raft_consensus.cc:1275] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:29.285751 10976 rpcz_store.cc:276] 0709 12:24:28.038656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.230610 (+1191954us) service_pool.cc:224] Handling call
0709 12:24:29.285224 (+ 54614us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:29.303874 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 69961.5us
I20260709 12:24:29.341967 11644 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:29.310501 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:29.316861 11129 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:29.325052 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:29.292086 13977 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:29.343528 11130 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:29.294080 11053 raft_consensus.cc:2410] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:24:29.341959 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1937) took 2355 ms. Trace:
I20260709 12:24:29.351020 11131 rpcz_store.cc:276] 0709 12:24:26.986770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.681331 (+1694561us) service_pool.cc:224] Handling call
0709 12:24:28.697014 (+ 15683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:29.051922 (+354908us) spinlock_profiling.cc:243] Waited 64.3 ms on lock 0x7b5400230da0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bd5bdc0 00007f8f8bde61c0 00007f8f8bde7231 00007f8f8bde3d8f 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c
0709 12:24:29.341710 (+289788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:29.341904 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147785600}
I20260709 12:24:29.309442 11055 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:24:29.342772 11025 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:29.344298 10975 raft_consensus.cc:2368] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 6. Current term is 7.
I20260709 12:24:29.353986 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.354738 10975 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:24:29.339581 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.344619 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:29.344853 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.356331 10983 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
W20260709 12:24:29.347338 11097 leader_election.cc:336] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.644s (SENT)
W20260709 12:24:29.358022 11097 leader_election.cc:336] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.795s (SENT)
I20260709 12:24:29.358660 11097 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:24:29.359514 10978 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:29.354620 11052 raft_consensus.cc:1240] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:24:29.363029 11060 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:29.324012 11134 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:29.370647 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.373440 10980 raft_consensus.cc:2393] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 6: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:29.376824 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:29.377858 10979 raft_consensus.cc:2410] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:24:29.381615 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.382431 10975 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:24:29.382968 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 345) took 1398 ms. Trace:
I20260709 12:24:29.383272 10975 rpcz_store.cc:276] 0709 12:24:27.984479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.381279 (+1396800us) service_pool.cc:224] Handling call
0709 12:24:29.382905 (+  1626us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:29.384228 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.364315 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.387741 11060 raft_consensus.cc:1240] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:29.372352 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:29.389526 10983 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:29.390350 10975 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:24:29.312464 14053 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:29.391417 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:29.392504 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:29.393844 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.394954 11098 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:29.313107 14082 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:29.394114 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 343) took 1503 ms. Trace:
I20260709 12:24:29.399369 10976 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:29.399490 10982 rpcz_store.cc:276] 0709 12:24:27.890447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.716083 (+825636us) service_pool.cc:224] Handling call
0709 12:24:29.362568 (+646485us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b5400229a54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:29.394034 (+ 31466us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1277520128}
I20260709 12:24:29.396739 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.288961 14046 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:29.392084 11678 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:29.400558 11098 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:29.400615 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:29.402143 10979 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:29.402432 10982 raft_consensus.cc:2393] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 9: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:29.398726 11025 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:29.408638 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 50655.1us
I20260709 12:24:29.409096 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:29.409315 11097 leader_election.cc:336] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.840s (SENT)
I20260709 12:24:29.410400 11097 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
W20260709 12:24:29.370328 14026 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:24:29.420403 10984 raft_consensus.cc:2393] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 10: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:29.391688 14040 raft_consensus.cc:2804] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:29.409039 10981 raft_consensus.cc:2393] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 8: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
W20260709 12:24:29.411903 11097 leader_election.cc:336] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.886s (SENT)
I20260709 12:24:29.411924 11052 raft_consensus.cc:1240] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:29.415292 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:29.415398 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.416067 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.427022 11023 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:29.364451 13989 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:29.371275 14031 raft_consensus.cc:2749] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:24:29.444332 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 45668.9us
I20260709 12:24:29.410456 14082 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:29.431270 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:29.346187 14055 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:29.436303 11097 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:29.414891 14021 raft_consensus.cc:2804] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:29.436043 10979 raft_consensus.cc:2393] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 8: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:29.440186 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:29.391914 14078 raft_consensus.cc:2749] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:29.445075 11025 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:29.410494 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.415539 14052 raft_consensus.cc:2804] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:29.446964 11053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:24:29.463315 11053 raft_consensus.cc:606] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:24:29.463716 11053 raft_consensus.cc:614] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:29.435894 10978 raft_consensus.cc:2410] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:24:29.443550 11098 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:29.427722 14015 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:29.436754 10975 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:24:29.441668 13989 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:29.435382 14040 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:29.442452 13932 raft_consensus.cc:2804] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:29.395500 13895 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:24:29.427558 13669 raft_consensus.cc:2749] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:29.452090 10983 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:29.454185 10980 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:29.450120 13988 raft_consensus.cc:2804] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:29.452829 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.488783 10982 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:29.460915 11025 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:29.489722 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.490891 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:29.491421 10982 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:29.468642 11098 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:29.469377 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.492738 10979 raft_consensus.cc:2410] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:24:29.470084 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:29.418519 13762 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:24:29.408520 13772 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:29.481293 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:29.482873 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 141002us
I20260709 12:24:29.483129 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:29.459326 14011 raft_consensus.cc:2804] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:29.468209 14052 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:29.487674 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:29.512440 10983 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:29.443208 14005 consensus_queue.cc:1048] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:24:29.486625 13932 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:29.499624 10978 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:29.499154 10977 raft_consensus.cc:2368] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 9. Current term is 10.
I20260709 12:24:29.500522 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.521714 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:29.522341 10978 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:29.504029 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:29.494436 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 82558.1us
I20260709 12:24:29.523490 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:29.523756 11097 leader_election.cc:336] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.951s (SENT)
I20260709 12:24:29.524271 11097 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:29.467852 14021 raft_consensus.cc:697] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:29.481981 14040 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:29.478432 13973 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:29.468487 14031 raft_consensus.cc:2749] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:29.466979 14053 raft_consensus.cc:2804] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:29.479465 13989 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:29.559361 11023 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:29.516592 11132 raft_consensus.cc:1275] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:29.499029 11098 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:29.525949 10980 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:29.526925 10979 raft_consensus.cc:2393] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 6: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:29.569538 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:29.570474 10977 raft_consensus.cc:2410] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:29.571141 11023 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:29.528430 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:29.529055 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 446968us
I20260709 12:24:29.497735 13988 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:29.568692 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:29.532289 11056 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
W20260709 12:24:29.534636 14096 log.cc:927] Time spent T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:24:29.535418 14092 log.cc:927] Time spent T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:24:29.539526 10982 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
W20260709 12:24:29.542689 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 52585.6us
I20260709 12:24:29.585700 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:29.558840 14053 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:29.502614 13967 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:29.503252 14034 raft_consensus.cc:2749] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:29.506458 14011 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:29.605587 14011 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:29.576472 13973 raft_consensus.cc:2804] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:29.606392 13973 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:29.606788 13973 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:29.604141 10949 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:52820 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1360)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1373)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1364)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1365)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1374)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1367)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1368)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1378)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1358)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1376)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1363)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1362)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1366)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1375)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1369)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1371)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1370)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 2053)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1328)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1341)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1361)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1372)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 2040)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 348)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1377)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1332)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:41958 (request call id 14)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2024)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 340)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2030)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2031)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 350)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2033)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 356)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 362)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1323)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1324)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1325)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1326)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1336)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2036)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2047)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2048)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2050)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2051)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1348)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1351)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1352)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2052)
I20260709 12:24:29.612756 11059 raft_consensus.cc:1275] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:24:29.613180 11059 pending_rounds.cc:85] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting all ops after (but not including) 7
I20260709 12:24:29.613391 11059 pending_rounds.cc:107] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:24:29.613590 11059 raft_consensus.cc:2889] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:29.614427 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.615420 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:29.549842 11097 leader_election.cc:336] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 2.041s (SENT)
I20260709 12:24:29.616537 11097 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:29.517517 14052 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:29.525797 13932 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:29.564785 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 65827.7us
W20260709 12:24:29.552238 14095 log.cc:927] Time spent T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.100s	user 0.000s	sys 0.002s
I20260709 12:24:29.563938 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1940) took 2575 ms. Trace:
I20260709 12:24:29.574856 10979 raft_consensus.cc:2393] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 7: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:29.578063 11023 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:29.631845 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 54097.6us
I20260709 12:24:29.576450 13988 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:29.584360 13992 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:29.568760 13410 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:24:29.553877 13669 raft_consensus.cc:2749] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:29.585548 11025 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:29.543071 10978 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:29.593581 10983 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:24:29.597019 14053 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:29.587245 13723 raft_consensus.cc:2804] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:29.595090 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:29.561362 14019 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:29.650982 10982 raft_consensus.cc:2410] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:24:29.597229 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.598208 14021 consensus_queue.cc:237] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:29.596269 13967 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:29.547358 10948 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:24:29.657022 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 109752us
W20260709 12:24:29.601867 14094 log.cc:927] Time spent T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:24:29.662415 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:29.617635 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.666149 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:29.662166 14019 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:29.666913 10982 raft_consensus.cc:2376] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10. Re-sending same reply.
I20260709 12:24:29.667857 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.638418 13986 raft_consensus.cc:2804] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:29.668671 10982 raft_consensus.cc:2410] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:24:29.620169 10977 raft_consensus.cc:2393] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 8: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:29.610217 10949 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:52820 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1360)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1373)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1364)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1365)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1374)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1367)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1368)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1378)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1358)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1376)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1363)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1362)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1366)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1375)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1369)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1371)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1370)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 2053)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1328)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1341)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1361)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1372)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 2040)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 348)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1377)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1332)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:41958 (request call id 14)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2024)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 340)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2030)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2031)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 350)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2033)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 356)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 362)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1323)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1324)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1325)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1326)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1336)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2036)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2047)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2048)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2050)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2051)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1348)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1351)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1352)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2052)
I20260709 12:24:29.630653 11132 rpcz_store.cc:276] 0709 12:24:26.988154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.680618 (+1692464us) service_pool.cc:224] Handling call
0709 12:24:28.680968 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:29.177980 (+497012us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b5400233fa0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bd5bdc0 00007f8f8bde61c0 00007f8f8bde7231 00007f8f8bde3d8f 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c
0709 12:24:29.563657 (+385677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:29.563881 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":648362368}
I20260709 12:24:29.582590 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.673369 10981 raft_consensus.cc:2368] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 8. Current term is 9.
I20260709 12:24:29.674374 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:29.630716 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.676615 10984 raft_consensus.cc:2410] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:24:29.635924 10976 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
W20260709 12:24:29.638402 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 88586us
I20260709 12:24:29.634845 11098 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:29.666816 14091 log.cc:927] Time spent T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:24:29.641356 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:29.586316 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 281206us
W20260709 12:24:29.642952 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 57475.2us
I20260709 12:24:29.683696 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.684518 10980 raft_consensus.cc:2368] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 8. Current term is 9.
I20260709 12:24:29.648553 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.649430 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.615321 13631 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.645587 14034 raft_consensus.cc:2749] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:29.636547 11023 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:29.679950 11060 raft_consensus.cc:1275] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:29.650067 13895 raft_consensus.cc:2804] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:29.650578 13723 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:29.663144 14090 log.cc:927] Time spent T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:24:29.691044 14019 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:29.691716 13631 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:29.681967 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 47207.9us
I20260709 12:24:29.664113 13967 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:29.645283 14031 consensus_queue.cc:1059] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:24:29.699695 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:29.689741 11025 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:29.693434 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:29.687707 10979 raft_consensus.cc:2410] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:29.659005 13739 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:29.700373 10981 raft_consensus.cc:2376] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6. Re-sending same reply.
I20260709 12:24:29.705221 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:29.706033 10977 raft_consensus.cc:2410] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:24:29.694284 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 57635.5us
I20260709 12:24:29.706858 11023 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:29.694777 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:29.707966 11054 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:29.708563 10978 raft_consensus.cc:2410] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:24:29.697310 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:29.704401 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:29.709182 10981 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:29.658717 14012 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:29.668823 13721 raft_consensus.cc:2804] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:29.712908 13721 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:29.715533 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.700651 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.701452 10982 raft_consensus.cc:2368] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 8. Current term is 9.
I20260709 12:24:29.716329 10978 raft_consensus.cc:2393] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 8: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:29.717502 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.717957 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:29.718173 10980 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:29.695871 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.719640 10976 raft_consensus.cc:2393] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 6: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
W20260709 12:24:29.687565 11097 leader_election.cc:336] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 2.045s (SENT)
I20260709 12:24:29.720110 11097 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:29.688331 13986 raft_consensus.cc:697] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:29.709271 10984 raft_consensus.cc:2410] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:24:29.707703 11023 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:29.725281 11052 raft_consensus.cc:2410] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:24:29.721246 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:29.720293 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.687048 13895 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:29.693063 13723 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:29.735797 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.740234 10982 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:29.741245 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.694276 13669 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:29.739403 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.743049 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.743909 10980 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
W20260709 12:24:29.745090 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.745548 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.699327 14025 raft_consensus.cc:2804] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:29.713330 13721 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:29.724411 14017 raft_consensus.cc:2804] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:29.713280 14055 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:29.760550 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.762488 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.734675 13895 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:29.763139 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.739332 14046 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:29.763700 10981 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
I20260709 12:24:29.746542 14038 raft_consensus.cc:3055] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:29.764730 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:29.758785 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.884737 10984 raft_consensus.cc:2393] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 8: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:29.749224 10979 raft_consensus.cc:2393] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 6: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:29.768530 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.737378 14028 raft_consensus.cc:2804] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:29.746622 13962 raft_consensus.cc:2804] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:29.761132 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:29.771744 10977 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:24:29.774256 11051 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:24:29.846513 11674 raft_consensus.cc:1240] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:29.786733 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 108418us
I20260709 12:24:29.776898 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.784565 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.789135 13986 consensus_queue.cc:237] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:29.764017 14025 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:29.747310 14005 consensus_queue.cc:1059] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:24:29.788317 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:29.767055 14034 raft_consensus.cc:2749] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:24:29.785022 14101 log.cc:927] Time spent T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 12:24:29.889497 11097 leader_election.cc:336] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 2.152s (SENT)
I20260709 12:24:29.894527 10980 raft_consensus.cc:2393] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 6: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:29.934309 11097 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:29.935061 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.936300 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.937400 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.938432 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.938927 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.886314 14038 raft_consensus.cc:740] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:29.939540 10980 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
I20260709 12:24:29.939647 14034 raft_consensus.cc:2749] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:29.940099 14038 consensus_queue.cc:260] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:29.940852 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 51393.2us
I20260709 12:24:29.941354 14038 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:29.941489 11097 leader_election.cc:336] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 2.170s (SENT)
I20260709 12:24:29.895670 10982 raft_consensus.cc:2393] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 6: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:29.896338 11680 raft_consensus.cc:1240] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []
W20260709 12:24:29.942317 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.942837 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.943572 10982 raft_consensus.cc:2393] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 8: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:29.894553 10981 raft_consensus.cc:2393] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 8: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:29.944384 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:29.878805 13948 consensus_meta.cc:287] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.661s	user 0.007s	sys 0.007s
I20260709 12:24:29.944941 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.945111 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:29.920444 14005 raft_consensus.cc:3055] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:29.888530 11098 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:29.945858 14005 raft_consensus.cc:740] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:29.905723 14025 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:29.946197 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 57759.1us
I20260709 12:24:29.946528 13948 raft_consensus.cc:2804] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:29.946666 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:29.947115 13948 raft_consensus.cc:697] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 9 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:29.948014 13948 consensus_queue.cc:237] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:29.948336 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:29.949105 11675 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:29.945394 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:29.950748 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.951313 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:29.952481 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:29.953576 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:29.954967 13631 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:29.873647 14017 raft_consensus.cc:697] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:29.940428 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:29.941758 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:29.956899 11677 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:29.943369 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:29.939260 10976 raft_consensus.cc:2393] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 7: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:29.928053 13723 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:29.888084 14103 log.cc:927] Time spent T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.142s	user 0.000s	sys 0.014s
I20260709 12:24:29.958276 11680 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:29.954677 14005 consensus_queue.cc:260] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:29.961226 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:29.962608 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 279326us
I20260709 12:24:29.962885 11024 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:24:29.959514 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:29.984261 10980 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
W20260709 12:24:29.963687 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.945744 11674 raft_consensus.cc:1240] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:29.923578 14015 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
W20260709 12:24:29.986306 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.982030 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:29.986820 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.987112 10976 raft_consensus.cc:2393] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 6: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
W20260709 12:24:29.987708 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.945726 10981 raft_consensus.cc:2393] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 7: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:29.988306 11023 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:29.968417 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:29.968652 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:29.942818 11097 leader_election.cc:336] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 2.516s (SENT)
I20260709 12:24:29.969403 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:29.989588 11134 raft_consensus.cc:2393] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 7: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:29.944953 10982 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:29.990226 11680 raft_consensus.cc:1240] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:29.970259 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 254139us
I20260709 12:24:29.992110 11097 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:29.992923 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:29.993101 11023 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
W20260709 12:24:29.979707 11643 leader_election.cc:336] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.904s (SENT)
I20260709 12:24:29.981000 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:29.970726 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:29.996088 11024 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
W20260709 12:24:29.977707 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 288014us
I20260709 12:24:29.991330 14015 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:29.995172 13669 raft_consensus.cc:697] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 9 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:29.999585 14053 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:29.999799 13669 consensus_queue.cc:237] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:30.002252 14021 raft_consensus.cc:2749] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:30.003119 11130 raft_consensus.cc:2368] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8.
I20260709 12:24:30.004756 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:30.006769 11128 raft_consensus.cc:2368] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 8. Current term is 9.
I20260709 12:24:30.005122 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:30.008675 11675 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:30.008875 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:30.001804 14053 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:30.014232 10980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945"
dest_uuid: "bc01179655564f29b83babe396377cbb"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:41958
I20260709 12:24:30.014973 10980 raft_consensus.cc:606] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:30.015357 10980 raft_consensus.cc:614] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:29.909504 13962 raft_consensus.cc:697] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:30.011431 10982 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:24:29.986043 14012 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.011330 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:30.011889 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:30.016497 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:30.035987 11130 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:29.999754 13723 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:30.010969 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:29.889705 13973 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:30.031975 13986 raft_consensus.cc:2749] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:30.046814 13986 raft_consensus.cc:2804] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:30.027455 14105 consensus_queue.cc:1048] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:24:30.011703 11677 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:24:29.948275 13932 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:30.049027 11125 raft_consensus.cc:2393] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 6: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:30.049746 13932 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:30.050743 11674 raft_consensus.cc:1275] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:30.042681 11126 raft_consensus.cc:2368] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 4. Current term is 5.
I20260709 12:24:30.052022 11681 raft_consensus.cc:2393] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 8: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:30.046823 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:30.054188 11127 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:30.059109 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:30.061997 10984 raft_consensus.cc:1240] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:30.062708 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2031) took 2064 ms. Trace:
I20260709 12:24:30.062884 13973 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:30.064399 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 121613us
I20260709 12:24:30.047317 13986 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:29.956055 14017 consensus_queue.cc:237] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:30.070175 10984 rpcz_store.cc:276] 0709 12:24:27.998268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.061527 (+2063259us) service_pool.cc:224] Handling call
0709 12:24:30.061827 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.062468 (+   641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.062649 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:29.923616 14011 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:30.081938 11097 connection.cc:256] RPC call timeout handler was delayed by -1.4294594830003007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3084s for a response
W20260709 12:24:30.085384 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:30.057868 13772 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:30.089437 11130 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
I20260709 12:24:30.094766 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:30.070039 11127 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
W20260709 12:24:30.099946 11097 leader_election.cc:336] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 2.882s (SENT)
W20260709 12:24:30.101104 11097 leader_election.cc:336] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 3.084s (SENT)
I20260709 12:24:30.101877 11097 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:30.032509 14028 raft_consensus.cc:697] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:29.991705 14108 consensus_queue.cc:1059] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.109s
W20260709 12:24:30.107649 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 111644us
I20260709 12:24:30.110739 10984 raft_consensus.cc:1240] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:24:30.078807 13986 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:30.119391 11126 raft_consensus.cc:1217] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[5.7-5.7]   Dedup: 5.7->[]
I20260709 12:24:30.068702 14012 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:30.088899 14005 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:30.136857 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:30.126214 14108 consensus_queue.cc:1243] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:24:30.105693 11130 raft_consensus.cc:1240] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8. Ops: [5.3-7.4]
I20260709 12:24:30.091650 14053 raft_consensus.cc:2749] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:30.167521 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:30.167727 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:30.091878 13228 raft_consensus.cc:2749] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:30.127071 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2033) took 1969 ms. Trace:
I20260709 12:24:30.128510 11126 raft_consensus.cc:1240] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:24:30.119621 10980 raft_consensus.cc:1275] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:30.172477 10984 rpcz_store.cc:276] 0709 12:24:28.157269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.106833 (+1949564us) service_pool.cc:224] Handling call
0709 12:24:30.110349 (+  3516us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:30.126713 (+ 16364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.127010 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.173529 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 356) took 1461 ms. Trace:
I20260709 12:24:30.124137 13973 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:30.145939 11643 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:30.175874 11643 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
W20260709 12:24:30.118434 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 119466us
I20260709 12:24:30.178402 11643 leader_election.cc:400] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Vote denied by peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777) with higher term. Message: Invalid argument: T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 9. Current term is 10.
I20260709 12:24:30.178838 11643 leader_election.cc:403] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:24:30.173877 10980 rpcz_store.cc:276] 0709 12:24:28.712095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.095225 (+1383130us) service_pool.cc:224] Handling call
0709 12:24:30.119303 (+ 24078us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.173265 (+ 53962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.173470 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.178599 11025 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:30.107131 14114 consensus_queue.cc:1048] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
W20260709 12:24:30.183772 11097 leader_election.cc:336] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:52820 dropped due to backpressure: service queue is full with 50 items
W20260709 12:24:30.171049 13989 consensus_meta.cc:287] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.592s	user 0.010s	sys 0.000s
I20260709 12:24:30.185788 11097 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
W20260709 12:24:30.171360 13992 consensus_meta.cc:287] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.528s	user 0.004s	sys 0.005s
I20260709 12:24:30.193571 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:30.118497 13962 consensus_queue.cc:237] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:30.204582 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:30.206350 11053 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:30.207434 11644 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:30.194789 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:30.213266 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:30.200536 11643 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:30.201748 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:30.214923 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:30.219945 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:30.220197 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:30.220877 11131 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:30.220885 10984 raft_consensus.cc:2393] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 7: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:30.137965 14109 consensus_queue.cc:1059] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:24:30.187527 13629 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:30.195680 14104 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:30.195144 14108 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:30.226787 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:30.207991 13932 raft_consensus.cc:2749] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777) with higher term. Message: Invalid argument: T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 9. Current term is 10.
I20260709 12:24:30.227097 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:30.227792 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:30.229838 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:30.235564 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:30.237607 10984 raft_consensus.cc:2376] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9. Re-sending same reply.
I20260709 12:24:30.226419 11097 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:30.245702 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:30.245929 11097 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:30.218787 13992 raft_consensus.cc:2749] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:30.220250 13973 raft_consensus.cc:2749] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:30.244769 11054 raft_consensus.cc:2368] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 6. Current term is 7.
I20260709 12:24:30.246937 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:30.246853 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:30.151163 14118 consensus_queue.cc:1059] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
W20260709 12:24:30.220366 13988 consensus_meta.cc:287] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.574s	user 0.006s	sys 0.003s
I20260709 12:24:30.252987 11097 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:24:30.258879 13410 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:30.282315 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 350) took 2244 ms. Trace:
I20260709 12:24:30.308697 10979 rpcz_store.cc:276] 0709 12:24:28.038327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.063690 (+2025363us) service_pool.cc:224] Handling call
0709 12:24:30.064049 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:30.079025 (+ 14976us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.079060 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:30.093895 (+ 14835us) log.cc:844] Serialized 26 byte log entry
0709 12:24:30.227499 (+133604us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:30.227540 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.227616 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:30.282032 (+ 54416us) raft_consensus.cc:1685] finished
0709 12:24:30.282055 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.282245 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7538,"raft.queue_time_us":14709,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":16218,"thread_start_us":100656,"threads_started":1,"wal-append.queue_time_us":166321}
W20260709 12:24:30.275681 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:30.208827 13228 consensus_queue.cc:1048] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 12:24:30.283269 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 82830.5us
I20260709 12:24:30.210773 13989 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:30.241046 14108 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:30.284829 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:30.319051 11053 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
I20260709 12:24:30.239579 14111 raft_consensus.cc:2749] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:30.287809 11130 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:30.289302 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:30.322181 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 131885us
I20260709 12:24:30.248992 14105 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:30.305500 11131 raft_consensus.cc:2368] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8.
I20260709 12:24:30.238330 14104 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:30.323513 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:30.284325 11097 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:30.327322 11097 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:30.327832 10975 raft_consensus.cc:2393] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 9: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:30.328532 11097 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:30.328697 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:30.329742 11097 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:30.333747 10949 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
W20260709 12:24:30.314929 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 321883us
I20260709 12:24:30.210875 13967 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:30.335491 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:30.240401 14053 raft_consensus.cc:3055] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:30.195978 14028 consensus_queue.cc:237] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:30.282502 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 340) took 2479 ms. Trace:
I20260709 12:24:30.285699 14021 raft_consensus.cc:2749] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:30.324342 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:30.313107 14082 consensus_meta.cc:287] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.852s	user 0.008s	sys 0.003s
I20260709 12:24:30.323241 14108 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:30.346866 11678 raft_consensus.cc:1275] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:30.347374 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:30.282755 14113 log.cc:927] Time spent T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 12:24:30.325991 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:30.334769 13772 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
W20260709 12:24:30.351235 13895 consensus_meta.cc:287] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.561s	user 0.009s	sys 0.000s
I20260709 12:24:30.351701 13895 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:30.352242 13989 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:30.334945 14026 raft_consensus.cc:2749] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:30.351766 11055 raft_consensus.cc:2393] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 7: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
W20260709 12:24:30.333295 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:30.333839 11130 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
I20260709 12:24:30.311800 14031 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:30.313899 13988 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:30.339895 10949 leader_election.cc:400] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8.
I20260709 12:24:30.363210 10949 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:30.343585 11053 raft_consensus.cc:2393] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 8: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:30.334985 14011 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:30.353925 13895 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:30.330435 14104 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:30.325516 11024 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:24:30.350299 11054 raft_consensus.cc:2376] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bc01179655564f29b83babe396377cbb in term 6. Re-sending same reply.
I20260709 12:24:30.348946 14078 raft_consensus.cc:2749] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:30.336308 11058 raft_consensus.cc:1240] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 7. Current term is 8. Ops: []
W20260709 12:24:30.355767 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:30.356068 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:30.411015 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:30.411115 11130 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
W20260709 12:24:30.411589 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:30.321931 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 114597us
W20260709 12:24:30.411958 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:30.360049 13973 raft_consensus.cc:2749] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:30.337234 14034 raft_consensus.cc:2804] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:30.339100 14053 raft_consensus.cc:740] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:24:30.349150 14052 consensus_meta.cc:287] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.705s	user 0.009s	sys 0.001s
I20260709 12:24:30.344461 14019 raft_consensus.cc:2749] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:30.344498 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:30.367661 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:30.421868 11673 raft_consensus.cc:1240] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:24:30.422034 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:30.422950 11053 raft_consensus.cc:2393] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 7: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:30.371006 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:30.423480 11128 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:30.372934 13988 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:30.349532 14082 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:30.378396 11133 raft_consensus.cc:2410] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:30.380169 13977 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:30.329303 10975 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
I20260709 12:24:30.432180 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:30.398517 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:30.407256 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 81805.7us
I20260709 12:24:30.427475 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:30.412806 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:30.461967 11053 raft_consensus.cc:2376] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bc01179655564f29b83babe396377cbb in term 8. Re-sending same reply.
I20260709 12:24:30.462177 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:30.462559 11054 raft_consensus.cc:2393] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 8: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:30.462885 10975 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:30.462992 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:30.463459 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:30.463975 11054 raft_consensus.cc:2376] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bc01179655564f29b83babe396377cbb in term 7. Re-sending same reply.
I20260709 12:24:30.464625 11053 raft_consensus.cc:1240] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:30.337602 10981 rpcz_store.cc:276] 0709 12:24:27.803244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.005963 (+2202719us) service_pool.cc:224] Handling call
0709 12:24:30.006313 (+   350us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:24:30.006626 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.006650 (+    24us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:24:30.029126 (+ 22476us) log.cc:844] Serialized 78 byte log entry
0709 12:24:30.127624 (+ 98498us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:30.127672 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.127735 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:30.282248 (+154513us) raft_consensus.cc:1685] finished
0709 12:24:30.282267 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.282437 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":6225,"thread_start_us":73058,"threads_started":1,"wal-append.queue_time_us":120805}
W20260709 12:24:30.413884 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 50761.7us
I20260709 12:24:30.466387 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:30.466665 10949 leader_election.cc:400] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 8. Current term is 9.
I20260709 12:24:30.466427 14136 consensus_queue.cc:1059] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:30.467245 10981 raft_consensus.cc:2393] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 8: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:30.467653 14136 raft_consensus.cc:3055] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:30.468034 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:30.468389 13895 consensus_queue.cc:1048] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:30.390677 11126 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:30.468835 11024 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:30.469674 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:30.470258 10975 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:30.470772 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:30.471454 11126 raft_consensus.cc:2393] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 6: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:30.472090 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:30.472168 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:30.473031 10975 raft_consensus.cc:2393] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 8: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:30.473645 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:30.474220 11679 raft_consensus.cc:1240] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:30.468008 14136 raft_consensus.cc:740] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:30.474244 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:30.475375 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:30.467021 10949 leader_election.cc:403] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:24:30.410041 14012 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:30.475926 14017 raft_consensus.cc:2749] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:30.475790 14136 consensus_queue.cc:260] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:30.475972 11677 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:30.477110 14136 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:30.473913 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:30.476496 14012 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.478595 14012 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:30.468690 10981 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:30.478282 11675 raft_consensus.cc:2376] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7. Re-sending same reply.
I20260709 12:24:30.480798 14012 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:30.481344 14012 raft_consensus.cc:2749] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 8. Current term is 9.
I20260709 12:24:30.478008 10949 leader_election.cc:400] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 4 pre-election: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 4. Current term is 5.
I20260709 12:24:30.473371 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:30.483091 10949 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:30.414407 13913 raft_consensus.cc:2749] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:30.415501 14034 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:30.484326 10949 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:30.483251 11126 raft_consensus.cc:2393] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 7: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:30.487419 11677 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:30.476382 10975 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:30.405794 14025 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:30.494515 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:30.502894 11053 raft_consensus.cc:2368] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8.
I20260709 12:24:30.492250 10949 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:30.417105 14112 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:30.490536 11024 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:30.495707 11130 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
I20260709 12:24:30.520503 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:30.498023 10981 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:30.509318 10949 leader_election.cc:400] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8.
I20260709 12:24:30.521569 10949 leader_election.cc:403] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:24:30.522336 10949 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:30.523164 10949 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:30.510809 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:30.520148 11672 raft_consensus.cc:1240] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:24:30.501463 11023 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:30.524497 11126 raft_consensus.cc:2393] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 7: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:24:30.498559 14129 log.cc:927] Time spent T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 12:24:30.526377 11023 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:30.432374 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 102713us
I20260709 12:24:30.489018 14034 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:30.529170 11056 raft_consensus.cc:2393] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 9: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:30.528229 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:30.504191 14019 raft_consensus.cc:2804] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:30.489928 14012 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:30.525454 14028 raft_consensus.cc:2804] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:30.550818 14028 raft_consensus.cc:697] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:30.551736 14028 consensus_queue.cc:237] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:30.552378 11128 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
I20260709 12:24:30.519443 13895 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.554620 13895 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:30.520066 13977 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:30.555747 13977 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:30.556107 13977 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:30.556740 13895 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:30.539521 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:30.521062 14053 consensus_queue.cc:260] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:30.557813 11130 raft_consensus.cc:2376] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8. Re-sending same reply.
W20260709 12:24:30.558188 13988 consensus_queue.cc:1175] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" responder_term: 8 status { last_received { term: 7 index: 7 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:30.527842 13986 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:30.558885 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:30.545512 14099 log.cc:927] Time spent T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.962s	user 0.002s	sys 0.002s
W20260709 12:24:30.543172 14040 consensus_meta.cc:287] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.981s	user 0.010s	sys 0.001s
I20260709 12:24:30.560134 11059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 397) took 3974 ms. Trace:
I20260709 12:24:30.560048 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:30.424767 14052 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:30.527633 14112 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:30.554630 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:30.558002 14053 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:30.541558 14025 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:30.573161 11128 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:30.561582 11130 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:30.572116 10975 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:30.528158 14130 raft_consensus.cc:2804] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:30.560427 11057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 405) took 1591 ms. Trace:
I20260709 12:24:30.546633 13913 raft_consensus.cc:2804] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:30.595829 11130 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:30.596807 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:30.560539 11059 rpcz_store.cc:276] 0709 12:24:26.585634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.717038 (+131404us) service_pool.cc:224] Handling call
0709 12:24:26.717412 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:29.614001 (+2896589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.559907 (+945906us) spinlock_profiling.cc:243] Waited 2.89 s on lock 0x7b54003020d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:30.560066 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6657728384}
I20260709 12:24:30.560580 14040 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:30.574013 11097 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:30.574644 14105 raft_consensus.cc:2749] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:30.561375 11051 raft_consensus.cc:1240] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:24:30.583065 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:30.504601 14121 consensus_queue.cc:1059] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 12:24:30.594090 14052 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:30.586544 11025 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:30.529465 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:30.545719 13721 consensus_meta.cc:287] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.772s	user 0.000s	sys 0.009s
I20260709 12:24:30.590739 11057 rpcz_store.cc:276] 0709 12:24:28.969375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.302271 (+332896us) service_pool.cc:224] Handling call
0709 12:24:29.302631 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:29.304403 (+  1772us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:29.304439 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:29.304922 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 12:24:29.450221 (+145299us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:29.450261 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:29.450348 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:30.373345 (+922997us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b48001f0158. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f90d0daa1 00007f8f90d04b37 00007f8f90d049ca 00007f8f90dfc26f 00007f8f90dfbf37 00007f8f90e1055c 00007f8f90e10508 00007f8f90e10488 00007f8f90e10443 00007f8f90e0f6ec 00007f8f8fd39a96
0709 12:24:30.544952 (+171607us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:30.560227 (+ 15275us) raft_consensus.cc:1685] finished
0709 12:24:30.560246 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.560369 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14805,"raft.queue_time_us":1406,"raft.run_cpu_time_us":5883,"raft.run_wall_time_us":1061046,"spinlock_wait_cycles":52538112,"thread_start_us":144968,"threads_started":1,"wal-append.queue_time_us":251626}
I20260709 12:24:30.571195 14078 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:30.572125 14143 raft_consensus.cc:2749] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8.
W20260709 12:24:30.594506 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 71411.8us
I20260709 12:24:30.594776 11131 raft_consensus.cc:2393] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 8: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:24:30.570188 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 45005us
I20260709 12:24:30.598168 11128 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:30.584228 13962 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.603859 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:30.612831 11052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52804 (request call id 408) took 1027 ms. Trace:
I20260709 12:24:30.618422 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:30.619320 10975 raft_consensus.cc:2376] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8. Re-sending same reply.
I20260709 12:24:30.620251 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:30.620796 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 53378.4us
I20260709 12:24:30.612337 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:30.621100 11052 rpcz_store.cc:276] 0709 12:24:29.585272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.585437 (+   165us) service_pool.cc:224] Handling call
0709 12:24:30.612646 (+1027209us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400278dd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:30.612775 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":318750976}
I20260709 12:24:30.614483 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:30.621213 10975 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:30.622970 11025 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:30.602941 14019 raft_consensus.cc:697] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 7 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:30.582260 10948 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:30.618968 11645 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:30.622128 11134 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:30.606717 13986 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:30.620517 11023 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:30.602025 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:30.626467 11025 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:30.609635 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:30.669271 10949 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:30.674067 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:30.672741 11134 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:30.674413 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:30.674414 11132 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:30.608063 14005 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:30.682628 13986 raft_consensus.cc:2804] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:30.683274 13895 raft_consensus.cc:2804] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:30.683723 13895 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:30.684127 13895 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:30.669009 14100 raft_consensus.cc:2749] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:30.599207 14130 raft_consensus.cc:697] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:30.687562 14130 consensus_queue.cc:237] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:30.689123 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:30.694568 11128 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:30.695225 14040 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:30.696470 14046 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:30.698189 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:30.699002 11133 raft_consensus.cc:2393] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 7: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:30.699899 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:30.700196 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2024) took 2953 ms. Trace:
I20260709 12:24:30.667502 14011 raft_consensus.cc:2749] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:30.702466 14145 raft_consensus.cc:2764] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:24:30.704121 10949 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:30.705183 10949 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:30.667697 11097 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:30.677942 11052 raft_consensus.cc:1275] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
W20260709 12:24:30.706792 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 80050.9us
I20260709 12:24:30.678874 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:30.679886 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:30.707880 10978 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:30.708259 14082 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:30.708671 14145 raft_consensus.cc:2749] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:30.674590 11130 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:30.597811 13913 raft_consensus.cc:697] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:30.700822 13992 raft_consensus.cc:3055] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:30.707403 14052 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:30.680353 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 53964.8us
I20260709 12:24:30.721623 11129 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:30.725273 11025 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:30.680794 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 60364.9us
I20260709 12:24:30.726069 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:30.711294 11132 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:30.711944 11052 raft_consensus.cc:1275] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:30.700575 10976 rpcz_store.cc:276] 0709 12:24:27.746746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.005509 (+2258763us) service_pool.cc:224] Handling call
0709 12:24:30.005830 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:30.153014 (+147184us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:30.315567 (+162553us) log.cc:844] Serialized 14 byte log entry
0709 12:24:30.433005 (+117438us) log.cc:844] Serialized 14 byte log entry
0709 12:24:30.573789 (+140784us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:30.585312 (+ 11523us) log.cc:844] Serialized 26 byte log entry
0709 12:24:30.585491 (+   179us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:30.585529 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.699836 (+114307us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54000da554. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:30.699884 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:30.699997 (+   113us) raft_consensus.cc:1685] finished
0709 12:24:30.700012 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.700140 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26863,"prepare.queue_time_us":209255,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":66935,"raft.run_cpu_time_us":366,"raft.run_wall_time_us":41266,"spinlock_wait_cycles":337507712,"thread_start_us":360012,"threads_started":3,"wal-append.queue_time_us":276162}
I20260709 12:24:30.670337 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:30.715751 10949 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:30.727882 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:30.707593 11134 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
W20260709 12:24:30.714672 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:30.627938 11645 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:30.723639 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:30.715229 11133 raft_consensus.cc:2410] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:30.707545 11097 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:30.729110 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:30.727566 11126 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:30.729468 10978 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:30.730738 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:30.730903 11097 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:30.731098 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:30.731305 11126 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:30.732594 11097 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:30.732797 11132 raft_consensus.cc:2376] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5. Re-sending same reply.
I20260709 12:24:30.727933 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:30.732589 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:30.733968 11134 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:30.734124 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:30.719401 11130 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:30.735621 13410 raft_consensus.cc:2749] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:30.627290 14025 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:30.736531 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:30.742146 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:30.742889 10976 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:30.743518 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:30.744174 11133 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:30.744531 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:30.745498 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:30.739342 11025 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
W20260709 12:24:30.736505 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 108642us
I20260709 12:24:30.740264 10949 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:30.608006 14112 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:30.764756 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:30.765045 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:30.748245 11023 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:30.738220 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:30.766706 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:30.765520 10978 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:30.746490 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:30.736490 14015 consensus_meta.cc:287] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.738s	user 0.011s	sys 0.000s
I20260709 12:24:30.713198 14005 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:30.794217 11130 raft_consensus.cc:2393] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:30.769152 11023 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:30.768035 11129 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:30.768018 11126 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:30.713048 14144 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:30.722595 13992 raft_consensus.cc:740] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:30.741894 14021 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:30.722030 13986 raft_consensus.cc:697] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:30.793555 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:30.742450 14038 raft_consensus.cc:2749] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:30.784651 11132 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:30.764273 14026 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:30.819715 11133 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:30.821421 11132 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:30.770188 11025 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:30.604396 13721 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:30.609850 14104 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:30.767447 10976 raft_consensus.cc:2393] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 6: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:30.748421 14046 raft_consensus.cc:2749] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:30.736431 13977 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:30.721493 13669 consensus_queue.cc:1048] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
W20260709 12:24:30.812435 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 230246us
I20260709 12:24:30.605065 14078 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:30.855350 11133 raft_consensus.cc:1240] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 9 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:24:30.855826 14078 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:30.813376 10978 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:30.856724 11133 raft_consensus.cc:1240] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:30.726616 10975 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:30.765811 14031 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.857841 14031 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:30.860116 14031 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:30.797976 11129 raft_consensus.cc:1240] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:24:30.795516 14112 consensus_queue.cc:1048] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:24:30.861790 11129 raft_consensus.cc:1275] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:30.768898 13228 raft_consensus.cc:2804] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:30.863341 13228 raft_consensus.cc:697] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:30.864275 13228 consensus_queue.cc:237] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:30.822225 11126 raft_consensus.cc:1240] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:30.825454 14019 consensus_queue.cc:237] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:24:30.868348 11126 raft_consensus.cc:1240] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:24:30.794186 14118 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:30.795368 14114 raft_consensus.cc:2804] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:30.826386 14026 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:30.870618 14114 raft_consensus.cc:697] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:30.871593 14114 consensus_queue.cc:237] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:30.872426 14026 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:30.768616 14025 raft_consensus.cc:697] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:30.874224 14025 consensus_queue.cc:237] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:30.875366 14034 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:30.824093 11132 raft_consensus.cc:1275] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:24:30.824537 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 54475.7us
I20260709 12:24:30.800279 14005 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:30.623865 13962 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:30.810251 11128 raft_consensus.cc:2393] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 10: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:30.827076 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 362) took 1949 ms. Trace:
I20260709 12:24:30.829321 13986 consensus_queue.cc:237] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:30.830380 13721 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:30.830950 10983 raft_consensus.cc:2393] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 8: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
W20260709 12:24:30.831602 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:30.832425 11134 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:30.834182 10980 raft_consensus.cc:1240] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:30.892750 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1323) took 1987 ms. Trace:
I20260709 12:24:30.893147 10980 rpcz_store.cc:276] 0709 12:24:28.905437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.833659 (+1928222us) service_pool.cc:224] Handling call
0709 12:24:30.833985 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.892479 (+ 58494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.892675 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.839715 13631 raft_consensus.cc:3055] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:30.894275 13631 raft_consensus.cc:740] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:30.853411 14017 raft_consensus.cc:2749] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:30.894471 10980 raft_consensus.cc:1240] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:30.879484 11025 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:30.895244 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1326) took 1882 ms. Trace:
I20260709 12:24:30.896087 11125 raft_consensus.cc:1240] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:30.895771 13631 consensus_queue.cc:260] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:24:30.897094 13631 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:30.881974 14148 raft_consensus.cc:2764] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:24:30.900066 10977 raft_consensus.cc:1240] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:30.900731 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1336) took 1865 ms. Trace:
I20260709 12:24:30.901051 10977 rpcz_store.cc:276] 0709 12:24:29.035369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.899495 (+1864126us) service_pool.cc:224] Handling call
0709 12:24:30.899875 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.900479 (+   604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.900662 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.895609 10980 rpcz_store.cc:276] 0709 12:24:29.013340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.893922 (+1880582us) service_pool.cc:224] Handling call
0709 12:24:30.894286 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.895000 (+   714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.895190 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:30.903435 13948 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.014s	sys 0.020s
W20260709 12:24:30.903867 13948 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.014s	sys 0.020s
I20260709 12:24:30.904351 11672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41784 (request call id 600) took 1635 ms. Trace:
I20260709 12:24:30.904763 11672 rpcz_store.cc:276] 0709 12:24:29.268922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.274132 (+  5210us) service_pool.cc:224] Handling call
0709 12:24:29.291005 (+ 16873us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:30.525729 (+1234724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.904093 (+378364us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540049ff54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:30.904288 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2826186112}
I20260709 12:24:30.907765 13992 consensus_queue.cc:260] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:30.908946 13992 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:30.910898 14143 raft_consensus.cc:3055] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:30.911347 14143 raft_consensus.cc:740] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:30.912278 14143 consensus_queue.cc:260] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:30.919541 10981 raft_consensus.cc:2393] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 7: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
W20260709 12:24:30.883474 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 141180us
I20260709 12:24:30.795835 13913 consensus_queue.cc:237] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:30.828356 14028 raft_consensus.cc:2804] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:30.922947 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 43542.5us
I20260709 12:24:30.882014 10975 raft_consensus.cc:1240] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:30.883813 10976 rpcz_store.cc:276] 0709 12:24:28.878125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.825496 (+1947371us) service_pool.cc:224] Handling call
0709 12:24:30.825796 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.826072 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.826735 (+   663us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:30.826787 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:30.826830 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.826892 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.827022 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:30.938671 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 201716us
I20260709 12:24:30.946461 10978 raft_consensus.cc:1240] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:30.885072 11132 raft_consensus.cc:1240] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:30.948539 11025 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:30.887073 14046 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.799996 14015 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:30.947153 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1325) took 1954 ms. Trace:
I20260709 12:24:30.948886 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1324) took 2023 ms. Trace:
I20260709 12:24:30.960235 10975 rpcz_store.cc:276] 0709 12:24:28.925150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.881558 (+1956408us) service_pool.cc:224] Handling call
0709 12:24:30.881855 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.946908 (+ 65053us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.948827 (+  1919us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.948647 10949 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:30.954775 10976 raft_consensus.cc:1240] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:30.962809 10978 rpcz_store.cc:276] 0709 12:24:28.992844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.882455 (+1889611us) service_pool.cc:224] Handling call
0709 12:24:30.946292 (+ 63837us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.946908 (+   616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.947099 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.083495 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2048) took 1475 ms. Trace:
I20260709 12:24:31.084030 10976 rpcz_store.cc:276] 0709 12:24:29.486458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.954294 (+1467836us) service_pool.cc:224] Handling call
0709 12:24:30.954600 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.961819 (+  7219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.962051 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:31.089828 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 77276.2us
I20260709 12:24:31.090260  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:30.920360 13988 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:31.006856 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:31.100867 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:31.103912 11681 raft_consensus.cc:1240] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:31.104770 11672 raft_consensus.cc:1240] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:24:31.105016 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:30.945398 14028 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:31.108790 11053 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:24:31.109264 11058 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:31.106053 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:31.117273 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 168680us
I20260709 12:24:31.118141 10949 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:30.887674 14045 consensus_queue.cc:1059] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.200s
I20260709 12:24:31.119199 10949 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:30.950564 14017 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:31.009850 14046 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:30.953159 14034 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:30.857535 14108 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:30.952068 14152 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:24:31.116693 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:31.145495 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:31.145893 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:31.146369 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:31.148000 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.090938 14150 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:31.153863 11098 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:31.137503 11058 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:24:31.139307 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:31.117978 14028 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:31.132313 14153 raft_consensus.cc:2749] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:31.089898 13895 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:31.116915 13762 consensus_queue.cc:1059] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 12:24:31.153074 14121 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:31.194046 14122 log.cc:927] Time spent T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:24:31.148444 14017 raft_consensus.cc:697] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:31.154343 14152 raft_consensus.cc:697] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:31.171042 14118 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:31.127264 13988 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:31.228689 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.235697 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1769) took 1056 ms. Trace:
I20260709 12:24:31.145157 14130 consensus_queue.cc:1048] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:24:31.199395 14155 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:31.199559 14150 raft_consensus.cc:697] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
W20260709 12:24:31.246024 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 476925us
W20260709 12:24:31.237113 14149 log.cc:927] Time spent T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
W20260709 12:24:31.258580 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 310088us
I20260709 12:24:31.237010 14121 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:31.220440 14105 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:31.270592 10979 raft_consensus.cc:1240] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:31.271420 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1351) took 1729 ms. Trace:
I20260709 12:24:31.271740 10979 rpcz_store.cc:276] 0709 12:24:29.541565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.261521 (+1719956us) service_pool.cc:224] Handling call
0709 12:24:31.261897 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.271116 (+  9219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.271354 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.273033 10979 raft_consensus.cc:1240] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:31.273633 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1352) took 1731 ms. Trace:
I20260709 12:24:31.274883 10979 rpcz_store.cc:276] 0709 12:24:29.541851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.272528 (+1730677us) service_pool.cc:224] Handling call
0709 12:24:31.272859 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.273393 (+   534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.273576 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.279810 14046 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:31.285080 13739 raft_consensus.cc:2749] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:31.287061 13895 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:31.288920 13967 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:31.292197 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 449) took 1180 ms. Trace:
I20260709 12:24:31.253831 11023 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:31.292699 11127 rpcz_store.cc:276] 0709 12:24:30.112124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.112261 (+   137us) service_pool.cc:224] Handling call
0709 12:24:30.112573 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.112772 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:30.168589 (+ 55817us) log.cc:844] Serialized 14 byte log entry
0709 12:24:30.168957 (+   368us) log.cc:844] Serialized 14 byte log entry
0709 12:24:31.291560 (+1122603us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b18002bc480. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88c71c0a 00007f8f923b1219 00007f8f8b99ad70 00007f8f8b98e293 00007f8f8b983cea 00007f8f8b98423a 00007f8f8bdeea2a 00007f8f8bdfe0bf 00007f8f8bdfe038
0709 12:24:31.291811 (+   251us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:31.291867 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:31.291923 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.291996 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.292127 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8137,"prepare.queue_time_us":310297,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":81,"raft.queue_time_us":3586,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":11017,"spinlock_wait_cycles":24931200,"thread_start_us":41632,"threads_started":1}
I20260709 12:24:31.259619 11025 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:31.251154 14082 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.249454 14155 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:31.259760 13762 raft_consensus.cc:3055] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:31.262744 14153 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:31.267083 14121 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:31.294507 14031 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.317827 11025 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
W20260709 12:24:31.318552 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:31.387701 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:31.388545 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:31.389024 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.305109 13977 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:31.307480 13967 raft_consensus.cc:2804] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:24:31.320950 14052 consensus_meta.cc:287] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.584s	user 0.000s	sys 0.010s
W20260709 12:24:31.425725 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 180027us
I20260709 12:24:31.315191 14082 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:31.314556 13762 raft_consensus.cc:740] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:31.314847 14155 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:31.458828 11644 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:31.470207 14052 raft_consensus.cc:2749] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:31.411966 13631 consensus_meta.cc:287] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.002s
I20260709 12:24:31.321489 14015 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:31.319438 14104 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:31.477843 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.516152 13762 consensus_queue.cc:260] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:31.517681 13762 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:31.324092 14158 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:31.469671 14150 consensus_queue.cc:237] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:31.518656 14046 consensus_queue.cc:1059] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:24:31.483100 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 165339us
I20260709 12:24:31.294798 14105 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:31.502842 14165 raft_consensus.cc:2804] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:31.503748 14161 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:31.504164 13962 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:31.506028 14097 log.cc:927] Time spent T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.187s	user 0.002s	sys 0.016s
I20260709 12:24:31.560472 14161 raft_consensus.cc:697] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:24:31.506294 14160 log.cc:927] Time spent T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 12:24:31.561754 14105 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:31.561519 14161 consensus_queue.cc:237] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:31.508260 13988 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:31.404126 14031 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:31.564304 14031 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:31.508329 14108 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:31.512329 14155 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:31.560465 14165 raft_consensus.cc:697] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:31.565945 14165 consensus_queue.cc:237] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:31.566735 14155 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:31.568689 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 46446us
W20260709 12:24:31.529600 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.569520 11025 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
W20260709 12:24:31.500584 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 73925.6us
W20260709 12:24:31.554607 14157 log.cc:927] Time spent T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.269s	user 0.001s	sys 0.001s
I20260709 12:24:31.577838 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:31.578485 11132 raft_consensus.cc:1275] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:31.578572 11125 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:31.579066 11128 raft_consensus.cc:1275] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 12:24:31.406540 14152 consensus_queue.cc:237] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:31.578601 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:31.555377 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:31.497203 14005 consensus_meta.cc:287] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.579s	user 0.007s	sys 0.003s
I20260709 12:24:31.580909 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:31.482481 13967 raft_consensus.cc:697] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:31.576988 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:31.582613 11059 raft_consensus.cc:2393] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 9: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:31.581995 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:31.314262 14017 consensus_queue.cc:237] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:31.573392 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:31.585258 11060 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:31.574337 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:31.575440 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:31.586575 11053 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:31.562057 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1976) took 1053 ms. Trace:
I20260709 12:24:31.581254 14005 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:31.587776 11133 rpcz_store.cc:276] 0709 12:24:30.508783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.858137 (+349354us) service_pool.cc:224] Handling call
0709 12:24:30.858469 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:30.858858 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.858886 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:30.859385 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 12:24:31.121482 (+262097us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:31.121516 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.121574 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:31.561824 (+440250us) raft_consensus.cc:1685] finished
0709 12:24:31.561856 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.561995 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1181,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":86,"thread_start_us":261689,"threads_started":1,"wal-append.queue_time_us":309944}
I20260709 12:24:31.586638 11128 pending_rounds.cc:85] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 2
I20260709 12:24:31.591872 11128 pending_rounds.cc:107] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 12:24:31.592226 11128 raft_consensus.cc:2889] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:31.591351 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:31.590626 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 471480us
W20260709 12:24:31.593739 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:31.577950 14132 log.cc:927] Time spent T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 1.209s	user 0.003s	sys 0.004s
I20260709 12:24:31.599385 11681 raft_consensus.cc:1240] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:24:31.600231 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:31.600869 11125 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:31.583650 13992 consensus_meta.cc:287] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.674s	user 0.013s	sys 0.001s
I20260709 12:24:31.599398 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:31.602876 10984 raft_consensus.cc:1275] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:31.604645 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1391) took 1669 ms. Trace:
I20260709 12:24:31.604949 10984 rpcz_store.cc:276] 0709 12:24:29.935500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.602312 (+1666812us) service_pool.cc:224] Handling call
0709 12:24:31.602587 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.604368 (+  1781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.604559 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.605780 11674 raft_consensus.cc:1275] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:31.606582 11681 raft_consensus.cc:1240] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 9. Current term is 10. Ops: [7.7-9.8]
I20260709 12:24:31.608462 10984 raft_consensus.cc:1275] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:31.609282 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2054) took 1621 ms. Trace:
I20260709 12:24:31.609745 10984 rpcz_store.cc:276] 0709 12:24:29.988107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.607840 (+1619733us) service_pool.cc:224] Handling call
0709 12:24:31.608120 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.609028 (+   908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.609222 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.610298 11056 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:24:31.609308 10949 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:31.585306 14108 raft_consensus.cc:2804] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:31.622915 11025 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:31.623190 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:31.634407 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:31.637006 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:31.637725 11675 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:31.639107 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:31.623649 13739 consensus_queue.cc:1048] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:24:31.641978 14108 raft_consensus.cc:697] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:31.642619 13739 raft_consensus.cc:2749] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:31.642972 14108 consensus_queue.cc:237] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:31.643391 13739 consensus_queue.cc:1059] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:31.644394 13739 raft_consensus.cc:3055] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:31.644744 13739 raft_consensus.cc:740] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:31.646723 11675 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:31.649369 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:31.651877 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.652778 11132 raft_consensus.cc:1275] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:31.653448 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:31.639840 14130 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.649369 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:31.656364 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.657634 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:31.668286 11674 raft_consensus.cc:2393] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 9: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:31.667852 11133 raft_consensus.cc:2393] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 7: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
W20260709 12:24:31.668220 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.668648 11677 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:24:31.633909 11053 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
I20260709 12:24:31.661693 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:31.672376 11675 raft_consensus.cc:2393] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 8: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
W20260709 12:24:31.654349 10948 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.006s	sys 0.007s
I20260709 12:24:31.602841 14019 consensus_queue.cc:1059] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:24:31.666064 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:24:31.673767 10948 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.006s	sys 0.007s
W20260709 12:24:31.675570 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 793417us
I20260709 12:24:31.675462 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2030) took 3683 ms. Trace:
W20260709 12:24:31.676362 11126 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.007s	sys 0.009s
I20260709 12:24:31.676255 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:24:31.677474 11126 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.007s	sys 0.009s
I20260709 12:24:31.677786 11681 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:31.676750 10982 rpcz_store.cc:276] 0709 12:24:27.991756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.036964 (+2045208us) service_pool.cc:224] Handling call
0709 12:24:30.037646 (+   682us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:30.071914 (+ 34268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.071944 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:30.104120 (+ 32176us) log.cc:844] Serialized 26 byte log entry
0709 12:24:30.320981 (+216861us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:30.321022 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.326423 (+  5401us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:31.570918 (+1244495us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:31.667483 (+ 96565us) raft_consensus.cc:1685] finished
0709 12:24:31.667505 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.675391 (+  7886us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":35779,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":12680,"spinlock_wait_cycles":37557120,"thread_start_us":184364,"threads_started":1,"wal-append.queue_time_us":242908}
I20260709 12:24:31.658949 14168 raft_consensus.cc:2749] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:31.680905 11644 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:31.681210 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.684185 11097 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:31.685209 11673 raft_consensus.cc:1240] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:31.687966 11673 raft_consensus.cc:1275] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:31.648223 14118 consensus_queue.cc:1048] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:24:31.696563 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:31.682704 14031 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:31.666366 13228 consensus_queue.cc:1048] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:24:31.726727 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:31.715958 11681 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:24:31.681126 13410 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:31.686477 14034 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.689250 14052 raft_consensus.cc:2749] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:24:31.731410 14053 consensus_meta.cc:287] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 1.149s	user 0.008s	sys 0.004s
I20260709 12:24:31.737180 14143 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:31.758656  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:31.728514 14031 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:31.680109 13739 consensus_queue.cc:260] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:31.764739 11057 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:31.742625 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 2061) took 1241 ms. Trace:
I20260709 12:24:31.766269 10981 rpcz_store.cc:276] 0709 12:24:30.501344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.527982 (+ 26638us) service_pool.cc:224] Handling call
0709 12:24:31.742376 (+1214394us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b540009ae54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:31.742533 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":893532928}
I20260709 12:24:31.768177 10981 raft_consensus.cc:1275] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:31.768841 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2063) took 1148 ms. Trace:
I20260709 12:24:31.769167 10981 rpcz_store.cc:276] 0709 12:24:30.620176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.767450 (+1147274us) service_pool.cc:224] Handling call
0709 12:24:31.767813 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.768570 (+   757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.768781 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.742249 13410 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:31.748003 11060 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
W20260709 12:24:31.749378 11131 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1785) took 1432 ms (client timeout 1612 ms). Trace:
W20260709 12:24:31.778908 11131 rpcz_store.cc:269] 0709 12:24:30.316914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.323828 (+  6914us) service_pool.cc:224] Handling call
0709 12:24:31.749112 (+1425284us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b5400107054. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:31.749279 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":387104128}
W20260709 12:24:31.750193 11055 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1706) took 1499 ms (client timeout 1629 ms). Trace:
W20260709 12:24:31.753705 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.679924 14130 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:31.663053 13967 consensus_queue.cc:237] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:31.758136 10880 catalog_manager.cc:5697] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 6 to 7, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 7 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:31.567754 14158 consensus_queue.cc:1048] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.236s
I20260709 12:24:31.599237 14148 consensus_queue.cc:1059] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.164s
I20260709 12:24:31.773995 10981 raft_consensus.cc:1275] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:31.782594 11643 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:31.780195 11055 rpcz_store.cc:269] 0709 12:24:30.250794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.308281 (+ 57487us) service_pool.cc:224] Handling call
0709 12:24:31.749967 (+1441686us) spinlock_profiling.cc:243] Waited 5.39 ms on lock 0x7b54002783d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:31.750127 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12391168}
W20260709 12:24:31.759917 14028 consensus_meta.cc:287] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.000s
I20260709 12:24:31.755563 14177 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:31.762501 14082 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:31.823711 14012 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.242s	user 0.004s	sys 0.016s
I20260709 12:24:31.826380 11643 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:31.786171 13762 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:31.757560 14034 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:31.786252 14179 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.818028 13739 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:31.812440 14169 log.cc:927] Time spent T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
W20260709 12:24:31.824090 14144 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.995s	user 0.007s	sys 0.005s
I20260709 12:24:31.909605 14148 consensus_queue.cc:1243] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [LEADER]: Peer 7518bdeb78f24e67a530754ae48547eb log is divergent from this leader: its last log entry 9.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:24:31.907128 14186 consensus_queue.cc:1048] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:24:31.880622 14012 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.273s	user 0.004s	sys 0.016s
I20260709 12:24:31.786317 14052 consensus_queue.cc:1059] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
W20260709 12:24:31.936667 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 110360us
I20260709 12:24:31.828337 14172 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:24:31.938889 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 236240us
W20260709 12:24:32.005659 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:32.006088 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:32.006490 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.881560 14177 raft_consensus.cc:697] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:24:31.906795 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 116980us
I20260709 12:24:31.884925 14019 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:31.977835 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.939348 14170 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.001961 14015 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:32.003916 11643 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:32.052413 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 48572.4us
I20260709 12:24:32.053333 11643 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
W20260709 12:24:31.950767 14144 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.122s	user 0.007s	sys 0.005s
I20260709 12:24:32.029771 11125 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
W20260709 12:24:32.047351 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 400239us
W20260709 12:24:32.047873 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 371572us
I20260709 12:24:31.994845 14012 raft_consensus.cc:697] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:32.004810 14172 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.073292 10975 raft_consensus.cc:1240] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:32.073432 14161 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.071362 14015 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:32.095898 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1978) took 1582 ms. Trace:
I20260709 12:24:32.096431 14015 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:32.075102 14031 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:31.949441 13762 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:32.076268 14104 raft_consensus.cc:2749] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:32.062077 14170 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:32.077389 13410 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:32.051900 14019 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:32.050597 14005 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:32.078711 14178 log.cc:927] Time spent T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:24:32.078933 11134 raft_consensus.cc:1275] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:32.053575 14158 consensus_queue.cc:1048] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:24:32.080116 11131 raft_consensus.cc:1275] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:24:32.081408 11133 raft_consensus.cc:1275] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:32.082458 11132 raft_consensus.cc:1275] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:24:32.082842 14183 log.cc:927] Time spent T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 12:24:32.149880 11134 raft_consensus.cc:1275] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:24:32.084189 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.032239 14189 raft_consensus.cc:3055] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:32.153151 14189 raft_consensus.cc:740] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:32.153620 14017 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.060912 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:31.963802 14192 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.087949 11128 raft_consensus.cc:1240] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:31.825454 14028 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:32.154601 13977 consensus_queue.cc:1059] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:32.156561 14028 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:32.157048 14181 log.cc:927] Time spent T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.217s	user 0.000s	sys 0.000s
I20260709 12:24:32.157189 11025 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:32.124313 14015 raft_consensus.cc:2749] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:32.158535 13962 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:32.071023 14176 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:32.072348 14148 raft_consensus.cc:3055] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:32.072522 10982 raft_consensus.cc:1240] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:32.154177 14017 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:32.087540 14144 raft_consensus.cc:697] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:31.945487 14118 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.945282 14164 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:32.096341 11129 rpcz_store.cc:276] 0709 12:24:30.513109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.862625 (+349516us) service_pool.cc:224] Handling call
0709 12:24:30.862918 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.878531 (+ 15613us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:30.921903 (+ 43372us) log.cc:844] Serialized 14 byte log entry
0709 12:24:31.236416 (+314513us) log.cc:844] Serialized 14 byte log entry
0709 12:24:31.237675 (+  1259us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:31.237731 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:31.237781 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.095639 (+857858us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b540012d254. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:32.095703 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.095824 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91481,"prepare.queue_time_us":66215,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":55,"raft.queue_time_us":3450,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":9862,"spinlock_wait_cycles":94458112,"thread_start_us":303490,"threads_started":1,"wal-append.queue_time_us":394550}
W20260709 12:24:32.160441 10949 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 1.612s (SENT) [suppressed 37 similar messages]
I20260709 12:24:31.939200 14179 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:32.181313 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 297239us
W20260709 12:24:32.193306 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 140060us
I20260709 12:24:32.098552 14172 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:32.219287 11643 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
W20260709 12:24:32.216253 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 209207us
W20260709 12:24:32.221378 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 57174.2us
I20260709 12:24:32.224864 11098 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:32.252000 11131 raft_consensus.cc:1275] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:32.139815 14031 consensus_queue.cc:1048] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.082s
W20260709 12:24:32.289876 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 61992.9us
I20260709 12:24:32.220799 14176 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:32.253307 11052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 421) took 1242 ms. Trace:
I20260709 12:24:32.212339 14148 raft_consensus.cc:740] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:32.295359 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:32.296859 11128 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:32.297406 11674 raft_consensus.cc:1275] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:32.293406 11052 rpcz_store.cc:276] 0709 12:24:31.010576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.089666 (+ 79090us) service_pool.cc:224] Handling call
0709 12:24:31.127518 (+ 37852us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:31.252371 (+124853us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:31.265201 (+ 12830us) log.cc:844] Serialized 14 byte log entry
0709 12:24:31.702605 (+437404us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:31.708395 (+  5790us) log.cc:844] Serialized 26 byte log entry
0709 12:24:31.708554 (+   159us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:31.708588 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.708667 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:32.253064 (+544397us) raft_consensus.cc:1685] finished
0709 12:24:32.253085 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.253235 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38996,"prepare.queue_time_us":26089,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":120552,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":9041,"thread_start_us":508051,"threads_started":2,"wal-append.queue_time_us":496357}
W20260709 12:24:32.233521 14184 log.cc:927] Time spent T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.075s	user 0.000s	sys 0.005s
I20260709 12:24:32.166663 14150 consensus_queue.cc:1059] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.135s
I20260709 12:24:32.254006 14105 raft_consensus.cc:2749] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:32.144065 14161 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:32.299082 14178 log.cc:927] Time spent T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:24:32.315363 14212 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:32.254276 14201 consensus_queue.cc:1048] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 12:24:32.317833 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:32.343575 11674 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:32.295369 14130 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:32.234166 14186 consensus_queue.cc:1048] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.084s
W20260709 12:24:32.329663 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 286266us
I20260709 12:24:32.337033 11128 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
W20260709 12:24:32.320698 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 161803us
I20260709 12:24:32.287863 13988 consensus_queue.cc:1048] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:24:32.223472 13962 raft_consensus.cc:697] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:32.368868 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 1983) took 1837 ms. Trace:
I20260709 12:24:32.313004 13977 raft_consensus.cc:3055] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:32.365729 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:32.368669 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:32.384972 11674 raft_consensus.cc:2393] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 10: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:32.369277 11126 rpcz_store.cc:276] 0709 12:24:30.531624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.869184 (+337560us) service_pool.cc:224] Handling call
0709 12:24:30.869479 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:30.876587 (+  7108us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.876620 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:30.877123 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 12:24:31.677870 (+800747us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:31.700468 (+ 22598us) log.cc:844] Serialized 14 byte log entry
0709 12:24:31.700701 (+   233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.700776 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:32.368643 (+667867us) raft_consensus.cc:1685] finished
0709 12:24:32.368674 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.368807 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22436,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":2004,"raft.queue_time_us":8384,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":85,"thread_start_us":800380,"threads_started":1,"wal-append.queue_time_us":942317}
I20260709 12:24:32.371628 14105 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.372223 14179 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:32.373138 14161 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:32.373360 14194 log.cc:927] Time spent T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 12:24:32.373723 14207 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:32.374332 14220 consensus_queue.cc:1048] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:24:32.378691 14188 log.cc:927] Time spent T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
W20260709 12:24:32.379585 14203 log.cc:927] Time spent T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:24:32.380182 13967 consensus_queue.cc:1048] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:32.224220 14192 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:32.216243 14177 consensus_queue.cc:237] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:32.383176 11024 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
W20260709 12:24:32.471824 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:32.472476 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 89401.5us
I20260709 12:24:32.473634 11024 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:24:32.386155 11673 raft_consensus.cc:3055] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:32.233382 14118 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:32.358500 14186 consensus_queue.cc:1243] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer 7518bdeb78f24e67a530754ae48547eb log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 12:24:32.368630 14198 log.cc:927] Time spent T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:24:32.466629 14031 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:32.365505 14121 consensus_meta.cc:287] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.971s	user 0.009s	sys 0.002s
I20260709 12:24:32.390969 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:32.369325 14034 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:32.384440 13977 raft_consensus.cc:740] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:32.362751 14130 consensus_queue.cc:1048] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:24:32.474545 11673 raft_consensus.cc:740] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:24:32.487541 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 344934us
I20260709 12:24:32.300786 14012 consensus_queue.cc:237] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:32.510247 10983 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 348) took 4459 ms (client timeout 4648 ms). Trace:
W20260709 12:24:32.510785 10983 rpcz_store.cc:269] 0709 12:24:28.037645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.760268 (+1722623us) service_pool.cc:224] Handling call
0709 12:24:32.496514 (+2736246us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400333454. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:32.496678 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2437645696}
I20260709 12:24:32.511948 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:32.513185 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:32.513484 11643 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:32.533715 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.468549 14207 raft_consensus.cc:697] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:32.433881 14179 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.354586 14212 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:32.497056 10976 raft_consensus.cc:1240] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 6. Current term is 8. Ops: [6.7-6.7]
I20260709 12:24:32.501713 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:32.553421 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 47625.7us
I20260709 12:24:32.382009 14144 consensus_queue.cc:237] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:32.558194 11678 raft_consensus.cc:2376] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10. Re-sending same reply.
I20260709 12:24:32.418430 14105 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:32.562628 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:32.567008 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 261451us
I20260709 12:24:32.559006 10948 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:32.496819 14019 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:32.572991 10983 raft_consensus.cc:2376] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6. Re-sending same reply.
I20260709 12:24:32.475795 14196 consensus_queue.cc:1048] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.131s
I20260709 12:24:32.533514 14170 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:32.494477 14201 consensus_queue.cc:1048] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:24:32.587335 11674 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:32.560396 14017 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:32.579444 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 353038us
I20260709 12:24:32.497381 14031 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:32.597652 11025 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:32.571185 14214 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:32.503198 14121 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:32.615762 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:32.565901 14179 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:32.496482 13962 consensus_queue.cc:237] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:32.429919 14148 consensus_queue.cc:260] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:32.616530 10983 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:24:32.620993 14227 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:32.622241 14200 log.cc:927] Time spent T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 12:24:32.621618 14227 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:32.623894 14209 log.cc:927] Time spent T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:24:32.624220 14217 consensus_queue.cc:1059] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:32.625126 14227 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:32.626170 14230 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.603012 14201 consensus_queue.cc:1243] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:32.603983 14170 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:32.564090 14193 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:24:32.631955 11643 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:32.625700 14227 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:32.633874 10979 raft_consensus.cc:1240] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:32.629607 14143 consensus_meta.cc:287] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.865s	user 0.008s	sys 0.003s
I20260709 12:24:32.587818 13977 consensus_queue.cc:260] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:32.629690 13762 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:32.626703 14230 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:32.622149 14206 consensus_queue.cc:1048] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.180s
I20260709 12:24:32.633901 14130 raft_consensus.cc:2804] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:32.640765 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:32.872397 10983 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:32.873445 14230 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:32.747272 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:32.871013 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 397434us
I20260709 12:24:32.663636 10980 raft_consensus.cc:1240] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:32.650200 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2050) took 3134 ms. Trace:
I20260709 12:24:32.881155 10975 rpcz_store.cc:276] 0709 12:24:29.516200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.962273 (+1446073us) service_pool.cc:224] Handling call
0709 12:24:30.962603 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.090521 (+1127918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.649897 (+559376us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540022ae54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:32.650129 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2553852800}
I20260709 12:24:32.888396 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:32.889220 10975 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
I20260709 12:24:32.896520 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2047) took 3417 ms. Trace:
I20260709 12:24:32.897068 10980 rpcz_store.cc:276] 0709 12:24:29.478820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.902787 (+1423967us) service_pool.cc:224] Handling call
0709 12:24:32.663196 (+1760409us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b5800003698. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90dbdfc0 00007f8f90da8929 00007f8f90da83d2 00007f8f8a31fbd4
0709 12:24:32.663434 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.880314 (+216880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.896457 (+ 16143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58784000}
I20260709 12:24:32.898499 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:32.899360 10980 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:32.905053 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:32.905175 11675 raft_consensus.cc:1217] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 2.5->[3.6-8.9]   Dedup: 3.6->[4.7-8.9]
I20260709 12:24:32.905795 11675 pending_rounds.cc:85] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Aborting all ops after (but not including) 6
I20260709 12:24:32.906077 11675 pending_rounds.cc:107] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:24:32.906582 11675 raft_consensus.cc:2889] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:32.907579 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:32.908243 10975 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:32.909457 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.913105 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:32.874622 13977 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:32.906076 13739 consensus_meta.cc:287] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.969s	user 0.009s	sys 0.002s
I20260709 12:24:32.916705 10980 raft_consensus.cc:2393] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 8: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:32.917232 13739 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.917728 13739 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:32.647951 14222 raft_consensus.cc:2804] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:32.917906 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:33.006163 10983 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:32.645375 14223 raft_consensus.cc:2749] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:32.880229 14118 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:32.933483 10975 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:33.018998 11052 raft_consensus.cc:1275] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:33.019376 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:33.020004 10975 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:32.967365 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 372706us
W20260709 12:24:32.968001 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 409033us
I20260709 12:24:33.014597 10980 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 4.
I20260709 12:24:33.054417 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:33.055809 10980 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:32.941347 14191 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.874079 14230 consensus_queue.cc:1059] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.137s
I20260709 12:24:33.056586 11126 raft_consensus.cc:1275] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:32.648605 14192 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:33.056990 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:33.026929 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:33.058394 10983 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:24:33.055186 10948 leader_election.cc:400] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 6. Current term is 7.
I20260709 12:24:33.059415 10948 leader_election.cc:403] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:24:33.053834 11098 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:32.909106 14179 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:33.059690 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.063174 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:33.064816 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:32.918923 14219 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.065631 11126 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:32.918383 14206 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.940762 14121 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:33.012269 14222 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:33.068252 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:33.075598 11125 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:33.016449 13762 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.058998 13977 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.070742 11098 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:33.017964 14031 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:32.913924 14130 raft_consensus.cc:697] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:33.053994 14193 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.065610 14015 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.064615 14152 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:33.077970 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:33.076946 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:32.630831 14207 consensus_queue.cc:237] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:33.067651 14143 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:33.260069 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 206479us
I20260709 12:24:33.081501 11128 raft_consensus.cc:1275] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:24:33.300030 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 229350us
I20260709 12:24:33.072392 13967 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.300341 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 385) took 1148 ms. Trace:
W20260709 12:24:33.131402 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 58164.7us
I20260709 12:24:33.311676 10980 rpcz_store.cc:276] 0709 12:24:32.152106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.072057 (+919951us) service_pool.cc:224] Handling call
0709 12:24:33.300277 (+228220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.306756 11098 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:33.313263 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:33.234643 10975 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:33.309540 10948 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:33.300944 10983 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:33.316524 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:33.316958 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:33.067150 14224 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:33.318437 10975 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:33.326066 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:33.326956 10975 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:33.334261 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:33.335026 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:33.335316 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:33.336730 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:33.336347 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:33.314352 11025 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:33.134845 14179 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 6. Current term is 7.
I20260709 12:24:33.237579 14196 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:33.158221 14234 log.cc:927] Time spent T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
W20260709 12:24:33.204624 14172 consensus_meta.cc:287] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.917s	user 0.003s	sys 0.012s
I20260709 12:24:33.423334 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:33.423038 14034 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.437379 14005 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:33.438180 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:33.437965 14005 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:33.439781 11098 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:33.440405 14112 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:33.440598 14038 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.080770 14118 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.430182 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:33.371274 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:33.348197 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 389) took 1190 ms. Trace:
I20260709 12:24:33.134311 13762 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:33.434332 14196 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:33.164448 13739 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:33.165125 14212 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:33.077754 14222 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:33.312346 14214 consensus_meta.cc:287] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.683s	user 0.010s	sys 0.000s
I20260709 12:24:33.442210 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 381) took 3116 ms. Trace:
I20260709 12:24:33.440901 14078 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:33.275518 14226 log.cc:927] Time spent T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:24:33.133754 14230 raft_consensus.cc:3055] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:33.443348 11098 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:33.212073 14240 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.082732 14165 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:33.311091 14015 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:33.162994 14245 raft_consensus.cc:2804] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:33.445652 10980 rpcz_store.cc:276] 0709 12:24:32.157962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.316247 (+1158285us) service_pool.cc:224] Handling call
0709 12:24:33.348113 (+ 31866us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.446434 10983 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:33.133908 14105 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:33.120409 13962 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:33.196954 14227 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
W20260709 12:24:33.426123 14177 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.004s	sys 0.014s
I20260709 12:24:33.075506 14206 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:33.448959 14038 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:33.371332 14031 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:33.546200 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:33.538955 10978 raft_consensus.cc:1240] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:33.521950 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:33.551617 11097 leader_election.cc:336] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 2.813s (SENT)
I20260709 12:24:33.347961 14155 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:33.254863 14239 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.432988 14130 consensus_queue.cc:237] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:33.311043 14152 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:33.063316 14191 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:33.072738 14219 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:33.616439 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 2086) took 1015 ms. Trace:
W20260709 12:24:33.555184 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 111887us
I20260709 12:24:33.656925 10983 rpcz_store.cc:276] 0709 12:24:32.601081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.315628 (+714547us) service_pool.cc:224] Handling call
0709 12:24:33.616375 (+300747us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.659590 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:33.311833 14237 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:33.440740 13948 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:33.317627 14223 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.313290 13977 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:33.440344 14005 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:33.333741 14011 consensus_queue.cc:1048] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.326s
I20260709 12:24:33.642151 14227 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:33.379596 14224 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:33.635676 13962 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:33.635926 14177 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.009s	sys 0.020s
I20260709 12:24:33.440922 14112 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:33.319141 14193 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:33.444964 14136 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:33.544147 14118 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:24:33.436878 14172 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:33.555413 14145 consensus_queue.cc:1059] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.158s
I20260709 12:24:33.621747 14212 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:33.554430 14230 raft_consensus.cc:740] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:33.662379 11676 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:33.538749 14121 raft_consensus.cc:2804] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:33.311293 14143 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:33.576761 14214 raft_consensus.cc:2749] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:33.646016 13762 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:33.652169 14038 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:33.651846 14031 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:33.575199 14240 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:33.749604 14031 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:33.651242 14206 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:33.702840 14220 raft_consensus.cc:2804] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:33.758567 14220 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:33.759025 14220 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:33.646878 14196 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:33.572186 14208 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:33.704349 14226 log.cc:927] Time spent T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.073s	user 0.001s	sys 0.001s
I20260709 12:24:33.744069 14219 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:33.578213 14078 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:33.774123 14078 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:33.775740 14191 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:33.776939 13977 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:33.655591 14152 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:33.784780 14031 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:33.615296 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 305795us
W20260709 12:24:33.520450 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 90351us
I20260709 12:24:33.599638 10975 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
W20260709 12:24:33.469718 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.068349 14082 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.069458 14082 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:34.070386 14038 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:24:34.071080 11025 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.012s	sys 0.052s
I20260709 12:24:34.071336 14038 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:34.050182 14191 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:34.073194 14191 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:33.868264 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1348) took 4327 ms. Trace:
I20260709 12:24:33.869740 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2036) took 4557 ms. Trace:
I20260709 12:24:33.871660 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2051) took 4343 ms. Trace:
I20260709 12:24:33.628401 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:34.075173 10978 rpcz_store.cc:276] 0709 12:24:29.527888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.964671 (+1436783us) service_pool.cc:224] Handling call
0709 12:24:31.103338 (+138667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.652365 (+2549027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.871122 (+218757us) spinlock_profiling.cc:243] Waited 2.44 s on lock 0x7b54003bae54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:33.871480 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5600869760}
I20260709 12:24:34.077817 10980 raft_consensus.cc:2410] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:24:34.078886 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:34.079615 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:34.080017 10978 raft_consensus.cc:2393] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 8: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:34.063432 14104 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.074859 10977 rpcz_store.cc:276] 0709 12:24:29.312685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.901878 (+1589193us) service_pool.cc:224] Handling call
0709 12:24:30.947063 (+ 45185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.947259 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:31.088772 (+141513us) log.cc:844] Serialized 14 byte log entry
0709 12:24:31.255426 (+166654us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:31.255483 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:31.255528 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.255607 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.869322 (+2613715us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b540035eb50. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:33.869538 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":142628,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":30370,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":55,"spinlock_wait_cycles":48815360,"thread_start_us":166314,"threads_started":1,"wal-append.queue_time_us":374597,"wal-append.run_cpu_time_us":1732,"wal-append.run_wall_time_us":1039196}
I20260709 12:24:33.873692 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:34.086228 11643 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.039s	sys 0.031s
W20260709 12:24:34.086927 11643 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.039s	sys 0.031s
I20260709 12:24:33.874549 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2058) took 3532 ms. Trace:
W20260709 12:24:34.087527 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 654920us
I20260709 12:24:34.087945 10982 rpcz_store.cc:276] 0709 12:24:30.341913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.687996 (+1346083us) service_pool.cc:224] Handling call
0709 12:24:31.688310 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.212950 (+524640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.873651 (+1660701us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b5400099f54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:33.874014 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":883171584}
I20260709 12:24:34.088776 14031 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:33.652787 11052 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:34.090634 14262 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.091965 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:33.652146 11054 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:24:33.652827 11097 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:33.882647 11128 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:31.759792  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:33.912065 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:34.117338 11023 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.012s	sys 0.018s
I20260709 12:24:34.117718 11134 raft_consensus.cc:2410] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:24:33.913651 11056 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41294 (request call id 1367) took 2813 ms (client timeout 1725 ms). Trace:
I20260709 12:24:33.914670 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:33.915979 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:33.916682 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:33.917433 11057 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41294 (request call id 1369) took 2811 ms (client timeout 1525 ms). Trace:
I20260709 12:24:33.917793 11058 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:31.243922 11130 rpcz_store.cc:276] 0709 12:24:30.179372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.802543 (+623171us) service_pool.cc:224] Handling call
0709 12:24:30.802863 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.803063 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:30.817340 (+ 14277us) log.cc:844] Serialized 14 byte log entry
0709 12:24:31.235100 (+417760us) log.cc:844] Serialized 14 byte log entry
0709 12:24:31.235291 (+   191us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:31.235340 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:31.235398 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.235474 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.235620 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21647,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":212,"spinlock_wait_cycles":7040,"thread_start_us":417075,"threads_started":1}
I20260709 12:24:33.546123 10984 rpcz_store.cc:276] 0709 12:24:30.325846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.611490 (+1285644us) service_pool.cc:224] Handling call
0709 12:24:31.611809 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.612025 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:24:31.612381 (+   356us) log.cc:844] Serialized 14 byte log entry
0709 12:24:33.189612 (+1577231us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b180044c140. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cd9e07 00007f8f91b349a9 00007f8f88cf669b 00007f8f88cf493f 00007f8f88cf6c02 00007f8f8b97e20b 00007f8f8b983d23 00007f8f8b98423a 00007f8f8bdeea2a
0709 12:24:33.441827 (+252215us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:33.441886 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:33.441936 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.442004 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.442148 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":132271,"prepare.queue_time_us":130,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":6209,"raft.queue_time_us":132404,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":95218,"spinlock_wait_cycles":10099968,"thread_start_us":119640,"threads_started":1,"wal-append.queue_time_us":1697110}
W20260709 12:24:33.714022 11674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41762 (request call id 637) took 1324 ms (client timeout 1676 ms). Trace:
I20260709 12:24:33.925904 11678 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:33.928349 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:33.933458 13410 raft_consensus.cc:3055] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:33.671861 13948 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:34.167598 14214 consensus_queue.cc:1059] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:34.168210 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:34.168794 14214 raft_consensus.cc:3055] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:34.169055 11130 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
I20260709 12:24:34.169457 11679 raft_consensus.cc:2393] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 8: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:33.749822 13962 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:34.156878 13410 raft_consensus.cc:740] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:33.436945 14034 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:33.713135 14015 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:33.755820 14112 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:33.752799 14118 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:33.336364 13967 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:33.784683 14170 consensus_meta.cc:287] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 1.150s	user 0.011s	sys 0.001s
W20260709 12:24:34.171006 11674 rpcz_store.cc:269] 0709 12:24:32.389798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.390704 (+   906us) service_pool.cc:224] Handling call
0709 12:24:33.713803 (+1323099us) spinlock_profiling.cc:243] Waited 92.9 ms on lock 0x7b54006757d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:33.713942 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213594368}
I20260709 12:24:34.181299 14170 raft_consensus.cc:2749] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:34.181802 13410 consensus_queue.cc:260] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:34.182422 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 55121.6us
I20260709 12:24:33.754345 14172 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:33.789958 14176 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:33.786067 14193 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:33.938447 14026 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.653056 14155 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:34.192193 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:33.787550 14204 log.cc:927] Time spent T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 1.566s	user 0.001s	sys 0.002s
I20260709 12:24:33.824743 14208 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:24:33.754889 14224 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:33.779462 14222 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:33.804914 14220 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:34.199059 14208 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:34.191687 13410 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:34.200683 14220 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:33.713487 14223 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:34.201494 11130 raft_consensus.cc:2393] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 7: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:33.753640 14227 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:33.828140 14230 consensus_queue.cc:260] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:33.653362 14239 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:34.206878 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:33.753597 14240 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:34.212888 11645 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:33.915868 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:33.974627 14206 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:33.992733 14237 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:34.214641 14206 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:34.215337 14237 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:33.911880 10880 catalog_manager.cc:5697] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 3 to 6, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 6 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:24:34.020942 14219 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:34.047086 14078 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.067081 14205 consensus_queue.cc:1048] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:24:34.073735 14143 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:34.229282 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2052) took 4676 ms. Trace:
I20260709 12:24:34.229775 10979 rpcz_store.cc:276] 0709 12:24:29.552708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.275801 (+1723093us) service_pool.cc:224] Handling call
0709 12:24:31.276145 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.635704 (+1359559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.228768 (+1593064us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54000d9654. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:34.229092 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3121997056}
W20260709 12:24:34.058082 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 53178.4us
W20260709 12:24:34.093560 11025 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.012s	sys 0.053s
I20260709 12:24:34.086704 10983 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:34.102933 10982 raft_consensus.cc:1275] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:34.091812 14262 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:34.114516 14038 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:34.086362 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 427941us
W20260709 12:24:34.115180 14199 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.137s	user 0.000s	sys 0.014s
W20260709 12:24:34.117933 11023 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.012s	sys 0.018s
I20260709 12:24:34.118741 10980 raft_consensus.cc:2410] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
W20260709 12:24:34.118223 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.105186 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2071) took 2782 ms. Trace:
W20260709 12:24:34.118163 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 566427us
I20260709 12:24:34.075479 10976 rpcz_store.cc:276] 0709 12:24:29.540490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.084949 (+1544459us) service_pool.cc:224] Handling call
0709 12:24:32.496828 (+1411879us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:32.560702 (+ 63874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.867509 (+1306807us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400333450. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:33.867911 (+   402us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3246038912}
I20260709 12:24:34.118643 11052 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
W20260709 12:24:34.120711 11057 rpcz_store.cc:269] 0709 12:24:31.105870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.106034 (+   164us) service_pool.cc:224] Handling call
0709 12:24:33.917006 (+2810972us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b54000b68d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:33.917225 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1376210816}
W20260709 12:24:34.120126 11056 rpcz_store.cc:269] 0709 12:24:31.100421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.100573 (+   152us) service_pool.cc:224] Handling call
0709 12:24:33.913014 (+2812441us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b54002ddf54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:33.913302 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1154784000}
I20260709 12:24:34.115743 14245 raft_consensus.cc:697] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 8 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:34.149583 10978 raft_consensus.cc:1275] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:24:34.152953 11131 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.011s	sys 0.017s
I20260709 12:24:34.066141 14121 raft_consensus.cc:697] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:34.162405 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:34.081593 14104 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:34.171605 11053 raft_consensus.cc:2410] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:24:34.169778 13948 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:34.171870 11127 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:34.172461 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:24:34.170006 11679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41774 (request call id 495) took 2544 ms (client timeout 1525 ms). Trace:
I20260709 12:24:34.191867 14026 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:33.518046 14244 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:34.194880 14155 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:34.353066 14052 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:34.211124 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 386) took 2004 ms. Trace:
I20260709 12:24:34.354511 10975 rpcz_store.cc:276] 0709 12:24:32.152371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.325771 (+1173400us) service_pool.cc:224] Handling call
0709 12:24:34.147831 (+822060us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.355849 14164 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:34.356325 10975 raft_consensus.cc:1240] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 7 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:34.350380 14208 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.357103 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1408) took 2206 ms. Trace:
I20260709 12:24:34.214715 11060 raft_consensus.cc:2368] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 7. Current term is 8.
I20260709 12:24:34.176127 14214 raft_consensus.cc:740] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:34.217005 14046 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:34.362556 11134 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:34.358181 10975 rpcz_store.cc:276] 0709 12:24:32.150323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.355568 (+2205245us) service_pool.cc:224] Handling call
0709 12:24:34.356033 (+   465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.356806 (+   773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.357030 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.230650 14189 consensus_queue.cc:260] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:34.316172 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 232265us
W20260709 12:24:34.359302 11131 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.015s	sys 0.021s
I20260709 12:24:34.339442 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2076) took 2691 ms. Trace:
W20260709 12:24:34.317814 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 71006.5us
I20260709 12:24:34.340893 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 2014) took 1237 ms. Trace:
I20260709 12:24:34.247216 11130 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 5.
I20260709 12:24:34.368137 11127 rpcz_store.cc:276] 0709 12:24:33.098503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.915439 (+816936us) service_pool.cc:224] Handling call
0709 12:24:34.335609 (+420170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.250330 10983 raft_consensus.cc:1275] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:34.245368 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2074) took 2723 ms. Trace:
I20260709 12:24:34.370126 10982 rpcz_store.cc:276] 0709 12:24:31.509056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.089249 (+2580193us) service_pool.cc:224] Handling call
0709 12:24:34.089815 (+   566us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.232312 (+142497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.232520 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.234660 10977 rpcz_store.cc:276] 0709 12:24:31.311873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.084397 (+2772524us) service_pool.cc:224] Handling call
0709 12:24:34.085018 (+   621us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.085740 (+   722us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:34.085779 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.085843 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:34.085887 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.085952 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.086082 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1858,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":225}
I20260709 12:24:34.253613 11023 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:34.330039 14239 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:34.247365 14114 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.290s	user 0.000s	sys 0.022s
I20260709 12:24:34.316242 14172 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:34.348677 14153 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:34.349298 14191 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:34.380934 14153 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:34.352293 14078 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:34.336790 11679 rpcz_store.cc:269] 0709 12:24:31.625123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.646949 (+ 21826us) service_pool.cc:224] Handling call
0709 12:24:33.927824 (+2280875us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b5800004598. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90daa0a0 00007f8f90da9984 00007f8f8a3246d4 00007f8f8a324662
0709 12:24:34.169854 (+242030us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5946752}
I20260709 12:24:34.349790 11098 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:34.330709 14038 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.226181 14082 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:34.246421 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 932052us
I20260709 12:24:34.367302 10978 rpcz_store.cc:276] 0709 12:24:31.648097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.148443 (+2500346us) service_pool.cc:224] Handling call
0709 12:24:34.149063 (+   620us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.336562 (+187499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.339327 (+  2765us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.366673 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:34.254071 14017 consensus_queue.cc:1059] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.117s
W20260709 12:24:34.377816 14114 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.503s	user 0.000s	sys 0.033s
I20260709 12:24:34.372299 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:34.372277 10976 raft_consensus.cc:1240] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:34.387537 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2077) took 2561 ms. Trace:
I20260709 12:24:34.387709 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1407) took 2237 ms. Trace:
I20260709 12:24:34.245992 14237 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:34.347579 14199 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.431s	user 0.000s	sys 0.025s
I20260709 12:24:34.372092 14214 consensus_queue.cc:260] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:34.375128 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:24:34.375373 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 121931us
I20260709 12:24:34.373564 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:34.376701 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1403) took 2221 ms. Trace:
I20260709 12:24:34.356715 14164 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:34.397159 14165 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:34.397756 14165 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:34.400120 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 2018) took 1300 ms. Trace:
I20260709 12:24:34.400630 11128 rpcz_store.cc:276] 0709 12:24:33.099491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.370990 (+271499us) service_pool.cc:224] Handling call
0709 12:24:34.399839 (+1028849us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b5400031e54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:34.400016 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1019588992}
I20260709 12:24:34.380342 14168 raft_consensus.cc:2804] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:34.403111 14038 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:34.403385 14015 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:34.254721 13228 consensus_queue.cc:1059] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.126s
I20260709 12:24:34.396090 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:34.362589 14046 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:34.405859 11675 raft_consensus.cc:2393] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 8: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:34.388159 10976 rpcz_store.cc:276] 0709 12:24:32.150042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.363549 (+2213507us) service_pool.cc:224] Handling call
0709 12:24:34.372070 (+  8521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.387431 (+ 15361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.387648 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.393539 10983 rpcz_store.cc:276] 0709 12:24:32.148724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.245713 (+2096989us) service_pool.cc:224] Handling call
0709 12:24:34.249715 (+  4002us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.369562 (+119847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.369776 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.387977 10984 rpcz_store.cc:276] 0709 12:24:31.648435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.151556 (+2503121us) service_pool.cc:224] Handling call
0709 12:24:34.152124 (+   568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.185631 (+ 33507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.185666 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.189244 (+  3578us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:34.209776 (+ 20532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.209851 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.209984 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22847,"raft.queue_time_us":34079,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":15642}
I20260709 12:24:34.319012 14219 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:34.395402 11023 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:34.395406 14172 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:34.402805 11053 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
I20260709 12:24:34.390864 11097 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:34.403007 14168 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:34.401988 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:34.353871 14052 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:34.435134 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:34.408351 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 58739.6us
I20260709 12:24:34.437189 14237 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:34.437794 11681 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:24:34.437942 14015 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.439359 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1411) took 2288 ms. Trace:
I20260709 12:24:34.408461 14046 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:34.440248 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 71799us
I20260709 12:24:34.386292 13967 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:34.446504 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 51301.2us
I20260709 12:24:34.408669 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:24:34.440963 14255 log.cc:927] Time spent T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
I20260709 12:24:34.408185 14017 consensus_queue.cc:1243] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer bc01179655564f29b83babe396377cbb log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:24:34.456494 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.405886 14038 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:34.447878 10975 rpcz_store.cc:276] 0709 12:24:32.151091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.374147 (+2223056us) service_pool.cc:224] Handling call
0709 12:24:34.420301 (+ 46154us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.438924 (+ 18623us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:34.438962 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.439027 (+    65us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:34.439062 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.439135 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.439295 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5401}
I20260709 12:24:34.353842 14244 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:34.437810 10948 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:34.442440 14168 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:34.458344 14114 raft_consensus.cc:2804] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:34.456681 14230 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:34.459990 14078 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:34.479847 11643 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:34.476101 14114 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:34.482551 14114 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:34.483814 14121 consensus_queue.cc:237] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:34.486238 14143 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:34.404971 13228 raft_consensus.cc:3055] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:34.444785 14237 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:34.409186 14222 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:34.453344 14239 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:34.470836 11128 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
W20260709 12:24:34.538241 14261 log.cc:927] Time spent T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 12:24:34.421327 14208 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:34.474992 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:34.478948 10984 raft_consensus.cc:1240] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:34.531639 14277 log.cc:927] Time spent T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
W20260709 12:24:34.534883 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 57720.7us
I20260709 12:24:34.535707 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 384) took 2383 ms. Trace:
I20260709 12:24:34.591840 10976 rpcz_store.cc:276] 0709 12:24:32.151833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.418720 (+2266887us) service_pool.cc:224] Handling call
0709 12:24:34.476756 (+ 58036us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.535296 (+ 58540us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.535323 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.535399 (+    76us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:34.535440 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.535516 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.535641 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:34.534664 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.468724 14189 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:34.554682 14237 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:34.583876 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:34.534546 14214 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:34.583623 11098 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:34.546722 13228 raft_consensus.cc:740] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:34.594213 11054 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:34.538569 14223 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:34.533994 14206 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:34.569185 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 160198us
I20260709 12:24:34.598776 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 390) took 2226 ms. Trace:
I20260709 12:24:34.554320 14239 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:34.594961 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 391) took 2222 ms. Trace:
I20260709 12:24:34.607474 10984 rpcz_store.cc:276] 0709 12:24:32.372854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.407259 (+2034405us) service_pool.cc:224] Handling call
0709 12:24:34.478681 (+ 71422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.594710 (+116029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.594904 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.602399 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2012) took 1493 ms. Trace:
I20260709 12:24:34.606519 11130 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:34.610778 11134 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:24:34.605150 10983 rpcz_store.cc:276] 0709 12:24:32.372560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.418618 (+2046058us) service_pool.cc:224] Handling call
0709 12:24:34.532081 (+113463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.532475 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:24:34.532859 (+   384us) log.cc:844] Serialized 14 byte log entry
0709 12:24:34.598385 (+ 65526us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.598444 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:34.598495 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.598570 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.598709 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6196,"prepare.queue_time_us":1562,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":54,"raft.queue_time_us":15897,"thread_start_us":51754,"threads_started":1}
I20260709 12:24:34.613030 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:34.615782 11645 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:34.591501 14205 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:34.550280 14015 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:34.615185 11127 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:34.618134 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 430572us
I20260709 12:24:34.610519 14239 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:34.668545 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:34.713752 11134 raft_consensus.cc:2393] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 9: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:34.606125 14104 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:34.631927 11644 leader_election.cc:400] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 7. Current term is 8.
W20260709 12:24:34.679463 14279 log.cc:927] Time spent T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 12:24:34.679296 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:34.679519 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.686062 10975 raft_consensus.cc:3055] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:34.690634 14206 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:34.691557 11023 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:34.696718 14264 log.cc:927] Time spent T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.116s	user 0.005s	sys 0.008s
I20260709 12:24:34.749913 13228 consensus_queue.cc:260] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:34.615787 14031 raft_consensus.cc:2749] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:34.608392 11131 rpcz_store.cc:276] 0709 12:24:33.097764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.097900 (+   136us) service_pool.cc:224] Handling call
0709 12:24:33.307091 (+209191us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:33.319688 (+ 12597us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.319732 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:33.320403 (+   671us) log.cc:844] Serialized 52 byte log entry
0709 12:24:34.419935 (+1099532us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:34.473373 (+ 53438us) log.cc:844] Serialized 14 byte log entry
0709 12:24:34.540345 (+ 66972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.586680 (+ 46335us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:34.589397 (+  2717us) raft_consensus.cc:1685] finished
0709 12:24:34.589413 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.591491 (+  2078us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12283,"prepare.queue_time_us":17569,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":75,"raft.queue_time_us":93499,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":61770,"spinlock_wait_cycles":97664,"thread_start_us":846475,"threads_started":1,"wal-append.queue_time_us":718378}
I20260709 12:24:34.753916 11680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41774 (request call id 502) took 1418 ms. Trace:
W20260709 12:24:34.752305 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 287848us
I20260709 12:24:34.795511 11128 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:34.795639 10975 raft_consensus.cc:740] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
W20260709 12:24:34.679466 14271 log.cc:927] Time spent T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 12:24:34.751502 14286 log.cc:927] Time spent T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:24:34.751627 14172 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:34.821792 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:34.750538 14219 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:34.823333 10983 raft_consensus.cc:1275] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:34.824018 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2081) took 2337 ms. Trace:
I20260709 12:24:34.824424 10983 rpcz_store.cc:276] 0709 12:24:32.487001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.613958 (+2126957us) service_pool.cc:224] Handling call
0709 12:24:34.808796 (+194838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.823755 (+ 14959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.823959 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.792260 14262 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:34.802543 14206 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:24:34.839725 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.841372 10948 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:34.842818 13721 raft_consensus.cc:2804] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:34.843276 14208 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:34.843487 13721 raft_consensus.cc:697] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 7 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:34.840432 14206 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:34.844796 13721 consensus_queue.cc:237] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:34.846516 10976 raft_consensus.cc:1240] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:24:34.847254 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 394) took 2473 ms. Trace:
I20260709 12:24:34.847563 10976 rpcz_store.cc:276] 0709 12:24:32.373661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.592894 (+2219233us) service_pool.cc:224] Handling call
0709 12:24:34.783936 (+191042us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:34.846979 (+ 63043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.847197 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.843317 10948 leader_election.cc:400] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8.
I20260709 12:24:34.848497 10948 leader_election.cc:403] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:24:34.848791 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 157375us
I20260709 12:24:34.742291 14114 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:34.840072 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:34.853564 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:34.854074 11128 raft_consensus.cc:2410] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:24:34.810439 11680 rpcz_store.cc:276] 0709 12:24:33.335530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.336247 (+   717us) service_pool.cc:224] Handling call
0709 12:24:33.336544 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:33.336937 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:33.429003 (+ 92066us) log.cc:844] Serialized 14 byte log entry
0709 12:24:33.450371 (+ 21368us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:33.619728 (+169357us) log.cc:844] Serialized 26 byte log entry
0709 12:24:33.619886 (+   158us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:33.619921 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.619995 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:34.753517 (+1133522us) raft_consensus.cc:1685] finished
0709 12:24:34.753555 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.753737 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1950,"prepare.queue_time_us":93594,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":64,"raft.queue_time_us":13238,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":96312,"spinlock_wait_cycles":21789056,"thread_start_us":11892,"threads_started":1,"wal-append.queue_time_us":638171}
I20260709 12:24:34.859938 11134 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
W20260709 12:24:34.860906 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 274934us
I20260709 12:24:34.818641 14082 raft_consensus.cc:2749] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:34.864130 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2010) took 1528 ms. Trace:
I20260709 12:24:34.855754 13895 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:34.867960 11025 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:34.869136 13631 consensus_queue.cc:1048] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:34.870916 11023 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:34.875015 14015 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:34.882246 13895 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:34.869027 14231 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:34.882431 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 343500us
I20260709 12:24:34.850472 14026 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:34.900187 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 285395us
I20260709 12:24:34.899420 11131 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:24:34.902715 11127 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:34.722084 14245 consensus_queue.cc:237] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:34.908299 11645 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:34.894742 13895 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:34.910880 14223 raft_consensus.cc:2749] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8.
I20260709 12:24:34.910167 10975 consensus_queue.cc:260] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:34.912935 10975 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:34.910583 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 53642.6us
I20260709 12:24:34.915917 11054 raft_consensus.cc:2410] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:24:34.876920 11126 rpcz_store.cc:276] 0709 12:24:33.075008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.075259 (+   251us) service_pool.cc:224] Handling call
0709 12:24:33.075580 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:33.106407 (+ 30827us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.106443 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:33.107032 (+   589us) log.cc:844] Serialized 26 byte log entry
0709 12:24:33.444006 (+336974us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:33.444052 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.444150 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:34.538503 (+1094353us) raft_consensus.cc:1685] finished
0709 12:24:34.584165 (+ 45662us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.603484 (+ 19319us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":166816,"raft.queue_time_us":88480,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":139590,"thread_start_us":336557,"threads_started":1,"wal-append.queue_time_us":970615}
I20260709 12:24:34.861780 14052 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:34.848477 14205 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:34.894572 14148 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:34.923978 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2083) took 2430 ms. Trace:
I20260709 12:24:34.927238 10983 rpcz_store.cc:276] 0709 12:24:32.493504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.825136 (+2331632us) service_pool.cc:224] Handling call
0709 12:24:34.864286 (+ 39150us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.923610 (+ 59324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.923643 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.923694 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:34.923727 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.923793 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.923918 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97}
I20260709 12:24:34.941256 11681 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:34.928458 13631 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:34.942911 10976 raft_consensus.cc:1240] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 9. Current term is 10. Ops: [7.7-9.8]
I20260709 12:24:34.943037 13631 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:34.943497 13631 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:34.943739 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1415) took 2374 ms. Trace:
I20260709 12:24:34.944161 10976 rpcz_store.cc:276] 0709 12:24:32.569097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.855995 (+2286898us) service_pool.cc:224] Handling call
0709 12:24:34.929665 (+ 73670us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:34.943413 (+ 13748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.943677 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.945361 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:34.917440 14231 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:34.950929 11098 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:34.951602 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:34.957613 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 61854.9us
W20260709 12:24:34.958561 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 115504us
I20260709 12:24:34.960613 11680 raft_consensus.cc:1275] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:24:34.961256 14222 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:34.961684 14222 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:34.962054 14222 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:34.962407 11097 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:34.965734 11134 pending_rounds.cc:85] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 3
I20260709 12:24:34.966091 11134 pending_rounds.cc:107] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:24:34.966398 11134 raft_consensus.cc:2889] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:34.967168 14100 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:34.968063 10980 raft_consensus.cc:1275] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 12:24:34.968466 10980 pending_rounds.cc:85] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 3
I20260709 12:24:34.968696 10980 pending_rounds.cc:107] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 12:24:34.968905 10980 raft_consensus.cc:2889] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:34.969627 14143 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.970139 14143 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:34.972251 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2078) took 2921 ms. Trace:
I20260709 12:24:34.972637 10979 rpcz_store.cc:276] 0709 12:24:32.051228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.231040 (+2179812us) service_pool.cc:224] Handling call
0709 12:24:34.378248 (+147208us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:24:34.478638 (+100390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.478678 (+    40us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:24:34.531794 (+ 53116us) log.cc:844] Serialized 78 byte log entry
0709 12:24:34.580427 (+ 48633us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:34.602337 (+ 21910us) log.cc:844] Serialized 14 byte log entry
0709 12:24:34.613756 (+ 11419us) log.cc:844] Serialized 14 byte log entry
0709 12:24:34.668223 (+ 54467us) log.cc:844] Serialized 14 byte log entry
0709 12:24:34.783404 (+115181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.783488 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:34.971987 (+188499us) raft_consensus.cc:1685] finished
0709 12:24:34.972007 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.972169 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":118533,"prepare.queue_time_us":99430,"prepare.run_cpu_time_us":132,"prepare.run_wall_time_us":47531,"raft.queue_time_us":97855,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":16014,"spinlock_wait_cycles":312739712,"thread_start_us":47266,"threads_started":1,"wal-append.queue_time_us":61698}
I20260709 12:24:34.974872 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:34.975767 10979 raft_consensus.cc:2393] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 7: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:34.974895 13631 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:34.976892 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:34.977689 10979 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:34.979916 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:34.981047 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:34.981734 13631 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:34.982280 13967 consensus_queue.cc:1059] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:34.982532 14229 consensus_queue.cc:1059] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:34.982952 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:34.983428 14229 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:34.960616 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:34.984124 14229 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:34.984859 11675 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:34.983461 14108 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:34.985761 14108 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:34.981081 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:34.982470 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:34.987890 14108 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:34.990092 13895 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:34.990696 14229 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:34.991139 14026 raft_consensus.cc:2804] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:34.991596 14026 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:34.991989 14026 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:34.983141 13967 consensus_queue.cc:1243] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer bc01179655564f29b83babe396377cbb log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:24:34.981868 11054 raft_consensus.cc:2393] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 8: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:34.975629 14231 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:34.954382 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:34.960681 10948 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:34.997602 10976 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:34.984011 13988 raft_consensus.cc:3055] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:24:35.199718 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 62111.6us
W20260709 12:24:35.227334 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 359505us
I20260709 12:24:35.246472 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:35.223554 14165 consensus_meta.cc:287] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.640s	user 0.011s	sys 0.000s
W20260709 12:24:35.241113 11097 leader_election.cc:336] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 2.022s (SENT)
I20260709 12:24:35.261788 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:35.262351 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:35.307255 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:35.307765 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:35.308089 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.263010 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:35.263365 14148 raft_consensus.cc:2749] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:35.263717 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:35.263664 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:35.309305 10979 raft_consensus.cc:2410] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 8 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 12:24:35.264199 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.261684 14130 raft_consensus.cc:3055] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:35.309374 11676 raft_consensus.cc:2393] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 8: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:35.266278 11059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 436) took 1173 ms. Trace:
I20260709 12:24:35.031126 14015 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:35.238715 14282 log.cc:927] Time spent T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.629s	user 0.000s	sys 0.001s
W20260709 12:24:35.276816 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.282464 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:35.227713 13988 raft_consensus.cc:740] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:35.290259 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:35.291481 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.092229 14230 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.238300 14082 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.300555 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:35.342841 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 68852.7us
I20260709 12:24:35.263048 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:35.281176 11125 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:35.315442 14130 raft_consensus.cc:740] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:35.342523 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:35.312409 11059 rpcz_store.cc:276] 0709 12:24:33.918560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.919992 (+  1432us) service_pool.cc:224] Handling call
0709 12:24:34.139029 (+219037us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.162162 (+ 23133us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.162199 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.164715 (+  2516us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:34.176989 (+ 12274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.180539 (+  3550us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:35.002667 (+822128us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b54002774d0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:35.091898 (+ 89231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":456960256}
W20260709 12:24:35.346724 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 386262us
I20260709 12:24:35.347484 11052 raft_consensus.cc:2410] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:24:35.327945 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:35.338362 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.327955 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:35.347271 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:35.321506 11678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41762 (request call id 638) took 2442 ms (client timeout 2748 ms). Trace:
W20260709 12:24:35.325635 14046 consensus_meta.cc:287] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.860s	user 0.008s	sys 0.003s
I20260709 12:24:35.323132 14015 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:35.348121 11056 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
W20260709 12:24:35.347867 11125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 2011) took 2265 ms (client timeout 1825 ms). Trace:
W20260709 12:24:35.348886 11678 rpcz_store.cc:269] 0709 12:24:32.879203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.881094 (+  1891us) service_pool.cc:224] Handling call
0709 12:24:35.297197 (+2416103us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54004e2fd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:35.321415 (+ 24218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2326607744}
I20260709 12:24:35.375770 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:35.376080 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:35.376808 11132 raft_consensus.cc:2393] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 5: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:35.377249 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:35.377797 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:35.348913 14114 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:35.391037 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:35.389883 10976 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:35.392421 10982 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.031s	sys 0.074s
W20260709 12:24:35.394372 10982 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.031s	sys 0.074s
I20260709 12:24:35.394032 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:35.361155 14015 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:35.396881 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:35.399029 11132 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:35.323035 14165 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:35.396921 10983 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:35.398752 11672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 630) took 2765 ms. Trace:
I20260709 12:24:35.406980 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:35.395241 14189 consensus_meta.cc:287] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.792s	user 0.011s	sys 0.000s
W20260709 12:24:35.407413 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 166352us
I20260709 12:24:35.415649 11054 raft_consensus.cc:2393] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 7: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:35.425022 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:35.427045 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:35.404135 11672 rpcz_store.cc:276] 0709 12:24:32.235583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.236254 (+   671us) service_pool.cc:224] Handling call
0709 12:24:32.296358 (+ 60104us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:32.311632 (+ 15274us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:32.311666 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:32.317177 (+  5511us) log.cc:844] Serialized 52 byte log entry
0709 12:24:33.926343 (+1609166us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b180025f420. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cd9e07 00007f8f91b349a9 00007f8f88cf669b 00007f8f88cf493f 00007f8f88cf6c02 00007f8f8b97e20b 00007f8f8b983d23 00007f8f8b9840d1 00007f8f8bd9fa0f
0709 12:24:34.172077 (+245734us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:34.172135 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.172230 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:34.996153 (+823923us) raft_consensus.cc:1685] finished
0709 12:24:34.996173 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:35.001320 (+  5147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4056,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":2226,"spinlock_wait_cycles":3220352,"thread_start_us":136888,"threads_started":1,"wal-append.queue_time_us":2102245}
I20260709 12:24:35.358513 14046 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:35.380486 14082 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:35.440579 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.439503 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:35.420068 11125 rpcz_store.cc:269] 0709 12:24:33.079135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.079331 (+   196us) service_pool.cc:224] Handling call
0709 12:24:34.806653 (+1727322us) spinlock_profiling.cc:243] Waited 5.96 ms on lock 0x7b5800117398. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90daa0a0 00007f8f90da9984 00007f8f8a3246d4 00007f8f8a324662
0709 12:24:35.343990 (+537337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13705472}
I20260709 12:24:35.453676 11054 raft_consensus.cc:1275] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:24:35.407109 14230 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:35.457219 11025 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:35.414261 14114 consensus_queue.cc:1048] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:24:35.462616 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:35.438297 13410 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.464897 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:35.470893 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:35.470778 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:35.448294 13895 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:35.473320 11025 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:35.462785 14153 consensus_meta.cc:287] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 1.081s	user 0.014s	sys 0.000s
I20260709 12:24:35.477591 11052 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
W20260709 12:24:35.463200 14206 consensus_meta.cc:287] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.619s	user 0.008s	sys 0.004s
W20260709 12:24:35.482910 10984 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.034s	sys 0.057s
I20260709 12:24:35.479679 10981 raft_consensus.cc:1275] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:24:35.483462 10984 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.034s	sys 0.057s
I20260709 12:24:35.483026 10979 raft_consensus.cc:1275] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:24:35.470018 13721 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.009s	sys 0.045s
I20260709 12:24:35.480548 11025 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:35.486166 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:35.491523 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:35.496011 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 104711us
I20260709 12:24:35.478580 14262 raft_consensus.cc:2804] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:35.493063 10983 raft_consensus.cc:1275] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:24:35.483852 14168 consensus_meta.cc:287] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 1.003s	user 0.013s	sys 0.000s
I20260709 12:24:35.502650 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2089) took 2425 ms. Trace:
I20260709 12:24:35.477258 14205 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:35.485445 14229 raft_consensus.cc:2804] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:35.491802 13721 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.009s	sys 0.046s
I20260709 12:24:35.508010 10983 rpcz_store.cc:276] 0709 12:24:33.077476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.469900 (+2392424us) service_pool.cc:224] Handling call
0709 12:24:35.479999 (+ 10099us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:35.502327 (+ 22328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.502581 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:35.511113 13977 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.470072 13988 consensus_queue.cc:260] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:35.470568 13410 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:35.518301 14108 raft_consensus.cc:2804] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:35.475919 14208 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:35.451583 14130 consensus_queue.cc:260] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:35.548692 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:35.528313 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:35.531912 13977 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:35.532122 14028 consensus_queue.cc:1048] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:35.508312 11125 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
I20260709 12:24:35.553484 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:35.478909 13967 consensus_queue.cc:1048] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:24:35.483294 14153 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:35.504873 14262 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
W20260709 12:24:35.545425 11675 consensus_meta.cc:287] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.001s
I20260709 12:24:35.563795 11675 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:24:35.545825 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:35.486316 14206 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:35.525857 14229 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:24:35.590248 14229 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:35.559216 13988 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:35.591989 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:35.556084 11130 consensus_meta.cc:287] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.938s	user 0.008s	sys 0.004s
W20260709 12:24:35.558539 10975 consensus_meta.cc:287] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.645s	user 0.008s	sys 0.005s
I20260709 12:24:35.607862 10975 raft_consensus.cc:1275] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:24:35.560449 11132 raft_consensus.cc:2410] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:35.557678 10977 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:35.568001 14165 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:35.568450 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:35.568953 14287 log.cc:927] Time spent T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.527s	user 0.000s	sys 0.001s
I20260709 12:24:35.569959 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:35.569984 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:35.572098 14046 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:35.579146 11098 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:35.580066 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:35.618448 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:35.583801 14259 log.cc:927] Time spent T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 1.513s	user 0.008s	sys 0.004s
I20260709 12:24:35.584317 14208 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:35.558290 13410 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:35.626950 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 97187us
I20260709 12:24:35.615262 11130 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:35.608276 10975 pending_rounds.cc:85] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 6
I20260709 12:24:35.621981 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:35.599614 14262 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:35.624061 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:35.568467 14285 log.cc:927] Time spent T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 12:24:35.510690 14168 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:35.618566 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 89614.8us
I20260709 12:24:35.634166 10975 pending_rounds.cc:107] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:24:35.639021 10975 raft_consensus.cc:2889] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:35.635164 11132 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:35.643446 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 2029) took 1228 ms. Trace:
I20260709 12:24:35.644587 11130 rpcz_store.cc:276] 0709 12:24:34.405419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.475510 (+ 70091us) service_pool.cc:224] Handling call
0709 12:24:35.633392 (+1157882us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:35.647511 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 68480.2us
I20260709 12:24:35.630698 14108 raft_consensus.cc:697] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:35.653119 14108 consensus_queue.cc:237] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:35.656793 14164 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:35.661439 14153 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:35.662487 11133 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1797) took 2223 ms (client timeout 1612 ms). Trace:
I20260709 12:24:35.663012 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1406) took 3513 ms. Trace:
I20260709 12:24:35.663971 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2069) took 4410 ms. Trace:
I20260709 12:24:35.664451 10981 rpcz_store.cc:276] 0709 12:24:31.253605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.046772 (+793167us) service_pool.cc:224] Handling call
0709 12:24:32.047077 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:35.483524 (+3436447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.663640 (+180116us) spinlock_profiling.cc:243] Waited 3.38 s on lock 0x7b5400382054. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:35.663895 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7778577280}
W20260709 12:24:35.663018 11133 rpcz_store.cc:269] 0709 12:24:33.438852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.909226 (+470374us) service_pool.cc:224] Handling call
0709 12:24:35.662206 (+1752980us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400107054. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:35.662396 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3162481920}
I20260709 12:24:35.667481 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:35.668212 11133 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:35.669166 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:35.663498 10980 rpcz_store.cc:276] 0709 12:24:32.149762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.254201 (+2104439us) service_pool.cc:224] Handling call
0709 12:24:34.348057 (+ 93856us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.969385 (+621328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.662713 (+693328us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b540035dc54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:35.662908 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1424884864}
I20260709 12:24:35.670356 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:35.671098 10980 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 7: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:24:35.651911 14239 consensus_meta.cc:287] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.824s	user 0.003s	sys 0.007s
I20260709 12:24:35.671589 14239 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:35.673789 14239 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:35.665916 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:35.650290 10983 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:35.646963 11125 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
I20260709 12:24:35.677122 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2080) took 3236 ms. Trace:
I20260709 12:24:35.670583 11673 consensus_queue.cc:260] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:35.675320 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:35.667228 14161 raft_consensus.cc:3055] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:35.682416 10980 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:35.686406 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:35.675856 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:35.681944 10984 rpcz_store.cc:276] 0709 12:24:32.440641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.614541 (+2173900us) service_pool.cc:224] Handling call
0709 12:24:34.819097 (+204556us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:34.862653 (+ 43556us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.862698 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:34.904884 (+ 42186us) log.cc:844] Serialized 26 byte log entry
0709 12:24:35.483938 (+579054us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:35.483979 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.484096 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:35.676892 (+192796us) raft_consensus.cc:1685] finished
0709 12:24:35.676912 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:35.677058 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19446,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":22669,"thread_start_us":556989,"threads_started":1,"wal-append.queue_time_us":754970}
I20260709 12:24:35.687629 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:35.689721 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:35.674032 11643 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:35.697187 10981 raft_consensus.cc:2393] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 7: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:35.698487 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:35.698657 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:35.701975 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 393) took 3328 ms. Trace:
I20260709 12:24:35.702469 10975 rpcz_store.cc:276] 0709 12:24:32.373425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.466728 (+2093303us) service_pool.cc:224] Handling call
0709 12:24:34.604315 (+137587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:35.701685 (+1097370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.701904 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:35.706239 10979 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:35.706427 10977 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
W20260709 12:24:35.709262 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 69420.7us
I20260709 12:24:35.649312 14082 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:35.708815 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:35.716090 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 112187us
I20260709 12:24:35.721196 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:35.713670 11673 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:35.722008 11130 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 5.
I20260709 12:24:35.689980 13410 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:35.674566 14165 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.724835 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:35.729810 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:35.689638 14245 consensus_queue.cc:1048] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:24:35.679015 13977 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:35.684983 14161 raft_consensus.cc:740] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:35.732735 11132 raft_consensus.cc:1275] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:35.699590 14239 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:35.740500 10977 raft_consensus.cc:1275] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:35.741961 10984 raft_consensus.cc:3055] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:35.742396 10984 raft_consensus.cc:740] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
W20260709 12:24:35.742440 11127 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.014s	sys 0.008s
W20260709 12:24:35.742901 11127 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.014s	sys 0.008s
I20260709 12:24:35.743788 11125 raft_consensus.cc:1275] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:35.745777 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:35.746482 10983 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:35.747913 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2021) took 2405 ms. Trace:
I20260709 12:24:35.704566 14218 raft_consensus.cc:2804] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:35.735270 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:35.734458 11023 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:35.748435 11132 rpcz_store.cc:276] 0709 12:24:33.333493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.699494 (+2366001us) service_pool.cc:224] Handling call
0709 12:24:35.731018 (+ 31524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:35.738171 (+  7153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.738412 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:35.748099 11645 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:35.750576 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2020) took 2426 ms. Trace:
I20260709 12:24:35.755590 11125 rpcz_store.cc:276] 0709 12:24:33.317618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.690833 (+2373215us) service_pool.cc:224] Handling call
0709 12:24:35.731881 (+ 41048us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:35.744197 (+ 12316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.744410 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:35.727380 13410 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:35.758416 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:35.761559 11130 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:35.754307 10980 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
W20260709 12:24:35.758057 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 199477us
I20260709 12:24:35.733592 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 382) took 3582 ms. Trace:
I20260709 12:24:35.772660 10981 raft_consensus.cc:1275] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:35.775754 10975 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:24:35.754781 14164 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:24:35.783186 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 93776.1us
I20260709 12:24:35.752691 14230 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:35.760628 14082 raft_consensus.cc:2804] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:24:35.790051 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.764480 13410 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:35.792757 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 60665us
I20260709 12:24:35.795707 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:35.773869 10982 rpcz_store.cc:276] 0709 12:24:32.151348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.384315 (+2232967us) service_pool.cc:224] Handling call
0709 12:24:34.470468 (+ 86153us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:34.699339 (+228871us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.699376 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:34.822210 (+122834us) log.cc:844] Serialized 26 byte log entry
0709 12:24:35.395699 (+573489us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:35.732189 (+336490us) log.cc:844] Serialized 14 byte log entry
0709 12:24:35.733273 (+  1084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.733339 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:35.733389 (+    50us) raft_consensus.cc:1685] finished
0709 12:24:35.733399 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:35.733516 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10825,"raft.queue_time_us":31668,"raft.run_cpu_time_us":7071,"raft.run_wall_time_us":140319,"thread_start_us":829871,"threads_started":2,"wal-append.queue_time_us":626987}
W20260709 12:24:35.801661 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 104704us
I20260709 12:24:35.802543 11023 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:35.771905 14108 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:35.806299 14222 consensus_meta.cc:287] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.844s	user 0.013s	sys 0.001s
I20260709 12:24:35.806197 14108 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:35.806803 14222 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:35.808512 14108 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:35.808903 14222 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:35.810276 11053 raft_consensus.cc:2393] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 9: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:35.810881 10981 raft_consensus.cc:1275] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:35.813153 10978 raft_consensus.cc:1240] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:35.813617 14154 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.755100 14165 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:35.813879 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 383) took 3662 ms. Trace:
I20260709 12:24:35.767580 14239 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:35.815748 10978 rpcz_store.cc:276] 0709 12:24:32.151588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.386464 (+2234876us) service_pool.cc:224] Handling call
0709 12:24:35.812809 (+1426345us) spinlock_profiling.cc:243] Waited 889 us on lock 0x7b5800003698. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfeee 000000000036eb39 00007f8f90d331e0 00007f8f90dfc0c4 00007f8f90dfc131 00007f8f90dbdfc0 00007f8f90da8929 00007f8f90da83d2 00007f8f8a31fbd4
0709 12:24:35.812956 (+   147us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:35.813635 (+   679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.813819 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2044800}
I20260709 12:24:35.817462 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2016) took 2718 ms. Trace:
I20260709 12:24:35.817878 11128 rpcz_store.cc:276] 0709 12:24:33.099006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.914947 (+1815941us) service_pool.cc:224] Handling call
0709 12:24:34.954306 (+ 39359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:35.238500 (+284194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:35.238559 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:35.281785 (+ 43226us) log.cc:844] Serialized 26 byte log entry
0709 12:24:35.700554 (+418769us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:35.700598 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.701009 (+   411us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:35.817217 (+116208us) raft_consensus.cc:1685] finished
0709 12:24:35.817237 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:35.817379 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76120,"raft.queue_time_us":95398,"spinlock_wait_cycles":42683136,"thread_start_us":352141,"threads_started":1,"wal-append.queue_time_us":454714}
I20260709 12:24:35.819636 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:35.820837 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:35.821235 14237 consensus_meta.cc:287] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 1.202s	user 0.010s	sys 0.000s
I20260709 12:24:35.806711 10982 raft_consensus.cc:1275] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:24:35.797902 10949 connection.cc:256] RPC call timeout handler was delayed by -1.5005813309999212s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
I20260709 12:24:35.822019 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:35.794642 14082 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:35.839727 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:35.843982 11132 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:35.842535 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.845338 11125 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 7: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:35.821695 14237 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:35.793664 14300 raft_consensus.cc:2749] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:35.849833 10983 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:35.822317 14165 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:35.798748 14164 raft_consensus.cc:697] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:24:35.837648 14026 consensus_meta.cc:287] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.845s	user 0.010s	sys 0.002s
I20260709 12:24:35.853127 11097 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:24:35.857594 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 57118.7us
I20260709 12:24:35.868034 14026 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:35.859287 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 65889.7us
I20260709 12:24:35.865880 11673 raft_consensus.cc:1275] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:35.871726 11673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 636) took 3500 ms. Trace:
I20260709 12:24:35.872048 11673 rpcz_store.cc:276] 0709 12:24:32.370985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.385714 (+ 14729us) service_pool.cc:224] Handling call
0709 12:24:32.386016 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:35.669959 (+3283943us) spinlock_profiling.cc:243] Waited 51 ms on lock 0x7b4c003d5c00. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8a0b0a20 00007f8f8a0c1a29 00007f8f8a087644 00007f8f8a0aef2d 00007f8f8a0aeb93 00007f8f8bddf18b 00007f8f8bddfcb5 00007f8f8bddaf30 00007f8f8bddc7de 00007f8f8bde6b49 00007f8f8bde7416
0709 12:24:35.871419 (+201460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.871665 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117223680}
I20260709 12:24:35.862159 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:35.873335 11052 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
W20260709 12:24:35.873358 14131 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:24:35.874282 14222 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:35.874621 14026 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:35.874014 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.875639 14208 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:35.876160 14172 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.848590 14082 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:35.876736 14172 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:35.865224 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:35.866935 14164 consensus_queue.cc:237] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:35.874478 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:35.880722 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:35.881270 11023 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:35.881675 11125 raft_consensus.cc:2410] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:24:35.881779 11128 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:24:35.866675 14292 log.cc:927] Time spent T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:24:35.886448 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2017) took 2787 ms. Trace:
I20260709 12:24:35.842132 14114 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:35.898073 11133 raft_consensus.cc:2393] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 9: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:35.899014 10979 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:24:35.889191 11127 rpcz_store.cc:276] 0709 12:24:33.099247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.916303 (+1817056us) service_pool.cc:224] Handling call
0709 12:24:34.953179 (+ 36876us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:34.993008 (+ 39829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.993039 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:34.993647 (+   608us) log.cc:844] Serialized 52 byte log entry
0709 12:24:35.743330 (+749683us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:35.827910 (+ 84580us) log.cc:844] Serialized 14 byte log entry
0709 12:24:35.860308 (+ 32398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.860391 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:35.886207 (+ 25816us) raft_consensus.cc:1685] finished
0709 12:24:35.886229 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:35.886382 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14283,"raft.queue_time_us":23867,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":175356,"thread_start_us":832076,"threads_started":3,"wal-append.queue_time_us":880478}
I20260709 12:24:35.875275 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:35.894510 10976 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:24:35.902599 14026 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.903249 14026 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:35.905159 10977 raft_consensus.cc:1275] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:24:35.906603 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2019) took 2806 ms. Trace:
I20260709 12:24:35.797343 14205 consensus_queue.cc:1059] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 12:24:35.907051 11126 rpcz_store.cc:276] 0709 12:24:33.099725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.939477 (+1839752us) service_pool.cc:224] Handling call
0709 12:24:35.271727 (+332250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:35.343138 (+ 71411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:35.343203 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:35.437732 (+ 94529us) log.cc:844] Serialized 26 byte log entry
0709 12:24:35.764986 (+327254us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:35.765030 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.765107 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:35.906391 (+141284us) raft_consensus.cc:1685] finished
0709 12:24:35.906410 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:35.906544 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20735,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":23980,"thread_start_us":272773,"threads_started":1,"wal-append.queue_time_us":429900}
W20260709 12:24:35.909731 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.910729 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:35.858589 14206 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:35.914037 11054 raft_consensus.cc:1240] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:35.914709 11052 raft_consensus.cc:1240] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:35.916427 11132 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:35.906741 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:35.920032 11055 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:35.841662 14015 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:35.935461 14302 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:35.937248 14158 consensus_queue.cc:1048] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:35.847455 14154 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:35.888485 14262 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:35.876187 14232 consensus_queue.cc:1048] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.126s
I20260709 12:24:35.875910 14222 consensus_queue.cc:1048] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.135s
I20260709 12:24:35.938087 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:35.925351 14161 consensus_queue.cc:260] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:35.911145 14304 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.633s
I20260709 12:24:35.937940 14108 consensus_queue.cc:1048] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.601s
W20260709 12:24:36.530015 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.538632 11051 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
W20260709 12:24:36.046531 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:36.539453 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.532500 14187 consensus_queue.cc:1048] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:24:36.540876 14154 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:35.942404 11131 raft_consensus.cc:1240] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:36.157133 11681 raft_consensus.cc:1240] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8. Ops: []
W20260709 12:24:36.467516 14280 log.cc:927] Time spent T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 1.937s	user 0.032s	sys 0.020s
W20260709 12:24:35.948647 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.542812 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:36.523531 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2015) took 3424 ms. Trace:
I20260709 12:24:36.524683 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:36.527273 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 684098us
I20260709 12:24:35.895790 14298 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:36.494223 10880 catalog_manager.cc:5697] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 4 to 7, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 7 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:24:36.529330 11023 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:36.588032 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 455) took 2663 ms. Trace:
I20260709 12:24:36.009117 11128 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
W20260709 12:24:36.542989 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:36.525050 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:36.017247 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 100123us
W20260709 12:24:36.542438 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:36.603024 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.601575 11131 rpcz_store.cc:276] 0709 12:24:33.934949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.941804 (+2006855us) service_pool.cc:224] Handling call
0709 12:24:35.942213 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:36.587720 (+645507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.587963 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:36.159008 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:36.147435 11055 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:24:36.158560 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:36.160772 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:36.606703 11676 raft_consensus.cc:2410] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:24:36.159377 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:36.159787 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:36.380667 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.258723 11674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 640) took 1904 ms. Trace:
I20260709 12:24:36.609019 11674 rpcz_store.cc:276] 0709 12:24:34.354067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.354683 (+   616us) service_pool.cc:224] Handling call
0709 12:24:34.355184 (+   501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.454500 (+ 99316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.454531 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.454574 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:34.454609 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.258463 (+1803854us) spinlock_profiling.cc:243] Waited 99.1 ms on lock 0x7b54004f47d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:36.258513 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:36.258654 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227833088}
I20260709 12:24:36.083165 11054 raft_consensus.cc:1240] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:24:36.524982 14143 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:36.603061 11645 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
W20260709 12:24:36.612481 10882 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41120 (request call id 265) took 19258 ms (client timeout 15000 ms). Trace:
I20260709 12:24:36.539069 14302 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:36.613349 14187 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:36.157512 14164 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:36.614391 14187 raft_consensus.cc:697] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:36.614243 14164 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:36.613081 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 457) took 2636 ms. Trace:
I20260709 12:24:36.615778 14187 consensus_queue.cc:237] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:36.617564 14131 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:36.402786 14239 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:36.618264 14302 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:36.389071 14130 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:36.617919 11128 rpcz_store.cc:276] 0709 12:24:33.988504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.611911 (+2623407us) service_pool.cc:224] Handling call
0709 12:24:36.612347 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:36.612644 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:36.612679 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:36.612757 (+    78us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:36.612798 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.612868 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:36.612995 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:36.530284 13721 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:36.622664 13721 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:36.513622 13410 consensus_meta.cc:287] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.691s	user 0.007s	sys 0.000s
I20260709 12:24:36.625960 13410 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:36.625355 14131 raft_consensus.cc:697] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:36.625103 11126 raft_consensus.cc:1240] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:36.620234 11132 raft_consensus.cc:1240] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:36.010812 14214 consensus_meta.cc:287] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 1.409s	user 0.011s	sys 0.008s
I20260709 12:24:36.548345 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:36.601238 11134 rpcz_store.cc:276] 0709 12:24:33.098757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.899832 (+1801075us) service_pool.cc:224] Handling call
0709 12:24:34.948929 (+ 49097us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:34.991531 (+ 42602us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.991563 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:34.992159 (+   596us) log.cc:844] Serialized 52 byte log entry
0709 12:24:35.462711 (+470552us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:35.462756 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.462829 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:36.523241 (+1060412us) raft_consensus.cc:1685] finished
0709 12:24:36.523265 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:36.523462 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24641,"raft.queue_time_us":27157,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":91761,"thread_start_us":470052,"threads_started":1,"wal-append.queue_time_us":727144}
W20260709 12:24:36.601730 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 72500.6us
I20260709 12:24:36.651711 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:36.668892 11130 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:36.667960 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1795) took 3229 ms. Trace:
I20260709 12:24:36.214092 11024 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:24:36.627691 11098 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:36.465410 10984 consensus_queue.cc:260] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:36.637768 11097 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:36.161139 14218 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:36.667816 11133 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:36.629645 11025 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:36.669585 11132 rpcz_store.cc:276] 0709 12:24:33.438339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.920612 (+2482273us) service_pool.cc:224] Handling call
0709 12:24:36.619838 (+699226us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b5800117398. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90dbdfc0 00007f8f90da8929 00007f8f90da83d2 00007f8f8a31fbd4
0709 12:24:36.620050 (+   212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:36.667678 (+ 47628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.667900 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36329216}
I20260709 12:24:36.668557 11023 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:36.671954 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 44454.4us
I20260709 12:24:36.672722 11127 raft_consensus.cc:2393] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 11: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:36.543198 13228 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:36.675004 11098 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:36.675420 10984 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:36.676594 10981 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.004s	sys 0.075s
W20260709 12:24:36.683622 10981 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.004s	sys 0.075s
W20260709 12:24:36.040405 14301 log.cc:927] Time spent T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 12:24:36.678886 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 464839us
I20260709 12:24:36.642468 11672 raft_consensus.cc:2393] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 8: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:24:36.681648 10982 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.003s	sys 0.012s
W20260709 12:24:36.692731 10982 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.003s	sys 0.012s
I20260709 12:24:36.693665 11125 raft_consensus.cc:1240] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:24:36.694140 13410 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:36.632705 14298 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:36.694499 14154 raft_consensus.cc:2749] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:36.694967 14298 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:36.686234 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 456) took 2706 ms. Trace:
I20260709 12:24:36.695742 11126 rpcz_store.cc:276] 0709 12:24:33.973460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.527887 (+2554427us) service_pool.cc:224] Handling call
0709 12:24:36.624666 (+ 96779us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b5800117398. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90dbdfc0 00007f8f90da8929 00007f8f90da83d2 00007f8f8a31fbd4
0709 12:24:36.624891 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:36.677205 (+ 52314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.677415 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35144576}
I20260709 12:24:36.625046 13721 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:36.680246 14205 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.152014 14034 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:36.257838 14244 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:36.216336 14186 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.218317 14046 raft_consensus.cc:3055] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:36.688788 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 465) took 2610 ms. Trace:
I20260709 12:24:36.287408 14168 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:36.698827 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 69279.6us
I20260709 12:24:36.685595 14052 raft_consensus.cc:2749] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:36.684283 10880 catalog_manager.cc:5697] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 1 to 5, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 5 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:36.067266 14026 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:36.676096 14218 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:36.650321 14143 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:36.707587 11131 raft_consensus.cc:1240] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:36.704723 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 458) took 2707 ms. Trace:
I20260709 12:24:36.705729 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:36.613013 10882 rpcz_store.cc:269] 0709 12:24:17.426857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.440519 (+ 13662us) service_pool.cc:224] Handling call
0709 12:24:36.612197 (+19171678us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:25.018586 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:25.032889 (+ 14303us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:25.032941 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:24:25.032958 (+    17us) tablet.cc:662] Decoding operations
0709 12:24:25.034425 (+  1467us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:25.034501 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:25.034530 (+    29us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:24:25.035775 (+  1245us) tablet.cc:701] Row locks acquired
0709 12:24:25.035827 (+    52us) write_op.cc:260] PREPARE: finished
0709 12:24:25.035990 (+   163us) write_op.cc:270] Start()
0709 12:24:25.036144 (+   154us) write_op.cc:276] Timestamp: P: 1783599865035928 usec, L: 0
0709 12:24:25.036166 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:24:25.135285 (+ 99119us) log.cc:844] Serialized 6386 byte log entry
0709 12:24:27.619924 (+2484639us) op_driver.cc:464] REPLICATION: finished
0709 12:24:28.108770 (+488846us) write_op.cc:301] APPLY: starting
0709 12:24:28.189826 (+ 81056us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:28.506191 (+316365us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:28.506342 (+   151us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:28.938484 (+432142us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:28.969884 (+ 31400us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:24:28.969937 (+    53us) write_op.cc:312] APPLY: finished
0709 12:24:28.970445 (+   508us) log.cc:844] Serialized 113 byte log entry
0709 12:24:29.007073 (+ 36628us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:29.007265 (+   192us) write_op.cc:454] Released schema lock
0709 12:24:29.007337 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:29.007808 (+   471us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:29.007837 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":299186,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":395368,"apply.run_cpu_time_us":22981,"apply.run_wall_time_us":962064,"num_ops":16,"prepare.queue_time_us":712456,"prepare.run_cpu_time_us":33070,"prepare.run_wall_time_us":384235,"raft.queue_time_us":1109046,"raft.run_cpu_time_us":79130,"raft.run_wall_time_us":481846,"replication_time_us":2472898,"thread_start_us":2460895,"threads_started":5,"wal-append.queue_time_us":381916,"wal-append.run_cpu_time_us":41745,"wal-append.run_wall_time_us":4390742}]]}
W20260709 12:24:36.701184 14213 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.041s	user 0.019s	sys 0.010s
I20260709 12:24:36.699537 11130 raft_consensus.cc:1240] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:36.699781 14306 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.011s	sys 0.071s
I20260709 12:24:36.711180 14046 raft_consensus.cc:740] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:36.728274 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:36.731304 13410 raft_consensus.cc:2804] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:36.674584 14158 consensus_queue.cc:1048] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:24:36.700423 14114 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:36.706019 14205 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:36.745942 14229 consensus_meta.cc:287] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 1.155s	user 0.010s	sys 0.006s
I20260709 12:24:36.761245 14229 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:36.761646 14114 raft_consensus.cc:697] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:24:36.736233 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 61285.4us
I20260709 12:24:36.733206 10949 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:36.734802 10880 catalog_manager.cc:5697] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:36.702639 14211 raft_consensus.cc:2804] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:36.739468 11134 rpcz_store.cc:276] 0709 12:24:34.019064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.668447 (+2649383us) service_pool.cc:224] Handling call
0709 12:24:36.685374 (+ 16927us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:36.704450 (+ 19076us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:36.704470 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:36.704502 (+    32us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:36.704532 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.704582 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:36.704667 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:36.715888 14237 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:36.742290 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 49893us
I20260709 12:24:36.731658 14252 consensus_queue.cc:1048] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:24:36.742849 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 459) took 2719 ms. Trace:
I20260709 12:24:36.710955 11132 rpcz_store.cc:276] 0709 12:24:34.078642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.673908 (+2595266us) service_pool.cc:224] Handling call
0709 12:24:36.688227 (+ 14319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:36.688458 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:36.688486 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:36.688531 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:36.688559 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.688615 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:36.688724 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:36.730382 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:36.705359 14302 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:36.750887 13410 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:24:36.733606 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 132458us
W20260709 12:24:36.740664 14213 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.081s	user 0.019s	sys 0.011s
I20260709 12:24:36.745622 11025 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:36.752296 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2013) took 3649 ms. Trace:
I20260709 12:24:36.733906 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 470) took 2402 ms. Trace:
W20260709 12:24:36.742353 14306 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.011s	sys 0.072s
I20260709 12:24:36.764328 11098 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:36.767761 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:36.742429 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 462) took 2660 ms. Trace:
I20260709 12:24:36.770015 11024 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:36.769423 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:36.773411 11126 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:36.772789 11130 rpcz_store.cc:276] 0709 12:24:34.022234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.669620 (+2647386us) service_pool.cc:224] Handling call
0709 12:24:36.699407 (+ 29787us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:36.740914 (+ 41507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.741108 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:36.736881 14245 raft_consensus.cc:2804] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:36.752277 14240 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.774461 10880 catalog_manager.cc:5697] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:36.781329 11127 rpcz_store.cc:276] 0709 12:24:34.331645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.684888 (+2353243us) service_pool.cc:224] Handling call
0709 12:24:36.704109 (+ 19221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:36.733581 (+ 29472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:36.733608 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:36.733653 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:36.733684 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.733743 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:36.733851 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:36.774652 13721 raft_consensus.cc:2804] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:36.743476 14011 consensus_queue.cc:1048] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 12:24:36.782480 10976 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:24:36.773025 14052 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 12:24:36.782395 11131 rpcz_store.cc:276] 0709 12:24:34.077450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.672393 (+2594943us) service_pool.cc:224] Handling call
0709 12:24:36.690861 (+ 18468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:36.737962 (+ 47101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.738206 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:36.747319 14143 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:36.786291 11132 raft_consensus.cc:1240] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:36.766706 14172 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:36.843833 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 58543.8us
I20260709 12:24:36.842267 13967 raft_consensus.cc:2804] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:36.737412 14186 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:36.847321 14304 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:36.780565 13410 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:36.849373 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 69827.7us
I20260709 12:24:36.762766 14114 consensus_queue.cc:237] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:36.884516 14186 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:36.784200 14245 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.885733 14245 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:36.780841 11129 rpcz_store.cc:276] 0709 12:24:33.098164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.098335 (+   171us) service_pool.cc:224] Handling call
0709 12:24:34.090492 (+992157us) spinlock_profiling.cc:243] Waited 5.12 ms on lock 0x7b5800117398. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfeee 000000000036eb39 00007f8f90d331e0 00007f8f90dfc0c4 00007f8f90dfc131 00007f8f90dbdfc0 00007f8f90da8929 00007f8f90da83d2 00007f8f8a31fbd4
0709 12:24:34.090811 (+   319us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:34.091922 (+  1111us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:34.136850 (+ 44928us) log.cc:844] Serialized 14 byte log entry
0709 12:24:34.363673 (+226823us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:34.455651 (+ 91978us) log.cc:844] Serialized 52 byte log entry
0709 12:24:34.466988 (+ 11337us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:34.608213 (+141225us) log.cc:844] Serialized 14 byte log entry
0709 12:24:34.613848 (+  5635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.613955 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:36.437830 (+1823875us) spinlock_profiling.cc:243] Waited 8.07 ms on lock 0x7b180022b220. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cc52a6 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88b7d9c4 00007f8f88b7bacb 00007f8f88d36dc9
0709 12:24:36.467208 (+ 29378us) spinlock_profiling.cc:243] Waited 7.71 ms on lock 0x7b24001f2338. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88b7d9c4 00007f8f88b7bacb 00007f8f88d36dc9 00007f8f88d36a55 00007f8f88d3609d 00007f8f8b96810e 00007f8f8b97f88c 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221
0709 12:24:36.746896 (+279688us) raft_consensus.cc:1685] finished
0709 12:24:36.746921 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:36.747076 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80100,"prepare.queue_time_us":74864,"prepare.run_cpu_time_us":165,"prepare.run_wall_time_us":3999,"raft.queue_time_us":16708,"raft.run_cpu_time_us":793,"raft.run_wall_time_us":69840,"spinlock_wait_cycles":49082112,"thread_start_us":376873,"threads_started":3,"wal-append.queue_time_us":283146}
I20260709 12:24:36.745926 14131 consensus_queue.cc:237] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:36.850317 10880 catalog_manager.cc:5697] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:36.767370 14211 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.784098 13721 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:36.780889 10949 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:36.845134 14237 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:36.860332 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1794) took 3422 ms. Trace:
I20260709 12:24:36.861445 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2027) took 2456 ms. Trace:
W20260709 12:24:36.862802 14313 log.cc:927] Time spent T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:24:36.917893 11125 rpcz_store.cc:276] 0709 12:24:33.438022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.917721 (+2479699us) service_pool.cc:224] Handling call
0709 12:24:35.942310 (+ 24589us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:36.694143 (+751833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.860036 (+165893us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b5400033ed4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:36.860269 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1717232000}
W20260709 12:24:36.922472 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 151143us
I20260709 12:24:36.859617 14046 consensus_queue.cc:260] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:36.758352 14165 consensus_queue.cc:1059] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
W20260709 12:24:36.853324 14308 log.cc:927] Time spent T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:24:36.851140 14108 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:36.844614 14240 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:36.894418 11133 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:36.896906 11097 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:36.855121 14262 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:36.865324 14315 log.cc:927] Time spent T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:24:36.910329 11098 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:36.904305 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:36.918269 11132 rpcz_store.cc:276] 0709 12:24:34.404837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.785422 (+2380585us) service_pool.cc:224] Handling call
0709 12:24:36.785757 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:36.861193 (+ 75436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.861387 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:36.934993 11125 raft_consensus.cc:1240] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:36.935779 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2032) took 2473 ms. Trace:
I20260709 12:24:36.920456 13721 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:36.940893 11132 raft_consensus.cc:1240] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:36.930246 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.891040 13967 raft_consensus.cc:697] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:36.931495 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:36.922400 14237 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:24:36.927361 14082 consensus_meta.cc:287] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 1.008s	user 0.011s	sys 0.000s
I20260709 12:24:36.936894 11098 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:36.920404 10976 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:36.949970 11133 raft_consensus.cc:1240] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:24:36.950771 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1799) took 1630 ms. Trace:
I20260709 12:24:36.951107 11133 rpcz_store.cc:276] 0709 12:24:35.320824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.935722 (+1614898us) service_pool.cc:224] Handling call
0709 12:24:36.949741 (+ 14019us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:36.950471 (+   730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.950709 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:36.918418 14186 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.911291 14211 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:36.955780 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 76477.4us
I20260709 12:24:36.940579 11672 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 5.
I20260709 12:24:36.943691 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:36.890849 14249 consensus_queue.cc:1059] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.194s
I20260709 12:24:36.963371 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2099) took 1499 ms. Trace:
I20260709 12:24:36.943228 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2031) took 2497 ms. Trace:
I20260709 12:24:36.946681 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1803) took 1528 ms. Trace:
I20260709 12:24:36.947515 11128 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
I20260709 12:24:36.936154 11125 rpcz_store.cc:276] 0709 12:24:34.464229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.923052 (+2458823us) service_pool.cc:224] Handling call
0709 12:24:36.934031 (+ 10979us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:36.935465 (+  1434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.935692 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:36.952703 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:36.939395 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:36.967096 11129 rpcz_store.cc:276] 0709 12:24:34.441428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.920738 (+2479310us) service_pool.cc:224] Handling call
0709 12:24:36.921071 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:36.932564 (+ 11493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:36.932604 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:36.938383 (+  5779us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:36.938436 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.938505 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:36.938649 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:36.968145 11677 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:36.970679 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2110) took 1252 ms. Trace:
I20260709 12:24:36.969167 10880 catalog_manager.cc:5697] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 4 to 7, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 7 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:36.967579 11132 rpcz_store.cc:276] 0709 12:24:35.412933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.940324 (+1527391us) service_pool.cc:224] Handling call
0709 12:24:36.940694 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:36.941368 (+   674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.941586 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:36.959586 11098 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:36.956622 11097 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:36.942725 14034 raft_consensus.cc:2804] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:36.935876 14031 raft_consensus.cc:2749] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:36.891676 14154 consensus_queue.cc:1048] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
W20260709 12:24:36.962304 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 181637us
I20260709 12:24:36.994283 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:36.994158 14298 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:36.965687 14186 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:36.968590 11674 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:24:36.996201 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:36.996789 11679 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:36.997035 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:36.997412 14186 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:36.997814 11674 raft_consensus.cc:2393] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 8: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:36.998373 11672 pending_rounds.cc:85] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95: Aborting all ops after (but not including) 7
I20260709 12:24:36.998731 11672 pending_rounds.cc:107] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:24:36.953358 14237 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:36.968468 14052 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:37.000351 14302 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:37.000936 14312 log.cc:927] Time spent T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:24:37.002404 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2097) took 1566 ms. Trace:
I20260709 12:24:37.002763 10980 rpcz_store.cc:276] 0709 12:24:35.435794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.763084 (+327290us) service_pool.cc:224] Handling call
0709 12:24:35.763475 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:35.789302 (+ 25827us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:35.789336 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:35.804549 (+ 15213us) log.cc:844] Serialized 26 byte log entry
0709 12:24:36.027447 (+222898us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:36.027495 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.027573 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:37.002162 (+974589us) raft_consensus.cc:1685] finished
0709 12:24:37.002188 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.002341 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19645,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":9328,"thread_start_us":116600,"threads_started":1,"wal-append.queue_time_us":893791}
I20260709 12:24:36.977931 11133 raft_consensus.cc:1217] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Deduplicated request from leader. Original: 5.3->[6.4-6.4]   Dedup: 6.4->[]
I20260709 12:24:37.006150 11133 raft_consensus.cc:1240] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:24:37.006811 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1807) took 1495 ms. Trace:
I20260709 12:24:37.007118 11133 rpcz_store.cc:276] 0709 12:24:35.522818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.957424 (+1434606us) service_pool.cc:224] Handling call
0709 12:24:36.977819 (+ 20395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:37.006535 (+ 28716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.006754 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:36.971220 10981 rpcz_store.cc:276] 0709 12:24:35.718369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.812823 (+ 94454us) service_pool.cc:224] Handling call
0709 12:24:35.813157 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:35.856433 (+ 43276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:35.856474 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:35.910329 (+ 53855us) log.cc:844] Serialized 26 byte log entry
0709 12:24:36.684154 (+773825us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:36.684195 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.684264 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:36.970435 (+286171us) raft_consensus.cc:1685] finished
0709 12:24:36.970470 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:36.970616 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15142,"raft.queue_time_us":33262,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":8617,"thread_start_us":770669,"threads_started":1,"wal-append.queue_time_us":830551}
I20260709 12:24:37.009632 10981 raft_consensus.cc:1240] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:37.009505 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:37.000397 11681 raft_consensus.cc:1240] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:37.011099 10981 raft_consensus.cc:1275] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:37.011462 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:36.981415 13723 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.977823 10975 rpcz_store.cc:276] 0709 12:24:35.463554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.776645 (+313091us) service_pool.cc:224] Handling call
0709 12:24:35.796383 (+ 19738us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:35.833580 (+ 37197us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:36.008384 (+174804us) log.cc:844] Serialized 14 byte log entry
0709 12:24:36.962971 (+954587us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:36.963030 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:36.963088 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.963162 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:36.963300 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28015,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":11426,"raft.queue_time_us":123,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":134,"thread_start_us":443730,"threads_started":2}
I20260709 12:24:36.956370 14046 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:36.959263 14082 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:36.991302 13967 consensus_queue.cc:237] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:36.890599 14304 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:36.998965 11672 raft_consensus.cc:2889] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:37.012203 10949 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:37.008616 11133 raft_consensus.cc:1275] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:37.087101 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2035) took 1364 ms. Trace:
I20260709 12:24:37.087468 11133 rpcz_store.cc:276] 0709 12:24:35.722785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.007909 (+1285124us) service_pool.cc:224] Handling call
0709 12:24:37.008254 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:37.086841 (+ 78587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.087041 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:36.980259 13739 raft_consensus.cc:2804] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:36.998888 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:37.014149 11132 raft_consensus.cc:1240] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:37.010387 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:37.020805 10984 raft_consensus.cc:1275] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:37.021874 11056 raft_consensus.cc:2410] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:24:37.025257 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2112) took 1299 ms. Trace:
W20260709 12:24:37.054584 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.069177 11126 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
W20260709 12:24:37.075068 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.083691 10981 raft_consensus.cc:1240] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:36.979641 14034 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:37.096858 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2095) took 1686 ms. Trace:
I20260709 12:24:37.100641 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2034) took 1384 ms. Trace:
W20260709 12:24:37.101572 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.101032 11673 raft_consensus.cc:2393] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 9: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:37.101413 10984 rpcz_store.cc:276] 0709 12:24:35.410910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.725944 (+315034us) service_pool.cc:224] Handling call
0709 12:24:35.726319 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:36.464918 (+738599us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b4c002e8a00. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8a0b0a20 00007f8f8a0c1a29 00007f8f8a087644 00007f8f8a0aef2d 00007f8f8a0aeb93 00007f8f8bddf18b 00007f8f8bddfcb5 00007f8f8bddaf30 00007f8f8bddc7de 00007f8f8bde6b49 00007f8f8bde7416
0709 12:24:37.096603 (+631685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.096797 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40570752}
I20260709 12:24:37.096796 10982 rpcz_store.cc:276] 0709 12:24:35.726028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.837146 (+111118us) service_pool.cc:224] Handling call
0709 12:24:35.852323 (+ 15177us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:35.897298 (+ 44975us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:35.897333 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:35.926656 (+ 29323us) log.cc:844] Serialized 52 byte log entry
0709 12:24:36.693199 (+766543us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:36.693261 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.693341 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:37.024978 (+331637us) raft_consensus.cc:1685] finished
0709 12:24:37.025014 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.025182 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23337,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":6861,"thread_start_us":589666,"threads_started":1,"wal-append.queue_time_us":703730}
I20260709 12:24:37.103909 11132 rpcz_store.cc:276] 0709 12:24:35.716149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.013569 (+1297420us) service_pool.cc:224] Handling call
0709 12:24:37.013922 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:37.095967 (+ 82045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.100566 (+  4599us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:37.055258 14244 raft_consensus.cc:2764] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 12:24:37.103823 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 91723.6us
W20260709 12:24:37.104105 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 147562us
I20260709 12:24:37.107332 11097 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
W20260709 12:24:37.107201 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 215412us
I20260709 12:24:37.108788 11025 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:37.110770 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:37.111616 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.109841 10880 catalog_manager.cc:5697] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 1 to 5, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 5 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:24:37.115770 10949 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:37.114518 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:37.117518 11057 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:24:37.070777 14052 raft_consensus.cc:697] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
W20260709 12:24:37.122747 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 127053us
I20260709 12:24:37.131531 11097 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:37.099414 14165 raft_consensus.cc:3055] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:37.139281 11097 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:37.110021 14199 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:24:37.096179 14302 raft_consensus.cc:2749] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:37.144589 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.104955 14034 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:37.100262 13739 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:37.114236 14148 raft_consensus.cc:2804] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:37.145200 14031 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:37.160840 10880 catalog_manager.cc:5697] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:24:37.127769 14114 raft_consensus.cc:2804] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:37.084932 13723 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:37.166869 11025 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:37.143349 14165 raft_consensus.cc:740] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:37.163985 13739 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:37.166843 14148 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.179147 11097 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:37.173552 10880 catalog_manager.cc:5697] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 3 to 6, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 6 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:37.187950 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 233406us
I20260709 12:24:37.170292 14298 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:37.180523 14130 consensus_meta.cc:287] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.561s	user 0.014s	sys 0.004s
I20260709 12:24:37.174906 14302 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:37.196897 14302 raft_consensus.cc:2749] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:37.196943 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2028) took 2791 ms. Trace:
I20260709 12:24:37.197751 14302 raft_consensus.cc:2804] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:37.198242 14302 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:37.198633 14302 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:37.199222 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:37.200043 11053 raft_consensus.cc:2393] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 6: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:37.201152 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:37.202605 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:37.205641 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:37.207386 14304 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:37.209519 14108 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:37.210407 11057 raft_consensus.cc:1240] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:37.184183 14262 raft_consensus.cc:2804] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:37.177958 14143 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:37.177656 14114 raft_consensus.cc:697] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:37.187094 14148 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:37.216435 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:37.217818 11025 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:37.204078 10880 catalog_manager.cc:5697] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 3 to 5, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 5 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:24:37.228047 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:37.220521 11059 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
W20260709 12:24:37.235347 14327 log.cc:927] Time spent T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:24:37.215022 14325 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.236055 14325 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:37.238485 14165 consensus_queue.cc:260] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:37.239884 14165 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:37.242939 14326 log.cc:927] Time spent T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:24:37.244961 14245 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:37.246199 11125 raft_consensus.cc:1240] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:37.247704 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:37.251876 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:37.264662 11677 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:24:37.266269 11679 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:37.270504 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:24:37.274650 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 80710.2us
W20260709 12:24:37.277855 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 171424us
I20260709 12:24:37.220870 14262 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.276744 10880 catalog_manager.cc:5697] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 5 to 8, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 8 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:37.281388 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:37.281774 11097 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:37.288563 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 70848.9us
I20260709 12:24:37.235522 13723 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:37.245033 14240 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:37.290959 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:37.291982 10949 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:37.295864 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:37.296528 11053 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:37.298128 14332 log.cc:927] Time spent T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:24:37.321210 11097 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:37.285652 14262 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:37.327517 11098 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:24:37.333112 14342 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:37.333716 14342 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:37.334156 14342 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:37.334424 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:37.335204 11679 raft_consensus.cc:2393] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 8: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:37.335713 14302 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:37.336198 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:37.336932 11060 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:24:37.338860 14345 raft_consensus.cc:2804] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:37.339336 14345 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:37.338717 10880 catalog_manager.cc:5697] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 3 to 6, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 6 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:37.339730 14345 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:37.340430 10880 catalog_manager.cc:5697] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
W20260709 12:24:37.333344 14322 log.cc:927] Time spent T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:24:37.292831 14304 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.300304 14031 raft_consensus.cc:2749] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:37.356000 11098 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:37.320055 14298 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:37.360085 10880 catalog_manager.cc:5697] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:24:37.364504 10880 catalog_manager.cc:5697] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:24:37.337982 14302 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:37.274081 14052 consensus_queue.cc:237] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:37.378878 11678 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:37.382512 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:37.384529 10880 catalog_manager.cc:5697] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:24:37.384841 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2026) took 2980 ms. Trace:
I20260709 12:24:37.388535 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:37.388268 11134 rpcz_store.cc:276] 0709 12:24:34.404485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.769428 (+2364943us) service_pool.cc:224] Handling call
0709 12:24:36.780206 (+ 10778us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:24:36.876411 (+ 96205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:36.876444 (+    33us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:24:36.921480 (+ 45036us) log.cc:844] Serialized 78 byte log entry
0709 12:24:37.099755 (+178275us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:37.109088 (+  9333us) log.cc:844] Serialized 14 byte log entry
0709 12:24:37.132648 (+ 23560us) log.cc:844] Serialized 14 byte log entry
0709 12:24:37.332527 (+199879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.332622 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:37.384592 (+ 51970us) raft_consensus.cc:1685] finished
0709 12:24:37.384617 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.384781 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22941,"prepare.queue_time_us":20909,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":88,"raft.queue_time_us":60052,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":22747,"spinlock_wait_cycles":29791360,"thread_start_us":337741,"threads_started":2,"wal-append.queue_time_us":296465}
I20260709 12:24:37.343183 14130 consensus_queue.cc:1059] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
W20260709 12:24:37.374558 14337 log.cc:927] Time spent T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 12:24:37.401237 11643 leader_election.cc:336] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 2.804s (SENT)
W20260709 12:24:37.377375 14218 consensus_meta.cc:287] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.636s	user 0.006s	sys 0.003s
I20260709 12:24:37.410189 13723 consensus_queue.cc:1048] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:24:37.414469 14245 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:37.394654 10880 catalog_manager.cc:5697] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 1 to 4, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 4 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:24:37.434126 14218 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:37.437122 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:37.448519 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 47329.9us
W20260709 12:24:37.451375 11643 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.758s (SENT) [suppressed 20 similar messages]
I20260709 12:24:37.361532 14304 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:37.448766 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:37.458288 11679 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:37.454571 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:37.455870 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:37.459954 11134 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 5.
I20260709 12:24:37.394640 14356 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:37.431679 14298 raft_consensus.cc:697] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:37.461180 10880 catalog_manager.cc:5697] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 2 to 9. New cstate: current_term: 9 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:37.434549 14302 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:37.462447 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:37.462639 13739 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:37.436743 14340 raft_consensus.cc:2749] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:37.469434 11053 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:24:37.480782 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:37.481762 11053 raft_consensus.cc:2410] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 12:24:37.469954 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 128985us
I20260709 12:24:37.372613 14211 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:37.437229 14082 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:37.486964 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.384187 14345 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:37.441177 14218 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:37.488771 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:37.395892 14114 consensus_queue.cc:237] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:37.493180 10880 catalog_manager.cc:5697] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 1 to 4, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 4 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:24:37.491743 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:37.448069 13721 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:37.477173 14325 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:37.533145 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:37.505270 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.498875 14304 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:37.516507 11051 raft_consensus.cc:2393] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 9: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:37.519496 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:37.547446 11053 raft_consensus.cc:2368] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 5. Current term is 6.
I20260709 12:24:37.461989 14350 consensus_queue.cc:1059] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:24:37.521612 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:37.551122 11060 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:24:37.522393 14298 consensus_queue.cc:237] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:37.553511 13721 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:37.549288 14237 consensus_meta.cc:287] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.550s	user 0.008s	sys 0.003s
I20260709 12:24:37.554916 14237 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:37.556726 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:37.557427 11673 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:24:37.523624 10880 catalog_manager.cc:5697] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
W20260709 12:24:37.527290 14321 log.cc:927] Time spent T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.540s	user 0.003s	sys 0.000s
I20260709 12:24:37.528849 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:37.572018 11058 raft_consensus.cc:2410] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:24:37.573159 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:37.530604 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:37.486471 14302 raft_consensus.cc:697] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:37.575349 14302 consensus_queue.cc:237] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:37.531738 14353 log.cc:927] Time spent T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
W20260709 12:24:37.537096 11643 leader_election.cc:336] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.662s (SENT)
I20260709 12:24:37.521045 13739 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:37.522964 14164 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:37.578997 14342 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:37.579578 11055 raft_consensus.cc:1240] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:37.581658 14342 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:37.584009 10880 catalog_manager.cc:5697] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 4 to 5, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 5 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:37.551589 14262 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:37.564239 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:37.589494 11058 raft_consensus.cc:2410] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:37.588002 14345 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:37.629995 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:37.672465 11053 raft_consensus.cc:2410] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:24:37.623238 10880 catalog_manager.cc:5697] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 1 to 3, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 3 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:37.676451 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:37.678232 11134 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
W20260709 12:24:37.692157 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 85967.7us
I20260709 12:24:37.694945 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:37.695726 11672 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:37.696601 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:37.694597 11673 raft_consensus.cc:1275] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:37.701409 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:37.702626 14237 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:37.702847 11054 raft_consensus.cc:1217] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 6.7->[7.8-7.8]   Dedup: 7.8->[]
I20260709 12:24:37.702929 11053 raft_consensus.cc:1240] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:37.703403 11054 raft_consensus.cc:1240] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:24:37.672580 14205 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
I20260709 12:24:37.720856 14211 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:37.723116 11053 raft_consensus.cc:1240] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:37.724982 14229 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:37.726337 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:37.729534 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:37.731235 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:37.739121 13410 consensus_meta.cc:287] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.836s	user 0.011s	sys 0.000s
I20260709 12:24:37.739604 13410 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:37.740656 11127 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:37.738893 10980 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:37.742960 10980 raft_consensus.cc:1275] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:37.744382 10980 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:24:37.745405 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:24:37.746206 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 212267us
I20260709 12:24:37.747423 11645 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
W20260709 12:24:37.731969 11059 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41294 (request call id 1402) took 2162 ms (client timeout 2771 ms). Trace:
I20260709 12:24:37.734300 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:37.735906 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:37.709352 14148 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:37.738160 14244 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.750674 10977 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:37.749766 11059 rpcz_store.cc:269] 0709 12:24:35.569513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.569646 (+   133us) service_pool.cc:224] Handling call
0709 12:24:37.731778 (+2162132us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54002df854. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:37.731911 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3687086336}
I20260709 12:24:37.753773 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:37.729421 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:37.760896 11058 raft_consensus.cc:1275] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:24:37.756873 11098 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:37.761857 11673 raft_consensus.cc:2393] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 9: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:37.762002 10975 raft_consensus.cc:1240] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:37.758466 11127 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:24:37.767112 11098 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:37.768491 11098 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:37.770490 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:37.782235 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:37.632189 14034 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:37.784973 10981 raft_consensus.cc:1240] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:24:37.785358 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2045) took 1925 ms. Trace:
I20260709 12:24:37.786641 14343 consensus_queue.cc:1048] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:37.762292 14011 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.787844 14011 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:24:37.790235 14148 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:37.785454 14237 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:37.791994 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2044) took 1955 ms. Trace:
I20260709 12:24:37.792451 11128 rpcz_store.cc:276] 0709 12:24:35.836329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.587032 (+1750703us) service_pool.cc:224] Handling call
0709 12:24:37.587440 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:37.587689 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:37.588038 (+   349us) log.cc:844] Serialized 14 byte log entry
0709 12:24:37.791624 (+203586us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:37.791683 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:37.791737 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.791802 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.791937 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10064,"prepare.queue_time_us":185,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":16199,"raft.run_cpu_time_us":57,"raft.run_wall_time_us":57,"thread_start_us":186798,"threads_started":1,"wal-append.queue_time_us":187181}
I20260709 12:24:37.793637 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:37.794791 14161 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:37.795459 11128 raft_consensus.cc:1275] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:37.796120 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2046) took 1885 ms. Trace:
I20260709 12:24:37.796448 11128 rpcz_store.cc:276] 0709 12:24:35.910704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.794794 (+1884090us) service_pool.cc:224] Handling call
0709 12:24:37.795129 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:37.795838 (+   709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.796026 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:37.787144 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:37.790125 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:37.786268 11134 rpcz_store.cc:276] 0709 12:24:35.860361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.727733 (+1867372us) service_pool.cc:224] Handling call
0709 12:24:37.728068 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:37.728297 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:37.728600 (+   303us) log.cc:844] Serialized 14 byte log entry
0709 12:24:37.784803 (+ 56203us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:37.784860 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:37.784912 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.784977 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.785281 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4209,"prepare.queue_time_us":119,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":10613,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":51592,"threads_started":1,"wal-append.queue_time_us":51922}
I20260709 12:24:37.797922 10977 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:24:37.798807 11059 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:37.782125 14346 raft_consensus.cc:2804] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:37.801021 14346 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:37.774039 14366 log.cc:927] Time spent T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:24:37.807065 11672 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:37.808336 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:37.813899 11053 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:37.814158 11134 raft_consensus.cc:1275] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:24:37.807467 11098 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:37.816144 11126 raft_consensus.cc:1240] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:37.816197 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:37.815027 11134 pending_rounds.cc:85] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 6
I20260709 12:24:37.823693 11134 pending_rounds.cc:107] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:24:37.824036 11134 raft_consensus.cc:2889] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:37.824440 11134 pending_rounds.cc:107] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:24:37.824687 11134 raft_consensus.cc:2889] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:37.825690 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:37.826421 13410 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:37.827236 11059 raft_consensus.cc:1240] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:37.812726 14346 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:37.829377 14015 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:37.772905 14244 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:37.830899 14328 raft_consensus.cc:3055] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:37.831342 14328 raft_consensus.cc:740] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:37.832377 14244 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:37.832231 14328 consensus_queue.cc:260] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:37.833485 14328 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:37.834187 14237 raft_consensus.cc:2749] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:37.838074 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2126) took 1090 ms. Trace:
I20260709 12:24:37.838531 10984 rpcz_store.cc:276] 0709 12:24:36.747503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.103022 (+355519us) service_pool.cc:224] Handling call
0709 12:24:37.103367 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:37.141614 (+ 38247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:37.141645 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:37.152747 (+ 11102us) log.cc:844] Serialized 26 byte log entry
0709 12:24:37.390399 (+237652us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:37.434546 (+ 44147us) log.cc:844] Serialized 14 byte log entry
0709 12:24:37.837473 (+402927us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b180026e120. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88c71c0a 00007f8f923b1219 00007f8f88cf9a40 00007f8f88cf44e4 00007f8f88cf4455 00007f8f8bddc060 00007f8f8bdee716 00007f8f8bdff287 00007f8f8bdff208
0709 12:24:37.837659 (+   186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.837737 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:37.837781 (+    44us) raft_consensus.cc:1685] finished
0709 12:24:37.837873 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.838010 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14470,"prepare.queue_time_us":46404,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":197633,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":12471,"spinlock_wait_cycles":23504640,"thread_start_us":228373,"threads_started":2,"wal-append.queue_time_us":319915}
W20260709 12:24:37.840895 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 351018us
I20260709 12:24:37.842031 14262 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:37.822338 14011 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:37.842923 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2036) took 2119 ms. Trace:
I20260709 12:24:37.843492 11060 raft_consensus.cc:1240] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:37.843675 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.846436 14351 consensus_queue.cc:1059] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:37.848034 13721 consensus_queue.cc:1059] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:37.850507 14342 raft_consensus.cc:3055] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:37.850899 14342 raft_consensus.cc:740] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:37.851773 14342 consensus_queue.cc:260] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:37.854966 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 152967us
I20260709 12:24:37.821210 11098 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:37.855957 11024 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:37.856626 10977 raft_consensus.cc:3055] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:37.857112 10977 raft_consensus.cc:740] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:37.843293 11125 rpcz_store.cc:276] 0709 12:24:35.723050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.023444 (+1300394us) service_pool.cc:224] Handling call
0709 12:24:37.082696 (+ 59252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:37.270688 (+187992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.842692 (+572004us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b5400106654. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:37.842865 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375527168}
I20260709 12:24:37.864894 11023 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:37.871395 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:37.895892 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:37.902988 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 81840.7us
W20260709 12:24:37.903412 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.905133 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:37.914539 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:37.866495 10977 consensus_queue.cc:260] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:37.915974 10977 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:37.917428 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 52642.7us
I20260709 12:24:37.918345 11024 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:37.927093 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:37.926457 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 476) took 1381 ms. Trace:
I20260709 12:24:37.929163 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:37.928838 11134 rpcz_store.cc:276] 0709 12:24:36.545373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.801159 (+1255786us) service_pool.cc:224] Handling call
0709 12:24:37.801950 (+   791us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:37.926195 (+124245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.926394 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:37.926644 11128 raft_consensus.cc:1240] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:37.930891 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2050) took 1237 ms. Trace:
I20260709 12:24:37.931125 11128 rpcz_store.cc:276] 0709 12:24:36.693106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.819309 (+1126203us) service_pool.cc:224] Handling call
0709 12:24:37.914514 (+ 95205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:37.930695 (+ 16181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.930846 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:37.931524 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.833753 14356 raft_consensus.cc:2749] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:37.913945 14011 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:37.914829 14325 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:37.938401 11057 raft_consensus.cc:1240] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:37.914199 13977 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.939397 11125 raft_consensus.cc:1240] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:37.929004 14187 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.067s	user 0.020s	sys 0.050s
I20260709 12:24:37.940418 11134 raft_consensus.cc:1240] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:24:37.926179 14130 raft_consensus.cc:2804] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:37.932225 14052 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:24:37.950124 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 108223us
I20260709 12:24:37.968084 10977 raft_consensus.cc:1275] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:24:38.000459 10977 pending_rounds.cc:85] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 3
I20260709 12:24:37.968627 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:38.000775 10977 pending_rounds.cc:107] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:24:38.001430 10977 raft_consensus.cc:2889] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:37.923395 14262 consensus_queue.cc:1059] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:24:37.843875 14360 consensus_queue.cc:1059] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.101s
W20260709 12:24:37.996654 14187 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.138s	user 0.025s	sys 0.056s
W20260709 12:24:38.009871 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 68019.6us
I20260709 12:24:37.937283 14211 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:37.942059 14011 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:38.017632 14211 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.919761 14346 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:38.022419 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:38.015425 14130 raft_consensus.cc:697] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:24:38.039659 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.071094 13228 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.018576 14336 consensus_queue.cc:1048] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:24:38.077384 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:38.028653 14011 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:38.073143 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:38.029495 14211 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:37.968631 13977 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:38.071682 13228 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:38.092540 11052 raft_consensus.cc:1275] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:24:38.088119 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 78159.7us
I20260709 12:24:38.095803 14034 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:38.098771 14373 log.cc:927] Time spent T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 12:24:38.108330 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 107300us
I20260709 12:24:38.113173 10949 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:38.114424 14130 consensus_queue.cc:237] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:38.110118 14368 log.cc:927] Time spent T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.086s	user 0.000s	sys 0.006s
I20260709 12:24:38.100657 14346 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:38.136235 14378 raft_consensus.cc:2804] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:38.136816 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:38.136847 14378 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.137687 14378 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:38.138164 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:38.138988 10984 raft_consensus.cc:2393] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 10: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:38.139930 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:38.140655 10984 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:24:38.141660 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:38.142490 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:38.142601 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:38.147922 10975 raft_consensus.cc:3055] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:38.148361 10975 raft_consensus.cc:740] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:38.148548 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:38.151176 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:38.154613 10979 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:24:38.154837 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:38.155611 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:38.157368 10979 raft_consensus.cc:2393] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 10: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:38.158625 14214 consensus_queue.cc:1048] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:37.197563 11131 rpcz_store.cc:276] 0709 12:24:34.405137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.858636 (+2453499us) service_pool.cc:224] Handling call
0709 12:24:36.880314 (+ 21678us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:36.925923 (+ 45609us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:36.942203 (+ 16280us) log.cc:844] Serialized 14 byte log entry
0709 12:24:37.196548 (+254345us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:37.196601 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:37.196652 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.196723 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.196855 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18237,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":43,"raft.queue_time_us":56543,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":9071,"thread_start_us":214342,"threads_started":2}
I20260709 12:24:38.161546 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2125) took 1444 ms. Trace:
I20260709 12:24:38.161981 10981 rpcz_store.cc:276] 0709 12:24:36.717460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.102574 (+385114us) service_pool.cc:224] Handling call
0709 12:24:37.128107 (+ 25533us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:37.786231 (+658124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.161283 (+375052us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b5400334354. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:38.161482 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1510000384}
I20260709 12:24:38.163381 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:38.164047 10981 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:24:38.149618 14262 consensus_queue.cc:1048] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:24:38.157857 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2113) took 2427 ms. Trace:
I20260709 12:24:38.163264 14379 raft_consensus.cc:3055] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:38.149874 14108 consensus_queue.cc:1059] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:24:38.151278 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:38.166607 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.164964 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:38.173792 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:38.168131 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.168720 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:38.176573 10976 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
I20260709 12:24:38.165454 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:38.169234 10975 consensus_queue.cc:260] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:38.166896 10982 raft_consensus.cc:2393] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 11: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:38.167694 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:38.171748 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:38.181589 11097 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:38.172520 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:38.182778 11097 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:38.167356 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:38.166359 10983 rpcz_store.cc:276] 0709 12:24:35.730916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.856774 (+125858us) service_pool.cc:224] Handling call
0709 12:24:35.866649 (+  9875us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:35.866861 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:35.866887 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:35.867409 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 12:24:36.523795 (+656386us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:36.523831 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.523907 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:38.156817 (+1632910us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b2400182ca8. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88b7d9c4 00007f8f88b7bacb 00007f8f88d36dc9 00007f8f88d36a55 00007f8f88d35fb0 00007f8f8b9ac488 00007f8f8b9acbe8 00007f8f8b984398 00007f8f8b97f76a 00007f8f8b97ebb6
0709 12:24:38.157581 (+   764us) raft_consensus.cc:1685] finished
0709 12:24:38.157602 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:38.157796 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53739776,"thread_start_us":376654,"threads_started":1,"wal-append.queue_time_us":853138}
I20260709 12:24:38.185750 10975 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:38.186569 10979 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:24:38.188311 10977 raft_consensus.cc:1240] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:38.182214 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:38.188216 10979 raft_consensus.cc:1240] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:38.197666 10984 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
I20260709 12:24:38.197436 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:38.207847 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:38.210160 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:38.210604 10976 raft_consensus.cc:2393] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 6: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:38.204244 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:38.159912 13977 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:38.213443 10978 raft_consensus.cc:1275] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:24:38.216086 11672 raft_consensus.cc:2368] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 8. Current term is 9.
I20260709 12:24:38.196873 11644 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:38.169039 14379 raft_consensus.cc:740] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:38.195463 14328 raft_consensus.cc:3055] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:38.226119 11644 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:38.228340 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.203254 14108 consensus_queue.cc:1048] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
W20260709 12:24:38.229867 14371 log.cc:927] Time spent T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:24:38.198551 14306 raft_consensus.cc:2749] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:38.198850 14034 raft_consensus.cc:2804] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:38.232370 14034 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:38.223982 14356 consensus_queue.cc:1048] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.009s
W20260709 12:24:38.239154 10948 connection.cc:256] RPC call timeout handler was delayed by -4.5176960690005217s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
W20260709 12:24:38.239697 10948 connection.cc:256] RPC call timeout handler was delayed by -4.4233144320000974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1837s for a response
W20260709 12:24:38.232674 14382 log.cc:927] Time spent T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
W20260709 12:24:38.250131 10948 connection.cc:256] RPC call timeout handler was delayed by -4.2008960690004642s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2122s for a response
I20260709 12:24:38.251814 10975 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:38.232857 14378 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:38.250185 11672 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:24:38.194164 14346 consensus_queue.cc:1048] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:24:38.258033 11681 raft_consensus.cc:1275] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:24:38.259588 10948 connection.cc:256] RPC call timeout handler was delayed by -1.4199377110003297s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.42510000000000003s for a response
I20260709 12:24:38.227309 14046 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:38.232800 14034 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:38.229903 14199 raft_consensus.cc:3055] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:24:38.277045 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 115308us
I20260709 12:24:38.278077 11678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41762 (request call id 649) took 1312 ms. Trace:
I20260709 12:24:38.242633 13977 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.227823 14328 raft_consensus.cc:740] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:24:38.281677 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 55666.2us
I20260709 12:24:38.282255 11678 rpcz_store.cc:276] 0709 12:24:36.956084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.971271 (+ 15187us) service_pool.cc:224] Handling call
0709 12:24:38.268370 (+1297099us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b5400446bd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:38.268515 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":882685312}
I20260709 12:24:38.287436 11644 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:38.287823 14262 consensus_queue.cc:1048] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:38.267161 14380 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.291513 11644 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:38.274556 14249 raft_consensus.cc:3055] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:38.282682 14143 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.281972 14199 raft_consensus.cc:740] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:38.279358 14046 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.291492 11023 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:24:38.274746 14350 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:38.309268 11023 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:38.284798 14100 raft_consensus.cc:2749] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:38.313696 14028 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:38.313858 14378 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:38.314427 14028 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.314723 11055 raft_consensus.cc:1240] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:38.314857 14028 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:38.315682 14172 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:38.316095 14172 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:38.304260 14249 raft_consensus.cc:740] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:38.254309 14379 consensus_queue.cc:260] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:38.308625 14262 raft_consensus.cc:2749] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:38.316452 14172 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:38.313839 11059 raft_consensus.cc:1275] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:24:38.310257 14046 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:38.286418 14130 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:24:38.332068 11023 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:38.293843 13977 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:38.320938 14215 consensus_queue.cc:1048] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:24:38.325966 14026 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:38.336289 14161 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:38.356710 10980 raft_consensus.cc:1240] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:24:38.318998 14143 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:38.364768 10975 raft_consensus.cc:1240] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:38.366677 10977 raft_consensus.cc:1240] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:38.336549 14386 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:24:38.375996 10978 raft_consensus.cc:1240] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:38.349928 14232 consensus_queue.cc:1048] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:24:38.346899 14328 consensus_queue.cc:260] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:38.381750 14328 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:38.386705 14390 consensus_queue.cc:1048] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:24:38.388567 14052 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.332481 14164 consensus_queue.cc:1059] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:24:38.334903 14168 consensus_queue.cc:1059] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:24:38.395011 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:38.403048 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:38.308540 14380 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:38.403191 11672 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:38.403810 11060 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:38.404618 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:38.411998 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:38.351066 14229 consensus_queue.cc:1059] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:24:38.396687 14379 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:38.372006 14161 raft_consensus.cc:697] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:38.398600 14356 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:24:38.426337 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:38.404440 14376 log.cc:927] Time spent T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.302s	user 0.001s	sys 0.003s
I20260709 12:24:38.413895 10948 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:38.429345 11054 raft_consensus.cc:1240] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:38.333952 14350 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:38.435971 11643 leader_election.cc:336] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 2.566s (SENT)
I20260709 12:24:38.443634 11643 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:38.404249 14052 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:38.450031 11672 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:24:38.451157 14378 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:38.427274 14187 raft_consensus.cc:3055] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:24:38.479189 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.443516 14356 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:38.401182 14306 consensus_queue.cc:1059] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:24:38.477770 14100 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:38.495757 14342 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:38.455895 14388 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:38.502420 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.503594 14172 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:38.506917 14143 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:38.512012 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 98185.9us
I20260709 12:24:38.398607 14199 consensus_queue.cc:260] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:38.482328 14187 raft_consensus.cc:740] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:38.530517 10948 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:38.547798 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 140633us
I20260709 12:24:38.551687 11098 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:38.543395 14143 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:38.555115 11098 leader_election.cc:400] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 8. Current term is 9.
I20260709 12:24:38.556550 10948 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:38.561193 11098 leader_election.cc:403] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 12:24:38.572638 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.575233 11132 raft_consensus.cc:1240] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:38.566226 11645 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:38.577605 11098 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:38.575371 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:38.557016 14306 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:38.589181 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:38.589249 11127 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:24:38.590170 11130 raft_consensus.cc:2393] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 8: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:38.538028 14161 consensus_queue.cc:237] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:38.592518 11134 raft_consensus.cc:1275] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:24:38.554598 14199 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:38.562696 13977 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:38.602061 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.548415 13721 consensus_queue.cc:1059] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:24:38.581156 14378 raft_consensus.cc:2749] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:38.609354 11645 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
W20260709 12:24:38.598963 14011 consensus_meta.cc:287] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.003s
I20260709 12:24:38.575690 14164 consensus_queue.cc:1048] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:24:38.575556 14082 consensus_queue.cc:1059] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:24:38.622162 14380 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:38.623147 14375 log.cc:927] Time spent T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.473s	user 0.002s	sys 0.000s
I20260709 12:24:38.622283 14252 raft_consensus.cc:3055] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:38.624032 14252 raft_consensus.cc:740] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:38.624925 14252 consensus_queue.cc:260] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:38.626775 14252 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:38.576995 14187 consensus_queue.cc:260] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:38.626823 11060 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:24:38.627930 14187 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:38.604657 14396 raft_consensus.cc:2804] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:38.637581 14329 raft_consensus.cc:2804] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:38.611177 14011 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:38.640460 14011 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:38.682724 13228 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:38.638039 14329 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.668910 14350 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:38.603370 14390 consensus_queue.cc:1059] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:24:38.685756 13228 consensus_queue.cc:1059] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:38.651279 14378 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:38.689550 14378 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:38.690292 14028 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:38.618688 14034 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:38.691778 14378 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:38.692416 14028 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:38.693415 14034 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:38.698547 14395 log.cc:927] Time spent T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 12:24:38.688128 14405 raft_consensus.cc:2749] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 8. Current term is 9.
W20260709 12:24:38.706827 14389 log.cc:927] Time spent T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:24:38.710817 14390 raft_consensus.cc:3055] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:38.711287 14390 raft_consensus.cc:740] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:38.712229 14390 consensus_queue.cc:260] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:38.713557 14390 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:38.714550 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:38.715246 10981 raft_consensus.cc:2376] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7. Re-sending same reply.
W20260709 12:24:38.662845 14392 log.cc:927] Time spent T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 12:24:38.716415 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:38.724246 10981 raft_consensus.cc:2393] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 9: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:38.727942 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:38.728610 10977 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:38.740501 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:38.741381 10983 raft_consensus.cc:2393] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 9: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
W20260709 12:24:38.747187 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 169621us
I20260709 12:24:38.693349 14356 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:38.758268 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:38.752556 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:38.759441 11132 raft_consensus.cc:2410] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:24:38.759160 10980 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:24:38.737660 14034 raft_consensus.cc:2804] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:38.767825 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:38.768028 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:38.768541 11127 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:38.768646 10983 raft_consensus.cc:2393] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 8: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:38.771359 11060 raft_consensus.cc:1275] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:24:38.772686 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:38.774084 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:38.775681 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:38.765729 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:38.684104 14052 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:38.780689 10981 raft_consensus.cc:2410] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:24:38.756672 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 210601us
I20260709 12:24:38.649482 14046 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:38.686381 14329 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:38.796649 10977 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:38.807893 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:38.760769 14402 raft_consensus.cc:3055] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:38.737841 14114 consensus_queue.cc:1059] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:24:38.811236 10948 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:38.819046 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:38.823949 11132 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:38.824334 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:38.835995 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.837823 11127 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:38.839159 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:38.789179 14306 raft_consensus.cc:697] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 7 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:38.857265 11132 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
I20260709 12:24:38.761003 13967 consensus_queue.cc:1059] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.061s
W20260709 12:24:38.861244 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.867111 11054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1733) took 1209 ms. Trace:
I20260709 12:24:38.869405 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:38.876055 11059 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:38.881747 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:38.882295 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:38.882966 11125 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:38.841902 14408 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:38.883901 14408 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:38.810359 14356 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.887923 14325 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:38.888465 14325 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:38.887598 14356 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:38.873205 11054 rpcz_store.cc:276] 0709 12:24:37.657592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.704125 (+ 46533us) service_pool.cc:224] Handling call
0709 12:24:37.732117 (+ 27992us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:38.440818 (+708701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.866816 (+425998us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b54001888d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:38.867037 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1602962816}
I20260709 12:24:38.794296 14034 raft_consensus.cc:697] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 9 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
W20260709 12:24:38.890985 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:38.906134 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 297038us
I20260709 12:24:38.895874 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:38.883306 14377 log.cc:927] Time spent T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.782s	user 0.001s	sys 0.004s
W20260709 12:24:38.904908 14398 log.cc:927] Time spent T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 12:24:38.904772 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:38.912281 10979 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:38.912838 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:38.915074 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:38.919595 11678 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:38.856894 14342 raft_consensus.cc:2749] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:38.823053 14402 raft_consensus.cc:740] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:38.913182 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:38.891614 11125 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
I20260709 12:24:38.920497 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:38.920768 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:38.921205 14396 raft_consensus.cc:697] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:38.921823 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:38.922358 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:39.474182 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2037) took 3741 ms. Trace:
I20260709 12:24:38.986428 11055 raft_consensus.cc:1240] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 9. Current term is 10. Ops: []
W20260709 12:24:39.033371 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.157004 11131 raft_consensus.cc:1240] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:39.482405 11132 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:39.482386 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 385062us
W20260709 12:24:39.016287 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.483141 10979 raft_consensus.cc:2393] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 7: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:39.157881 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 471) took 3331 ms. Trace:
I20260709 12:24:38.928166 11673 raft_consensus.cc:1275] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:39.056914 11678 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:24:39.019672 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:38.917870 14211 consensus_meta.cc:287] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.810s	user 0.006s	sys 0.006s
I20260709 12:24:39.482676 11127 raft_consensus.cc:2410] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:24:39.130992 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 230506us
I20260709 12:24:39.162904 11057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1738) took 1243 ms. Trace:
W20260709 12:24:38.924415 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 113276us
I20260709 12:24:39.487459 10980 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:39.487126 11643 leader_election.cc:336] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.521s (SENT)
I20260709 12:24:39.052971 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:39.535061 11643 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:39.083387 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:39.484694 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:38.955717 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:39.536978 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 49907.9us
I20260709 12:24:39.002904 11134 raft_consensus.cc:1240] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:39.048389 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.028544 11051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52804 (request call id 440) took 2051 ms. Trace:
I20260709 12:24:39.223625 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:39.532626 11126 rpcz_store.cc:276] 0709 12:24:35.826597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.584000 (+1757403us) service_pool.cc:224] Handling call
0709 12:24:37.584355 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:37.816562 (+232207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.157573 (+1341011us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b5400030a54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:39.157806 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532628224}
I20260709 12:24:39.542608 10975 raft_consensus.cc:2393] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 9: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:39.533937 11057 rpcz_store.cc:276] 0709 12:24:37.919603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.932643 (+ 13040us) service_pool.cc:224] Handling call
0709 12:24:37.932959 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:37.942903 (+  9944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.162568 (+1219665us) spinlock_profiling.cc:243] Waited 5.23 ms on lock 0x7b5400300cd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:39.162820 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12036992}
I20260709 12:24:39.483511 11133 rpcz_store.cc:276] 0709 12:24:35.733194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.109610 (+1376416us) service_pool.cc:224] Handling call
0709 12:24:37.588834 (+479224us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:37.625905 (+ 37071us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:37.625944 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:38.179905 (+553961us) spinlock_profiling.cc:243] Waited 52.4 ms on lock 0x7b2c000b1d08. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8a6dda11 00007f8f8a6ed372 00007f8f8be1fa01 00007f8f8bde443a 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2
0709 12:24:38.198398 (+ 18493us) log.cc:844] Serialized 26 byte log entry
0709 12:24:38.322971 (+124573us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:38.323012 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.323137 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:38.423468 (+100331us) raft_consensus.cc:1685] finished
0709 12:24:38.423487 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:39.473934 (+1050447us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b54000eecd0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:39.474091 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37154,"raft.queue_time_us":186,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":5939,"spinlock_wait_cycles":1144437888,"thread_start_us":89352,"threads_started":1,"wal-append.queue_time_us":197485,"wal-append.run_cpu_time_us":1950,"wal-append.run_wall_time_us":1006425}
I20260709 12:24:39.535151 10977 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 5.
W20260709 12:24:39.538535 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:39.535131 11097 leader_election.cc:336] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.628s (SENT)
W20260709 12:24:39.550431 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:39.551093 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.551018 11097 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:39.535382 10981 raft_consensus.cc:2393] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 9: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:39.538514 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:39.546495 14082 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:39.088699 14222 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.924s	user 0.008s	sys 0.008s
I20260709 12:24:39.549441 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:39.538828 11051 rpcz_store.cc:276] 0709 12:24:36.956661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.970719 (+ 14058us) service_pool.cc:224] Handling call
0709 12:24:39.007406 (+2036687us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b54000b68d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:39.007549 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":964913536}
I20260709 12:24:39.552640 11678 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
W20260709 12:24:39.479023 14374 log.cc:927] Time spent T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 1.387s	user 0.000s	sys 0.012s
I20260709 12:24:39.548962 14211 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:39.148622 14249 consensus_queue.cc:260] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:39.569774 14249 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:38.933559 11098 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:39.481974 14331 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.366s	user 0.005s	sys 0.018s
I20260709 12:24:39.219877 14052 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:39.219455 14424 log.cc:927] Time spent T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:24:39.510676 14015 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.420462 14108 raft_consensus.cc:3055] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:39.476095 14172 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:39.153889 14026 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:39.507853 14302 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.564672 11127 raft_consensus.cc:1240] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:38.915639 14034 consensus_queue.cc:237] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:39.220438 14046 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:39.229789 14421 log.cc:927] Time spent T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 12:24:39.489504 14408 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:39.003643 14405 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.006429 14306 consensus_queue.cc:237] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:39.570351 14416 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.570523 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:39.570830 14426 log.cc:927] Time spent T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:24:39.571858 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:39.572265 14356 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:39.572634 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2038) took 3813 ms. Trace:
W20260709 12:24:39.573221 14329 consensus_meta.cc:287] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.744s	user 0.004s	sys 0.004s
I20260709 12:24:39.636714 10979 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:39.634770 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2147) took 1281 ms. Trace:
I20260709 12:24:39.565809  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:39.109517 14199 consensus_meta.cc:287] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.505s	user 0.005s	sys 0.002s
I20260709 12:24:39.629309 14026 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:39.566872 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:39.638796 11129 rpcz_store.cc:276] 0709 12:24:35.759351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.553060 (+1793709us) service_pool.cc:224] Handling call
0709 12:24:37.553503 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:37.553946 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:37.553974 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:37.701719 (+147745us) log.cc:844] Serialized 26 byte log entry
0709 12:24:37.905155 (+203436us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:37.905198 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.905262 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:39.478342 (+1573080us) spinlock_profiling.cc:243] Waited 5.73 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:39.572321 (+ 93979us) raft_consensus.cc:1685] finished
0709 12:24:39.572343 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:39.572563 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":596,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":13174016,"thread_start_us":134973,"threads_started":1,"wal-append.queue_time_us":229482}
I20260709 12:24:39.639736 14416 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:39.622323 14414 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:39.638525 14405 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:39.642285 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2155) took 1036 ms. Trace:
I20260709 12:24:39.637850 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:39.638629 10983 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:39.583310 11643 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:39.120648 14262 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:39.024410 14409 log.cc:927] Time spent T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 12:24:39.470985 14346 raft_consensus.cc:3055] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:24:39.152906 14410 log.cc:927] Time spent T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.282s	user 0.000s	sys 0.000s
I20260709 12:24:39.586270 11054 raft_consensus.cc:2393] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 11: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:39.586552 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:39.587985 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:39.247406 13977 raft_consensus.cc:3055] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:24:39.589411 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 54311.6us
I20260709 12:24:39.655926 11134 raft_consensus.cc:2393] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 10: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:39.590068 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:24:39.470314 14325 consensus_meta.cc:287] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.581s	user 0.011s	sys 0.000s
W20260709 12:24:39.556313 14222 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.392s	user 0.018s	sys 0.038s
I20260709 12:24:39.409090 14100 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.218695 14011 raft_consensus.cc:3055] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:39.006364 13739 raft_consensus.cc:3055] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:39.677759 10977 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
W20260709 12:24:39.607928 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.581856 11132 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
I20260709 12:24:39.611213 14378 consensus_queue.cc:1059] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:39.613391 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:39.586584 14331 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.471s	user 0.008s	sys 0.024s
I20260709 12:24:39.649703 14346 raft_consensus.cc:740] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:39.619863 14388 raft_consensus.cc:3055] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:39.595077 14237 raft_consensus.cc:2749] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:39.657506 14356 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.645938 14046 consensus_queue.cc:1059] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:24:39.617643 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:39.556653 14360 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.647665 14329 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:39.690747 11056 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 465) took 1279 ms. Trace:
I20260709 12:24:39.690616 14360 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:39.691176 11056 rpcz_store.cc:276] 0709 12:24:38.411229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.411403 (+   174us) service_pool.cc:224] Handling call
0709 12:24:38.411778 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:38.417459 (+  5681us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:38.417497 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:38.433986 (+ 16489us) log.cc:844] Serialized 26 byte log entry
0709 12:24:38.612877 (+178891us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:38.612918 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.612985 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:39.690528 (+1077543us) raft_consensus.cc:1685] finished
0709 12:24:39.690548 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:39.690688 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5228,"raft.queue_time_us":5362,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":11804,"thread_start_us":126982,"threads_started":1,"wal-append.queue_time_us":310070}
I20260709 12:24:39.625056 11125 raft_consensus.cc:1240] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:24:39.625839 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:39.669551 14325 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:39.692708 14026 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:39.694024 11126 raft_consensus.cc:1240] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:24:38.972414 14164 consensus_queue.cc:1048] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.631s
I20260709 12:24:39.694868 14325 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:39.623593 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.629784 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:39.696512 11127 raft_consensus.cc:2393] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 9: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:39.697352 11675 raft_consensus.cc:1240] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:39.652945 14420 consensus_queue.cc:1059] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
W20260709 12:24:39.613922 14422 log.cc:927] Time spent T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.517s	user 0.010s	sys 0.001s
I20260709 12:24:39.633177 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:39.702090 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:24:39.636097 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.643910 10979 raft_consensus.cc:2376] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11. Re-sending same reply.
W20260709 12:24:39.645258 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 62062.6us
I20260709 12:24:39.703951 11643 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:39.704416 10983 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:39.623410 14108 raft_consensus.cc:740] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:39.643551 10978 rpcz_store.cc:276] 0709 12:24:38.605893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.606060 (+   167us) service_pool.cc:224] Handling call
0709 12:24:38.618753 (+ 12693us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:38.644346 (+ 25593us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:38.644375 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:38.644862 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 12:24:38.777389 (+132527us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:38.777431 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.777505 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:39.229124 (+451619us) spinlock_profiling.cc:243] Waited 4.94 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:39.631956 (+402832us) raft_consensus.cc:1685] finished
0709 12:24:39.631976 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:39.642209 (+ 10233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25012,"raft.queue_time_us":34077,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":10680,"spinlock_wait_cycles":11366656,"thread_start_us":132200,"threads_started":1,"wal-append.queue_time_us":420319}
I20260709 12:24:39.705760 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:39.664482 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:39.672554 14100 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:39.657608 14414 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:39.607252 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 673753us
I20260709 12:24:39.707326 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:39.708140 10979 raft_consensus.cc:2393] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 6: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:39.649101 14390 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:24:39.679577 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.679838 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:39.710057 11132 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:39.710495 10949 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:39.613008 14396 consensus_queue.cc:237] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:39.626890 14015 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:39.681775 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:39.605497 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:39.683444 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:39.630380 14302 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:39.612444 14402 consensus_queue.cc:260] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:39.673758 14011 raft_consensus.cc:740] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:39.674698 13739 raft_consensus.cc:740] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:39.689118 14356 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:39.658888 13977 raft_consensus.cc:740] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:39.716734 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:39.717294 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:39.654528 14262 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:39.720382 11643 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:39.721004 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1448) took 1007 ms. Trace:
I20260709 12:24:39.700748 14164 raft_consensus.cc:3055] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:39.637852 10982 rpcz_store.cc:276] 0709 12:24:38.353580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.233544 (+879964us) service_pool.cc:224] Handling call
0709 12:24:39.233946 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:39.234203 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:39.234466 (+   263us) log.cc:844] Serialized 14 byte log entry
0709 12:24:39.634392 (+399926us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:39.634450 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:39.634501 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.634566 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:39.634708 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2646,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":97,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":10880,"thread_start_us":399402,"threads_started":1}
W20260709 12:24:39.957469 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.732151 11132 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
W20260709 12:24:39.978935 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:39.979470 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.824648 11058 raft_consensus.cc:1240] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:39.789345 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:39.833931 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:39.764803 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:39.771982 10978 raft_consensus.cc:3055] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:39.981096 10978 raft_consensus.cc:740] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:39.763912 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:39.982164 11056 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:39.728330 10949 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:39.973443 11672 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
W20260709 12:24:39.867424 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 54233.4us
I20260709 12:24:39.919206 11051 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:24:39.976048 10979 rpcz_store.cc:276] 0709 12:24:38.713196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.707090 (+993894us) service_pool.cc:224] Handling call
0709 12:24:39.720943 (+ 13853us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:39.685820 14378 consensus_queue.cc:1243] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [LEADER]: Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:39.899005 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1450) took 1185 ms. Trace:
I20260709 12:24:39.789402 11677 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:39.993940 10977 rpcz_store.cc:276] 0709 12:24:38.713630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.570189 (+856559us) service_pool.cc:224] Handling call
0709 12:24:39.898786 (+328597us) spinlock_profiling.cc:243] Waited 6.94 ms on lock 0x7b540009b354. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:39.898924 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15971072}
I20260709 12:24:39.973124 11134 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:39.974130 10981 raft_consensus.cc:2393] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 8: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:39.995198 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:39.973562 11133 raft_consensus.cc:2393] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 6: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:39.975180 11679 raft_consensus.cc:2393] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 9: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:39.995450 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1465) took 1248 ms. Trace:
I20260709 12:24:39.692765 14329 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
I20260709 12:24:39.685988 14388 raft_consensus.cc:740] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:39.728895 11673 raft_consensus.cc:1275] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:24:40.008723 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 460957us
I20260709 12:24:39.998817 10981 rpcz_store.cc:276] 0709 12:24:38.746812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.583905 (+837093us) service_pool.cc:224] Handling call
0709 12:24:39.995391 (+411486us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:39.979797 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:24:39.999840 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 254800us
I20260709 12:24:40.022128 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:39.692762 14360 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:39.904053 14428 log.cc:927] Time spent T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.245s	user 0.000s	sys 0.000s
W20260709 12:24:39.863711 14429 log.cc:927] Time spent T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
W20260709 12:24:39.858415 14431 log.cc:927] Time spent T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.002s
I20260709 12:24:39.996707 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:40.049513 10979 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:40.022953 10949 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:39.694908 14026 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:39.982030 10978 consensus_queue.cc:260] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:39.719179 14390 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:39.883635 14331 raft_consensus.cc:3055] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:39.858763 14161 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.789880 14222 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.789747 14199 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:40.032708 11131 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:40.033197 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:39.875550 14416 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:40.034166 10948 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:39.764034 14046 raft_consensus.cc:2749] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:40.038403 11132 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:40.040745 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:40.065055 11133 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
I20260709 12:24:40.043015 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2161) took 1267 ms. Trace:
I20260709 12:24:39.977463 14164 raft_consensus.cc:740] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:40.004244 14342 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:24:40.084311 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 58985.9us
W20260709 12:24:40.044219 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.984503 14405 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:39.918678 14108 consensus_queue.cc:260] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:40.047886 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2162) took 1266 ms. Trace:
I20260709 12:24:40.093466 10976 rpcz_store.cc:276] 0709 12:24:38.781938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.025184 (+1243246us) service_pool.cc:224] Handling call
0709 12:24:40.047364 (+ 22180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:40.047553 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:40.047589 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:40.047633 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:40.047667 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.047718 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:40.047824 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:40.032848 14402 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:39.813724 14130 consensus_queue.cc:1059] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.226s
I20260709 12:24:39.905267 14100 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:40.051766 10978 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:40.051796 10949 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:39.761011 14418 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.310s
W20260709 12:24:40.052482 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 261445us
I20260709 12:24:39.760854 14052 consensus_queue.cc:1059] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.279s
I20260709 12:24:39.790441 14414 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:40.050730 14360 raft_consensus.cc:2804] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:40.115199 10948 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:40.062018 11134 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:40.044163 14211 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:40.066064 10982 rpcz_store.cc:276] 0709 12:24:38.775770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.024184 (+1248414us) service_pool.cc:224] Handling call
0709 12:24:40.042454 (+ 18270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:40.042663 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:40.042690 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:40.042736 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:40.042772 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.042824 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:40.042945 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:39.860195 14346 consensus_queue.cc:260] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:40.072548 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:40.075865 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.085780 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:40.126590 11132 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
W20260709 12:24:40.047034 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:40.084357 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 364033us
I20260709 12:24:40.054968 14390 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:40.129340 11643 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
W20260709 12:24:40.095927 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 103216us
I20260709 12:24:40.096135 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:40.131191 11133 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
I20260709 12:24:40.131587 14408 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.055622 14331 raft_consensus.cc:740] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:40.132133 14408 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:40.133136 14331 consensus_queue.cc:260] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:40.099221 10980 consensus_meta.cc:287] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.000s
I20260709 12:24:40.134347 10980 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:40.132189 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:40.124364 11056 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:24:40.112663 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2165) took 1197 ms. Trace:
I20260709 12:24:40.135973 11133 raft_consensus.cc:2393] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 9: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:40.134341 11025 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:40.137053 10976 rpcz_store.cc:276] 0709 12:24:38.915015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.094572 (+1179557us) service_pool.cc:224] Handling call
0709 12:24:40.112137 (+ 17565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:40.112328 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:40.112355 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:40.112396 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:40.112433 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.112484 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:40.112597 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:40.140918 10980 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1457) took 1405 ms (client timeout 1795 ms). Trace:
I20260709 12:24:40.140913 11025 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
W20260709 12:24:40.141534 10980 rpcz_store.cc:269] 0709 12:24:38.729157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.854073 (+124916us) service_pool.cc:224] Handling call
0709 12:24:40.134782 (+1280709us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:40.060545 14161 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:40.125929 11129 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
I20260709 12:24:40.147758 11025 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:40.149144 11025 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:40.114517 14100 raft_consensus.cc:2804] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:40.066331 14222 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:40.152496 11025 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:40.155901 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:40.164746 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:40.167543 11131 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:40.129307 14108 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:40.167122 11129 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:40.173498 10976 raft_consensus.cc:1275] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:40.174317 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2168) took 1198 ms. Trace:
I20260709 12:24:40.174649 10976 rpcz_store.cc:276] 0709 12:24:38.975913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.140732 (+1164819us) service_pool.cc:224] Handling call
0709 12:24:40.173121 (+ 32389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:40.173996 (+   875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.174239 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:40.136226 14331 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:40.191473 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 535150us
I20260709 12:24:40.199339 11097 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:40.060899 13977 consensus_queue.cc:260] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:40.146394 14130 raft_consensus.cc:2749] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:40.151398 14211 raft_consensus.cc:2749] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:40.164463 14336 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:40.155143 14215 raft_consensus.cc:2804] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:40.191663 14232 raft_consensus.cc:2749] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:40.219692 10976 raft_consensus.cc:1240] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 12:24:40.063905 13739 consensus_queue.cc:260] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:24:40.140729 14306 consensus_queue.cc:1048] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:24:40.169482 14346 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:40.137581 14437 consensus_queue.cc:1059] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 12:24:40.137085 14034 consensus_queue.cc:1059] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 12:24:40.212976 11129 raft_consensus.cc:1275] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:40.162963 14408 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:40.191833 14329 raft_consensus.cc:2749] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:40.098853 14388 consensus_queue.cc:260] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:40.227926 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1472) took 1146 ms. Trace:
I20260709 12:24:40.166185 14100 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:40.225186 14336 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.264967 11129 raft_consensus.cc:1240] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:40.267447 10976 rpcz_store.cc:276] 0709 12:24:39.081579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.175438 (+1093859us) service_pool.cc:224] Handling call
0709 12:24:40.219437 (+ 43999us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:40.227611 (+  8174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.227859 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:40.230182 14249 consensus_meta.cc:287] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.639s	user 0.007s	sys 0.004s
I20260709 12:24:40.241839 11134 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:24:40.292011 11129 raft_consensus.cc:1240] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
W20260709 12:24:40.274031 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 144793us
I20260709 12:24:40.259151 13977 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:40.294505 10976 raft_consensus.cc:1240] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:24:40.299274 11681 raft_consensus.cc:1275] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:24:40.267740 14215 raft_consensus.cc:697] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:40.287401 14100 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:40.330732 14441 log.cc:927] Time spent T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:24:40.325759 14046 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.303509 14262 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:40.307727 13739 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:40.288156 14015 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:40.291112 14336 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:40.293035 14237 raft_consensus.cc:2804] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:40.340656 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1449) took 1627 ms. Trace:
I20260709 12:24:40.290812 14360 raft_consensus.cc:697] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:40.370038 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:40.381892 11125 raft_consensus.cc:1240] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:24:40.299949 14356 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:40.226269 14164 consensus_queue.cc:260] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:40.345285 11132 raft_consensus.cc:1240] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []
W20260709 12:24:40.355706 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.357398 11644 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:40.360239 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:24:40.361284 11128 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1815) took 1609 ms (client timeout 1695 ms). Trace:
W20260709 12:24:40.388041 11128 rpcz_store.cc:269] 0709 12:24:38.752297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.752412 (+   115us) service_pool.cc:224] Handling call
0709 12:24:40.361069 (+1608657us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400374954. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:40.361221 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2911355136}
W20260709 12:24:40.363260 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.390502 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:40.371402 10978 raft_consensus.cc:1275] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:24:40.369344 10976 pending_rounds.cc:85] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 5
I20260709 12:24:40.393576 10976 pending_rounds.cc:107] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:24:40.393909 10976 raft_consensus.cc:2889] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:40.369346 10975 rpcz_store.cc:276] 0709 12:24:38.713408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.826360 (+1112952us) service_pool.cc:224] Handling call
0709 12:24:39.826775 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:39.879952 (+ 53177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:39.879991 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:39.890757 (+ 10766us) log.cc:844] Serialized 26 byte log entry
0709 12:24:40.062395 (+171638us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:40.062435 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.063905 (+  1470us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:40.340371 (+276466us) raft_consensus.cc:1685] finished
0709 12:24:40.340395 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:40.340581 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4250,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":158,"thread_start_us":118606,"threads_started":1,"wal-append.queue_time_us":384283}
I20260709 12:24:40.372592 11131 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
W20260709 12:24:40.356550 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.320773 11643 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:40.382912 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:40.396324 10975 raft_consensus.cc:1275] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:24:40.398169 10978 pending_rounds.cc:85] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 4
I20260709 12:24:40.398923 10978 pending_rounds.cc:107] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:24:40.399335 10978 raft_consensus.cc:2889] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:40.400135 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2159) took 1783 ms. Trace:
I20260709 12:24:40.400548 10978 rpcz_store.cc:276] 0709 12:24:38.616411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.706341 (+1089930us) service_pool.cc:224] Handling call
0709 12:24:39.771828 (+ 65487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:40.399866 (+628038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.400071 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:40.396595 11129 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:24:40.407207 11129 raft_consensus.cc:1275] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:40.338032 14052 raft_consensus.cc:3055] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:40.340212 14378 raft_consensus.cc:2804] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:24:40.408452 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 51118.7us
I20260709 12:24:40.514298 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:40.515215 11057 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
W20260709 12:24:40.409178 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 209916us
W20260709 12:24:40.409224 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 88557.4us
I20260709 12:24:40.516932 11643 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:40.426352 14052 raft_consensus.cc:740] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:40.359017 14262 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:40.346210 14414 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:40.486511 14015 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:40.408669 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:40.521314 11125 raft_consensus.cc:2393] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 9: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:40.366922 14237 raft_consensus.cc:697] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 7 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:40.342757 14222 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:40.470021 11134 raft_consensus.cc:1275] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:40.363087 14215 consensus_queue.cc:237] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:40.471372 11132 raft_consensus.cc:1275] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:24:40.452589 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:40.480163 14429 log.cc:927] Time spent T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.425s	user 0.004s	sys 0.000s
I20260709 12:24:40.539194 14237 consensus_queue.cc:237] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:40.464443 14164 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:40.494361 10978 raft_consensus.cc:1240] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:40.541388 14052 consensus_queue.cc:260] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:40.542517 14052 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:40.467175 14011 consensus_queue.cc:260] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:40.338820 14046 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:40.480280 14402 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.402431 14199 raft_consensus.cc:697] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 7 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:40.465991 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2148) took 2112 ms. Trace:
I20260709 12:24:40.557502 10984 rpcz_store.cc:276] 0709 12:24:38.353869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.554375 (+1200506us) service_pool.cc:224] Handling call
0709 12:24:39.563845 (+  9470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:40.033455 (+469610us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:40.033486 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:40.037116 (+  3630us) log.cc:844] Serialized 26 byte log entry
0709 12:24:40.195670 (+158554us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:40.195709 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.195786 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:40.465717 (+269931us) raft_consensus.cc:1685] finished
0709 12:24:40.465743 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:40.465920 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40493,"raft.queue_time_us":55377,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":586866,"threads_started":2,"wal-append.queue_time_us":344009}
I20260709 12:24:40.475636 14416 raft_consensus.cc:3055] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:40.478904 11023 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:40.478545 14360 consensus_queue.cc:237] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:40.552670 11098 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:40.343842 14161 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:40.529335 11131 raft_consensus.cc:1275] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:24:40.524704 14262 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:40.520131 14249 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:40.535543 14015 raft_consensus.cc:697] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:40.536945 11643 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
W20260709 12:24:40.583755 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 46900.7us
I20260709 12:24:40.509140 14460 raft_consensus.cc:2749] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:40.538084 14446 consensus_queue.cc:1059] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:40.545370 11097 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
W20260709 12:24:40.545235 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 492971us
W20260709 12:24:40.591133 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 45871.2us
I20260709 12:24:40.591655 11678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 674) took 1008 ms. Trace:
I20260709 12:24:40.592113 11678 rpcz_store.cc:276] 0709 12:24:39.582865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.584065 (+  1200us) service_pool.cc:224] Handling call
0709 12:24:39.584479 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:39.637094 (+ 52615us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:39.637124 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:39.648071 (+ 10947us) log.cc:844] Serialized 26 byte log entry
0709 12:24:40.036572 (+388501us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:40.036612 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.036689 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:40.591460 (+554771us) raft_consensus.cc:1685] finished
0709 12:24:40.591477 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:40.591597 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39327,"raft.queue_time_us":50031,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":9159,"thread_start_us":364076,"threads_started":1,"wal-append.queue_time_us":833472}
I20260709 12:24:40.549556 11125 raft_consensus.cc:1275] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:24:40.553705 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 438558us
I20260709 12:24:40.514469 13977 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:40.559950 14416 raft_consensus.cc:740] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:24:40.560837 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 388661us
I20260709 12:24:40.595844 11643 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:40.504858 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 62542.8us
W20260709 12:24:40.562819 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 84002.7us
I20260709 12:24:40.567796 14222 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:24:40.571115 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.602347 11025 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:40.610783 11025 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:40.559815 14402 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:40.518052 14302 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:40.568346 14011 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:40.597705 11645 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:40.591881 11097 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:40.567142 14414 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:40.577983 14342 raft_consensus.cc:697] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 9 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:40.613967 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:40.625710 10978 raft_consensus.cc:2393] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 10: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:40.559559 14390 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:40.614933 11058 raft_consensus.cc:1275] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:40.561614 14466 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:24:40.575908 11098 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:40.635878 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 66958.5us
I20260709 12:24:40.627249 11644 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:40.614173 14161 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:40.618682 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.600239 14306 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:40.581385 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2059) took 1039 ms. Trace:
I20260709 12:24:40.707458 11127 rpcz_store.cc:276] 0709 12:24:39.541774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.897117 (+355343us) service_pool.cc:224] Handling call
0709 12:24:39.933967 (+ 36850us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:39.934251 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:40.156931 (+222680us) log.cc:844] Serialized 14 byte log entry
0709 12:24:40.580764 (+423833us) log.cc:844] Serialized 14 byte log entry
0709 12:24:40.580986 (+   222us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:40.581035 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:40.581089 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.581167 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:40.581311 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27215,"prepare.queue_time_us":262703,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":89,"raft.queue_time_us":171,"spinlock_wait_cycles":11954688,"thread_start_us":599114,"threads_started":2}
I20260709 12:24:40.563160 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2057) took 1021 ms. Trace:
I20260709 12:24:40.627867 11097 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:24:40.599444 14459 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:40.704216 11125 raft_consensus.cc:1240] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 6. Current term is 8. Ops: []
I20260709 12:24:40.710851 14444 raft_consensus.cc:2749] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:40.705536 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:40.706730 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:40.710615 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 83024.6us
I20260709 12:24:40.715186 11097 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:40.716359 11097 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:40.726392 11097 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:40.611795 14325 consensus_queue.cc:1048] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:24:40.613972 14028 consensus_queue.cc:1048] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 12:24:40.729213 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:40.731405 10949 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:40.613243 13977 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:40.634642 14302 raft_consensus.cc:2749] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:40.709782 11130 rpcz_store.cc:276] 0709 12:24:39.541325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.693325 (+152000us) service_pool.cc:224] Handling call
0709 12:24:39.693649 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:39.693850 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:40.045353 (+351503us) log.cc:844] Serialized 14 byte log entry
0709 12:24:40.562780 (+517427us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:40.562838 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:40.562894 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.562962 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:40.563092 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2395,"prepare.queue_time_us":390173,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":85490,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":1910,"thread_start_us":865393,"threads_started":3,"wal-append.queue_time_us":506226}
I20260709 12:24:40.640223 14449 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:40.614135 14100 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:40.703066 14329 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:24:40.785566 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.782778 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:40.789954 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:40.819602 10978 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:40.703246 14468 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:40.707350 14306 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:40.705349 14161 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.610378 14336 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
W20260709 12:24:40.824193 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 199680us
I20260709 12:24:40.690052 14378 raft_consensus.cc:697] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:40.828262 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:40.728160 14440 raft_consensus.cc:2749] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:40.753026 14437 raft_consensus.cc:3055] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:40.833405 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:40.833783 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 206590us
W20260709 12:24:40.790380 14443 log.cc:927] Time spent T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 12:24:40.775051 14446 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:40.872078 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:40.832949 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.853458 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:40.777560 14108 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:40.854234 11024 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
W20260709 12:24:40.869711 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 138393us
I20260709 12:24:40.874656 10949 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:40.873600 10978 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:40.876052 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:40.876645 10978 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:40.873065 10979 raft_consensus.cc:1275] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:24:40.885759 11677 raft_consensus.cc:1240] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 9. Current term is 11. Ops: []
I20260709 12:24:40.734009 14249 consensus_queue.cc:1048] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.121s
I20260709 12:24:40.751878 14082 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.114s
I20260709 12:24:40.832933 14414 raft_consensus.cc:2804] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:40.821017 14444 raft_consensus.cc:2749] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:40.706226 14199 consensus_queue.cc:237] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:40.837003 14306 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:40.829257 14161 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:40.829125 14222 raft_consensus.cc:697] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:40.705453 11056 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:24:40.852322 14437 raft_consensus.cc:740] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:40.879268 14302 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.850682 14467 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:40.882254 14446 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.881719 14468 raft_consensus.cc:697] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 9 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:40.897627 14130 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:40.894718 14414 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:40.883148 14108 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.911801 11056 raft_consensus.cc:606] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:24:40.962565 11056 raft_consensus.cc:614] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:40.879576 14440 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:40.964046 14440 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:40.967525 14331 consensus_queue.cc:1059] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:24:40.914958 14471 log.cc:927] Time spent T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
W20260709 12:24:40.929899 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 55311.7us
W20260709 12:24:40.943895 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:40.914808 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.980360 10949 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:24:40.980876 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:40.979736 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 126027us
W20260709 12:24:40.981612 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.982117 10978 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
W20260709 12:24:40.982339 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:40.982857 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:40.983223 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.987775 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:40.983865 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 47004.1us
I20260709 12:24:40.821768 14416 consensus_queue.cc:260] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:40.911569 14465 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:24:41.000875 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.991297 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:40.817936 14015 consensus_queue.cc:237] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:41.001910 11057 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:24:40.972153 14046 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:40.929731 14446 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:41.009819 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.856487 14215 consensus_queue.cc:1048] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:24:40.961299 13739 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.921492 14262 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:40.986138 14458 log.cc:927] Time spent T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.389s	user 0.001s	sys 0.001s
I20260709 12:24:40.960565 14459 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.060103 14459 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:40.960909 14302 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
W20260709 12:24:41.068776 14472 log.cc:927] Time spent T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:24:41.071030 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1454) took 2342 ms. Trace:
I20260709 12:24:41.071440 10981 rpcz_store.cc:276] 0709 12:24:38.728307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.019613 (+1291306us) service_pool.cc:224] Handling call
0709 12:24:40.020047 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:40.020342 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:40.229573 (+209231us) log.cc:844] Serialized 14 byte log entry
0709 12:24:40.375561 (+145988us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:40.406369 (+ 30808us) log.cc:844] Serialized 26 byte log entry
0709 12:24:40.406674 (+   305us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:40.508299 (+101625us) log.cc:844] Serialized 14 byte log entry
0709 12:24:40.511552 (+  3253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.511635 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:41.070806 (+559171us) raft_consensus.cc:1685] finished
0709 12:24:41.070827 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:41.070968 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104200,"prepare.queue_time_us":536056,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":90,"raft.queue_time_us":385063,"raft.run_wall_time_us":17250,"spinlock_wait_cycles":6140160,"thread_start_us":283706,"threads_started":2,"wal-append.queue_time_us":620570}
I20260709 12:24:40.999400 14396 consensus_queue.cc:1048] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:24:40.977945 14414 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:40.960220 14130 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:24:41.000003 14454 log.cc:927] Time spent T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.412s	user 0.001s	sys 0.000s
I20260709 12:24:40.893289 14342 consensus_queue.cc:237] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:40.973289 14460 raft_consensus.cc:2804] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:24:41.037519 14469 log.cc:927] Time spent T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 12:24:41.039772 13739 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:40.980731 14108 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:41.109390 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.065937 14346 consensus_meta.cc:287] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.804s	user 0.006s	sys 0.001s
W20260709 12:24:41.080684 14456 log.cc:927] Time spent T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.443s	user 0.000s	sys 0.001s
I20260709 12:24:41.039322 14461 raft_consensus.cc:2804] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:41.129158 11129 raft_consensus.cc:1275] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:24:40.927879 14467 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:41.132833 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:41.086735 14262 raft_consensus.cc:3055] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:24:41.140266 11023 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.003s	sys 0.003s
W20260709 12:24:41.140859 11023 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.003s	sys 0.003s
W20260709 12:24:41.140461 10980 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.001s	sys 0.005s
I20260709 12:24:41.086958 14130 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:41.142179 10980 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.002s	sys 0.005s
W20260709 12:24:41.143826 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 526902us
I20260709 12:24:41.148303 11672 raft_consensus.cc:1275] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:41.082834 14402 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:41.162232 11673 raft_consensus.cc:1275] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:24:41.086247 14440 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:41.169119 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 442773us
I20260709 12:24:41.169988 11097 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:41.163405 11025 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.009s	sys 0.003s
I20260709 12:24:40.995867 14378 consensus_queue.cc:237] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:41.122682 14390 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:41.174549 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.174021 11025 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.009s	sys 0.003s
I20260709 12:24:41.172410 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:41.134732 14463 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:41.179116 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:41.177654 11097 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:41.013586 14465 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:41.136531 14336 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:41.191725 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 580976us
I20260709 12:24:41.188369 11644 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:41.133860 14461 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:41.208290 11097 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:41.201309 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 221021us
I20260709 12:24:41.140018 14262 raft_consensus.cc:740] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:41.218441 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:41.079999 14222 consensus_queue.cc:237] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:41.219133 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:41.224670 11097 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:41.224874 10949 leader_election.cc:336] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 1.695s (SENT)
I20260709 12:24:41.179067 14491 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.187299 14474 raft_consensus.cc:2804] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:41.226719 11052 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:41.174374 13977 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:41.187644 14459 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:41.225250 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:41.246457 11127 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
W20260709 12:24:41.237150 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 48887us
I20260709 12:24:41.232297 10949 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:41.242240 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:41.248201 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:41.215467 14463 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:41.186148 14418 consensus_queue.cc:1048] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 12:24:41.255091 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.082275 14437 consensus_queue.cc:260] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:41.255983 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2061) took 1713 ms. Trace:
I20260709 12:24:41.212857 14346 raft_consensus.cc:2749] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:41.262404 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:41.262791 14480 log.cc:927] Time spent T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:24:41.169325 14468 consensus_queue.cc:237] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:41.267293 13739 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:41.260219 14052 consensus_meta.cc:287] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.717s	user 0.011s	sys 0.002s
I20260709 12:24:41.269999 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2173) took 1565 ms. Trace:
I20260709 12:24:41.245836 14474 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:41.216235 14100 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:41.188009 14440 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:24:41.278832 11133 rpcz_store.cc:276] 0709 12:24:39.542754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.165197 (+622443us) service_pool.cc:224] Handling call
0709 12:24:40.165625 (+   428us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:40.166024 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:40.166055 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:40.192501 (+ 26446us) log.cc:844] Serialized 52 byte log entry
0709 12:24:40.301846 (+109345us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:40.301889 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.301960 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:41.255703 (+953743us) raft_consensus.cc:1685] finished
0709 12:24:41.255728 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:41.255913 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92240,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":4713,"thread_start_us":72445,"threads_started":1,"wal-append.queue_time_us":423272}
W20260709 12:24:41.278554 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.292505 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 67922us
I20260709 12:24:41.340142 11097 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:41.240626 14336 consensus_queue.cc:1048] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:24:41.226066 14461 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:41.303946 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 108254us
I20260709 12:24:41.332173 10977 rpcz_store.cc:276] 0709 12:24:39.705017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.364890 (+659873us) service_pool.cc:224] Handling call
0709 12:24:40.365238 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:40.365595 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:40.365623 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:40.367977 (+  2354us) log.cc:844] Serialized 26 byte log entry
0709 12:24:40.685896 (+317919us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:40.685946 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.686057 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:41.269746 (+583689us) raft_consensus.cc:1685] finished
0709 12:24:41.269772 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:41.269931 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105091,"raft.queue_time_us":369443,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":19792,"thread_start_us":266681,"threads_started":1,"wal-append.queue_time_us":865855}
I20260709 12:24:41.270396 14459 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:24:41.333987 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 110849us
I20260709 12:24:41.274972 14161 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:41.333847 10948 connection.cc:256] RPC call timeout handler was delayed by -3.3891836459997648s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
I20260709 12:24:41.340884 10949 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:24:41.344162 10948 connection.cc:256] RPC call timeout handler was delayed by -3.3252836459996615s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1673s for a response
W20260709 12:24:41.344578 10948 connection.cc:256] RPC call timeout handler was delayed by -3.26852219400007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 12:24:41.344980 10948 connection.cc:256] RPC call timeout handler was delayed by -3.2541836460000013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
W20260709 12:24:41.345299 10948 connection.cc:256] RPC call timeout handler was delayed by -3.2109836459999315s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18000000000000002s for a response
W20260709 12:24:41.345602 10948 connection.cc:256] RPC call timeout handler was delayed by -3.0966836459997467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1927s for a response
W20260709 12:24:41.345892 10948 connection.cc:256] RPC call timeout handler was delayed by -3.0723836459997074s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
W20260709 12:24:41.346249 10948 connection.cc:256] RPC call timeout handler was delayed by -2.9832836460000181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2053s for a response
W20260709 12:24:41.346558 10948 connection.cc:256] RPC call timeout handler was delayed by -2.9715836459999991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2066s for a response
W20260709 12:24:41.346884 10948 connection.cc:256] RPC call timeout handler was delayed by -2.9553836459999729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20840000000000003s for a response
W20260709 12:24:41.347187 10948 connection.cc:256] RPC call timeout handler was delayed by -2.933783645999938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21080000000000002s for a response
I20260709 12:24:41.278519 14463 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:41.347678 10948 connection.cc:256] RPC call timeout handler was delayed by -2.913983645999906s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.213s for a response
I20260709 12:24:41.352483 11127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:54492
I20260709 12:24:41.353976 11127 raft_consensus.cc:606] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:24:41.354432 11127 raft_consensus.cc:614] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:24:41.355140 10948 connection.cc:256] RPC call timeout handler was delayed by -2.8419836459997896s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
I20260709 12:24:41.351323 10949 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:24:41.355806 10948 connection.cc:256] RPC call timeout handler was delayed by -2.8320836459997736s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22210000000000002s for a response
I20260709 12:24:41.296998 14237 raft_consensus.cc:2749] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:41.295398 14475 raft_consensus.cc:2749] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:41.356707 10982 raft_consensus.cc:1240] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:24:41.291875 14034 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:41.326908 14466 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.368284 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:41.356664 10948 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:41.332921 14444 raft_consensus.cc:2749] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:41.374631 11023 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:41.338560 14474 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:41.246335 14491 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:41.348165 14459 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:41.391022 10977 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
W20260709 12:24:41.411229 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.367506 14495 raft_consensus.cc:2804] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:24:41.455696 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 99113us
W20260709 12:24:41.455982 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 81420.2us
I20260709 12:24:41.444630 14459 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:41.381881 14466 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:41.459017 14011 consensus_meta.cc:287] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.838s	user 0.010s	sys 0.002s
W20260709 12:24:41.461565 14164 consensus_meta.cc:287] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.913s	user 0.009s	sys 0.000s
I20260709 12:24:41.377080 14034 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:41.462850 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2163) took 2548 ms. Trace:
I20260709 12:24:41.328629 14488 consensus_queue.cc:1048] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.100s
I20260709 12:24:41.378839 13739 consensus_queue.cc:1059] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
W20260709 12:24:41.428874 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.379683 14396 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:24:41.481268 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 90492.3us
I20260709 12:24:41.482785 11675 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:41.482872 11023 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:41.372677 14187 consensus_queue.cc:1048] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.095s
I20260709 12:24:41.334524 14262 consensus_queue.cc:260] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:41.447739 14475 raft_consensus.cc:2749] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:41.380738 14360 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:41.501586 10979 rpcz_store.cc:276] 0709 12:24:38.914416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.050535 (+1136119us) service_pool.cc:224] Handling call
0709 12:24:40.050841 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:40.878023 (+827182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:41.462572 (+584549us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b54000d9154. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:41.462781 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1890166144}
I20260709 12:24:41.446758 14390 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:41.486855 14480 log.cc:927] Time spent T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:24:41.519878 14360 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.529767 14360 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:41.486685 14336 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:41.531275 14336 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.531795 14336 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:41.532797 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:41.533505 10979 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:41.534415 14414 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:41.538662 10948 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:41.540736 14414 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:41.496199 14505 raft_consensus.cc:2749] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:41.543807 10979 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
I20260709 12:24:41.498085 14495 raft_consensus.cc:697] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
W20260709 12:24:41.542021 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 201942us
I20260709 12:24:41.548720 11097 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:41.549646 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.550910 11097 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:41.487419 14408 consensus_queue.cc:1059] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 12:24:41.529503 14262 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:41.557637 10948 leader_election.cc:400] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 5 pre-election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 5. Current term is 6.
I20260709 12:24:41.559836 11097 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:41.563779 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.564801 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:41.568231 11097 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:41.571008 11097 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:41.571884 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 71507.4us
I20260709 12:24:41.578238 11097 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:41.580256 14505 raft_consensus.cc:2749] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:41.581259 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 43912us
I20260709 12:24:41.582057 14505 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:41.583503 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:41.578588 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2160) took 2926 ms. Trace:
I20260709 12:24:41.574126 10948 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:41.584668 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:41.587189 10979 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:24:41.588202 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:41.589295 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:41.556056 14414 raft_consensus.cc:2749] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:41.564751 14444 raft_consensus.cc:2804] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:41.559191 14475 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:41.584095 10983 rpcz_store.cc:276] 0709 12:24:38.651958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.381243 (+1729285us) service_pool.cc:224] Handling call
0709 12:24:40.381638 (+   395us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:40.402362 (+ 20724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:40.402394 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:40.402995 (+   601us) log.cc:844] Serialized 52 byte log entry
0709 12:24:40.690902 (+287907us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:40.750655 (+ 59753us) log.cc:844] Serialized 14 byte log entry
0709 12:24:40.868863 (+118208us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b1800315b80. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88c71c0a 00007f8f923b1219 00007f8f88cf9a40 00007f8f88cf44e4 00007f8f88cf4455 00007f8f8bddc060 00007f8f8bdee716 00007f8f8bdff287 00007f8f8bdff208
0709 12:24:40.869058 (+   195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.869149 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:41.565390 (+696241us) raft_consensus.cc:1685] finished
0709 12:24:41.578307 (+ 12917us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:41.578508 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25637,"prepare.queue_time_us":59136,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":41,"raft.queue_time_us":668923,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":103022,"spinlock_wait_cycles":87399424,"thread_start_us":220431,"threads_started":1,"wal-append.queue_time_us":662238}
I20260709 12:24:41.575394 14161 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:41.569973 14440 raft_consensus.cc:2749] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:41.570195 14237 raft_consensus.cc:2749] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:41.582649 14505 raft_consensus.cc:697] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 8 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:41.544160 14390 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:41.599591 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.599684 10983 raft_consensus.cc:1275] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:24:41.556591 14011 consensus_queue.cc:1048] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:24:41.594652 10948 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:41.601501 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.595181 14465 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:41.609704 11126 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58414 (request call id 492) took 1909 ms (client timeout 1801 ms). Trace:
W20260709 12:24:41.609856 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.594185 13739 raft_consensus.cc:2749] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:41.608237 14462 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:41.610319 14501 raft_consensus.cc:2749] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:41.583261 14187 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:41.624619 14479 log.cc:927] Time spent T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:24:41.618253 14475 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:41.716428 14034 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:41.717732 14491 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:41.614745 14493 log.cc:927] Time spent T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:24:41.650863 14161 consensus_queue.cc:1048] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:24:41.718014 14475 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:41.720878 14446 consensus_meta.cc:287] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.643s	user 0.004s	sys 0.007s
I20260709 12:24:41.724107 14459 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:41.632596 14302 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:41.628504 11126 rpcz_store.cc:269] 0709 12:24:39.700071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.359865 (+659794us) service_pool.cc:224] Handling call
0709 12:24:41.609473 (+1249608us) spinlock_profiling.cc:243] Waited 824 ms on lock 0x7b5400030054. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:41.609625 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1895752576}
I20260709 12:24:41.632547 14130 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:41.637529 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:41.643306 14466 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:41.726775 14360 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:41.643791 14390 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:41.727890 14130 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:41.645359 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:41.728852 11052 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:24:41.728991 14360 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:41.645363 14462 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:41.731215 14462 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:41.733265 14492 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:41.733866 14492 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:41.638801 14237 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.735747 14436 raft_consensus.cc:2749] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:41.735555 14237 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:41.736078 14492 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:41.737540 14108 consensus_meta.cc:287] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.604s	user 0.003s	sys 0.005s
I20260709 12:24:41.649338 14215 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.738421 14215 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:41.740761 14215 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:41.737948 14108 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:41.744414 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.721367 14446 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:41.710861 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.608033 14521 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:41.715216 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:41.738343 14505 consensus_queue.cc:237] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:41.757341 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:41.758126 11052 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:24:41.745575 14463 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:41.759177 14396 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:41.759672 14396 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:41.759316 14306 consensus_meta.cc:287] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.841s	user 0.011s	sys 0.000s
I20260709 12:24:41.760645 14463 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:41.760536 14306 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:41.762337 14028 consensus_queue.cc:1048] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:41.760932 11681 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 8: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:41.760432 14446 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:41.763861 14483 raft_consensus.cc:3055] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:41.764036 14028 consensus_queue.cc:1243] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer bc01179655564f29b83babe396377cbb log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:41.764645 14461 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:41.766848 14437 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:41.746086 14336 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:41.753561 14521 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.770612 14521 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:41.770781 14336 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:41.610327 14510 consensus_queue.cc:1048] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.204s
I20260709 12:24:41.607164 14444 raft_consensus.cc:697] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:41.750442 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:41.783852 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:41.784780 10978 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:24:41.752727 13739 raft_consensus.cc:2749] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:41.802929 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2171) took 2099 ms. Trace:
W20260709 12:24:41.716562 14517 log.cc:927] Time spent T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:24:41.806033 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:41.807029 11059 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 8: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:41.806855 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:41.737766 14237 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:41.732415 14474 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:41.754714 11128 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:24:41.791664 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:41.811606 11127 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:41.707530 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 110124us
I20260709 12:24:41.812930 11645 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:41.820902 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:41.762794 14306 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:41.803480 10976 rpcz_store.cc:276] 0709 12:24:39.703871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.326701 (+622830us) service_pool.cc:224] Handling call
0709 12:24:40.369154 (+ 42453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:40.404698 (+ 35544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:40.404730 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:40.405155 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 12:24:40.849754 (+444599us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:40.849793 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.849867 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:41.802647 (+952780us) raft_consensus.cc:1685] finished
0709 12:24:41.802673 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:41.802853 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":362587,"threads_started":1,"wal-append.queue_time_us":1198746}
I20260709 12:24:41.774065 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:41.763778 14459 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:41.807662 11131 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:24:41.824393 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:41.824999 11131 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:41.746294 14489 consensus_queue.cc:1048] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.186s
I20260709 12:24:41.764338 14483 raft_consensus.cc:740] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
W20260709 12:24:41.810060 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 215477us
I20260709 12:24:41.833405 10948 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:41.833698 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:41.827590 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1471) took 2762 ms. Trace:
W20260709 12:24:41.828400 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.834419 11131 raft_consensus.cc:2376] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8. Re-sending same reply.
I20260709 12:24:41.829535 11645 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:41.835415 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:41.831621 11128 raft_consensus.cc:1240] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:41.832260 10978 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:41.753190 14187 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:41.840121 11128 raft_consensus.cc:1240] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:41.868312 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:41.868901 11128 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:41.840191 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:41.869730 10976 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:41.840925 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:41.836527 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:41.870486 11133 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:41.838474 11023 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:41.844394 14492 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:24:41.845140 14509 log.cc:927] Time spent T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:24:41.847782 10948 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:41.834417 10980 rpcz_store.cc:276] 0709 12:24:39.065723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.142261 (+1076538us) service_pool.cc:224] Handling call
0709 12:24:40.142604 (+   343us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:40.558428 (+415824us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:40.607625 (+ 49197us) log.cc:844] Serialized 14 byte log entry
0709 12:24:41.170910 (+563285us) log.cc:844] Serialized 14 byte log entry
0709 12:24:41.183955 (+ 13045us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:41.461048 (+277093us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b18003a4020. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cf7522 00007f8f88cf97c1 00007f8f88cf9779 00007f8f88cf9709 00007f8f88cf96d1 00007f8f88cf89cd 0000000000388634 0000000000388479 00007f8f88cda83a
0709 12:24:41.734344 (+273296us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b2c00030d28. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8a6dda11 00007f8f8a6ed372 00007f8f8be1fa01 00007f8f8bde443a 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2
0709 12:24:41.734970 (+   626us) log.cc:844] Serialized 52 byte log entry
0709 12:24:41.735149 (+   179us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:41.735182 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:41.735259 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:41.827353 (+ 92094us) raft_consensus.cc:1685] finished
0709 12:24:41.827375 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:41.827522 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28045,"prepare.queue_time_us":50212,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":82,"raft.queue_time_us":733173,"raft.run_cpu_time_us":387,"raft.run_wall_time_us":66826,"spinlock_wait_cycles":6794368,"thread_start_us":923545,"threads_started":2,"wal-append.queue_time_us":762432}
I20260709 12:24:41.844965 14459 raft_consensus.cc:2749] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:41.849680 14496 log.cc:927] Time spent T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
W20260709 12:24:41.844365 14508 log.cc:927] Time spent T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
W20260709 12:24:41.844277 14506 log.cc:927] Time spent T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.081s	user 0.004s	sys 0.002s
I20260709 12:24:41.850471 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:41.879441 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 494) took 1525 ms. Trace:
W20260709 12:24:41.852545 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.851904 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:24:41.877714 11643 connection.cc:256] RPC call timeout handler was delayed by -1.0036953109997739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
I20260709 12:24:41.884883 11131 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:41.886068 11643 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:41.886961 14491 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:41.887447 14491 raft_consensus.cc:697] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:41.857740 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:41.857336 14521 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:41.888314 14491 consensus_queue.cc:237] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:41.884255 11134 rpcz_store.cc:276] 0709 12:24:40.354027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.523581 (+169554us) service_pool.cc:224] Handling call
0709 12:24:40.553731 (+ 30150us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:40.556224 (+  2493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:40.556255 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:40.560276 (+  4021us) log.cc:844] Serialized 26 byte log entry
0709 12:24:41.081148 (+520872us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:41.081192 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:41.081258 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:41.879203 (+797945us) raft_consensus.cc:1685] finished
0709 12:24:41.879227 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:41.879377 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2045,"raft.queue_time_us":2991,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":4096,"thread_start_us":484578,"threads_started":1,"wal-append.queue_time_us":1072517}
I20260709 12:24:41.890225 14521 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:41.891237 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 424) took 1300 ms. Trace:
I20260709 12:24:41.891633 10984 rpcz_store.cc:276] 0709 12:24:40.591361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.592141 (+   780us) service_pool.cc:224] Handling call
0709 12:24:40.592461 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:41.090339 (+497878us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:41.090371 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:41.092633 (+  2262us) log.cc:844] Serialized 26 byte log entry
0709 12:24:41.292294 (+199661us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:41.292336 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:41.292419 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:41.891036 (+598617us) raft_consensus.cc:1685] finished
0709 12:24:41.891054 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:41.891176 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21536,"raft.queue_time_us":328035,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":61442,"thread_start_us":621080,"threads_started":2,"wal-append.queue_time_us":410000}
I20260709 12:24:41.892601 14474 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:41.894398 14528 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:41.653247 14495 consensus_queue.cc:237] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:41.859498 14420 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:41.861375 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:41.862088 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:41.870985 13739 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.898772 11679 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:41.830134 14172 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:41.863224 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:41.863970 11674 raft_consensus.cc:1240] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:41.865195 10977 raft_consensus.cc:1240] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:41.907945 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:41.908533 10977 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:41.864995 14444 consensus_queue.cc:237] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:41.865803 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:41.875635 14463 raft_consensus.cc:2749] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:41.878577 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:41.919631 11133 raft_consensus.cc:2393] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 9: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:41.880240 11127 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
I20260709 12:24:41.882546 10948 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:41.862367 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:41.900130 11643 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:41.922920 11643 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:41.924350 11024 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
W20260709 12:24:41.900545 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 307589us
I20260709 12:24:41.902999 11131 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
W20260709 12:24:41.928526 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 46019.6us
I20260709 12:24:41.904228 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:41.930503 11130 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:41.872329 14492 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.906548 11128 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:41.939764 10976 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:41.906556 14172 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:41.963765 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.918361 14528 raft_consensus.cc:697] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:41.955586 14446 raft_consensus.cc:2804] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:41.920166 14461 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:41.956871 14015 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:41.961006 14492 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:41.957121 14501 raft_consensus.cc:2749] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:41.967521 14172 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:41.917404 13739 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:41.962206 14346 consensus_queue.cc:1048] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:24:41.913949 14420 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:41.970032 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.981539 10977 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:41.980895 10976 pending_rounds.cc:85] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 5
I20260709 12:24:41.996187 10976 pending_rounds.cc:107] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:24:41.996541 10976 raft_consensus.cc:2889] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:41.960839 14436 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:24:41.979064 14015 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.981129 14446 raft_consensus.cc:697] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:41.985356 14161 raft_consensus.cc:2749] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:41.970306 14531 consensus_queue.cc:1048] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
W20260709 12:24:42.031628 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:42.032289 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.893426 14483 consensus_queue.cc:260] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:42.028051 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 103777us
I20260709 12:24:42.024983 14015 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:42.030206 14378 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:42.048563 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:42.043165 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 127494us
I20260709 12:24:42.048863 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:42.052409 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:42.056387 11058 raft_consensus.cc:1240] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 9. Current term is 11. Ops: []
I20260709 12:24:42.057677 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:42.058223 11023 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:42.066844 11053 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
W20260709 12:24:42.071903 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.073525 11053 raft_consensus.cc:1240] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:42.074492 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:42.075382 11056 raft_consensus.cc:2410] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:24:42.075958 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:42.076251 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:42.077157 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:42.077904 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:42.036360 14528 consensus_queue.cc:237] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:42.047101 14187 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:42.060177 14336 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.082929 14336 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:42.085206 14336 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:42.085831 14446 consensus_queue.cc:237] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:42.089680 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:42.092600 11058 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
I20260709 12:24:42.093662 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:42.094452 11058 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 8: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:42.075476 11059 raft_consensus.cc:1240] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:42.098953 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:42.092470 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:42.056643 14500 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.043236 14378 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:42.056138 14161 consensus_queue.cc:1059] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 12:24:42.399828 14447 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.391425 13739 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:42.149839 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2167) took 3234 ms. Trace:
I20260709 12:24:42.401654 14447 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:42.131642 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:42.402987 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.403281 11058 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 10.
I20260709 12:24:42.402508 14356 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.133503 14336 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:42.059639 14331 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:42.404068 14356 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:42.404623 14331 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:42.407701 11680 raft_consensus.cc:1240] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:42.105854 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 47891us
I20260709 12:24:42.402372 10982 rpcz_store.cc:276] 0709 12:24:38.915534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.117393 (+1201859us) service_pool.cc:224] Handling call
0709 12:24:40.141006 (+ 23613us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:41.357644 (+1216638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.149542 (+791898us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400334354. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:42.149767 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2795205376}
W20260709 12:24:42.286331 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.162336 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:24:42.410820 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.073889 14483 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:24:42.183497 11060 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
I20260709 12:24:42.412896 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:42.413450 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:42.153398 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2081) took 2087 ms. Trace:
I20260709 12:24:42.401266 11025 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:42.406857 14356 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:42.401512 14161 raft_consensus.cc:3055] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:42.449167 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:42.449182 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:42.416014 14336 raft_consensus.cc:697] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:42.450485 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:42.454679 14512 log.cc:927] Time spent T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.832s	user 0.003s	sys 0.000s
I20260709 12:24:42.422209 14500 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:42.077907 14527 consensus_queue.cc:1059] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.520s
W20260709 12:24:42.947072 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 545849us
W20260709 12:24:42.947306 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.445706 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:42.485405 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:42.831041 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.476438 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:24:42.925130 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:42.295243 14437 consensus_meta.cc:287] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.528s	user 0.005s	sys 0.006s
I20260709 12:24:42.574388 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:42.960028 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:24:42.959887 11134 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.000s	sys 0.010s
I20260709 12:24:42.949972 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:42.963325 10979 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:42.276671 14496 log.cc:927] Time spent T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
I20260709 12:24:42.954907 10982 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
W20260709 12:24:42.952412 11131 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.005s	sys 0.006s
W20260709 12:24:42.966961 11131 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.005s	sys 0.006s
I20260709 12:24:42.955521 11130 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:42.488090 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:42.417392 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:42.328498 14165 raft_consensus.cc:3055] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:42.460578 11133 raft_consensus.cc:1275] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:42.961643 11060 raft_consensus.cc:1275] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:24:42.973543 11060 pending_rounds.cc:85] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting all ops after (but not including) 3
I20260709 12:24:42.973863 11060 pending_rounds.cc:107] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:24:42.723078 14405 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.975571 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:42.138919 14533 log.cc:927] Time spent T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:24:42.723088 14548 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.142865 14396 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:42.593422 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:24:42.722751 11024 leader_election.cc:336] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Timed out: RequestConsensusVote RPC to 127.9.145.196:42197 timed out after 1.720s (SENT)
I20260709 12:24:42.951946 11677 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:42.407043 14378 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:42.404153 14447 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:42.949358 11025 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:42.969401 11127 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 8: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:42.150900 14520 raft_consensus.cc:3055] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:42.448089 11129 rpcz_store.cc:276] 0709 12:24:40.065729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.502170 (+436441us) service_pool.cc:224] Handling call
0709 12:24:40.505188 (+  3018us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:41.130925 (+625737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.153085 (+1022160us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b5400373054. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:42.153322 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1434119936}
I20260709 12:24:42.971518 10979 raft_consensus.cc:2410] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:24:42.152004 14460 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:42.411906 14420 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:42.950373 14492 consensus_meta.cc:287] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.962s	user 0.010s	sys 0.001s
I20260709 12:24:42.406935 14331 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:42.975651 11054 raft_consensus.cc:2410] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:42.573521 14547 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:42.974881 11133 raft_consensus.cc:1240] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []
W20260709 12:24:42.964027 11644 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.003s	sys 0.008s
W20260709 12:24:43.025496 11644 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.004s	sys 0.008s
W20260709 12:24:43.025826 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 564911us
I20260709 12:24:42.722849 14211 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.445825 14499 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.974185 11060 raft_consensus.cc:2889] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:42.444000 14388 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:42.459748 14172 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:42.571743 14545 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.977598 11126 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
I20260709 12:24:42.481014 14464 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:42.977974 11055 raft_consensus.cc:1275] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:43.034746 14464 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:43.035434 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:43.036216 11052 raft_consensus.cc:2410] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:24:42.948562 14161 raft_consensus.cc:740] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:42.159240 14015 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:43.037359 14161 consensus_queue.cc:260] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:43.038656 14161 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:43.038996 14015 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:42.972827 14491 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.005s	sys 0.007s
W20260709 12:24:43.039815 14491 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.005s	sys 0.007s
W20260709 12:24:42.964318 11134 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.000s	sys 0.011s
I20260709 12:24:42.982292 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2203) took 1108 ms. Trace:
W20260709 12:24:42.982249 11647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.000s	sys 0.014s
I20260709 12:24:42.983596 11024 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:43.040887 10982 rpcz_store.cc:276] 0709 12:24:41.873637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.967243 (+1093606us) service_pool.cc:224] Handling call
0709 12:24:42.978291 (+ 11048us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:42.981897 (+  3606us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:42.981926 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:42.981970 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:42.982000 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.982060 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:42.982232 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:43.041805 11647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.000s	sys 0.015s
I20260709 12:24:42.973114 14165 raft_consensus.cc:740] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:42.986825 11025 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:42.987550 14402 raft_consensus.cc:2749] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:43.043561 14165 consensus_queue.cc:260] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:43.044984 14165 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:43.045083 14545 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:42.993736 14467 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:42.995659 11681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41784 (request call id 618) took 2171 ms (client timeout 2000 ms). Trace:
W20260709 12:24:43.005141 11125 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.008s	sys 0.015s
I20260709 12:24:43.009537 11129 raft_consensus.cc:1240] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:43.049477 11125 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.008s	sys 0.015s
I20260709 12:24:43.013034 14302 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:24:43.049335 11681 rpcz_store.cc:269] 0709 12:24:40.823934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.824061 (+   127us) service_pool.cc:224] Handling call
0709 12:24:42.995395 (+2171334us) spinlock_profiling.cc:243] Waited 928 ms on lock 0x7b5400446bd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:42.995568 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2134754176}
I20260709 12:24:42.978925 14405 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:43.015156 14011 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:43.050704 14011 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:43.015441 11051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 482) took 1825 ms. Trace:
I20260709 12:24:43.012904 11057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1440) took 1840 ms. Trace:
I20260709 12:24:43.017172 14356 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.052356 14331 raft_consensus.cc:2804] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:43.052788 14356 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:43.017848 14418 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.029987 14547 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.052099 11057 rpcz_store.cc:276] 0709 12:24:41.172869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.173009 (+   140us) service_pool.cc:224] Handling call
0709 12:24:41.173388 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:41.182148 (+  8760us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:41.182180 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:41.182686 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 12:24:41.301092 (+118406us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:41.301144 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:41.301228 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:42.454053 (+1152825us) spinlock_profiling.cc:243] Waited 6.41 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:43.005805 (+551752us) raft_consensus.cc:1685] finished
0709 12:24:43.005827 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:43.012821 (+  6994us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85687,"raft.queue_time_us":66589,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":10404,"spinlock_wait_cycles":14733696,"thread_start_us":69345,"threads_started":1,"wal-append.queue_time_us":405906}
I20260709 12:24:42.989552 14336 consensus_queue.cc:237] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:43.041549 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 318825us
I20260709 12:24:43.061349 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:43.066426 11677 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:43.044265 14402 raft_consensus.cc:2749] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:43.043588 10982 raft_consensus.cc:1240] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:43.054500 11645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.030s	sys 0.026s
I20260709 12:24:43.051762 11051 rpcz_store.cc:276] 0709 12:24:41.189567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.189810 (+   243us) service_pool.cc:224] Handling call
0709 12:24:41.190231 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:41.207577 (+ 17346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:41.207611 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:41.221077 (+ 13466us) log.cc:844] Serialized 26 byte log entry
0709 12:24:43.014812 (+1793735us) spinlock_profiling.cc:243] Waited 8.78 ms on lock 0x7b18002bd7a0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f8b98c4bc 00007f8f88cda48b 00007f8f91b349a9 00007f8f88cf669b 00007f8f88cf493f 00007f8f88cf6c02 00007f8f8b97e20b 00007f8f8b983d23 00007f8f8b9840d1
0709 12:24:43.014978 (+   166us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:43.015014 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.015109 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:43.015157 (+    48us) raft_consensus.cc:1685] finished
0709 12:24:43.015167 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:43.015383 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":144267,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":7699,"spinlock_wait_cycles":20188416,"thread_start_us":72373,"threads_started":1,"wal-append.queue_time_us":334289,"wal-append.run_cpu_time_us":2985,"wal-append.run_wall_time_us":1292168}
I20260709 12:24:43.073356 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:43.075074 11678 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
W20260709 12:24:43.075614 11645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.031s	sys 0.027s
W20260709 12:24:43.075953 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 615548us
I20260709 12:24:43.076069 11680 raft_consensus.cc:2368] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 9. Current term is 10.
I20260709 12:24:43.078433 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:43.079617 11129 raft_consensus.cc:1240] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:43.079840 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:43.081317 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:43.080444 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2206) took 1029 ms. Trace:
I20260709 12:24:43.083799 10982 rpcz_store.cc:276] 0709 12:24:42.051190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.043151 (+991961us) service_pool.cc:224] Handling call
0709 12:24:43.043433 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.080175 (+ 36742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.080388 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:43.057430 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:43.018765 11098 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:43.051964 14405 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:43.082410 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:43.008759 14520 raft_consensus.cc:740] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:43.044984 14464 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:43.059146 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:43.019758 14460 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:43.092888 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:43.093570 11678 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:43.096041 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 77369.1us
I20260709 12:24:43.081334 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:43.084025 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:43.024941 14492 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:43.059796 14547 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:43.091393 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:43.052798 14331 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.099586 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:42.981768 14548 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:43.101871 14405 raft_consensus.cc:2749] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:43.102541 11051 raft_consensus.cc:1275] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:43.102753 14500 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:43.050361 14302 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:43.104971 14558 consensus_queue.cc:1048] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:43.105875 11060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:24:43.174826 11060 raft_consensus.cc:606] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:43.175242 11060 raft_consensus.cc:614] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:43.100199 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2207) took 1048 ms. Trace:
I20260709 12:24:43.068727 14015 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.067942 14564 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.074690 14491 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:43.054347 14211 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:43.142023 11676 raft_consensus.cc:2368] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12.
I20260709 12:24:43.102427 14356 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:43.067903 14418 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:43.183023 14172 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:43.182688 14564 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:43.183579 14418 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:43.162979 14302 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:43.111699 14416 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:43.184913 14548 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:43.185081 14564 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:43.185735 14015 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:43.188660 14015 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:43.189222 14491 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:43.190236 14492 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:43.190976 14435 log.cc:927] Time spent T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 2.354s	user 0.008s	sys 0.011s
I20260709 12:24:43.191570 14491 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:43.054632 14499 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:43.194000 14499 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:43.196127 14211 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:43.197297 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:43.197980 11677 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:43.199342 11024 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:43.125525 14331 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:43.203192 11052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1761) took 1100 ms. Trace:
W20260709 12:24:43.204972 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 108177us
I20260709 12:24:43.177435 11678 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
I20260709 12:24:43.177944 11056 raft_consensus.cc:1275] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:43.175834 10982 rpcz_store.cc:276] 0709 12:24:42.051725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.084622 (+1032897us) service_pool.cc:224] Handling call
0709 12:24:43.099646 (+ 15024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.099861 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:43.099886 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:43.099930 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:43.099961 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.100012 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:43.100136 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:43.203672 11052 rpcz_store.cc:276] 0709 12:24:42.102849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.103012 (+   163us) service_pool.cc:224] Handling call
0709 12:24:43.201989 (+1098977us) spinlock_profiling.cc:243] Waited 80 ms on lock 0x7b54003e0654. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:43.203113 (+  1124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184916096}
I20260709 12:24:43.191495 14396 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:43.209888 11128 raft_consensus.cc:1240] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:43.211421 11131 raft_consensus.cc:1240] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 9 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:43.212276 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2209) took 1154 ms. Trace:
I20260709 12:24:43.212749 10982 rpcz_store.cc:276] 0709 12:24:42.057411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.206222 (+1148811us) service_pool.cc:224] Handling call
0709 12:24:43.211753 (+  5531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.211932 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:43.211961 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:43.212008 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:43.212045 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.212099 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:43.212215 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:43.213477 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:43.219904 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:43.218794 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:43.294420 11126 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:43.218896 11128 raft_consensus.cc:1275] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:24:43.216015 11131 raft_consensus.cc:2393] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 9: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:24:43.214164 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 124083us
I20260709 12:24:43.219498 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:43.177084 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 190318us
W20260709 12:24:43.300568 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 86834.2us
I20260709 12:24:43.294741 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:43.391505 11025 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:43.393155 11025 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:43.394923 14548 raft_consensus.cc:2749] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:43.395643 14548 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:43.396169 14548 raft_consensus.cc:697] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:43.397133 14548 consensus_queue.cc:237] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:24:43.398425 11025 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:43.399375 14504 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:43.400934 11025 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:43.401816 14504 raft_consensus.cc:2804] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:43.402294 14504 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.402627 14504 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:43.407435 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 106011us
W20260709 12:24:43.409211 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 112808us
I20260709 12:24:43.406909 11025 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:43.414234 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:43.414899 11051 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:43.412580 11052 raft_consensus.cc:1275] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:24:43.417675 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:43.408277 11645 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:43.208424 14557 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.205467 14161 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:43.440971 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:43.453819 11052 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:43.448941 11643 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.575s (SENT) [suppressed 18 similar messages]
I20260709 12:24:43.214145 14545 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:43.390589 14211 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:43.466682 11051 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:24:43.437490 14396 raft_consensus.cc:2764] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:24:43.467823 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:43.451738 14464 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:43.472348 11126 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
I20260709 12:24:43.452770 14161 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:43.468204 14483 consensus_meta.cc:287] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 1.005s	user 0.005s	sys 0.006s
I20260709 12:24:43.477926 14161 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:43.480281 14464 raft_consensus.cc:697] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:24:43.503072 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 46445.2us
I20260709 12:24:43.503583 10975 raft_consensus.cc:1240] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 9 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:43.470424 14211 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:43.490468 14495 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.026s	sys 0.008s
I20260709 12:24:43.576026 11679 raft_consensus.cc:1240] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:24:43.600472 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:43.608649 11055 raft_consensus.cc:2410] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:24:43.456677 14557 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:43.574971 14562 log.cc:927] Time spent T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:24:43.581022 14495 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.026s	sys 0.008s
W20260709 12:24:43.627140 14560 log.cc:927] Time spent T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 12:24:43.632649 14545 raft_consensus.cc:2955] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Committing config change with OpId 6.6: config changed from index 2 to 6, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:24:43.639825 11681 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
I20260709 12:24:43.673341 14211 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:43.674850 14464 consensus_queue.cc:237] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:43.680191 14504 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:43.627174 14302 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:43.685168 14302 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:43.687112 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2101) took 1283 ms. Trace:
I20260709 12:24:43.687438 14302 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:43.595883 14547 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:43.689779 14547 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:43.789767 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 340827us
I20260709 12:24:43.818675 11052 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
W20260709 12:24:43.703738 14331 consensus_meta.cc:287] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.503s	user 0.007s	sys 0.004s
I20260709 12:24:43.691263 11125 rpcz_store.cc:276] 0709 12:24:42.403722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.404361 (+   639us) service_pool.cc:224] Handling call
0709 12:24:42.404720 (+   359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:42.405155 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:42.405187 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:42.451291 (+ 46104us) log.cc:844] Serialized 52 byte log entry
0709 12:24:43.050153 (+598862us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:43.050197 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.050262 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:43.686889 (+636627us) raft_consensus.cc:1685] finished
0709 12:24:43.686911 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:43.687049 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1236,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"thread_start_us":598436,"threads_started":1,"wal-append.queue_time_us":750120}
I20260709 12:24:43.690439 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2103) took 1273 ms. Trace:
I20260709 12:24:43.822985 11134 rpcz_store.cc:276] 0709 12:24:42.416887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.417015 (+   128us) service_pool.cc:224] Handling call
0709 12:24:42.458515 (+ 41500us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:42.458897 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:42.459195 (+   298us) log.cc:844] Serialized 14 byte log entry
0709 12:24:43.474977 (+1015782us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:43.475479 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 12:24:43.478733 (+  3254us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:43.478777 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.479306 (+   529us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:43.690188 (+210882us) raft_consensus.cc:1685] finished
0709 12:24:43.690209 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:43.690373 (+   164us) inbound_call.cc:177] Queueing success response
0709 12:24:43.695997 (+  5624us) spinlock_profiling.cc:243] Waited 5.42 ms on lock 0x7b18003b35c0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cf73f3 00007f8f88cf97c1 00007f8f88cf9779 00007f8f88cf9709 00007f8f88cf96d1 00007f8f88cf89cd 0000000000388634 0000000000388479 00007f8f88cda83a
Metrics: {"prepare.queue_time_us":16386,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":68133,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":13626,"spinlock_wait_cycles":12454784,"thread_start_us":1015328,"threads_started":2,"wal-append.queue_time_us":558314}
I20260709 12:24:43.842154 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:43.844125 11672 raft_consensus.cc:1240] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:43.845230 11679 raft_consensus.cc:1240] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:43.851291 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:43.855285 14566 consensus_queue.cc:1059] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:43.856259 14566 raft_consensus.cc:3055] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:43.856575 14566 raft_consensus.cc:740] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:43.857409 14566 consensus_queue.cc:260] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:43.849049 14578 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.852552 14504 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:43.908330 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:43.909127 11672 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:43.910179 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:43.910789 14460 consensus_meta.cc:287] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.769s	user 0.007s	sys 0.003s
I20260709 12:24:43.910966 11672 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:24:43.911568 14460 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:43.911837 14578 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:43.912925 11677 raft_consensus.cc:1240] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:43.915905 11677 raft_consensus.cc:1240] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:43.839711 14331 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:43.851082 14302 consensus_queue.cc:1059] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 12:24:43.933341 11059 raft_consensus.cc:1240] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 6. Current term is 8. Ops: []
I20260709 12:24:43.999117 11059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1760) took 1907 ms. Trace:
I20260709 12:24:43.999657 11059 rpcz_store.cc:276] 0709 12:24:42.091757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.104007 (+ 12250us) service_pool.cc:224] Handling call
0709 12:24:43.932956 (+1828949us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b58001a5e98. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbff8c 00007f8f88cbfef6 000000000036eb39 00007f8f90d331e0 00007f8f90dfc0c4 00007f8f90dfc131 00007f8f90dbdfc0 00007f8f90da8929 00007f8f90da83d2 00007f8f8a31fbd4
0709 12:24:43.933132 (+   176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.998703 (+ 65571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.998949 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2644736}
I20260709 12:24:44.003021 14331 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:44.005313 11052 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
I20260709 12:24:43.945858 14388 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:43.974320 14460 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:44.042876 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:44.044986 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.049567 14547 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.050318 14547 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:44.052124 14578 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:44.052699 14547 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:44.053282 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:44.054176 11058 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1764) took 1914 ms (client timeout 1651 ms). Trace:
I20260709 12:24:44.054298 14547 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.054860 14547 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:44.056118 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:44.057322 14547 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:44.058329 14388 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:43.909016 14161 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:44.054554 11058 rpcz_store.cc:269] 0709 12:24:42.139581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.404097 (+264516us) service_pool.cc:224] Handling call
0709 12:24:44.053118 (+1649021us) spinlock_profiling.cc:243] Waited 971 us on lock 0x7b58001a5e98. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90daa0a0 00007f8f90da9984 00007f8f8a3246d4 00007f8f8a324662
0709 12:24:44.054080 (+   962us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2233216}
I20260709 12:24:44.033694 14511 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:44.035909 14108 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:44.072220 11051 raft_consensus.cc:2393] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 10: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:44.077534 14511 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:44.122018 14460 consensus_queue.cc:1059] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:44.122203 14302 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:44.178385 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:44.098752 14108 raft_consensus.cc:3055] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:44.178174 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:44.157840 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:44.179965 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:44.189241 11134 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:44.194224 11130 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:44.173494 14586 log.cc:927] Time spent T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:24:44.123036 14578 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.177979 14388 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:44.173094 14460 raft_consensus.cc:3055] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:44.133539 14418 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:44.122988 14302 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:44.214668 14418 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:44.176738 14161 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:44.195691 14108 raft_consensus.cc:740] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:24:44.239763 14581 log.cc:927] Time spent T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:24:44.212112 14460 raft_consensus.cc:740] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:44.208279 14578 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:44.152900 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:44.331367 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:44.341317 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:44.338848 11125 raft_consensus.cc:2393] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 10: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
W20260709 12:24:44.360731 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.343389 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:44.362917 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:44.241070 14511 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:44.340382 11127 raft_consensus.cc:3055] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:44.342020 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:44.418728 11127 raft_consensus.cc:740] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:44.343331 11134 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:24:44.425400 11133 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:24:44.438066 11645 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:44.440272 14601 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:44.440398 11645 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:44.441836 14601 raft_consensus.cc:697] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:44.444470 14601 consensus_queue.cc:237] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:44.447885 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2176) took 4623 ms. Trace:
I20260709 12:24:44.450079 11051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52804 (request call id 494) took 1038 ms. Trace:
I20260709 12:24:44.450425 11132 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:24:44.451272 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:44.452688 11054 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1754) took 2383 ms (client timeout 1907 ms). Trace:
I20260709 12:24:44.367755 14302 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:44.359079 14108 consensus_queue.cc:260] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:44.369637 14418 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:44.505127 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:44.573885 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.934263 14108 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:44.935279 14449 raft_consensus.cc:2804] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:44.935904 14449 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.936336 14449 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:44.726765 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:44.938426 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:44.576206 14011 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:44.319075 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 270610us
I20260709 12:24:44.486085 14578 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:44.477047 11676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41762 (request call id 682) took 2613 ms (client timeout 1720 ms). Trace:
I20260709 12:24:44.505752 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:44.481029 11680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41762 (request call id 687) took 2035 ms (client timeout 1982 ms). Trace:
W20260709 12:24:44.941056 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 500824us
I20260709 12:24:44.505646 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:44.717185 11056 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1454) took 1700 ms. Trace:
I20260709 12:24:44.946641 11056 rpcz_store.cc:276] 0709 12:24:43.016981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.147756 (+130775us) service_pool.cc:224] Handling call
0709 12:24:43.163889 (+ 16133us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.205706 (+ 41817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.716536 (+1510830us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b54002df854. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:44.716936 (+   400us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31442688}
I20260709 12:24:44.947687 14302 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:44.487779 14082 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.949072 14302 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:44.940379 11054 rpcz_store.cc:269] 0709 12:24:42.070862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.076929 (+  6067us) service_pool.cc:224] Handling call
0709 12:24:44.452232 (+2375303us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b54002792d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:44.452459 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2057583488}
W20260709 12:24:44.941694 11676 rpcz_store.cc:269] 0709 12:24:41.863381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.865534 (+  2153us) service_pool.cc:224] Handling call
0709 12:24:44.476408 (+2610874us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54006801d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:44.476763 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2777861888}
I20260709 12:24:44.954583 11059 raft_consensus.cc:2393] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 10: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:44.954741 11052 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
I20260709 12:24:44.755585 11130 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
W20260709 12:24:44.944854 11053 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1762) took 2833 ms (client timeout 1702 ms). Trace:
W20260709 12:24:44.944443 11680 rpcz_store.cc:269] 0709 12:24:42.445247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.445387 (+   140us) service_pool.cc:224] Handling call
0709 12:24:44.480439 (+2035052us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54006315d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:44.480751 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281266048}
I20260709 12:24:44.933259 11051 rpcz_store.cc:276] 0709 12:24:43.411518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.467546 (+ 56028us) service_pool.cc:224] Handling call
0709 12:24:44.449628 (+982082us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b54001879d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:44.449907 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1384170880}
W20260709 12:24:44.959473 11053 rpcz_store.cc:269] 0709 12:24:42.108811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.207618 (+ 98807us) service_pool.cc:224] Handling call
0709 12:24:44.450862 (+2243244us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b58001a5e98. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90daa0a0 00007f8f90da9984 00007f8f8a3246d4 00007f8f8a324662
0709 12:24:44.942213 (+491351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3072896}
I20260709 12:24:44.596975 14557 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:44.949244 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:44.964401 14402 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.333s	user 0.022s	sys 0.013s
I20260709 12:24:44.691001 14601 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:44.464382 11127 consensus_queue.cc:260] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:44.474634 14585 raft_consensus.cc:3055] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:44.965000 11059 raft_consensus.cc:1275] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:48.773936 11059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1461) took 4268 ms. Trace:
I20260709 12:24:45.052162 14601 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:48.778014 11059 rpcz_store.cc:276] 0709 12:24:44.505965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.955588 (+449623us) service_pool.cc:224] Handling call
0709 12:24:44.956210 (+   622us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.773493 (+3817283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.773824 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76544}
I20260709 12:24:48.781122 14601 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:45.031519 11678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41774 (request call id 544) took 1555 ms. Trace:
I20260709 12:24:48.784859 11678 rpcz_store.cc:276] 0709 12:24:43.475903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.477599 (+  1696us) service_pool.cc:224] Handling call
0709 12:24:43.477997 (+   398us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:43.482443 (+  4446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:43.482475 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:43.489114 (+  6639us) log.cc:844] Serialized 52 byte log entry
0709 12:24:44.004029 (+514915us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:44.152707 (+148678us) log.cc:844] Serialized 14 byte log entry
0709 12:24:45.030706 (+877999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.030903 (+   197us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.031005 (+   102us) raft_consensus.cc:1685] finished
0709 12:24:45.031027 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.031309 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6773,"prepare.queue_time_us":235416,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":69129,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":46600,"thread_start_us":987505,"threads_started":3,"wal-append.queue_time_us":558153,"wal-append.run_cpu_time_us":14725,"wal-append.run_wall_time_us":1139291}
I20260709 12:24:44.950040 14082 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:45.055780 14302 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:44.967823 14402 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.339s	user 0.022s	sys 0.014s
I20260709 12:24:48.805876 11052 raft_consensus.cc:1275] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:48.806670 11052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 503) took 3927 ms. Trace:
I20260709 12:24:48.806977 11052 rpcz_store.cc:276] 0709 12:24:44.879186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.955684 (+ 76498us) service_pool.cc:224] Handling call
0709 12:24:44.959318 (+  3634us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.806397 (+3847079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.806613 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:44.476583 14460 consensus_queue.cc:260] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:44.987600 14449 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:45.025024 14520 consensus_queue.cc:260] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:48.970490 14520 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:45.827662 14603 log.cc:927] Time spent T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 12:24:46.702147 10913 debug-util.cc:398] Leaking SignalData structure 0x7b080018f800 after lost signal to thread 9799
W20260709 12:24:48.975049 10913 debug-util.cc:398] Leaking SignalData structure 0x7b0800089e80 after lost signal to thread 9802
W20260709 12:24:48.976532 10913 debug-util.cc:398] Leaking SignalData structure 0x7b0800038b20 after lost signal to thread 10916
I20260709 12:24:47.052604 11057 raft_consensus.cc:2393] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 12: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:47.228645 10879 catalog_manager.cc:5697] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 5 to 6, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 6 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:47.540357 11127 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:48.977735 11057 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41294 (request call id 1463) took 4257 ms (client timeout 2092 ms). Trace:
I20260709 12:24:48.443902 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2191) took 6919 ms. Trace:
W20260709 12:24:48.448550 11055 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41294 (request call id 1453) took 5431 ms (client timeout 2032 ms). Trace:
W20260709 12:24:48.978147 11057 rpcz_store.cc:269] 0709 12:24:44.800967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.938003 (+137036us) service_pool.cc:224] Handling call
0709 12:24:48.977650 (+4039647us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:48.978469 11055 rpcz_store.cc:269] 0709 12:24:43.016704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.035140 (+ 18436us) service_pool.cc:224] Handling call
0709 12:24:48.448033 (+5412893us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b5400348354. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:48.448332 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1315843840}
I20260709 12:24:48.458057 11056 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
W20260709 12:24:48.979609 11056 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41294 (request call id 1459) took 4474 ms (client timeout 2638 ms). Trace:
W20260709 12:24:48.979991 11056 rpcz_store.cc:269] 0709 12:24:44.505226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.948788 (+443562us) service_pool.cc:224] Handling call
0709 12:24:48.979527 (+4030739us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.646241 14608 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:48.981050 14608 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:48.983430 14608 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:48.654214 11097 connection.cc:256] RPC call timeout handler was delayed by -5.1634330830002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
W20260709 12:24:48.984193 11097 connection.cc:256] RPC call timeout handler was delayed by -5.0941330830000879s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
W20260709 12:24:48.984515 11097 connection.cc:256] RPC call timeout handler was delayed by -5.082433083000069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1634s for a response
W20260709 12:24:48.984776 11097 connection.cc:256] RPC call timeout handler was delayed by -5.0536330830000225s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1666s for a response
W20260709 12:24:48.985023 11097 connection.cc:256] RPC call timeout handler was delayed by -5.0500330830000166s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.167s for a response
W20260709 12:24:48.985280 11097 connection.cc:256] RPC call timeout handler was delayed by -5.0257330829999773s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16970000000000002s for a response
W20260709 12:24:48.985731 11097 connection.cc:256] RPC call timeout handler was delayed by -4.8214330830001018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19240000000000002s for a response
I20260709 12:24:48.722746 14474 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:48.986513 14474 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:48.988658 14474 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:48.989205 14474 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:48.728042 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:48.993737 11643 connection.cc:256] RPC call timeout handler was delayed by -5.1219771930000206s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2218s for a response
W20260709 12:24:48.741532 11025 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 3.788s	user 0.013s	sys 0.021s
W20260709 12:24:48.994580 11025 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 4.041s	user 0.014s	sys 0.022s
W20260709 12:24:48.994912 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 4.04165e+06us
W20260709 12:24:48.995385 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:48.995958 11025 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 2.304s (SENT) [suppressed 5 similar messages]
W20260709 12:24:48.770342 10979 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 2192) took 7245 ms (client timeout 2525 ms). Trace:
W20260709 12:24:48.997107 10979 rpcz_store.cc:269] 0709 12:24:41.525004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.589052 (+ 64048us) service_pool.cc:224] Handling call
0709 12:24:48.769680 (+7180628us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54003bae54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:48.770004 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3158640896}
I20260709 12:24:48.775385 11645 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:44.967495 14585 raft_consensus.cc:740] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:48.793991 14082 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:48.998709 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 223535us
I20260709 12:24:48.999572 11645 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:49.000383 14082 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:24:48.829036 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.000675 14015 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:24:49.001341 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:49.002245 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.453657 10975 rpcz_store.cc:276] 0709 12:24:39.824287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.397176 (+572889us) service_pool.cc:224] Handling call
0709 12:24:40.397455 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.505890 (+3108435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.447233 (+941343us) spinlock_profiling.cc:243] Waited 3.11 s on lock 0x7b5400229554. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:44.447616 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7142957824}
I20260709 12:24:49.002988 14356 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.863879 14446 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.003655 14356 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:49.003911 14446 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:48.870266 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:49.006443 11678 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
W20260709 12:24:48.882256 14108 consensus_meta.cc:287] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 3.947s	user 0.012s	sys 0.038s
I20260709 12:24:48.884863 14610 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.889671 14611 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:24:48.890479 11098 connection.cc:256] RPC call timeout handler was delayed by -4.0134091810004975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
I20260709 12:24:49.003783 10981 rpcz_store.cc:276] 0709 12:24:41.524725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.731464 (+206739us) service_pool.cc:224] Handling call
0709 12:24:41.731810 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:41.732012 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:41.870888 (+138876us) log.cc:844] Serialized 14 byte log entry
0709 12:24:48.434352 (+6563464us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b18002703a0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88c71c0a 00007f8f923b1219 00007f8f88cf9a40 00007f8f88cf44e4 00007f8f88cf4455 00007f8f8bddc060 00007f8f8bdee716 00007f8f8bdff287 00007f8f8bdff208
0709 12:24:48.443119 (+  8767us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:48.443228 (+   109us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:48.443361 (+   133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.443485 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.443701 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22648,"prepare.queue_time_us":298153,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":1929,"spinlock_wait_cycles":5029632,"thread_start_us":275980,"threads_started":2,"wal-append.queue_time_us":213847,"wal-append.run_cpu_time_us":1037,"wal-append.run_wall_time_us":1001071}
I20260709 12:24:49.001699 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:48.896467 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.009176 11130 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:24:48.910945 14613 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:48.919015 14567 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 5.291s	user 0.025s	sys 0.028s
I20260709 12:24:49.008230 14610 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:48.920796 11023 connection.cc:256] RPC call timeout handler was delayed by -4.7972366959998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2247s for a response
W20260709 12:24:49.014906 11023 connection.cc:256] RPC call timeout handler was delayed by -4.7253416439998546s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
W20260709 12:24:49.015887 11023 connection.cc:256] RPC call timeout handler was delayed by -3.9644352639998033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2002s for a response
W20260709 12:24:49.016252 11023 connection.cc:256] RPC call timeout handler was delayed by -3.8986005169999771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19790000000000002s for a response
I20260709 12:24:48.935765 14346 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.016453 14610 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:48.942296 14571 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.017269 14611 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:49.014546 14567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 5.391s	user 0.025s	sys 0.028s
I20260709 12:24:49.018157 14402 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.018770 14402 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:49.019891 14611 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:49.008862 11098 connection.cc:256] RPC call timeout handler was delayed by -3.9906409720001648s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
I20260709 12:24:49.020750 14356 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:49.020877 11098 connection.cc:256] RPC call timeout handler was delayed by -3.4073673040002177s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
W20260709 12:24:49.021275 11098 connection.cc:256] RPC call timeout handler was delayed by -3.2238409719998344s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2638s for a response
I20260709 12:24:49.017436 14571 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:49.021809 14418 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.016969 14346 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:49.004508 14302 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:49.022703 14302 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:49.024039 14346 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:49.024991 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:49.025198 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:49.026237 11057 raft_consensus.cc:2410] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:49.026485 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:49.027289 11056 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:24:49.028357 14460 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:49.028741 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:49.021574 11098 connection.cc:256] RPC call timeout handler was delayed by -3.20584097200026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2658s for a response
W20260709 12:24:49.016530 11023 connection.cc:256] RPC call timeout handler was delayed by -3.8439518459999817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2202s for a response
I20260709 12:24:49.028117 11059 raft_consensus.cc:1240] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:49.029855 11023 connection.cc:256] RPC call timeout handler was delayed by -3.7233607939997455s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1615s for a response
W20260709 12:24:49.030269 11023 connection.cc:256] RPC call timeout handler was delayed by -3.5101533010001731s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18610000000000002s for a response
W20260709 12:24:49.029696 11098 connection.cc:256] RPC call timeout handler was delayed by -3.20584097200026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2658s for a response
W20260709 12:24:49.031009 11098 connection.cc:256] RPC call timeout handler was delayed by -3.1494091810004647s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2992s for a response
W20260709 12:24:49.031277 11098 connection.cc:256] RPC call timeout handler was delayed by -3.0735409720000462s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2805s for a response
W20260709 12:24:49.031558 11098 connection.cc:256] RPC call timeout handler was delayed by -3.0735409720000462s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2805s for a response
W20260709 12:24:49.031864 11098 connection.cc:256] RPC call timeout handler was delayed by -2.9548221600002762s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20920000000000002s for a response
I20260709 12:24:48.961444 14566 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:48.962189 11644 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 3.976s	user 0.009s	sys 0.037s
I20260709 12:24:49.001258 14015 raft_consensus.cc:697] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:24:48.911684 11058 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.957s	user 0.004s	sys 0.038s
I20260709 12:24:48.897411 14464 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:48.986029 11097 connection.cc:256] RPC call timeout handler was delayed by -4.6846330830003353s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2076s for a response
W20260709 12:24:49.035653 11097 connection.cc:256] RPC call timeout handler was delayed by -4.6216330830002335s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2146s for a response
W20260709 12:24:49.032133 11098 connection.cc:256] RPC call timeout handler was delayed by -2.9093745170002876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20920000000000002s for a response
W20260709 12:24:49.036218 11097 connection.cc:256] RPC call timeout handler was delayed by -4.6081330830002116s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21610000000000001s for a response
W20260709 12:24:49.036854 11097 connection.cc:256] RPC call timeout handler was delayed by -4.5775330830001622s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2195s for a response
W20260709 12:24:49.035663 10913 debug-util.cc:398] Leaking SignalData structure 0x7b0800358a80 after lost signal to thread 10949
W20260709 12:24:49.036139 11644 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 4.050s	user 0.009s	sys 0.038s
W20260709 12:24:49.038180 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 4.07749e+06us
W20260709 12:24:49.038616 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:49.037326 11097 connection.cc:256] RPC call timeout handler was delayed by -4.3912330830003157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24020000000000002s for a response
W20260709 12:24:49.039355 11097 connection.cc:256] RPC call timeout handler was delayed by -4.2385060750002594s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
W20260709 12:24:49.039767 11097 connection.cc:256] RPC call timeout handler was delayed by -3.8602330830003666s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2992s for a response
W20260709 12:24:49.040046 11097 connection.cc:256] RPC call timeout handler was delayed by -2.6686330830002589s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4316s for a response
W20260709 12:24:49.040343 11097 connection.cc:256] RPC call timeout handler was delayed by -2.0692330830001993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.49820000000000003s for a response
W20260709 12:24:49.037729 10913 debug-util.cc:398] Leaking SignalData structure 0x7b08002fc880 after lost signal to thread 10950
W20260709 12:24:49.043035 10913 debug-util.cc:398] Leaking SignalData structure 0x7b0800381960 after lost signal to thread 10976
W20260709 12:24:49.043566 10913 debug-util.cc:398] Leaking SignalData structure 0x7b08003c6500 after lost signal to thread 10977
W20260709 12:24:49.030635 11023 connection.cc:256] RPC call timeout handler was delayed by -3.4227529879999565s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16040000000000001s for a response
W20260709 12:24:49.044657 11023 connection.cc:256] RPC call timeout handler was delayed by -3.3282124300003488s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2074s for a response
W20260709 12:24:49.044999 11023 connection.cc:256] RPC call timeout handler was delayed by -1.9926053200001661s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.42500000000000004s for a response
W20260709 12:24:49.045687 10913 debug-util.cc:398] Leaking SignalData structure 0x7b08003c4a00 after lost signal to thread 10978
W20260709 12:24:49.046147 10913 debug-util.cc:398] Leaking SignalData structure 0x7b08003c6660 after lost signal to thread 10984
I20260709 12:24:49.030474 14082 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:49.046742 10913 debug-util.cc:398] Leaking SignalData structure 0x7b080039ba60 after lost signal to thread 11009
I20260709 12:24:48.989794 14474 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:49.025024 14302 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:49.047545 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 49727.2us
I20260709 12:24:49.046490 11645 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
W20260709 12:24:49.048620 10913 debug-util.cc:398] Leaking SignalData structure 0x7b080039b900 after lost signal to thread 11010
W20260709 12:24:49.048978 11058 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 4.095s	user 0.005s	sys 0.039s
I20260709 12:24:49.066406 11058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1460) took 4560 ms. Trace:
W20260709 12:24:49.068656 10913 debug-util.cc:398] Leaking SignalData structure 0x7b0800380160 after lost signal to thread 11084
I20260709 12:24:49.031347 14608 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.034261 14446 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:49.052625 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.036883 14464 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:49.076645 14464 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:49.055017 14402 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:49.055198 14015 consensus_queue.cc:237] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:49.055714 11098 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:49.081176 11098 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:49.082664 14356 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:49.083264 14356 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.083747 14356 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:49.037125 14418 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:49.086026 14611 consensus_queue.cc:1059] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:49.050786 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:49.057540 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:49.089586 14302 consensus_queue.cc:1048] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:49.057719 14474 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:49.058562 14449 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:49.059348 11133 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 5.
I20260709 12:24:49.036104 14613 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:49.058836 14571 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:49.049945 14082 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:49.086622 10879 catalog_manager.cc:5697] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:49.087363 14418 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:49.082221 14346 raft_consensus.cc:2804] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:49.094640 14346 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.086383 14610 consensus_queue.cc:1059] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:24:49.089828 11129 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
I20260709 12:24:49.061053 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2201) took 7279 ms. Trace:
I20260709 12:24:49.097319 10977 rpcz_store.cc:276] 0709 12:24:41.781232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.995833 (+214601us) service_pool.cc:224] Handling call
0709 12:24:42.024534 (+ 28701us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.920823 (+1896289us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:44.077931 (+157108us) log.cc:844] Serialized 14 byte log entry
0709 12:24:49.056172 (+4978241us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:49.056268 (+    96us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:49.056347 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.060666 (+  4319us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b540028a5d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:49.060710 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:49.060880 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4937320,"prepare.queue_time_us":322774,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"spinlock_wait_cycles":4357192448,"thread_start_us":196156,"threads_started":2,"wal-append.queue_time_us":165573,"wal-append.run_cpu_time_us":1355,"wal-append.run_wall_time_us":1021687}
I20260709 12:24:49.100701 14610 raft_consensus.cc:3055] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:49.101444 14610 raft_consensus.cc:740] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:49.093223 14613 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:49.066833 11058 rpcz_store.cc:276] 0709 12:24:44.505555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.952539 (+446984us) service_pool.cc:224] Handling call
0709 12:24:44.953065 (+   526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.953533 (+   468us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:24:44.953971 (+   438us) log.cc:844] Serialized 14 byte log entry
0709 12:24:49.065985 (+4112014us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:49.066048 (+    63us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:49.066120 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.066195 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:49.066338 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":200,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":59,"raft.queue_time_us":107,"thread_start_us":4111434,"threads_started":1,"wal-append.queue_time_us":1490927,"wal-append.run_cpu_time_us":1476,"wal-append.run_wall_time_us":1001499}
I20260709 12:24:49.106348 14608 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:24:49.106945 14611 raft_consensus.cc:3055] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:49.107477 14611 raft_consensus.cc:740] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
W20260709 12:24:49.107614 11644 connection.cc:256] RPC call timeout handler was delayed by -3.9101729799999703s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.191s for a response
W20260709 12:24:49.108083 11644 connection.cc:256] RPC call timeout handler was delayed by -3.9065729799999644s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19140000000000001s for a response
I20260709 12:24:49.108382 14342 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:49.108516 11644 connection.cc:256] RPC call timeout handler was delayed by -3.6077729799999361s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22460000000000002s for a response
W20260709 12:24:49.109010 11644 connection.cc:256] RPC call timeout handler was delayed by -3.59787297999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2257s for a response
I20260709 12:24:49.109061 14342 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:49.095177 14346 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:49.110610 14396 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:49.111233 14396 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:49.112985 14614 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.113521 14396 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:49.103801 14199 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:49.109622 11644 connection.cc:256] RPC call timeout handler was delayed by -3.3641713609999897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16620000000000001s for a response
I20260709 12:24:49.095362 10879 catalog_manager.cc:5697] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:24:49.113677 14614 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:49.116604 10913 debug-util.cc:398] Leaking SignalData structure 0x7b08003b44e0 after lost signal to thread 11159
W20260709 12:24:49.118502 10913 debug-util.cc:398] Leaking SignalData structure 0x7b08000f6da0 after lost signal to thread 11705
W20260709 12:24:49.119231 10913 debug-util.cc:398] Leaking SignalData structure 0x7b0800369240 after lost signal to thread 14378
W20260709 12:24:49.119575 10913 debug-util.cc:398] Leaking SignalData structure 0x7b08003d55c0 after lost signal to thread 14405
W20260709 12:24:49.119786 10913 debug-util.cc:398] Leaking SignalData structure 0x7b08003df280 after lost signal to thread 14414
W20260709 12:24:49.120025 10913 debug-util.cc:398] Leaking SignalData structure 0x7b08000f2d80 after lost signal to thread 14436
W20260709 12:24:49.120235 10913 debug-util.cc:398] Leaking SignalData structure 0x7b08003df160 after lost signal to thread 14437
W20260709 12:24:49.121016 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 74605.9us
W20260709 12:24:49.121335 10913 debug-util.cc:398] Leaking SignalData structure 0x7b08003d95c0 after lost signal to thread 14454
I20260709 12:24:49.114853 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:24:49.121660 10913 debug-util.cc:398] Leaking SignalData structure 0x7b08003df080 after lost signal to thread 14459
W20260709 12:24:49.124127 10913 debug-util.cc:398] Leaking SignalData structure 0x7b08003d5680 after lost signal to thread 14463
I20260709 12:24:49.122608 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:49.124298 11054 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 8
W20260709 12:24:49.124718 10913 debug-util.cc:398] Leaking SignalData structure 0x7b08003b4980 after lost signal to thread 14467
I20260709 12:24:49.126529 14378 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:49.127674 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.127372 14378 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:49.120795 14108 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.129644 14108 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:49.130702 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:49.131974 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:49.116447 14199 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:49.133188 14342 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:49.133671 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:49.109087 14608 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:49.132119 14108 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:49.135128 14199 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:49.107157 10948 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:49.129354 11645 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
W20260709 12:24:49.139425 10913 debug-util.cc:398] Leaking SignalData structure 0x7b080040d0c0 after lost signal to thread 14505
W20260709 12:24:49.140456 10913 debug-util.cc:398] Leaking SignalData structure 0x7b0800323d80 after lost signal to thread 14510
I20260709 12:24:49.130517 14612 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:49.116943 11097 leader_election.cc:336] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.544s (SENT)
I20260709 12:24:49.141947 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:49.070236 14567 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
W20260709 12:24:49.142976 11644 connection.cc:256] RPC call timeout handler was delayed by -2.6816729799998029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3275s for a response
W20260709 12:24:49.140750 10913 debug-util.cc:398] Leaking SignalData structure 0x7b080040d120 after lost signal to thread 14527
W20260709 12:24:49.148074 10913 debug-util.cc:398] Leaking SignalData structure 0x7b080040cf80 after lost signal to thread 14534
W20260709 12:24:49.148465 10913 debug-util.cc:398] Leaking SignalData structure 0x7b08003c9f80 after lost signal to thread 14544
W20260709 12:24:49.148869 10913 debug-util.cc:398] Leaking SignalData structure 0x7b080040d140 after lost signal to thread 14573
W20260709 12:24:49.149731 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 64773.1us
W20260709 12:24:49.150907 10913 debug-util.cc:398] Leaking SignalData structure 0x7b08003c9fc0 after lost signal to thread 14576
I20260709 12:24:49.155678 11097 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:24:49.157964 11127 raft_consensus.cc:1275] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:24:49.147207 14601 raft_consensus.cc:2804] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:49.161867 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 123854us
W20260709 12:24:49.159401 11025 connection.cc:256] RPC call timeout handler was delayed by -3.8570554619996074s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19240000000000002s for a response
W20260709 12:24:49.164765 11025 connection.cc:256] RPC call timeout handler was delayed by -3.8075554619995273s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19790000000000002s for a response
W20260709 12:24:49.165177 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.127714 14614 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:49.162187 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:49.165645 11025 connection.cc:256] RPC call timeout handler was delayed by -3.7868554619994939s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2002s for a response
I20260709 12:24:49.139890 14378 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:49.149286 14449 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:49.168710 11025 connection.cc:256] RPC call timeout handler was delayed by -3.7089323320001313s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
W20260709 12:24:49.167369 11643 connection.cc:256] RPC call timeout handler was delayed by -4.5725131009999131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2247s for a response
W20260709 12:24:49.167860 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.108498 14611 consensus_queue.cc:260] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:49.037395 14585 consensus_queue.cc:260] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:49.169078 11025 connection.cc:256] RPC call timeout handler was delayed by -3.6312663059998158s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16040000000000001s for a response
I20260709 12:24:49.158805 11127 pending_rounds.cc:85] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 8
W20260709 12:24:49.171602 11025 connection.cc:256] RPC call timeout handler was delayed by -3.6213663059998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1615s for a response
W20260709 12:24:49.172039 11643 connection.cc:256] RPC call timeout handler was delayed by -4.4704681229995913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
W20260709 12:24:49.172115 11025 connection.cc:256] RPC call timeout handler was delayed by -3.6095554619996619s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21989999999999998s for a response
W20260709 12:24:49.172573 11643 connection.cc:256] RPC call timeout handler was delayed by -4.4387563390000651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
W20260709 12:24:49.172989 11643 connection.cc:256] RPC call timeout handler was delayed by -4.42353692100005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1529s for a response
W20260709 12:24:49.173395 11643 connection.cc:256] RPC call timeout handler was delayed by -3.7711647090000042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2257s for a response
I20260709 12:24:49.173678 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:49.174072 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:49.172801 11025 connection.cc:256] RPC call timeout handler was delayed by -3.6069663059997765s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
I20260709 12:24:49.174437 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:49.174877 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:49.174902 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:49.176760 14501 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:24:49.179179 11025 connection.cc:256] RPC call timeout handler was delayed by -3.3999663059998966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18610000000000002s for a response
I20260709 12:24:49.181090 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2199) took 7399 ms. Trace:
I20260709 12:24:49.181543 14199 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:49.160557 14558 raft_consensus.cc:2804] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:49.164639 14601 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.183568 11130 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
W20260709 12:24:49.184659 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 119770us
I20260709 12:24:49.163861 14567 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:49.196803 11097 leader_election.cc:336] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.621s (SENT)
W20260709 12:24:49.185256 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.186674 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2194) took 7661 ms. Trace:
W20260709 12:24:49.187289 10880 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41098 (request call id 284) took 25354 ms (client timeout 15000 ms). Trace:
W20260709 12:24:49.189476 11025 connection.cc:256] RPC call timeout handler was delayed by -3.1797556319997966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
I20260709 12:24:49.182757 14611 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:49.198345 11025 connection.cc:256] RPC call timeout handler was delayed by -3.1118259559998478s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
I20260709 12:24:49.167550 14446 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:49.196894 11055 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:49.187767 11127 pending_rounds.cc:107] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:24:49.201906 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:49.202448 11127 raft_consensus.cc:2889] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:49.200281 11097 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:49.200621 11025 connection.cc:256] RPC call timeout handler was delayed by -2.9066259559999708s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
W20260709 12:24:49.203409 11025 connection.cc:256] RPC call timeout handler was delayed by -2.5428503220000493s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1816s for a response
W20260709 12:24:49.203807 11025 connection.cc:256] RPC call timeout handler was delayed by -1.7636554619998606s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.42500000000000004s for a response
I20260709 12:24:49.203930 11128 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:49.187151 14608 raft_consensus.cc:2749] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:49.147236 14612 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:49.188395 10984 rpcz_store.cc:276] 0709 12:24:41.770710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.893177 (+122467us) service_pool.cc:224] Handling call
0709 12:24:41.893488 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:41.893707 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:24:42.026199 (+132492us) log.cc:844] Serialized 14 byte log entry
0709 12:24:49.125677 (+7099478us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:49.141302 (+ 15625us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:49.150692 (+  9390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.160583 (+  9891us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:49.169901 (+  9318us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7030696,"prepare.queue_time_us":151973,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":7104626,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":96,"thread_start_us":200380,"threads_started":2}
I20260709 12:24:49.209602 11680 raft_consensus.cc:1275] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:49.205018 14342 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:49.200357 10879 catalog_manager.cc:5697] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:49.195199 14558 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.198572 14601 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:49.210037 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:49.218977 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:49.220203 11130 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:49.216833 14342 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:49.223274 13739 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.223914 13739 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:49.225071 14342 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:49.205036 14449 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:49.226660 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 119849us
I20260709 12:24:49.226950 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 523) took 4892 ms. Trace:
I20260709 12:24:49.227329 11127 rpcz_store.cc:276] 0709 12:24:44.334905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.339212 (+  4307us) service_pool.cc:224] Handling call
0709 12:24:44.339984 (+   772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.226627 (+4886643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.226860 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:49.228183 14449 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:49.229067 14521 consensus_queue.cc:1048] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:49.229405 14388 consensus_queue.cc:1048] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:49.229785 14331 consensus_queue.cc:1048] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:49.230319 14619 raft_consensus.cc:2749] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:49.230863 14521 consensus_queue.cc:1059] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:49.219273 14199 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:49.211169 14446 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:49.221858 10879 catalog_manager.cc:5697] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 3 to 7, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 7 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:49.219554 14558 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:49.195147 14501 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:49.197449 10978 rpcz_store.cc:276] 0709 12:24:41.525514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.843339 (+317825us) service_pool.cc:224] Handling call
0709 12:24:41.843689 (+   350us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:41.848756 (+  5067us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:41.848786 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:41.849373 (+   587us) log.cc:844] Serialized 52 byte log entry
0709 12:24:41.990510 (+141137us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:42.496211 (+505701us) log.cc:844] Serialized 14 byte log entry
0709 12:24:49.168097 (+6671886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.186225 (+ 18128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:49.186289 (+    64us) raft_consensus.cc:1685] finished
0709 12:24:49.186305 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:49.186485 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6561250,"prepare.queue_time_us":84160,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":31,"raft.queue_time_us":6636164,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":194,"thread_start_us":703940,"threads_started":3,"wal-append.queue_time_us":231376,"wal-append.run_cpu_time_us":2679,"wal-append.run_wall_time_us":1416930}
I20260709 12:24:49.238601 14492 consensus_queue.cc:1048] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:49.240417 14612 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:49.242130 14446 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:49.188056 14610 consensus_queue.cc:260] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:49.197909 10880 rpcz_store.cc:269] 0709 12:24:23.833066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.856529 (+ 23463us) service_pool.cc:224] Handling call
0709 12:24:23.923769 (+ 67240us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b5400002490. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cc00b2 00007f8f91c39759 00007f8f91bd1a76 00007f8f91ba2d58 00007f8f91ca104e 00007f8f901622a4 00007f8f90162232 00007f8f90162161 00007f8f901620dc
0709 12:24:49.187018 (+25263249us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:38.419133 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:38.419923 (+   790us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:38.419973 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:24:38.419995 (+    22us) tablet.cc:662] Decoding operations
0709 12:24:38.421927 (+  1932us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:38.422031 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:38.422061 (+    30us) tablet.cc:685] Acquiring locks for 24 operations
0709 12:24:38.727635 (+305574us) tablet.cc:701] Row locks acquired
0709 12:24:38.737076 (+  9441us) write_op.cc:260] PREPARE: finished
0709 12:24:38.747913 (+ 10837us) write_op.cc:270] Start()
0709 12:24:38.780241 (+ 32328us) write_op.cc:276] Timestamp: P: 1783599878737221 usec, L: 0
0709 12:24:38.782000 (+  1759us) op_driver.cc:348] REPLICATION: starting
0709 12:24:39.217321 (+435321us) log.cc:844] Serialized 9418 byte log entry
0709 12:24:41.184815 (+1967494us) op_driver.cc:464] REPLICATION: finished
0709 12:24:41.534815 (+350000us) write_op.cc:301] APPLY: starting
0709 12:24:41.534920 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:41.535391 (+   471us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:41.535521 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:41.580897 (+ 45376us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:41.581341 (+   444us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=24
0709 12:24:41.581388 (+    47us) write_op.cc:312] APPLY: finished
0709 12:24:41.581892 (+   504us) log.cc:844] Serialized 164 byte log entry
0709 12:24:41.600330 (+ 18438us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:41.615147 (+ 14817us) write_op.cc:454] Released schema lock
0709 12:24:41.643977 (+ 28830us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:41.644518 (+   541us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:41.644547 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8202333,"reported_tablets":49,"spinlock_wait_cycles":4325632,"child_traces":[["op",{"apply.queue_time_us":325773,"apply.run_cpu_time_us":6797,"apply.run_wall_time_us":109686,"num_ops":24,"prepare.queue_time_us":254772,"prepare.run_cpu_time_us":40978,"prepare.run_wall_time_us":1157388,"raft.queue_time_us":817821,"raft.run_cpu_time_us":99401,"raft.run_wall_time_us":386529,"replication_time_us":2356703,"thread_start_us":958775,"threads_started":4,"wal-append.queue_time_us":457103,"wal-append.run_cpu_time_us":44667,"wal-append.run_wall_time_us":2911612}]]}
I20260709 12:24:49.244694 14610 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:49.247869 11644 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:49.218194 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:49.251559 11055 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:24:49.212827 14585 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:49.251377 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 49893.5us
I20260709 12:24:49.234547 10879 catalog_manager.cc:5697] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 7 to 8, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 8 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:49.264372 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:49.228991 14620 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:49.268673 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:49.275082 11126 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:49.274461 11676 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 8: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:49.234091 14199 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:49.277407 14302 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:49.277724 13739 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:49.280690 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:49.256273 14608 raft_consensus.cc:2749] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:49.286397 11127 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:24:49.288570 11645 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:49.289608 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:49.289961 14396 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.290558 14396 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:49.276309 14501 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:49.294541 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2200) took 7513 ms. Trace:
I20260709 12:24:49.294981 10976 rpcz_store.cc:276] 0709 12:24:41.780929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.958647 (+177718us) service_pool.cc:224] Handling call
0709 12:24:41.980520 (+ 21873us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:49.053400 (+7072880us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:49.053452 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:49.055266 (+  1814us) log.cc:844] Serialized 590 byte log entry
0709 12:24:49.163516 (+108250us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:49.163557 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.168235 (+  4678us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:49.294175 (+125940us) raft_consensus.cc:1685] finished
0709 12:24:49.294195 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:49.294368 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7055809,"raft.queue_time_us":7133134,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":137,"thread_start_us":107805,"threads_started":1,"wal-append.queue_time_us":157621}
I20260709 12:24:49.299916 14464 raft_consensus.cc:3055] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:49.300446 14464 raft_consensus.cc:740] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:49.294973 14566 consensus_queue.cc:1048] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
W20260709 12:24:49.302003 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.302271 14388 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:49.282610 14620 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:49.306895 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:49.307760 11676 raft_consensus.cc:2368] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8.
I20260709 12:24:49.308831 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:49.309723 11681 raft_consensus.cc:2410] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:24:49.307636 14620 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:49.311142 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:49.282721 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 86048.9us
I20260709 12:24:49.293458 11098 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:49.327370 11126 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:49.305859 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:49.326800 10984 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
W20260709 12:24:49.334826 10949 connection.cc:256] RPC call timeout handler was delayed by -5.9359297259998129s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
W20260709 12:24:49.335271 10949 connection.cc:256] RPC call timeout handler was delayed by -5.8261297259996354s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1705s for a response
I20260709 12:24:49.334429 11130 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
W20260709 12:24:49.335577 10949 connection.cc:256] RPC call timeout handler was delayed by -5.6200297259997569s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19340000000000002s for a response
W20260709 12:24:49.336297 10949 connection.cc:256] RPC call timeout handler was delayed by -5.4283297259999017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2147s for a response
W20260709 12:24:49.336591 10949 connection.cc:256] RPC call timeout handler was delayed by -5.0365009919996737s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2967s for a response
I20260709 12:24:49.279973 10879 catalog_manager.cc:5697] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 3 to 6, now has a pending config: VOTER bc01179655564f29b83babe396377cbb (127.9.145.193), VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194), VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195), VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 6 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:24:49.327039 14492 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:49.340891 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:49.341974 11132 raft_consensus.cc:1275] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:49.301538 14464 consensus_queue.cc:260] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:49.345695 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:49.343290 14501 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:49.341714 14620 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.347652 10879 catalog_manager.cc:5697] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:49.348570 10978 raft_consensus.cc:1240] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:49.338376 11678 raft_consensus.cc:2955] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 2 to 6, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:24:49.349879 10983 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
W20260709 12:24:49.356462 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 63104.9us
I20260709 12:24:49.359162 11098 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:49.343446 14302 raft_consensus.cc:2749] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:49.349392 14492 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.361919 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:49.363373 11025 leader_election.cc:336] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 1.706s (SENT)
I20260709 12:24:49.361392 10979 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:49.364797 14567 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:49.365236 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:49.365767 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:49.366225 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:49.361874 14402 consensus_queue.cc:1059] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:24:49.366767 14620 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:49.368320 14521 consensus_queue.cc:1048] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:49.368711 14396 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:49.368937 11054 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
I20260709 12:24:49.370401 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:49.362651 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:49.359786 10879 catalog_manager.cc:5697] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 3 to 6, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 6 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:24:49.375881 10981 raft_consensus.cc:1275] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:49.392261 10980 raft_consensus.cc:1240] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:49.376228 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:49.375869 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:49.377076 14199 consensus_queue.cc:1059] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:49.377439 14501 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:49.379196 10948 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:49.395730 11130 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:49.390549 11098 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:49.373769 14492 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:49.398047 14611 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:49.377012 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:49.398792 11132 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:49.405133 11644 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:49.405438 11673 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:24:49.408385 11130 raft_consensus.cc:1275] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:49.410049 11127 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:24:49.412290 14462 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:49.412870 14462 raft_consensus.cc:697] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 9 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:49.413959 14462 consensus_queue.cc:237] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:49.416726 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:49.417426 14199 consensus_queue.cc:1243] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [LEADER]: Peer 7518bdeb78f24e67a530754ae48547eb log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:24:49.417987 14378 consensus_queue.cc:1048] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:49.419111 10976 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:49.420396 10879 catalog_manager.cc:5697] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:24:49.424888 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:49.425123 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:49.441056 14501 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:49.398234 13739 consensus_queue.cc:1059] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:24:49.441557 14558 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:49.420324 14015 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:49.455443 10983 raft_consensus.cc:1275] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:24:49.456238 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 117183us
I20260709 12:24:49.389842 14082 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:49.457463 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:49.395596 14601 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:49.457803 11645 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
W20260709 12:24:49.459872 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 107446us
I20260709 12:24:49.446507 14302 consensus_queue.cc:1059] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
W20260709 12:24:49.465790 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.466296 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:49.471711 10975 raft_consensus.cc:2410] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:24:49.455677 14331 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:49.479799 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:49.488694 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:49.479592 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:49.478855 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:49.490271 11677 raft_consensus.cc:2393] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 11: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:49.479097 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:49.488118 11674 raft_consensus.cc:2393] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 10: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
W20260709 12:24:49.491645 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.492877 10981 raft_consensus.cc:1275] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:49.486935 10948 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:49.434430 14346 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:49.469271 14474 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:49.497653 10984 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:49.504678 11024 leader_election.cc:400] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8.
I20260709 12:24:49.505059 11024 leader_election.cc:403] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:49.505868 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:49.506428 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:49.506955 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:49.476266 14015 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:49.508023 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:49.504565 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:49.509740 11055 raft_consensus.cc:2393] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 9: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:49.510730 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:49.515785 11681 raft_consensus.cc:2393] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 10: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:49.516311 10975 raft_consensus.cc:2410] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:24:49.516405 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:49.517185 10984 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:24:49.519554 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:49.513283 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:49.523368 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:49.530791 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:49.606695 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:49.537863 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:49.523445 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:49.536800 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:49.523609 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:49.522965 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 49414.9us
I20260709 12:24:49.603675 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:49.612864 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 143695us
I20260709 12:24:49.644687 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:49.642184 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:49.650781 10981 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
W20260709 12:24:49.527321 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 54179.8us
I20260709 12:24:49.526847 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:49.557542 11128 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:49.736393 11060 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:24:49.656817 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:49.526480 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:49.515443 14015 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.536160 10983 raft_consensus.cc:1275] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:24:49.671713 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.540979 11129 raft_consensus.cc:2393] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 8: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:49.658811 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:49.645407 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:49.497797 14302 consensus_queue.cc:1243] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer c979ef00e0ad4157b49ebbdc13ce7cd7 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:49.611083 14464 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:49.560674 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.738289 10981 pending_rounds.cc:85] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 5
I20260709 12:24:49.534621 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:49.501449 14474 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:49.524371 14346 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:49.540467 14082 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:49.745373 11057 raft_consensus.cc:2393] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 9: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:49.538218 14211 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8.
I20260709 12:24:49.535256 14388 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:49.746778 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:49.743163 11676 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:49.611709 11675 raft_consensus.cc:1240] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 7. Current term is 8. Ops: [7.9-7.9]
W20260709 12:24:49.609589 14630 log.cc:927] Time spent T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:24:49.654131 14601 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:49.743607 11052 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:49.751817 11053 raft_consensus.cc:2393] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 8: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:49.751857 11127 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:49.498315 14331 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:49.523497 14390 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.294s
I20260709 12:24:49.658835 14492 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:49.753341 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:49.523653 14501 raft_consensus.cc:2804] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:49.538710 14620 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:49.751593 11058 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:24:49.755954 11024 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:49.755204 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:49.746315 14015 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:49.760335 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:49.532140 14356 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:49.766872 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:49.767163 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:49.784588 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:49.794256 11679 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:49.798213 10983 raft_consensus.cc:2410] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 12:24:49.792021 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:49.794571 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:49.800884 11676 raft_consensus.cc:2393] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 8: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:49.790508 10980 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:49.799824 10979 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:24:49.805444 11057 raft_consensus.cc:2393] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 8: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:49.809414 14331 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:49.752702 10981 pending_rounds.cc:107] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:24:49.772219 11128 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
I20260709 12:24:49.814987 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:49.814678 10981 raft_consensus.cc:2889] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:49.816009 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:49.816709 11132 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
W20260709 12:24:49.775830 11097 leader_election.cc:336] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.697s (SENT)
I20260709 12:24:49.779160 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:49.779336 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:49.818599 11097 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:49.796411 11134 raft_consensus.cc:2393] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 10: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:49.810392 14356 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:49.810894 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 70777.4us
I20260709 12:24:49.811491 14492 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:49.812529 14619 raft_consensus.cc:3055] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:49.771996 14501 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:49.755052 14474 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:49.743055 11130 raft_consensus.cc:2393] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 9: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:49.827512 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:49.767867 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:49.797574 14108 raft_consensus.cc:2749] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:49.789618 14446 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:24:49.838402 10977 raft_consensus.cc:3055] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:49.838791 10977 raft_consensus.cc:740] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:49.839659 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:49.839602 10977 consensus_queue.cc:260] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:49.818205 11098 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:49.821173 11024 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:49.840411 11127 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:24:49.841560 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:24:49.842069 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.842482 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:49.843130 11128 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:49.843684 14558 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:49.844025 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:49.844238 14187 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:49.822682 14619 raft_consensus.cc:740] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:49.845762 14619 consensus_queue.cc:260] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:49.847168 14619 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:49.847622 14566 raft_consensus.cc:3055] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:49.848057 14566 raft_consensus.cc:740] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:49.848987 14566 consensus_queue.cc:260] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:49.830775 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:49.851397 10981 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:49.852388 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:49.853155 10981 raft_consensus.cc:2393] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 10: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:49.854032 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:49.814983 14402 consensus_queue.cc:1059] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:24:49.855505 10981 raft_consensus.cc:2410] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:24:49.833822 14346 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:49.834522 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:49.836148 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:49.826905 14501 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:49.831440 14611 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.844692 11128 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:49.856431 10975 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:49.832617 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:49.860071 11127 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:24:49.844674 14187 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.874774 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:49.875735 11132 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 8: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:49.912150 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:49.933966 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:49.953104 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.975558 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:49.976358 11130 raft_consensus.cc:2376] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9. Re-sending same reply.
I20260709 12:24:49.982542 10982 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:49.991338 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:49.913144 14187 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:49.874629 14611 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:50.019170 14346 raft_consensus.cc:2804] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:50.019786 14346 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.020179 14346 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:50.021731 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:50.022550 11132 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:50.019351 14566 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:50.019277 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 202461us
I20260709 12:24:50.019170 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:50.033136 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:50.033983 10981 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:50.035367 10975 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:50.004217 11131 raft_consensus.cc:2376] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8. Re-sending same reply.
I20260709 12:24:50.041489 10980 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:24:50.044688 10977 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:50.048838 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:50.049363 10983 raft_consensus.cc:2393] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 9: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:50.049780 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:50.073335 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:50.078418 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:50.079923 10980 raft_consensus.cc:2393] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 8: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:50.081528 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:50.086256 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:50.091657 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:50.082125 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:50.082616 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:50.105012 11128 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:24:50.106750 11645 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:50.115013 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:50.115861 11130 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:50.118369 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:50.026803 14520 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.120298 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:50.111027 11098 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:50.139719 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 368357us
I20260709 12:24:50.136616 10981 raft_consensus.cc:2393] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 6: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:50.141242 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:50.144797 10983 raft_consensus.cc:2393] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 10: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:50.143329 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:50.145462 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.146341 10975 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:50.149477 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:50.151865 11128 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:24:50.152915 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:50.154837 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:50.155441 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 44509.9us
W20260709 12:24:50.159282 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:50.159993 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.163373 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:50.168257 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:50.164176 11125 raft_consensus.cc:2376] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9. Re-sending same reply.
I20260709 12:24:50.173671 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:50.175944 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:50.169104 10982 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:50.179129 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:50.180002 11130 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
I20260709 12:24:50.189904 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:50.194636 10879 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.009s	sys 0.021s
W20260709 12:24:50.196966 10879 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.009s	sys 0.021s
W20260709 12:24:50.186702 11644 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.012s	sys 0.033s
W20260709 12:24:50.218044 11644 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.015s	sys 0.033s
W20260709 12:24:50.218405 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 719913us
I20260709 12:24:50.165246 14356 raft_consensus.cc:2749] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:50.220988 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:50.225215 11127 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:24:50.229580 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:50.230448 11127 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
W20260709 12:24:50.231541 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 52992.9us
I20260709 12:24:50.225131 11644 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
W20260709 12:24:50.219743 14462 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.018s	sys 0.030s
W20260709 12:24:50.238432 14462 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.018s	sys 0.030s
I20260709 12:24:50.164656 14520 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:50.250325 14329 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:24:50.251425 14635 log.cc:927] Time spent T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.432s	user 0.000s	sys 0.001s
I20260709 12:24:50.252038 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:50.253697 11126 raft_consensus.cc:1240] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:50.250000 14520 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:50.255198 11126 raft_consensus.cc:1240] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:50.256917 11126 raft_consensus.cc:2955] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 2 to 6, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
W20260709 12:24:50.258555 14633 log.cc:927] Time spent T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.522s	user 0.001s	sys 0.013s
I20260709 12:24:50.262995 11133 raft_consensus.cc:1240] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8. Ops: []
W20260709 12:24:50.274722 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.282608 10981 raft_consensus.cc:1275] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:24:50.287880 14346 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:50.302659 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:50.306382 10981 raft_consensus.cc:1275] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 12:24:50.306927 10981 pending_rounds.cc:85] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 6
I20260709 12:24:50.307185 10981 pending_rounds.cc:107] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:24:50.307439 10981 raft_consensus.cc:2889] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:50.308182 11680 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.026s	sys 0.021s
W20260709 12:24:50.308566 11680 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.026s	sys 0.021s
W20260709 12:24:50.311056 11023 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.057s	sys 0.078s
W20260709 12:24:50.311570 11023 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.057s	sys 0.078s
W20260709 12:24:50.312105 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 514946us
W20260709 12:24:50.315442 11678 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.014s	sys 0.032s
W20260709 12:24:50.315878 11678 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.014s	sys 0.032s
I20260709 12:24:50.317894 11130 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:50.319676 11054 raft_consensus.cc:1240] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:24:50.323256 11678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 707) took 1016 ms. Trace:
I20260709 12:24:50.323755 11678 rpcz_store.cc:276] 0709 12:24:49.306786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.311921 (+  5135us) service_pool.cc:224] Handling call
0709 12:24:49.312197 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.326791 (+ 14594us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:49.438024 (+111233us) log.cc:844] Serialized 14 byte log entry
0709 12:24:49.855788 (+417764us) spinlock_profiling.cc:243] Waited 5 ms on lock 0x7b180038bfc0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cf7522 00007f8f88cf97c1 00007f8f88cf9779 00007f8f88cf9709 00007f8f88cf96d1 00007f8f88cf89cd 0000000000388634 0000000000388479 00007f8f88cda83a
0709 12:24:50.316233 (+460445us) log.cc:844] Serialized 14 byte log entry
0709 12:24:50.322888 (+  6655us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:50.322940 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:50.322986 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.323067 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.323190 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6400,"prepare.queue_time_us":7021,"prepare.run_wall_time_us":36,"raft.queue_time_us":81,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":5987,"spinlock_wait_cycles":15903232,"thread_start_us":848849,"threads_started":2,"wal-append.queue_time_us":513342}
I20260709 12:24:50.332512 10982 raft_consensus.cc:1240] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:50.334250 11132 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
W20260709 12:24:50.336357 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 111286us
I20260709 12:24:50.336839 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:50.341992 11672 raft_consensus.cc:2393] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 10: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:50.343935 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:50.336478 11059 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.010s	sys 0.045s
W20260709 12:24:50.345512 11059 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.010s	sys 0.045s
I20260709 12:24:50.317301 14558 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:24:50.362720 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.368880 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:50.356119 14346 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:50.379642 10982 raft_consensus.cc:1275] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:50.174997 11128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:54492
I20260709 12:24:50.382630 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:50.368755 14558 raft_consensus.cc:697] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:50.387389 14558 consensus_queue.cc:237] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:50.392125 11129 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58414 (request call id 532) took 1262 ms (client timeout 1673 ms). Trace:
W20260709 12:24:50.392712 11129 rpcz_store.cc:269] 0709 12:24:49.129802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.130410 (+   608us) service_pool.cc:224] Handling call
0709 12:24:50.391812 (+1261402us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b5400030a54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:50.391996 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":941487872}
I20260709 12:24:50.399590 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:50.400513 10979 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:24:50.402732 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 2116) took 1228 ms. Trace:
I20260709 12:24:50.403234 11134 rpcz_store.cc:276] 0709 12:24:49.173972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.174196 (+   224us) service_pool.cc:224] Handling call
0709 12:24:50.402479 (+1228283us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b54000eecd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:50.402653 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1419326208}
I20260709 12:24:50.405375 11679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 708) took 1098 ms. Trace:
I20260709 12:24:50.405869 11679 rpcz_store.cc:276] 0709 12:24:49.307167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.310226 (+  3059us) service_pool.cc:224] Handling call
0709 12:24:49.310570 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.799099 (+488529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.405058 (+605959us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b5400674b54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:50.405301 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1056979328}
I20260709 12:24:50.408710 14521 raft_consensus.cc:3055] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:50.409281 14521 raft_consensus.cc:740] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:24:50.412058 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.411792 14187 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:50.414790 14015 consensus_meta.cc:287] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.621s	user 0.010s	sys 0.006s
I20260709 12:24:50.415283 14015 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:50.415917 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:50.416534 11675 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:50.423945 11675 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:24:50.424064 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:50.424934 10981 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:50.430842 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:50.433377 10976 raft_consensus.cc:1240] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:50.435084 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:50.436003 11053 raft_consensus.cc:2393] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 10: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:50.416229 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:50.438283 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.439388 11024 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:50.426054 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:50.401947 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:50.441886 10979 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:50.443014 11645 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:50.444182 11645 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:50.444864 14211 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:50.445690 14211 consensus_queue.cc:1243] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:24:50.446345 14492 raft_consensus.cc:2804] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:50.446980 14492 raft_consensus.cc:697] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:50.448119 14492 consensus_queue.cc:237] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:50.448534 14396 raft_consensus.cc:2804] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:50.440197 11128 raft_consensus.cc:606] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
W20260709 12:24:50.454181 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 48679.7us
I20260709 12:24:50.453729 11128 raft_consensus.cc:614] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:50.456961 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:50.463581 10977 raft_consensus.cc:1275] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:24:50.464129 10977 pending_rounds.cc:85] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 3
I20260709 12:24:50.464425 10977 pending_rounds.cc:107] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:24:50.465826 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:50.452682 14187 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:50.471688 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:50.485633 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:50.454346 14402 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:50.490949 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:50.495586 10948 connection.cc:256] RPC call timeout handler was delayed by -7.7292126659999667s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
I20260709 12:24:50.500707 11128 raft_consensus.cc:1275] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:24:50.510484 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:50.469492 14396 raft_consensus.cc:697] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:50.521045 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:50.525682 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:50.526014 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:50.465122 14567 consensus_queue.cc:1048] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:24:50.528007 11098 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:50.531028 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:50.536765 10984 raft_consensus.cc:1240] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:50.536193 14331 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.552260 11055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1482) took 1020 ms. Trace:
I20260709 12:24:50.460954 14521 consensus_queue.cc:260] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:50.556120 14611 consensus_meta.cc:287] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.537s	user 0.003s	sys 0.006s
I20260709 12:24:50.681967 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1505) took 1016 ms. Trace:
W20260709 12:24:50.619225 14566 consensus_meta.cc:287] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.000s
W20260709 12:24:50.686211 10948 connection.cc:256] RPC call timeout handler was delayed by -7.7229126659999565s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16080000000000003s for a response
I20260709 12:24:50.686563 11127 raft_consensus.cc:1275] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:24:50.687002 11127 pending_rounds.cc:85] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 5
I20260709 12:24:50.687314 11127 pending_rounds.cc:107] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:24:50.687556 11127 raft_consensus.cc:2889] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:50.688683 14402 raft_consensus.cc:697] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:24:50.642048 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 302020us
W20260709 12:24:50.689373 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.625725 11134 raft_consensus.cc:1275] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:50.560395 11052 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:24:50.573529 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:50.560770 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:50.577831 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2241) took 1040 ms. Trace:
I20260709 12:24:50.570758 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:50.694454 10977 raft_consensus.cc:2889] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:50.638859 11673 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.891s	user 0.024s	sys 0.074s
I20260709 12:24:50.695120 11132 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:50.695674 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 167749us
W20260709 12:24:50.695250 11673 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.953s	user 0.031s	sys 0.074s
I20260709 12:24:50.690421 11644 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:50.527467 14015 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:50.696377 11098 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
W20260709 12:24:50.559986 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:50.566756 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 104539us
W20260709 12:24:50.695561 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 153685us
I20260709 12:24:50.651122 11680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 715) took 1182 ms. Trace:
I20260709 12:24:50.688283 11678 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 10.
I20260709 12:24:50.696643 11057 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:50.677959 10979 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
W20260709 12:24:50.687003 10948 connection.cc:256] RPC call timeout handler was delayed by -7.6320126659998095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
W20260709 12:24:50.709583 10948 connection.cc:256] RPC call timeout handler was delayed by -7.5564126660001421s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
W20260709 12:24:50.710150 10948 connection.cc:256] RPC call timeout handler was delayed by -7.4538126659999762s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
I20260709 12:24:50.696069 10976 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 8: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:50.700001 14449 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:50.701301 11673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41774 (request call id 562) took 1174 ms. Trace:
I20260709 12:24:50.702023 14082 raft_consensus.cc:2804] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:50.703441 11674 raft_consensus.cc:2368] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 11. Current term is 12.
I20260709 12:24:50.711539 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:50.713014 11677 raft_consensus.cc:2393] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 9: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:50.713197 10976 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
W20260709 12:24:50.705360 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.704480 11055 rpcz_store.cc:276] 0709 12:24:49.531540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.820827 (+289287us) service_pool.cc:224] Handling call
0709 12:24:49.835333 (+ 14506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:49.835830 (+   497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:49.835867 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:49.836440 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 12:24:50.317444 (+481004us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:50.317482 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.317545 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:50.552030 (+234485us) raft_consensus.cc:1685] finished
0709 12:24:50.552050 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.552177 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2170,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":111,"thread_start_us":480529,"threads_started":1,"wal-append.queue_time_us":653393}
I20260709 12:24:50.715766 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:50.716378 10979 raft_consensus.cc:2376] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11. Re-sending same reply.
W20260709 12:24:50.530339 14474 consensus_meta.cc:287] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.000s
W20260709 12:24:50.717193 11643 leader_election.cc:336] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.575s (SENT)
I20260709 12:24:50.730012 11643 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:50.728307 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.708825 11680 rpcz_store.cc:276] 0709 12:24:49.468251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.468380 (+   129us) service_pool.cc:224] Handling call
0709 12:24:49.478523 (+ 10143us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.478736 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:49.479051 (+   315us) log.cc:844] Serialized 14 byte log entry
0709 12:24:50.390569 (+911518us) spinlock_profiling.cc:243] Waited 8.03 ms on lock 0x7b18000707e0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cd9e07 00007f8f91b349a9 00007f8f88cf669b 00007f8f88cf493f 00007f8f88cf4455 00007f8f8f7dc3c7 00007f8f8bdee9a7 00007f8f8bdfe0bf 00007f8f8bdfe038
0709 12:24:50.643280 (+252711us) log.cc:844] Serialized 14 byte log entry
0709 12:24:50.650676 (+  7396us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:50.650741 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:50.650807 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.650882 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.651040 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20601,"prepare.queue_time_us":62902,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":5922,"raft.queue_time_us":20882,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":20755,"spinlock_wait_cycles":18467200,"thread_start_us":1081975,"threads_started":2,"wal-append.queue_time_us":1058077}
I20260709 12:24:50.732059 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2232) took 1296 ms. Trace:
I20260709 12:24:50.737114 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:50.733827 10981 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:24:50.734745 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:50.733335 10977 rpcz_store.cc:276] 0709 12:24:49.417262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.419561 (+  2299us) service_pool.cc:224] Handling call
0709 12:24:49.419877 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.838306 (+418429us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b54001beca0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bd5bdc0 00007f8f8bde61c0 00007f8f8bde7231 00007f8f8bde3d8f 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c
0709 12:24:50.713442 (+875136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.713675 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54248832}
W20260709 12:24:50.740368 14647 log.cc:927] Time spent T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:24:50.684895 10982 rpcz_store.cc:276] 0709 12:24:49.735373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.384529 (+649156us) service_pool.cc:224] Handling call
0709 12:24:50.384922 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.385231 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:50.385623 (+   392us) log.cc:844] Serialized 14 byte log entry
0709 12:24:50.679768 (+294145us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:50.679829 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:50.679886 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.679962 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.681891 (+  1929us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1240,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":40029,"spinlock_wait_cycles":18816,"thread_start_us":255877,"threads_started":1,"wal-append.queue_time_us":235583}
I20260709 12:24:50.694658 10975 rpcz_store.cc:276] 0709 12:24:49.537859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.154737 (+616878us) service_pool.cc:224] Handling call
0709 12:24:50.155137 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.196536 (+ 41399us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:50.243027 (+ 46491us) log.cc:844] Serialized 14 byte log entry
0709 12:24:50.576543 (+333516us) log.cc:844] Serialized 14 byte log entry
0709 12:24:50.577448 (+   905us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:50.577496 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:50.577547 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.577623 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.577761 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":30066,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":784,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":7434,"spinlock_wait_cycles":40881664,"thread_start_us":332837,"threads_started":1,"wal-append.queue_time_us":448666}
I20260709 12:24:50.743456 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:50.744159 10975 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:24:50.693460 14402 consensus_queue.cc:237] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:50.748144 10975 raft_consensus.cc:1275] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:24:50.748539 10948 connection.cc:256] RPC call timeout handler was delayed by -7.39441266599988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19730000000000003s for a response
I20260709 12:24:50.748127 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:50.748988 10948 connection.cc:256] RPC call timeout handler was delayed by -7.3701126659998408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
W20260709 12:24:50.749410 10948 connection.cc:256] RPC call timeout handler was delayed by -7.3386126660002446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20350000000000001s for a response
W20260709 12:24:50.749761 10948 connection.cc:256] RPC call timeout handler was delayed by -7.3260126660002243s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2049s for a response
I20260709 12:24:50.749791 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:50.750177 10948 connection.cc:256] RPC call timeout handler was delayed by -7.3143126660002054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2062s for a response
W20260709 12:24:50.750507 10948 connection.cc:256] RPC call timeout handler was delayed by -7.311612666000201s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
W20260709 12:24:50.750794 10948 connection.cc:256] RPC call timeout handler was delayed by -7.2693126660001326s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
W20260709 12:24:50.751086 10948 connection.cc:256] RPC call timeout handler was delayed by -7.2459126660000948s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2138s for a response
W20260709 12:24:50.751381 10948 connection.cc:256] RPC call timeout handler was delayed by -7.1991126660000191s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.219s for a response
W20260709 12:24:50.751652 10948 connection.cc:256] RPC call timeout handler was delayed by -7.1730126659999769s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2219s for a response
I20260709 12:24:50.755065 14660 raft_consensus.cc:2749] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:50.758409 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:50.759137 10976 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:50.571867 14329 raft_consensus.cc:697] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:50.767611 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:50.768162 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:50.768407 10975 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:24:50.760463 11059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1480) took 1229 ms. Trace:
I20260709 12:24:50.712692 11673 rpcz_store.cc:276] 0709 12:24:49.527117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.670422 (+143305us) service_pool.cc:224] Handling call
0709 12:24:49.670807 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.671040 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:24:49.671363 (+   323us) log.cc:844] Serialized 14 byte log entry
0709 12:24:50.700952 (+1029589us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:50.701004 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:50.701055 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.701116 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.701243 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3984,"prepare.queue_time_us":27983,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":4846,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"thread_start_us":954627,"threads_started":1,"wal-append.queue_time_us":889854}
I20260709 12:24:50.768814 10981 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:50.741535 14649 log.cc:927] Time spent T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 12:24:50.766331 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.767699 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:50.606320 14585 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.771574 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:50.717007 14346 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:24:50.768687 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 213999us
I20260709 12:24:50.796463 11025 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:50.796541 10979 raft_consensus.cc:1275] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:50.797467 11025 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:50.773636 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2136) took 1247 ms. Trace:
I20260709 12:24:50.788776 11644 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:50.685412 14396 consensus_queue.cc:237] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:50.730906 14566 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:50.734623 13739 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:24:50.787521 10984 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
I20260709 12:24:50.788870 10975 raft_consensus.cc:1240] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:24:50.798482 11127 rpcz_store.cc:276] 0709 12:24:49.525845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.249625 (+723780us) service_pool.cc:224] Handling call
0709 12:24:50.249947 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.688062 (+438115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.773341 (+ 85279us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b5400034654. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:50.773565 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1003224448}
I20260709 12:24:50.754269 14521 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:50.802043 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:50.917745 11054 raft_consensus.cc:2393] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 10: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:50.769639 11059 rpcz_store.cc:276] 0709 12:24:49.531023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.732268 (+201245us) service_pool.cc:224] Handling call
0709 12:24:49.745682 (+ 13414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:49.754661 (+  8979us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:49.754694 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:49.759333 (+  4639us) log.cc:844] Serialized 26 byte log entry
0709 12:24:50.345932 (+586599us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:50.693918 (+347986us) log.cc:844] Serialized 14 byte log entry
0709 12:24:50.694172 (+   254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.694329 (+   157us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:50.760126 (+ 65797us) raft_consensus.cc:1685] finished
0709 12:24:50.760148 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.760324 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":388062,"raft.queue_time_us":313,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":8855,"thread_start_us":880521,"threads_started":2,"wal-append.queue_time_us":756840}
I20260709 12:24:50.801817 14346 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.918776 14346 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:50.844549 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 135925us
W20260709 12:24:50.925148 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.801537 14082 raft_consensus.cc:697] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:50.926304 11678 pending_rounds.cc:85] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Aborting all ops after (but not including) 4
I20260709 12:24:50.926697 11678 pending_rounds.cc:107] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.5
I20260709 12:24:50.927002 11678 raft_consensus.cc:2917] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Aborting config change with OpId 6.5: Aborted: Op aborted by new leader
I20260709 12:24:50.926791 14082 consensus_queue.cc:237] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:50.927390 11678 raft_consensus.cc:2889] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:50.849231 11051 raft_consensus.cc:1275] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:24:50.849867 14660 raft_consensus.cc:2749] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:50.741765 14474 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:50.853287 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 55248.2us
W20260709 12:24:50.856061 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.859256 11057 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
W20260709 12:24:50.863224 10948 connection.cc:256] RPC call timeout handler was delayed by -6.378038614000161s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
W20260709 12:24:50.941310 10948 connection.cc:256] RPC call timeout handler was delayed by -6.3168386140000621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
W20260709 12:24:50.941666 10948 connection.cc:256] RPC call timeout handler was delayed by -6.2709386139999879s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17020000000000002s for a response
W20260709 12:24:50.941992 10948 connection.cc:256] RPC call timeout handler was delayed by -6.2682386139999835s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1705s for a response
W20260709 12:24:50.942307 10948 connection.cc:256] RPC call timeout handler was delayed by -6.062138614000105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19340000000000002s for a response
W20260709 12:24:50.942581 10948 connection.cc:256] RPC call timeout handler was delayed by -5.8515386140002192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21680000000000002s for a response
W20260709 12:24:50.942853 10948 connection.cc:256] RPC call timeout handler was delayed by -5.4177386139999726s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.265s for a response
I20260709 12:24:50.943126 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2138) took 1301 ms. Trace:
I20260709 12:24:50.944139 10948 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:50.713901 14520 consensus_queue.cc:1048] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:24:50.877816 10979 raft_consensus.cc:1275] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:24:50.878432 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:50.733649 14331 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:50.915354 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 117953us
I20260709 12:24:50.943594 11126 rpcz_store.cc:276] 0709 12:24:49.644117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.256161 (+612044us) service_pool.cc:224] Handling call
0709 12:24:50.256508 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.256775 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:50.267902 (+ 11127us) log.cc:844] Serialized 14 byte log entry
0709 12:24:50.942567 (+674665us) log.cc:844] Serialized 14 byte log entry
0709 12:24:50.942772 (+   205us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:50.942818 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:50.942869 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.942942 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.943067 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3899,"raft.queue_time_us":96,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":39263,"thread_start_us":569348,"threads_started":2,"wal-append.queue_time_us":574905}
I20260709 12:24:50.948446 11025 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:50.947899 14331 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:50.950721 14331 consensus_queue.cc:1048] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:50.733273 14611 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:50.852519 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1494) took 1189 ms. Trace:
I20260709 12:24:50.954876 10983 rpcz_store.cc:276] 0709 12:24:49.663060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.244216 (+581156us) service_pool.cc:224] Handling call
0709 12:24:50.244641 (+   425us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:24:50.245071 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.245305 (+   234us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:24:50.250180 (+  4875us) log.cc:844] Serialized 78 byte log entry
0709 12:24:50.573060 (+322880us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:50.573102 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.573221 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:50.852246 (+279025us) raft_consensus.cc:1685] finished
0709 12:24:50.852269 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.852428 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":123,"thread_start_us":322441,"threads_started":1,"wal-append.queue_time_us":484066}
W20260709 12:24:50.936488 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 76113.2us
I20260709 12:24:50.973289 14331 raft_consensus.cc:2764] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:24:50.981436 14492 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:50.982226 14492 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:50.983494 14611 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:50.991827 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2145) took 1240 ms. Trace:
I20260709 12:24:50.994167 11644 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:50.992623 11131 rpcz_store.cc:276] 0709 12:24:49.754552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.338286 (+583734us) service_pool.cc:224] Handling call
0709 12:24:50.529011 (+190725us) spinlock_profiling.cc:243] Waited 4.92 ms on lock 0x7b5800117398. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90dbdfc0 00007f8f90da8929 00007f8f90da83d2 00007f8f8a31fbd4
0709 12:24:50.529206 (+   195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.529437 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:50.707201 (+177764us) log.cc:844] Serialized 14 byte log entry
0709 12:24:50.990494 (+283293us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:50.990681 (+   187us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:50.990834 (+   153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.991092 (+   258us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.991703 (+   611us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":428,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":282,"spinlock_wait_cycles":11324800,"thread_start_us":383158,"threads_started":2}
I20260709 12:24:50.995426 14396 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:50.997702 14390 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:51.004858 11057 raft_consensus.cc:1275] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:24:50.853994 14211 raft_consensus.cc:2804] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:51.012945 11052 raft_consensus.cc:606] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
W20260709 12:24:51.004858 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 127107us
I20260709 12:24:50.914525 14619 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.914525 14648 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:51.027387 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:50.939075 14356 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:50.842353 14585 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:51.021862 14656 log.cc:927] Time spent T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 12:24:51.049264 11132 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
I20260709 12:24:50.937264 14566 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:51.019094 14211 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.054818 14474 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:51.048184 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 351852us
W20260709 12:24:51.050233 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.032229 14462 raft_consensus.cc:2749] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:51.028334 14648 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:51.077663 11643 leader_election.cc:336] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.529s (SENT)
I20260709 12:24:51.077759 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.080092 11023 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:51.081095 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 137082us
I20260709 12:24:51.083536 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:50.852429 14329 consensus_queue.cc:237] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:51.085116 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:51.096873 10983 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 8: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:51.094148 11643 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:51.130610 10984 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
I20260709 12:24:51.034476 14619 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:51.138669 11056 raft_consensus.cc:1240] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 8. Current term is 9. Ops: [8.7-8.7]
W20260709 12:24:51.138865 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 58090.9us
I20260709 12:24:51.082713 14211 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:51.138477 11060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1481) took 1607 ms. Trace:
W20260709 12:24:51.160522 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 212148us
W20260709 12:24:51.128710 14633 log.cc:927] Time spent T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.051s	user 0.000s	sys 0.006s
I20260709 12:24:51.165234 10948 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:51.096091 14648 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:51.171430 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 89252.4us
I20260709 12:24:51.175480 11098 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:51.167299 11025 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:51.174891 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.177188 10984 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
W20260709 12:24:51.188213 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 110591us
W20260709 12:24:51.191183 11643 leader_election.cc:336] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.647s (SENT)
I20260709 12:24:51.191449 11643 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:51.186914 13739 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:51.196038 14667 log.cc:927] Time spent T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.260s	user 0.000s	sys 0.000s
W20260709 12:24:51.197126 14664 log.cc:927] Time spent T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
W20260709 12:24:51.200498 14678 log.cc:927] Time spent T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:24:51.165743 14686 consensus_queue.cc:1048] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
W20260709 12:24:51.202580 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 70279.8us
I20260709 12:24:51.203420 10948 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:51.205368 10948 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:51.206359 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2146) took 1439 ms. Trace:
I20260709 12:24:51.206787 11125 rpcz_store.cc:276] 0709 12:24:49.766468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.353418 (+586950us) service_pool.cc:224] Handling call
0709 12:24:50.366979 (+ 13561us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:50.381300 (+ 14321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.381335 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:50.435083 (+ 53748us) log.cc:844] Serialized 26 byte log entry
0709 12:24:50.719362 (+284279us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:50.719401 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.719485 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:51.206079 (+486594us) raft_consensus.cc:1685] finished
0709 12:24:51.206117 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.206277 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7381,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"thread_start_us":283880,"threads_started":1,"wal-append.queue_time_us":624058}
I20260709 12:24:51.212961 14346 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:51.215101 14566 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:51.217819 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.218437 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.219609 14585 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:51.219959 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:51.220690 14402 consensus_queue.cc:1048] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:51.221138 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:51.222445 14638 log.cc:927] Time spent T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.994s	user 0.000s	sys 0.007s
W20260709 12:24:51.223385 14665 log.cc:927] Time spent T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 12:24:51.224485 14520 raft_consensus.cc:2764] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:24:51.229604 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.230360 10975 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:24:51.231258 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.231812 10975 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
W20260709 12:24:51.236193 14671 log.cc:927] Time spent T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:24:51.167495 14015 raft_consensus.cc:2749] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:51.218557 10984 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:24:51.219626 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:51.241904 10981 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:24:51.246290 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:51.253485 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:51.256078 10981 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:51.255771 10976 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
I20260709 12:24:51.144320 11060 rpcz_store.cc:276] 0709 12:24:49.531299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.750278 (+218979us) service_pool.cc:224] Handling call
0709 12:24:49.765916 (+ 15638us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:50.238294 (+472378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.238653 (+   359us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:50.247835 (+  9182us) log.cc:844] Serialized 26 byte log entry
0709 12:24:50.573635 (+325800us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:50.573714 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.573800 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:51.138199 (+564399us) raft_consensus.cc:1685] finished
0709 12:24:51.138234 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.138411 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5812,"raft.queue_time_us":17576,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":765656,"threads_started":2,"wal-append.queue_time_us":442427}
I20260709 12:24:51.286159 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2230) took 1869 ms. Trace:
I20260709 12:24:51.266989 14342 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.203495 14686 raft_consensus.cc:2804] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:51.305176 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:51.310237 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.316828 10981 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:24:51.318522 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:51.319339 10976 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:51.325400 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 134230us
I20260709 12:24:51.288314 14449 raft_consensus.cc:2749] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:51.328612 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.329914 10983 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
I20260709 12:24:51.279124 14462 raft_consensus.cc:2804] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:51.289645 13739 raft_consensus.cc:2749] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:51.334805 13739 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.335336 13739 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:51.304464 14342 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:51.337366 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2142) took 1603 ms. Trace:
I20260709 12:24:51.337749 13739 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:51.337800 11133 rpcz_store.cc:276] 0709 12:24:49.733949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.263977 (+530028us) service_pool.cc:224] Handling call
0709 12:24:50.264347 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:50.264769 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.264799 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:50.265350 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 12:24:50.571131 (+305781us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:50.571176 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.571252 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:51.337100 (+765848us) raft_consensus.cc:1685] finished
0709 12:24:51.337122 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.337272 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5594,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":145,"thread_start_us":305337,"threads_started":1,"wal-append.queue_time_us":1067770}
W20260709 12:24:51.339061 14501 consensus_meta.cc:287] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 1.267s	user 0.011s	sys 0.001s
W20260709 12:24:51.342360 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 137069us
I20260709 12:24:51.340354 14619 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:51.346312 14346 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:51.359236 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 65570.7us
I20260709 12:24:51.286679 10978 rpcz_store.cc:276] 0709 12:24:49.416645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.443846 (+ 27201us) service_pool.cc:224] Handling call
0709 12:24:49.451406 (+  7560us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:49.451822 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:49.451852 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:50.416569 (+964717us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b2c00030d28. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8a6dda11 00007f8f8a6ed372 00007f8f8be1fa01 00007f8f8bde443a 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2
0709 12:24:50.417063 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 12:24:50.642390 (+225327us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:50.642435 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.642516 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:51.262131 (+619615us) raft_consensus.cc:1685] finished
0709 12:24:51.262158 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.286042 (+ 23884us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3914,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":8694,"spinlock_wait_cycles":4989696,"thread_start_us":224866,"threads_started":1,"wal-append.queue_time_us":330778}
W20260709 12:24:51.353551 11643 leader_election.cc:336] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.844s (SENT)
I20260709 12:24:51.360530 11643 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:51.375842 10948 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:51.321758 14686 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.380841 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.385995 10976 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
I20260709 12:24:51.375277 14501 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:51.389150 14660 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:51.406533 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.406900 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:51.408911 10948 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:51.398729 10980 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:24:51.431485 10983 raft_consensus.cc:2376] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7. Re-sending same reply.
W20260709 12:24:51.430483 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 263311us
W20260709 12:24:51.433427 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 105681us
I20260709 12:24:51.420979 11097 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:51.412501 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 326364us
W20260709 12:24:51.435546 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.435714 10981 raft_consensus.cc:1275] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 12:24:51.439600 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.441094  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:51.444398  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:51.445848  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:51.433887 11025 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:51.431639 10978 raft_consensus.cc:2376] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9. Re-sending same reply.
W20260709 12:24:51.445853 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:51.448511 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.450699 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:51.413147 14464 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.002s	sys 0.032s
W20260709 12:24:51.454905 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 46086.7us
I20260709 12:24:51.457604 11025 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:51.458920 11025 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:51.459815 14669 raft_consensus.cc:2804] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:51.460421 14669 raft_consensus.cc:697] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:51.462293 14682 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:51.462852 14682 raft_consensus.cc:697] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:51.387780 14686 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:51.461406 14669 consensus_queue.cc:237] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:51.398518 14501 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:51.467293 10948 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:51.460098 11025 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
W20260709 12:24:51.466578 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 291185us
I20260709 12:24:51.475693 11098 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:51.409014 13739 raft_consensus.cc:2749] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:24:51.469888 14655 log.cc:927] Time spent T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7: Append to log took a long time: real 0.377s	user 0.000s	sys 0.002s
I20260709 12:24:51.460420 14697 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:24:51.473500 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.434808 14462 raft_consensus.cc:697] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 9 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
W20260709 12:24:51.488495 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:51.465579 14464 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.002s	sys 0.032s
I20260709 12:24:51.477166 11645 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:51.474385 14187 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:51.481890 10949 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:51.394023 14211 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:51.487100 14521 raft_consensus.cc:2749] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:51.488657 11025 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
W20260709 12:24:51.493227 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 72350.9us
I20260709 12:24:51.588783 11097 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:51.486862 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 320761us
I20260709 12:24:51.496311 10949 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:51.496877 13739 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:51.502627 10948 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:51.487838 14611 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:51.505192 14474 raft_consensus.cc:2749] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:51.506920 11098 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:51.507583 14585 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:24:51.510746 14683 log.cc:927] Time spent T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.286s	user 0.000s	sys 0.002s
W20260709 12:24:51.505904 14688 log.cc:927] Time spent T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.368s	user 0.003s	sys 0.002s
I20260709 12:24:51.513939 11129 raft_consensus.cc:1275] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:24:51.514678 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:51.516428 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.516959 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1509) took 1669 ms. Trace:
I20260709 12:24:51.546777 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2143) took 1806 ms. Trace:
I20260709 12:24:51.503330 14660 consensus_queue.cc:1048] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:51.493248 14501 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:51.590684 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 94448.6us
W20260709 12:24:51.601372 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 94532.5us
I20260709 12:24:51.463841 14682 consensus_queue.cc:237] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:51.604821 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 127735us
W20260709 12:24:51.608414 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.604925 11023 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
W20260709 12:24:51.613162 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 125108us
I20260709 12:24:51.607503 10980 rpcz_store.cc:276] 0709 12:24:49.828653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.097323 (+268670us) service_pool.cc:224] Handling call
0709 12:24:51.497551 (+1400228us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54000da054. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:51.497682 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2859029248}
I20260709 12:24:51.613893 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:51.614626 11674 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:51.590346 14082 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:51.607710 11130 rpcz_store.cc:276] 0709 12:24:49.740210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.329881 (+589671us) service_pool.cc:224] Handling call
0709 12:24:50.371136 (+ 41255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.456258 (+ 85122us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:51.004152 (+547894us) log.cc:844] Serialized 14 byte log entry
0709 12:24:51.131042 (+126890us) log.cc:844] Serialized 14 byte log entry
0709 12:24:51.461032 (+329990us) spinlock_profiling.cc:243] Waited 4.82 ms on lock 0x7b18003561a0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88c71c0a 00007f8f923b1219 00007f8f88cf9a40 00007f8f88cf44e4 00007f8f88cf4455 00007f8f8bddc060 00007f8f8bdee716 00007f8f8bdff287 00007f8f8bdff208
0709 12:24:51.546336 (+ 85304us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:51.546408 (+    72us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:51.546467 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.546542 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.546699 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":460491,"prepare.queue_time_us":888077,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":445044,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":18670,"spinlock_wait_cycles":11096448,"thread_start_us":400153,"threads_started":3,"wal-append.queue_time_us":291580}
W20260709 12:24:51.602697 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 114132us
I20260709 12:24:51.616921 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:51.616266 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:51.617851 11025 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:51.618305 11674 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:51.597518 13739 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:51.613938 11643 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:51.618708 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.619073 11025 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:51.608804 14566 raft_consensus.cc:2804] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:51.605906 14672 raft_consensus.cc:2749] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:51.624711 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:51.621300 11679 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:51.625382 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:51.631402 11128 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 10.
I20260709 12:24:51.635567 11098 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:51.638558 14708 consensus_queue.cc:1059] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:51.640949 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:51.641168 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:51.641754 11130 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:51.642797 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:51.643824 11127 raft_consensus.cc:2410] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:51.643635 11023 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:51.644811 11132 raft_consensus.cc:1240] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:51.651494 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:51.652040 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:51.652316 11128 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
I20260709 12:24:51.655022 11134 raft_consensus.cc:1240] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:24:51.657155 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:51.658000 11130 raft_consensus.cc:2368] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 9. Current term is 10.
I20260709 12:24:51.621734 13739 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:51.622867 14464 raft_consensus.cc:2804] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:51.608202 14449 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:24:51.621217 14619 raft_consensus.cc:2749] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:51.621420 14521 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:51.515717 14697 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:51.660789 11129 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
W20260709 12:24:51.677598 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 56689.7us
W20260709 12:24:51.680976 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 61984.6us
I20260709 12:24:51.652953 14669 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:51.654117 14501 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:24:51.698181 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 87605.6us
I20260709 12:24:51.699190 11025 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:51.700984 11025 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:51.701174 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.701900 14520 raft_consensus.cc:2804] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:51.702749 10975 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:51.682809 11132 raft_consensus.cc:1240] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:51.704615 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.705858 11051 raft_consensus.cc:1275] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:51.706816 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.681818 14672 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:51.709985 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.680007 14464 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:51.711735 11025 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:51.712375 10975 raft_consensus.cc:2410] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 11 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:24:51.712853 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:51.713516 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.713740 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.714370 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.714851 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:51.715185 10983 raft_consensus.cc:2410] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:24:51.714932 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:51.715875 10981 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:51.714478 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:51.714056 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.717996 10978 raft_consensus.cc:2410] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 12:24:51.718660 10984 raft_consensus.cc:2393] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 9: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:51.713584 10976 raft_consensus.cc:2368] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12.
W20260709 12:24:51.708648 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 95949.5us
I20260709 12:24:51.682034 14521 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:24:51.722554 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 88688.3us
I20260709 12:24:51.722846 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:51.699513 14501 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.723197 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.726922 10984 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:51.708113 14685 raft_consensus.cc:2749] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:51.728005 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.725804 10983 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:51.724769 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.629877 14462 consensus_queue.cc:237] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:51.731173 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.731838 10977 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:24:51.732805 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.733301 10977 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:51.733989 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.712011 14672 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.736934 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.730557 11023 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:51.763055 10980 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:24:51.715871 14082 raft_consensus.cc:697] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:51.737949 14696 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:51.774921 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.738416 14700 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.127s
I20260709 12:24:51.727428 14521 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:51.739657 14695 raft_consensus.cc:2749] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:51.738224 14356 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:51.729187 14501 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:51.743317 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.750505 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.786796 10976 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:51.751137 14703 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:51.758592 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:24:51.759146 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 49187.1us
I20260709 12:24:51.788897 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:51.715624 14464 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:51.765702 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.770445 10983 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:24:51.723407 14708 raft_consensus.cc:3055] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:51.706773 14474 consensus_queue.cc:1048] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
W20260709 12:24:51.739126 14694 log.cc:927] Time spent T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:24:51.775669 10980 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:51.774998 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.772294 14672 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:51.775420 14696 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:24:51.782652 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 57769.7us
I20260709 12:24:51.730193 14669 raft_consensus.cc:2749] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:51.724148 14698 raft_consensus.cc:2764] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:24:51.784029 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:51.809005 11060 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:51.784062 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:51.783100 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 115552us
I20260709 12:24:51.786475 10979 raft_consensus.cc:2393] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 10: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
W20260709 12:24:51.787782 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 67609.9us
I20260709 12:24:51.779225 10981 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
I20260709 12:24:51.813067 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.813920 10981 raft_consensus.cc:2410] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:24:51.771204 14566 raft_consensus.cc:697] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:51.800516 10984 raft_consensus.cc:2393] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 10: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
W20260709 12:24:51.781991 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 279412us
I20260709 12:24:51.786391 14356 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:51.777524 14700 consensus_queue.cc:1243] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer bc01179655564f29b83babe396377cbb log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:24:51.804472 11025 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:51.815068 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.817546 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.791396 14703 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:51.799691 14211 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:51.801658 14520 raft_consensus.cc:697] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:51.798364 14708 raft_consensus.cc:740] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:51.820109 10981 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:51.824872 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:51.830499 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.831553 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.832028 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.832401 10984 raft_consensus.cc:2410] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:24:51.832962 10976 raft_consensus.cc:2393] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 8: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:51.833909 10976 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:51.834601 14708 consensus_queue.cc:260] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:51.835914 14708 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:51.837245 14691 log.cc:927] Time spent T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 12:24:51.826452 11126 raft_consensus.cc:1275] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:51.828850 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.826963 11097 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:51.831553 10948 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:51.873086 10979 raft_consensus.cc:2368] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 6. Current term is 7.
I20260709 12:24:51.876070 11132 raft_consensus.cc:1275] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:24:51.809577 14696 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:51.878865 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 51979us
I20260709 12:24:51.881669 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:51.800132 14709 consensus_queue.cc:1059] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
W20260709 12:24:51.884969 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 45206.7us
W20260709 12:24:51.888881 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 125432us
I20260709 12:24:51.889869 11023 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:51.890067 14520 consensus_queue.cc:237] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:51.898799 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 67328.2us
I20260709 12:24:51.828599 14703 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:51.815438 14449 consensus_queue.cc:1048] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 12:24:51.839461 14715 raft_consensus.cc:2804] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:51.907146 11097 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:51.912271 11097 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:51.897871 14691 log.cc:927] Time spent T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:24:51.877790 14716 raft_consensus.cc:2804] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:51.926061 11674 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:24:51.906731 14474 raft_consensus.cc:2764] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:24:51.907001 14715 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:51.969012 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 57654.9us
I20260709 12:24:51.905038 14211 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:24:51.970484 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.922436 14462 raft_consensus.cc:2749] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:51.830129 14082 consensus_queue.cc:237] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:51.974959 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 85322.4us
I20260709 12:24:51.983377 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 448) took 1367 ms. Trace:
I20260709 12:24:51.983840 10982 rpcz_store.cc:276] 0709 12:24:50.616063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.801691 (+185628us) service_pool.cc:224] Handling call
0709 12:24:50.915141 (+113450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:51.021268 (+106127us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:24:51.045045 (+ 23777us) log.cc:844] Serialized 14 byte log entry
0709 12:24:51.355968 (+310923us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:51.366606 (+ 10638us) log.cc:844] Serialized 26 byte log entry
0709 12:24:51.366761 (+   155us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:51.366975 (+   214us) log.cc:844] Serialized 14 byte log entry
0709 12:24:51.367136 (+   161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.367214 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:51.983158 (+615944us) raft_consensus.cc:1685] finished
0709 12:24:51.983179 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.983312 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26200,"prepare.run_wall_time_us":40,"raft.queue_time_us":82134,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":20634,"spinlock_wait_cycles":15236992,"thread_start_us":216524,"threads_started":1,"wal-append.queue_time_us":378621}
I20260709 12:24:51.986256 10976 raft_consensus.cc:1275] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:24:51.986804 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 74641us
I20260709 12:24:51.987430 11097 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:51.919775 14707 consensus_queue.cc:1048] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.203s
I20260709 12:24:51.975064 14211 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:51.974321 14697 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:51.974275 14715 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:51.920765 14566 consensus_queue.cc:237] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:52.012694 14735 consensus_queue.cc:1048] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:51.985729 14585 raft_consensus.cc:2749] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:52.013294 14697 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:24:52.014192 14705 log.cc:927] Time spent T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
W20260709 12:24:52.040717 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 54890.7us
I20260709 12:24:52.007813 14211 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:52.042788 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 55410.2us
W20260709 12:24:52.024222 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.980402 14717 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.205s
I20260709 12:24:51.983806 14700 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:24:52.060519 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:52.062124 10982 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:52.014986 14474 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:52.064090 14717 raft_consensus.cc:2749] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:52.066459 11097 leader_election.cc:400] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Vote denied by peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777) with higher term. Message: Invalid argument: T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12.
I20260709 12:24:52.073314 11097 leader_election.cc:403] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:24:52.066787 10948 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:52.073575 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 459710us
I20260709 12:24:52.069007 14728 consensus_queue.cc:1059] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
W20260709 12:24:52.069900 14730 log.cc:927] Time spent T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 12:24:52.070264 14725 log.cc:927] Time spent T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
W20260709 12:24:52.070933 14719 log.cc:927] Time spent T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:24:52.043627 14697 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:52.086170 14697 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:52.089120 14501 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:52.091132 11056 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1770) took 1920 ms. Trace:
I20260709 12:24:52.091532 11056 rpcz_store.cc:276] 0709 12:24:50.170609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.170752 (+   143us) service_pool.cc:224] Handling call
0709 12:24:51.138419 (+967667us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:51.139918 (+  1499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:52.090921 (+951003us) spinlock_profiling.cc:243] Waited 953 ms on lock 0x7b54002df850. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:52.091064 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2191987584}
I20260709 12:24:52.094264 14733 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.094908 14733 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:52.096545 14698 raft_consensus.cc:3055] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:52.094324 14585 raft_consensus.cc:2749] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777) with higher term. Message: Invalid argument: T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12.
W20260709 12:24:52.097361 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:52.094265 14723 log.cc:927] Time spent T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 12:24:52.097790 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:52.098219 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:52.059461 14704 log.cc:927] Time spent T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 12:24:52.098320 14712 consensus_queue.cc:1048] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:24:52.074590 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 439082us
I20260709 12:24:52.069736 14737 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.083241 10977 raft_consensus.cc:2955] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 2 to 6, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:24:52.102449 11053 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:24:52.101626 11098 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:52.106457 10949 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:52.109853 10949 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:52.083598 14449 consensus_queue.cc:1048] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:24:52.111768 14732 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.112315 14732 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:52.115695 10948 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:52.120384 11060 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:24:52.097029 14698 raft_consensus.cc:740] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:52.080724 14709 raft_consensus.cc:2749] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:52.123229 11645 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:52.131057 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:52.131567 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 88033.7us
I20260709 12:24:52.144367 11097 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:52.131762 11098 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:52.097111 14733 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:52.118809 14717 raft_consensus.cc:2804] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:52.117401 14697 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:52.125164 14669 raft_consensus.cc:3055] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:52.153558 11643 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:52.161644 10948 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:52.159718 14697 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:52.143389 14462 raft_consensus.cc:2749] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:52.167400 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:52.168109 10984 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:24:52.147471 14712 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:52.152406 14717 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.157694 14709 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:52.111647 14737 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:52.175096 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:52.165015 14648 consensus_meta.cc:287] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.969s	user 0.012s	sys 0.006s
W20260709 12:24:52.174212 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 262231us
I20260709 12:24:52.177688 10984 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:52.163144 14669 raft_consensus.cc:740] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:52.181056 14669 consensus_queue.cc:260] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:52.167936 14697 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:52.185719 14566 raft_consensus.cc:2749] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:52.189633 14492 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:52.186806 11097 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:52.188076 10979 raft_consensus.cc:1240] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:52.176754 14717 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:52.177871 14709 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.178642 14707 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:52.162530 14356 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:52.164588 14396 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:24:52.221485 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:52.191687 14731 log.cc:927] Time spent T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:24:52.226958 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 83212us
I20260709 12:24:52.230569 14211 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:52.231050 11643 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:52.232251 14707 raft_consensus.cc:2804] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:52.232647 14707 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:52.232990 14707 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:52.234592 11127 raft_consensus.cc:1240] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:52.224021 14462 raft_consensus.cc:2749] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:52.229682 10979 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:52.195891 14709 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:52.180950 14718 consensus_queue.cc:1059] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.110s
I20260709 12:24:52.185227 14648 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:52.207234 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 75554.9us
W20260709 12:24:52.248306 14739 log.cc:927] Time spent T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:24:52.248960 14718 raft_consensus.cc:3055] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:24:52.250736 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 64008us
I20260709 12:24:52.263413 11097 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:52.252377 14211 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:52.254758 14740 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:52.266652 14566 raft_consensus.cc:2749] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:24:52.238723 14686 consensus_meta.cc:287] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.757s	user 0.012s	sys 0.000s
I20260709 12:24:52.236850 14585 raft_consensus.cc:2749] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:52.264806 14718 raft_consensus.cc:740] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:52.269109 14718 consensus_queue.cc:260] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:52.195324 14734 consensus_queue.cc:1048] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 12:24:52.270501 14718 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:52.270211 14709 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:52.271291 14737 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:52.271880 10978 raft_consensus.cc:1240] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:24:52.272428 14709 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:52.275484 14686 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:52.195766 14698 consensus_queue.cc:260] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:52.283329 14689 log.cc:927] Time spent T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.834s	user 0.002s	sys 0.000s
I20260709 12:24:52.243109 14501 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:52.257917 14356 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:52.269977 14521 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:52.288877 14715 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:52.290735 11097 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:52.290817 11051 raft_consensus.cc:2393] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 10: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:52.304080 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:52.358142 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.300346 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:52.314440 10984 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:24:52.359365 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:24:52.287487 13739 consensus_meta.cc:287] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.580s	user 0.009s	sys 0.000s
W20260709 12:24:52.358561 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 67911.6us
I20260709 12:24:52.361490 13739 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:52.288671 11023 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:52.360038 10980 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
W20260709 12:24:52.362689 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 74142.8us
I20260709 12:24:52.363700 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:52.364384 10980 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:24:52.310087 11130 raft_consensus.cc:1275] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:52.361845 11097 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:52.309268 11055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 518) took 1544 ms. Trace:
W20260709 12:24:52.368736 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 142401us
I20260709 12:24:52.369634 10975 raft_consensus.cc:2393] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 10: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
W20260709 12:24:52.314302 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 152710us
I20260709 12:24:52.360711 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:52.375468 10984 raft_consensus.cc:2393] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 11: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:52.374478 11098 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:52.374406 11097 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:52.299273 14733 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.379343 11023 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:52.266923 14740 raft_consensus.cc:697] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:52.299533 14736 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.388913 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:52.383960 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:52.304831 14698 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:52.306022 14686 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:52.304122 14703 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:52.310242 14672 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:52.296667 14697 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:52.374126 14681 raft_consensus.cc:2804] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:52.372186 11055 rpcz_store.cc:276] 0709 12:24:50.765356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.918317 (+152961us) service_pool.cc:224] Handling call
0709 12:24:50.919145 (+   828us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:51.060904 (+141759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:51.061017 (+   113us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:51.068438 (+  7421us) log.cc:844] Serialized 26 byte log entry
0709 12:24:51.190572 (+122134us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:51.190612 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.190681 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:52.282716 (+1092035us) spinlock_profiling.cc:243] Waited 6.24 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:52.308942 (+ 26226us) raft_consensus.cc:1685] finished
0709 12:24:52.308964 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:52.309204 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33644,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":93,"spinlock_wait_cycles":14348160,"thread_start_us":245854,"threads_started":2,"wal-append.queue_time_us":327527}
I20260709 12:24:52.433306 10980 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:52.426242 10948 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:52.475193 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 365387us
W20260709 12:24:52.443550 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 64332.4us
I20260709 12:24:52.471570 10984 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:24:52.474206 13739 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:52.476291 10980 pending_rounds.cc:85] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 4
I20260709 12:24:52.476840 10980 pending_rounds.cc:107] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.5
I20260709 12:24:52.290490 14648 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:52.476415 11023 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:52.435166 14747 log.cc:927] Time spent T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:24:52.369091 14611 raft_consensus.cc:2804] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:52.443131 14673 log.cc:927] Time spent T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 1.243s	user 0.000s	sys 0.003s
I20260709 12:24:52.479848 10949 leader_election.cc:400] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 9. Current term is 10.
I20260709 12:24:52.438207 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:52.369254 14356 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:52.489593 11023 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:52.472661 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 93331.7us
I20260709 12:24:52.490685 10980 raft_consensus.cc:2917] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Aborting config change with OpId 6.5: Aborted: Op aborted by new leader
I20260709 12:24:52.387071 14346 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:52.448042 10978 raft_consensus.cc:1275] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:24:52.505518 10984 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:24:52.439219 14585 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:52.445063 14520 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:52.440240 14715 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:52.453248 14521 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:52.590780 10980 raft_consensus.cc:2889] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:52.600206 10949 leader_election.cc:403] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:24:52.526160 11053 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 12. Current term is 13. Ops: []
W20260709 12:24:52.569655 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 176521us
W20260709 12:24:52.515645 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.284924 14464 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:52.478801 14681 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:52.295778 14696 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:52.428067 14342 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:52.577793 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 203387us
W20260709 12:24:52.572782 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 198448us
W20260709 12:24:52.605361 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 374375us
I20260709 12:24:52.617996 11097 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:52.618824 11643 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
W20260709 12:24:52.576866 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 87328us
I20260709 12:24:52.431187 14501 consensus_queue.cc:1048] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.139s
I20260709 12:24:52.435439 14728 consensus_queue.cc:1048] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.134s
I20260709 12:24:52.311995 14717 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:52.392819 14733 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:52.649076 11023 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:52.496443 14708 raft_consensus.cc:2749] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:52.603223 14585 raft_consensus.cc:697] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 9 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:52.571570 14346 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:52.653334 11055 raft_consensus.cc:1240] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:52.498983 14686 raft_consensus.cc:2804] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:52.499001 14611 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:52.478423 14402 consensus_queue.cc:1048] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.135s
W20260709 12:24:52.615813 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 138260us
I20260709 12:24:52.654728 11058 raft_consensus.cc:1240] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:52.478535 14736 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:52.600162 14520 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:52.673343 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:52.604737 14211 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:52.684146 10948 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:52.600792 14356 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:52.611554 14681 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:52.710325 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:52.618753 14390 consensus_queue.cc:1059] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 12:24:52.714682 11054 raft_consensus.cc:1240] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:52.715728 10949 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:52.655133 14346 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:52.672211 14611 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:52.651973 14449 raft_consensus.cc:2749] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:52.623298 14619 raft_consensus.cc:2749] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 9. Current term is 10.
I20260709 12:24:52.731760 10983 raft_consensus.cc:2410] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:24:52.732559 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:52.732867 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 114121us
I20260709 12:24:52.736404 11643 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:52.698395 14520 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:52.700501 14211 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:52.748085 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 64048us
I20260709 12:24:52.744601 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:52.744230 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 126202us
I20260709 12:24:52.700992 14686 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.751118 11097 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:52.757781 14701 raft_consensus.cc:2749] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:52.668470 14709 consensus_queue.cc:1059] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 12:24:52.760970 11098 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:52.785801 10948 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:52.730024 14342 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:52.786015 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:52.752614 14211 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:52.727245 14708 consensus_queue.cc:1059] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
W20260709 12:24:52.840217 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:52.787184 14724 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.012s	sys 0.006s
I20260709 12:24:52.838531 14751 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:52.842072 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:52.866997 11643 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:52.858500 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:52.869963 11127 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:52.871182 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:52.871773 11127 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:52.851807 11023 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:52.788869 14619 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.789397 14342 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:52.863339 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.879310 14329 consensus_queue.cc:1048] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:52.880187 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:52.880888 11134 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:52.879590 14356 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:52.883306 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:52.884577 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:52.885192 11126 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:52.885593 14767 raft_consensus.cc:2749] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:52.873260 14697 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:52.886395 14767 raft_consensus.cc:2749] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:52.886722 14697 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:52.890763 14464 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:52.891163 11058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 526) took 1049 ms. Trace:
I20260709 12:24:52.891562 11058 rpcz_store.cc:276] 0709 12:24:51.841779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.841940 (+   161us) service_pool.cc:224] Handling call
0709 12:24:51.842309 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:52.712387 (+870078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:52.890896 (+178509us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b5400301bd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:52.891095 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1867900800}
W20260709 12:24:52.893070 14707 consensus_meta.cc:287] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.660s	user 0.008s	sys 0.003s
I20260709 12:24:52.893412 11127 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:52.893543 14707 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:52.894248 14342 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:52.894989 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:52.895534 14733 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:52.896027 14736 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:52.897709 14717 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:52.899147 14672 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:52.840416 14760 raft_consensus.cc:2804] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:52.900216 14760 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:24:52.900326 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 140464us
I20260709 12:24:52.716513 14740 consensus_queue.cc:237] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:52.902235 10948 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:52.906646 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:52.885972 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:52.908670 11126 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:52.909256 10948 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:52.907006 10980 raft_consensus.cc:3055] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:52.911127 10980 raft_consensus.cc:740] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:52.752565 14686 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:52.759862 14743 consensus_queue.cc:1059] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.111s
W20260709 12:24:52.912547 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 161505us
I20260709 12:24:52.926359 11097 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:52.868322 14724 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.046s	user 0.012s	sys 0.007s
I20260709 12:24:52.918226 10948 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:52.928812 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:52.851008 14711 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:52.884640 14741 log.cc:927] Time spent T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.636s	user 0.001s	sys 0.001s
I20260709 12:24:52.932842 10948 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:52.933058 11127 raft_consensus.cc:2393] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 10: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:52.851274 14744 raft_consensus.cc:2804] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:52.900655 14760 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:52.944327 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 183435us
I20260709 12:24:52.944589 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:52.933974 10980 consensus_queue.cc:260] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:52.951961 11679 raft_consensus.cc:1240] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:52.953438 11126 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:24:52.914076 14619 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:52.979048 14752 raft_consensus.cc:2804] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:52.929616 14449 raft_consensus.cc:2804] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:53.015319 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:24:53.005728 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 79422.8us
I20260709 12:24:53.019230 11097 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:24:52.913151 14700 consensus_queue.cc:1048] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 12:24:53.023675 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:53.024839 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:52.912966 14715 raft_consensus.cc:2804] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:52.941397 14703 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:53.052634 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:53.042425 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:52.880110 14585 consensus_queue.cc:237] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:52.944079 14390 consensus_queue.cc:1048] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 12:24:53.013854 14752 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:53.010543 14774 raft_consensus.cc:2804] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:53.048677 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 135397us
I20260709 12:24:52.955355 14711 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:53.060329 11677 raft_consensus.cc:1240] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:53.023401 14753 raft_consensus.cc:2749] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:53.067477 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 137407us
I20260709 12:24:53.067935 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:53.068560 11678 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:53.068456 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:53.070956 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:53.071259 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:53.071790 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:53.031250 14449 raft_consensus.cc:697] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:53.075624 11097 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:53.072414 11673 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:53.073721 11025 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:53.077045 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:53.077761 11128 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:53.080711 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:53.028215 14492 consensus_queue.cc:1059] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
W20260709 12:24:53.082756 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 150085us
I20260709 12:24:53.067610 14464 raft_consensus.cc:3055] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:53.060046 14767 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:53.106334 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.102437 11678 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:53.056697 14696 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:53.081732 14757 log.cc:927] Time spent T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.358s	user 0.001s	sys 0.000s
I20260709 12:24:53.103978 11680 raft_consensus.cc:1275] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:24:53.182726 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 115651us
I20260709 12:24:53.097406 14708 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:53.165663 11128 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 10.
I20260709 12:24:53.215512 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:53.216879 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:53.217754 11128 raft_consensus.cc:2393] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 9: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:53.168530 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:24:53.149117 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 64304.3us
I20260709 12:24:53.060665 14752 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:53.222081 10949 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:53.222504 11098 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:53.060832 14774 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:53.223824 14771 raft_consensus.cc:2804] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:53.224112 14774 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:53.224512 14771 raft_consensus.cc:697] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 8 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:53.161819 11134 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:53.103829 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:53.103324 14464 raft_consensus.cc:740] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:53.197590 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:53.225462 14771 consensus_queue.cc:237] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:53.198697 14728 raft_consensus.cc:2804] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:53.229089 11128 raft_consensus.cc:1275] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
W20260709 12:24:53.228690 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 149199us
I20260709 12:24:53.235713 11128 raft_consensus.cc:1240] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:53.199002 11024 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:24:53.204119 14773 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:53.204564 14754 log.cc:927] Time spent T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.434s	user 0.000s	sys 0.001s
I20260709 12:24:54.514922 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2272) took 2228 ms. Trace:
I20260709 12:24:53.204862 14766 raft_consensus.cc:2804] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:54.515385 10978 rpcz_store.cc:276] 0709 12:24:52.286334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.608858 (+322524us) service_pool.cc:224] Handling call
0709 12:24:52.609202 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:52.609392 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:54.470542 (+1861150us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b18003af2a0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f8b98c4bc 00007f8f88cda48b 00007f8f91b349a9 00007f8f88cf669b 00007f8f88cf493f 00007f8f88cf4455 00007f8f8f7dc3c7 00007f8f8bdee9a7 00007f8f8bdfe0bf
0709 12:24:54.470746 (+   204us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.513368 (+ 42622us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:54.513427 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:54.513473 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.514683 (+  1210us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.514852 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10704,"prepare.queue_time_us":122698,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":4183,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":121,"spinlock_wait_cycles":6063872,"thread_start_us":134865,"threads_started":3,"wal-append.queue_time_us":39810}
I20260709 12:24:54.516697 14766 raft_consensus.cc:697] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:54.517882 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:54.518333 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 563) took 2258 ms. Trace:
I20260709 12:24:53.205320 14711 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:53.226943 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:53.227130 11132 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:53.197990 11677 raft_consensus.cc:1240] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 9. Current term is 10. Ops: []
W20260709 12:24:53.207597 10948 connection.cc:256] RPC call timeout handler was delayed by -1.9378173730001436s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
W20260709 12:24:54.522856 10948 connection.cc:256] RPC call timeout handler was delayed by -1.928817373000129s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
I20260709 12:24:53.203148 11097 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:53.255151 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:54.523207 10948 connection.cc:256] RPC call timeout handler was delayed by -1.9054173730000912s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
W20260709 12:24:54.523517 10948 connection.cc:256] RPC call timeout handler was delayed by -1.8982173730000795s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
W20260709 12:24:54.523829 10948 connection.cc:256] RPC call timeout handler was delayed by -1.869417373000033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
I20260709 12:24:54.524353 14771 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:54.524533 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 1.32134e+06us
I20260709 12:24:54.525374 11097 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:53.255198 11134 raft_consensus.cc:1240] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:24:54.519635 11672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41784 (request call id 637) took 1316 ms. Trace:
I20260709 12:24:54.526932 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1863) took 1470 ms. Trace:
I20260709 12:24:53.205082 14716 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:53.233726 14707 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:53.295392 14708 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:53.293502 14781 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.527702 14716 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:54.526309 11132 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 10.
I20260709 12:24:54.528262 14781 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:54.528697 11097 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:54.529141 11125 raft_consensus.cc:1240] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:53.291196 14672 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:24:53.325515 14779 log.cc:927] Time spent T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
W20260709 12:24:54.530175 11132 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1866) took 1457 ms (client timeout 1545 ms). Trace:
I20260709 12:24:53.341768 14758 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:24:53.345016 14211 consensus_meta.cc:287] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.506s	user 0.005s	sys 0.002s
W20260709 12:24:54.530593 11132 rpcz_store.cc:269] 0709 12:24:53.073010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.078692 (+  5682us) service_pool.cc:224] Handling call
0709 12:24:54.530077 (+1451385us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:54.531112 14211 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:54.532454 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2183) took 1295 ms. Trace:
I20260709 12:24:53.233057 14449 consensus_queue.cc:237] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:54.533310 10948 connection.cc:256] RPC call timeout handler was delayed by -1.869417373000033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
W20260709 12:24:54.533682 10948 connection.cc:256] RPC call timeout handler was delayed by -1.8073173729999326s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
W20260709 12:24:54.533955 10948 connection.cc:256] RPC call timeout handler was delayed by -1.5958173730000453s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19340000000000002s for a response
W20260709 12:24:53.352236 14520 consensus_meta.cc:287] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.568s	user 0.010s	sys 0.000s
I20260709 12:24:54.534484 14520 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:53.348188 11673 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
W20260709 12:24:53.555076 14698 consensus_meta.cc:287] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 1.082s	user 0.006s	sys 0.004s
I20260709 12:24:53.308770 14464 consensus_queue.cc:260] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:53.556416 14686 consensus_meta.cc:287] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.616s	user 0.001s	sys 0.010s
W20260709 12:24:53.578467 14681 consensus_meta.cc:287] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.832s	user 0.009s	sys 0.001s
I20260709 12:24:54.536957 14713 raft_consensus.cc:3055] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:53.563421 14775 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.538203 14464 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:54.538561 14775 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:54.540879 14775 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:53.573891 14728 raft_consensus.cc:697] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:54.542220 14728 consensus_queue.cc:237] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:53.589346 14611 consensus_meta.cc:287] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.840s	user 0.009s	sys 0.002s
I20260709 12:24:54.546919 10976 raft_consensus.cc:1275] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:24:53.568207 14715 raft_consensus.cc:697] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:53.621395 14650 consensus_queue.cc:1048] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.053s
W20260709 12:24:53.630729 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.636121 14780 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:53.601804 14740 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.551683 14520 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:54.552027 14780 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:53.574445 14744 raft_consensus.cc:697] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:24:53.641764 14346 consensus_meta.cc:287] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.915s	user 0.009s	sys 0.002s
W20260709 12:24:53.860293 14799 log.cc:927] Time spent T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
W20260709 12:24:53.861274 14752 consensus_meta.cc:287] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.640s	user 0.011s	sys 0.000s
W20260709 12:24:53.867627 14760 consensus_meta.cc:287] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.846s	user 0.004s	sys 0.007s
W20260709 12:24:53.869863 14774 consensus_meta.cc:287] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.645s	user 0.007s	sys 0.002s
I20260709 12:24:54.555182 14735 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:53.874562 14342 consensus_meta.cc:287] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.946s	user 0.010s	sys 0.001s
I20260709 12:24:54.555310 14346 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:54.536451 14672 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:54.555678 14774 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:54.556082 14342 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:54.557489 14346 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:54.557618 14672 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:54.304303 14695 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.002s	sys 0.008s
W20260709 12:24:54.308743 11129 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.960s	user 0.047s	sys 0.054s
W20260709 12:24:54.309201 11098 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.006s	sys 0.029s
W20260709 12:24:54.387738 14585 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.004s	sys 0.011s
W20260709 12:24:54.471711 11099 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.907s	user 0.018s	sys 0.049s
I20260709 12:24:54.513666 14751 raft_consensus.cc:2749] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:54.520210 11677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41784 (request call id 635) took 1337 ms. Trace:
I20260709 12:24:54.518746 11133 rpcz_store.cc:276] 0709 12:24:52.259557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.259734 (+   177us) service_pool.cc:224] Handling call
0709 12:24:52.273392 (+ 13658us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:52.273782 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:52.273814 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:52.274368 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 12:24:52.486639 (+212271us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:24:52.728687 (+242048us) log.cc:844] Serialized 14 byte log entry
0709 12:24:52.914575 (+185888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:52.914657 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:54.518044 (+1603387us) raft_consensus.cc:1685] finished
0709 12:24:54.518069 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.518248 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":364667,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":121484,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":35221,"thread_start_us":622143,"threads_started":3,"wal-append.queue_time_us":373365}
I20260709 12:24:54.519414 14685 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:54.526777 11672 rpcz_store.cc:276] 0709 12:24:53.214461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.226693 (+ 12232us) service_pool.cc:224] Handling call
0709 12:24:54.519567 (+1292874us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:54.517817 14766 consensus_queue.cc:237] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:54.527479 11134 rpcz_store.cc:276] 0709 12:24:53.056221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.231244 (+175023us) service_pool.cc:224] Handling call
0709 12:24:53.254893 (+ 23649us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:54.526640 (+1271747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.526872 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:54.523684 11675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41784 (request call id 638) took 1304 ms. Trace:
W20260709 12:24:53.229285 14759 log.cc:927] Time spent T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.361s	user 0.000s	sys 0.001s
W20260709 12:24:53.319520 14777 log.cc:927] Time spent T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 12:24:53.326292 14619 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:54.538125 14681 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:54.558312 11131 raft_consensus.cc:1240] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:54.558260 11127 raft_consensus.cc:1240] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:54.532827 11125 rpcz_store.cc:276] 0709 12:24:53.237138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.565259 (+328121us) service_pool.cc:224] Handling call
0709 12:24:54.528961 (+963702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:54.529550 (+   589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.532262 (+  2712us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b5400031e50. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:54.532395 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2184158976}
W20260709 12:24:54.535640 11673 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41774 (request call id 574) took 1481 ms (client timeout 1780 ms). Trace:
I20260709 12:24:54.534499 14781 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:53.387104 14402 consensus_queue.cc:1059] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.188s
I20260709 12:24:54.584779 14402 raft_consensus.cc:3055] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:24:54.579612 14695 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.960s	user 0.007s	sys 0.009s
I20260709 12:24:54.550969 14715 consensus_queue.cc:237] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:54.585448 14681 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:54.532994 14211 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:54.580427 11129 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.232s	user 0.048s	sys 0.055s
I20260709 12:24:54.586136 14752 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:54.581249 11673 rpcz_store.cc:269] 0709 12:24:53.054144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.054334 (+   190us) service_pool.cc:224] Handling call
0709 12:24:54.535534 (+1481200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:54.587262 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2172) took 1730 ms. Trace:
I20260709 12:24:54.587424 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2182) took 1350 ms. Trace:
I20260709 12:24:54.545912 14686 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:54.581164 11675 rpcz_store.cc:276] 0709 12:24:53.219614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.219744 (+   130us) service_pool.cc:224] Handling call
0709 12:24:54.523619 (+1303875us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:54.536610 14758 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:54.558017 14342 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:54.547778 14775 raft_consensus.cc:2749] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:54.594866 11098 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.029s	user 0.006s	sys 0.032s
I20260709 12:24:54.537400 14713 raft_consensus.cc:740] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:54.558517 14740 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:54.597072 11099 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.032s	user 0.022s	sys 0.049s
I20260709 12:24:54.576709 14780 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:54.559124 14744 consensus_queue.cc:237] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:54.598527 14740 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:54.587673 11127 rpcz_store.cc:276] 0709 12:24:52.856847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.947811 (+ 90964us) service_pool.cc:224] Handling call
0709 12:24:52.948124 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:54.580885 (+1632761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.587016 (+  6131us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b5400210a54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:54.587200 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3702470528}
I20260709 12:24:54.587838 11129 rpcz_store.cc:276] 0709 12:24:53.236837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.345152 (+108315us) service_pool.cc:224] Handling call
0709 12:24:53.345505 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:53.345874 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:53.345901 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:53.346410 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 12:24:54.586672 (+1240262us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:54.586715 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.586811 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:54.586854 (+    43us) raft_consensus.cc:1685] finished
0709 12:24:54.586865 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.587367 (+   502us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":96,"thread_start_us":1238052,"threads_started":1,"wal-append.queue_time_us":529832}
I20260709 12:24:54.602352 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2174) took 1745 ms. Trace:
I20260709 12:24:54.602537 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:54.600684 14758 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:54.580799 11677 rpcz_store.cc:276] 0709 12:24:53.182735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.197458 (+ 14723us) service_pool.cc:224] Handling call
0709 12:24:53.197817 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:54.519973 (+1322156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.520157 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:54.603673 11133 raft_consensus.cc:1275] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:24:54.579818 14585 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.975s	user 0.007s	sys 0.015s
I20260709 12:24:54.604578 11134 raft_consensus.cc:1275] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:24:54.555635 14760 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:54.606635 11127 raft_consensus.cc:1240] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:54.607182 11126 rpcz_store.cc:276] 0709 12:24:52.857325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.014600 (+157275us) service_pool.cc:224] Handling call
0709 12:24:53.014903 (+   303us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:53.060463 (+ 45560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:53.060492 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:53.071181 (+ 10689us) log.cc:844] Serialized 52 byte log entry
0709 12:24:53.586508 (+515327us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:53.586555 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.586638 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:54.602120 (+1015482us) raft_consensus.cc:1685] finished
0709 12:24:54.602140 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.602294 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45145,"raft.queue_time_us":45735,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":10237,"thread_start_us":437120,"threads_started":1,"wal-append.queue_time_us":554725}
I20260709 12:24:54.557895 14774 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:54.547176 14708 raft_consensus.cc:697] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 10 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:54.553936 14611 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:54.623764 14697 raft_consensus.cc:3055] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:54.624219 14697 raft_consensus.cc:740] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:54.625030 14697 consensus_queue.cc:260] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:54.623785 14686 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:54.626833 14732 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:54.627705 14329 raft_consensus.cc:3055] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:54.628132 14329 raft_consensus.cc:740] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:54.628991 14329 consensus_queue.cc:260] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:54.588377 14735 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:54.632498 14735 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:54.585197 14402 raft_consensus.cc:740] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:54.633579 14402 consensus_queue.cc:260] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:54.635331 11680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 731) took 1696 ms. Trace:
I20260709 12:24:54.636240 14760 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:54.636936 11674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 730) took 1698 ms. Trace:
I20260709 12:24:54.637225 14329 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:54.637305 11674 rpcz_store.cc:276] 0709 12:24:52.938151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.938545 (+   394us) service_pool.cc:224] Handling call
0709 12:24:52.938899 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:53.013600 (+ 74701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:53.013629 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:53.013670 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:53.013706 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.636723 (+1623017us) spinlock_profiling.cc:243] Waited 74.5 ms on lock 0x7b5400447854. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:54.636766 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.636884 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171318656}
I20260709 12:24:54.642283 14697 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:54.644852 14446 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:54.645473 14446 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:54.646323 14707 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:54.648747 14707 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:54.650087 14446 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:54.650928 14707 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:54.651140 14708 consensus_queue.cc:237] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:54.635743 11680 rpcz_store.cc:276] 0709 12:24:52.939101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.942602 (+  3501us) service_pool.cc:224] Handling call
0709 12:24:53.005283 (+ 62681us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:53.200792 (+195509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.635083 (+1434291us) spinlock_profiling.cc:243] Waited 79.5 ms on lock 0x7b54000a4bd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:54.635255 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182866816}
I20260709 12:24:54.647452 14660 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:54.652740 14660 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:54.653187 14721 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.653825 14721 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:54.654721 14752 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:54.654891 14660 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:54.597062 14713 consensus_queue.cc:260] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:54.649802 14669 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:54.656045 14752 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.615998 14813 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:54.647341 11679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41774 (request call id 572) took 1595 ms (client timeout 1740 ms). Trace:
W20260709 12:24:54.657974 11679 rpcz_store.cc:269] 0709 12:24:53.051729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.052428 (+   699us) service_pool.cc:224] Handling call
0709 12:24:54.647134 (+1594706us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54005fffd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:54.647281 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3552618880}
I20260709 12:24:54.656018 14721 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:54.655467 14396 consensus_queue.cc:1059] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:54.661021 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:54.626235 14611 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:54.615772 14771 raft_consensus.cc:2749] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:54.656737 14752 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:54.679307 14446 raft_consensus.cc:3055] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:24:54.534262 10948 connection.cc:256] RPC call timeout handler was delayed by -1.437417373000244s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.211s for a response
W20260709 12:24:54.518822 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 1.31978e+06us
W20260709 12:24:53.678689 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:54.723598 11024 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:54.547307 10976 pending_rounds.cc:85] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 5
I20260709 12:24:54.725564 10976 pending_rounds.cc:107] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:24:54.726238 10976 raft_consensus.cc:2889] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:54.518697 10978 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 481) took 1453 ms (client timeout 1609 ms). Trace:
W20260709 12:24:54.728662 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 199890us
W20260709 12:24:54.728371 10978 rpcz_store.cc:269] 0709 12:24:53.065253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.517592 (+1452339us) service_pool.cc:224] Handling call
0709 12:24:54.518643 (+  1051us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:54.723521 10948 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:54.733145 11097 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:54.735737 10948 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:54.736027 11097 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:54.744758 11125 raft_consensus.cc:1240] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:24:54.746719 11129 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:54.751865 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 88844.2us
I20260709 12:24:54.747306 11133 raft_consensus.cc:1240] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:54.753739 14709 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.755643 14713 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:54.758507 11024 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:54.758793 14501 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.759651 14501 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:54.762528 14695 raft_consensus.cc:2749] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:24:54.754817 14709 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:54.754804 14446 raft_consensus.cc:740] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:54.769091 14709 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:54.768649 14446 consensus_queue.cc:260] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:54.768802 14716 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:54.733201 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:54.788069 10978 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
W20260709 12:24:54.789007 10978 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 477) took 1730 ms (client timeout 1901 ms). Trace:
I20260709 12:24:54.775679 14752 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:54.773350 14751 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:54.769994 14709 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:54.765753 14695 consensus_queue.cc:1059] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
W20260709 12:24:54.792505 14816 log.cc:927] Time spent T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:24:54.792665 14819 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.790691 14751 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:54.794015 14819 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:54.794960 10978 rpcz_store.cc:269] 0709 12:24:53.058467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.732489 (+1674022us) service_pool.cc:224] Handling call
0709 12:24:54.788896 (+ 56407us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:54.795763 14784 consensus_queue.cc:1048] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:54.792670 14695 raft_consensus.cc:3055] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:54.797454 14695 raft_consensus.cc:740] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:24:54.799358 10949 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.576s	user 0.013s	sys 0.031s
I20260709 12:24:54.799022 14695 consensus_queue.cc:260] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:54.801007 14695 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:54.774035 14767 raft_consensus.cc:2749] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:54.799949 10949 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.577s	user 0.014s	sys 0.031s
I20260709 12:24:54.810382 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2284) took 1953 ms. Trace:
I20260709 12:24:54.814576 10978 rpcz_store.cc:276] 0709 12:24:52.850862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.795936 (+1945074us) service_pool.cc:224] Handling call
0709 12:24:54.796565 (+   629us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:54.796990 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:54.797014 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:54.797096 (+    82us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:54.797128 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.803816 (+  6688us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.803987 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:54.771569 14342 raft_consensus.cc:2749] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:54.772199 14716 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:54.758015 14464 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:54.817102 11643 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.609s (SENT) [suppressed 60 similar messages]
W20260709 12:24:54.820730 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 1.59859e+06us
I20260709 12:24:54.827263 11127 raft_consensus.cc:1240] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:54.829826 14751 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:54.831094 14819 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:54.831768 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:54.831926 11097 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:54.834331 11097 leader_election.cc:400] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Vote denied by peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777) with higher term. Message: Invalid argument: T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 6. Current term is 7.
I20260709 12:24:54.834594 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:54.835879 11127 raft_consensus.cc:2410] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:24:54.842399 14819 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:54.842980 14446 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:54.847018 14567 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.847820 14567 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:54.849653 10975 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1521) took 3136 ms (client timeout 1670 ms). Trace:
W20260709 12:24:54.851083 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 109370us
I20260709 12:24:54.834718 11097 leader_election.cc:403] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:54.853101 10979 raft_consensus.cc:1240] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 9. Current term is 10. Ops: []
W20260709 12:24:54.854288 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:54.820274 11129 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
W20260709 12:24:54.863518 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 49014.7us
W20260709 12:24:54.854996 10975 rpcz_store.cc:269] 0709 12:24:51.713038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.713248 (+   210us) service_pool.cc:224] Handling call
0709 12:24:54.845976 (+3132728us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b540009a454. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:54.849382 (+  3406us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1503196032}
W20260709 12:24:54.871733 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:54.878357 14501 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:54.879271 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:54.879632 14822 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:54.880538 14822 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:54.885406 14650 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.886446 14650 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:54.887641 14819 raft_consensus.cc:2749] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777) with higher term. Message: Invalid argument: T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 6. Current term is 7.
I20260709 12:24:54.888581 10948 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:54.890122 10948 leader_election.cc:400] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 11. Current term is 12.
I20260709 12:24:54.890668 10948 leader_election.cc:403] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:54.891764 14501 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:54.892308 14501 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:54.886861 14751 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:24:54.887823 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 53822.9us
I20260709 12:24:54.894901 14501 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:54.900295 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:54.901552 10948 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:54.909437 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:54.912885 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:54.914219 14697 raft_consensus.cc:2749] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 11. Current term is 12.
W20260709 12:24:54.917117 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:54.918686 14708 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:54.919754 14708 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:54.920130 14464 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:54.920933 14464 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:54.921200 14815 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:54.922281 14695 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:54.922114 14815 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:54.923082 14695 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:54.923942 14784 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:54.924780 14784 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:54.925523 14695 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:54.913926 11133 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:54.927431 14784 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:54.918758 14342 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.928561 14342 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:54.923434 14464 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:54.931372 14751 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:54.937960 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:54.949687 11052 raft_consensus.cc:1240] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:54.950361 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:54.950826 14342 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:54.951362 11060 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1778) took 2264 ms (client timeout 1630 ms). Trace:
W20260709 12:24:54.951783 11060 rpcz_store.cc:269] 0709 12:24:52.687429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.713854 (+ 26425us) service_pool.cc:224] Handling call
0709 12:24:54.945907 (+2232053us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b58001a5e98. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90daa0a0 00007f8f90da9984 00007f8f8a3246d4 00007f8f8a324662
0709 12:24:54.951209 (+  5302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4879744}
I20260709 12:24:54.953594 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:54.955797 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 558) took 3124 ms. Trace:
I20260709 12:24:54.956348 11130 rpcz_store.cc:276] 0709 12:24:51.831736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.833312 (+  1576us) service_pool.cc:224] Handling call
0709 12:24:51.833612 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:52.373137 (+539525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.955139 (+2582002us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b5400030a54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:54.955547 (+   408us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1094917376}
I20260709 12:24:54.957356 11060 raft_consensus.cc:2410] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 12:24:54.957998 11060 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1790) took 1330 ms (client timeout 1515 ms). Trace:
W20260709 12:24:54.958421 11060 rpcz_store.cc:269] 0709 12:24:53.627679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.953077 (+1325398us) service_pool.cc:224] Handling call
0709 12:24:54.957911 (+  4834us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:54.959635 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:24:54.960572 11060 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1791) took 1332 ms (client timeout 1545 ms). Trace:
I20260709 12:24:54.961719 14695 consensus_queue.cc:1059] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:54.962262 14669 consensus_queue.cc:1059] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:54.963750 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:54.964550 11126 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:54.966264 14751 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:54.967518 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:54.967262 11679 raft_consensus.cc:1240] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:54.960963 11060 rpcz_store.cc:269] 0709 12:24:53.627988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.959185 (+1331197us) service_pool.cc:224] Handling call
0709 12:24:54.960468 (+  1283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:54.970538 11097 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:54.930459 14708 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:54.924782 14815 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:54.974967 14743 raft_consensus.cc:3055] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:54.978680 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:54.986255 14743 raft_consensus.cc:740] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:54.987545 14742 consensus_queue.cc:1059] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:54.987531 14743 consensus_queue.cc:260] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:54.979429 14342 raft_consensus.cc:2749] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:54.980337 14780 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:54.980860 14402 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:54.989184 14797 raft_consensus.cc:3055] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:54.989766 14797 raft_consensus.cc:740] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:54.991076 14797 consensus_queue.cc:260] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:54.983176 14520 consensus_queue.cc:1048] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:54.984933 14716 consensus_queue.cc:1059] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:54.995502 14716 raft_consensus.cc:3055] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:54.995994 14716 raft_consensus.cc:740] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:54.982892 14686 consensus_queue.cc:1048] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:55.003284 14819 raft_consensus.cc:2749] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:55.003435 14813 raft_consensus.cc:2804] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:55.004069 11126 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:24:55.005549 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:54.973011 14751 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.009790 14716 consensus_queue.cc:260] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:55.010658 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.012617 14501 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:24:54.989108 14743 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:55.018333 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.015219 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:55.020457 14709 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.021296 14709 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:55.021914 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:55.022817 11677 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:24:55.004575 14780 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:55.024893 14619 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:55.038606 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 146017us
W20260709 12:24:55.028537 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 121859us
I20260709 12:24:54.977905 14708 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:55.028883 14780 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:55.030412 14698 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.046547 14619 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:55.049937 14698 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:55.052145 14619 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:55.053864 11025 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:55.055799 14686 raft_consensus.cc:2804] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:55.056360 14686 raft_consensus.cc:697] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:55.029728 14773 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.030479 14709 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:55.030498 11023 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.952s	user 0.014s	sys 0.018s
I20260709 12:24:55.020502 14781 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.031196 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 478) took 1966 ms. Trace:
I20260709 12:24:55.033541 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:55.060222 11132 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
I20260709 12:24:55.059521 14781 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:55.028828 10984 raft_consensus.cc:1240] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:24:55.062981 14781 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:55.059376 10978 rpcz_store.cc:276] 0709 12:24:53.064465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.838690 (+1774225us) service_pool.cc:224] Handling call
0709 12:24:54.839261 (+   571us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:54.839844 (+   583us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:54.839882 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:54.840750 (+   868us) log.cc:844] Serialized 26 byte log entry
0709 12:24:54.898122 (+ 57372us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:54.898562 (+   440us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.900014 (+  1452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.902495 (+  2481us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:55.030925 (+128430us) raft_consensus.cc:1685] finished
0709 12:24:55.030958 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.031106 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5851,"raft.run_cpu_time_us":385,"raft.run_wall_time_us":2411,"thread_start_us":56773,"threads_started":1,"wal-append.queue_time_us":101290}
I20260709 12:24:55.063362 10948 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:55.063736 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2273) took 2777 ms. Trace:
I20260709 12:24:55.060452 14716 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:55.064088 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:55.036049 14501 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:55.064930 10978 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:55.006312 14342 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:55.070523 14342 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:55.073112 14342 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:55.074855 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:55.059752 11643 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:55.077134 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2277) took 2789 ms. Trace:
I20260709 12:24:55.070606 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:55.069777 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:55.059072 14773 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:55.052500 14698 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:55.079723 11024 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:55.106566 14685 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:55.107024 14685 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:55.107401 14685 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:55.108692 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2170) took 2252 ms. Trace:
I20260709 12:24:55.109179 11131 rpcz_store.cc:276] 0709 12:24:52.856303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.938908 (+ 82605us) service_pool.cc:224] Handling call
0709 12:24:53.005322 (+ 66414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:54.588376 (+1583054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.108169 (+519793us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b5400068954. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:55.108466 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3566496512}
I20260709 12:24:55.110534 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:55.111373 11131 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
I20260709 12:24:55.111728 11054 raft_consensus.cc:1240] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:55.111941 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:55.112351 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:55.112785 11128 raft_consensus.cc:2393] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 8: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:55.113665 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:55.034785 10983 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 2279) took 2670 ms (client timeout 2133 ms). Trace:
I20260709 12:24:55.035825 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:55.120042 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:55.124393 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:55.134071 11680 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:24:55.125514 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:55.128119 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:55.135834 11673 raft_consensus.cc:2393] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 9: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:55.095914 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:55.137446 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:55.138759 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:55.139376 11132 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:24:55.064128 10984 rpcz_store.cc:276] 0709 12:24:52.286670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.896088 (+609418us) service_pool.cc:224] Handling call
0709 12:24:52.896442 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:55.061844 (+2165402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.063393 (+  1549us) spinlock_profiling.cc:243] Waited 2.13 s on lock 0x7b5400099f54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:55.063651 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4903120128}
I20260709 12:24:55.077668 10976 rpcz_store.cc:276] 0709 12:24:52.287872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.902232 (+614360us) service_pool.cc:224] Handling call
0709 12:24:52.902515 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:54.727550 (+1825035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.076758 (+349208us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b540035eb54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:55.077057 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3779170048}
I20260709 12:24:55.098599 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:55.132579 11133 raft_consensus.cc:2410] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:24:55.048389 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:55.131075 11057 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 10.
I20260709 12:24:55.133603 11679 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:24:55.131224 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:55.141796 11024 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:55.146744 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:55.149305 11023 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.071s	user 0.015s	sys 0.018s
I20260709 12:24:55.083446 14815 raft_consensus.cc:1064] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
W20260709 12:24:55.133236 10983 rpcz_store.cc:269] 0709 12:24:52.364149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.437899 (+ 73750us) service_pool.cc:224] Handling call
0709 12:24:55.026313 (+2588414us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b5400229554. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:55.034582 (+  8269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":365073792}
I20260709 12:24:55.057468 14686 consensus_queue.cc:237] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:55.090369 14446 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:55.034842 14751 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:55.159484 11132 raft_consensus.cc:1240] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:55.161070 11126 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 10.
I20260709 12:24:55.160524 11131 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
W20260709 12:24:55.166131 11060 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1787) took 1531 ms (client timeout 1611 ms). Trace:
W20260709 12:24:55.166576 11060 rpcz_store.cc:269] 0709 12:24:53.626805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.972434 (+1345629us) service_pool.cc:224] Handling call
0709 12:24:55.158449 (+186015us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.162261 11128 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:24:55.082037 14773 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:55.091876 14698 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:55.164417 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:55.170377 11130 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 10.
W20260709 12:24:55.156127 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 2.0777e+06us
I20260709 12:24:55.094090 14708 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:55.200975 14708 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:55.080844 14520 consensus_queue.cc:1059] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 12:24:55.205955 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:55.192986 14751 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:55.193512 14783 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:55.196226 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:55.210599 10984 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
I20260709 12:24:55.211778 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:55.212565 10984 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
I20260709 12:24:55.213572 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:55.161988 14446 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:55.214322 14446 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:55.198557 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:55.217926 10983 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:24:55.219136 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:55.219813 10983 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:24:55.221282 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:55.222016 11673 raft_consensus.cc:2376] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9. Re-sending same reply.
I20260709 12:24:55.227690 10984 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:55.231268 10978 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:24:55.238233 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:55.205192 14815 consensus_queue.cc:237] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 5, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:55.244421 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:55.244980 11051 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41294 (request call id 1487) took 3487 ms (client timeout 3309 ms). Trace:
I20260709 12:24:55.251436 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:55.247123 11051 rpcz_store.cc:269] 0709 12:24:51.757223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.758037 (+   814us) service_pool.cc:224] Handling call
0709 12:24:55.239323 (+3481286us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54002dd054. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:55.244767 (+  5444us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1147667328}
I20260709 12:24:55.256237 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 480) took 2185 ms. Trace:
I20260709 12:24:55.259792 10983 rpcz_store.cc:276] 0709 12:24:53.065008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.220436 (+2155428us) service_pool.cc:224] Handling call
0709 12:24:55.227417 (+  6981us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.249755 (+ 22338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:55.249786 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:55.249835 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:55.249872 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.249934 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.250078 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:55.262663 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 64588.6us
I20260709 12:24:55.282866 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 479) took 2208 ms. Trace:
W20260709 12:24:55.308952 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:55.309566 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.312016 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:55.315791 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:55.308579 10978 raft_consensus.cc:1275] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:24:55.321116 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 482) took 2251 ms. Trace:
I20260709 12:24:55.321539 10978 rpcz_store.cc:276] 0709 12:24:53.065521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.244020 (+2178499us) service_pool.cc:224] Handling call
0709 12:24:55.263526 (+ 19506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.316625 (+ 53099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.316874 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.305938 10975 rpcz_store.cc:276] 0709 12:24:53.064763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.878645 (+1813882us) service_pool.cc:224] Handling call
0709 12:24:54.883328 (+  4683us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:54.889203 (+  5875us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:54.889335 (+   132us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:54.909079 (+ 19744us) log.cc:844] Serialized 52 byte log entry
0709 12:24:54.971770 (+ 62691us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:55.261346 (+289576us) log.cc:844] Serialized 14 byte log entry
0709 12:24:55.271260 (+  9914us) log.cc:844] Serialized 14 byte log entry
0709 12:24:55.272760 (+  1500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.272840 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:55.272881 (+    41us) raft_consensus.cc:1685] finished
0709 12:24:55.272894 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.273033 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1823,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":16871,"spinlock_wait_cycles":8499456,"thread_start_us":298467,"threads_started":2,"wal-append.queue_time_us":213873}
W20260709 12:24:55.326860 11060 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1792) took 1698 ms (client timeout 1872 ms). Trace:
W20260709 12:24:55.327328 11060 rpcz_store.cc:269] 0709 12:24:53.628287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.177176 (+1548889us) service_pool.cc:224] Handling call
0709 12:24:55.326790 (+149614us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:55.331348 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.335222 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:55.336031 10978 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:55.348835 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:55.351016 11051 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1785) took 1724 ms (client timeout 2010 ms). Trace:
W20260709 12:24:55.351480 11051 rpcz_store.cc:269] 0709 12:24:53.626255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.325231 (+1698976us) service_pool.cc:224] Handling call
0709 12:24:55.350903 (+ 25672us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.352632 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:55.353484 11051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1786) took 1727 ms. Trace:
I20260709 12:24:55.354396 10983 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:55.353821 11051 rpcz_store.cc:276] 0709 12:24:53.626524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.352207 (+1725683us) service_pool.cc:224] Handling call
0709 12:24:55.353426 (+  1219us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:55.379897 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.381153 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:55.384029 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:55.384999 11051 raft_consensus.cc:2393] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 11: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:55.385417 11051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1789) took 1758 ms. Trace:
I20260709 12:24:55.385740 11051 rpcz_store.cc:276] 0709 12:24:53.627355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.378316 (+1750961us) service_pool.cc:224] Handling call
0709 12:24:55.385355 (+  7039us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.387125 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:55.388254 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:55.394261 14835 log.cc:927] Time spent T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:24:55.396346 10984 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:24:55.405197 10978 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:55.406010 10983 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:55.387777 11051 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
W20260709 12:24:55.409638 11060 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1788) took 1773 ms (client timeout 2161 ms). Trace:
W20260709 12:24:55.410178 11060 rpcz_store.cc:269] 0709 12:24:53.627085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.346238 (+1719153us) service_pool.cc:224] Handling call
0709 12:24:55.400928 (+ 54690us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.411890 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:55.416846 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:55.418313 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 186095us
W20260709 12:24:55.419780 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.420310 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:55.419358 10984 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:55.433688 10983 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:55.436473 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.437011 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:55.438728 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:55.441920 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:55.446544 10984 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:24:55.454768 10983 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:24:55.456388 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:55.458000 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:55.458212 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:55.459033 10983 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:55.466533 10983 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:24:55.467135 10948 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:55.458781 11060 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:24:55.468886 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:55.470329 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:55.470621 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:55.472080 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:24:55.473501 11058 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41294 (request call id 1497) took 2394 ms (client timeout 2900 ms). Trace:
I20260709 12:24:55.470362 10978 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:55.474452 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:55.475334 11053 raft_consensus.cc:1240] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 9. Current term is 10. Ops: []
W20260709 12:24:55.466604 11057 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1773) took 2845 ms (client timeout 1554 ms). Trace:
W20260709 12:24:55.476040 11057 rpcz_store.cc:269] 0709 12:24:52.624786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.625111 (+   325us) service_pool.cc:224] Handling call
0709 12:24:55.069466 (+2444355us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b58001a5e98. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90daa0a0 00007f8f90da9984 00007f8f8a3246d4 00007f8f8a324662
0709 12:24:55.466368 (+396902us) spinlock_profiling.cc:243] Waited 51.2 ms on lock 0x7b54001888d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:55.466523 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170605696}
I20260709 12:24:55.481211 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:55.482354 11057 raft_consensus.cc:2410] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:24:55.483551 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:55.485046 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:55.488715  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:55.476753 11058 rpcz_store.cc:269] 0709 12:24:53.078925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.080467 (+  1542us) service_pool.cc:224] Handling call
0709 12:24:55.473142 (+2392675us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b54003138d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:55.473328 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4662042880}
W20260709 12:24:55.511590 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.506348 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:55.510555 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:55.495718 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.517412 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:55.518903 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:55.520565 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:55.531307 10984 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
W20260709 12:24:55.532467 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 65434.2us
I20260709 12:24:55.535943 10948 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:55.537832 10978 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:24:55.536032 10976 raft_consensus.cc:1240] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:55.543504 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2255) took 3463 ms. Trace:
I20260709 12:24:55.543988 10982 rpcz_store.cc:276] 0709 12:24:52.080001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.082159 (+  2158us) service_pool.cc:224] Handling call
0709 12:24:52.082505 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:52.146770 (+ 64265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:52.146796 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:52.146836 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:52.146866 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.543072 (+3396206us) spinlock_profiling.cc:243] Waited 64.1 ms on lock 0x7b54001a0754. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:55.543137 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.543328 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147363072}
I20260709 12:24:55.548839 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:55.552781 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:55.555311 14848 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.556030 14848 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:55.561738 11054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 537) took 2625 ms. Trace:
I20260709 12:24:55.562270 11054 rpcz_store.cc:276] 0709 12:24:52.936280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.936428 (+   148us) service_pool.cc:224] Handling call
0709 12:24:53.006866 (+ 70438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.146401 (+2139535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.561364 (+414963us) spinlock_profiling.cc:243] Waited 2.1 s on lock 0x7b54003007d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:55.561638 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4839676672}
I20260709 12:24:55.563941 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:55.564656 14619 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:55.565395 14342 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.565305 14619 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:55.565996 14342 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:55.562263 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:55.564818 11054 raft_consensus.cc:2393] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 13: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:55.562538 10978 raft_consensus.cc:1240] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:24:55.512771 14849 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.571902 10982 raft_consensus.cc:1240] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:55.572782 14850 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.573521 14619 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:55.573375 14850 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:55.573779 14342 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:55.577390 14342 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:55.578420 14619 raft_consensus.cc:2749] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:55.575148 11055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 530) took 3077 ms. Trace:
I20260709 12:24:55.579098 14849 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:55.579645 14619 raft_consensus.cc:2749] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:55.578157 14342 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:55.579198 11055 rpcz_store.cc:276] 0709 12:24:52.498070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.498290 (+   220us) service_pool.cc:224] Handling call
0709 12:24:52.569941 (+ 71651us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:52.653794 (+ 83853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.574699 (+2920905us) spinlock_profiling.cc:243] Waited 83.2 ms on lock 0x7b54003e0654. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:55.574962 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191331584}
I20260709 12:24:55.571530 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:55.581452 14619 consensus_queue.cc:1059] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:55.581642 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:55.579680 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:55.582602 10983 raft_consensus.cc:1275] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:24:55.588179 10983 pending_rounds.cc:85] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 5
I20260709 12:24:55.588536 10983 pending_rounds.cc:107] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:24:55.588846 10983 raft_consensus.cc:2889] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:55.591809 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 54658.2us
I20260709 12:24:55.591075 14342 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:55.593698 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:55.594484 14619 consensus_queue.cc:1243] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [LEADER]: Peer 7518bdeb78f24e67a530754ae48547eb log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:24:55.598300 14848 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:55.599699 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:55.600530 11055 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 10.
I20260709 12:24:55.601470 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:55.602885 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:55.604555 11055 raft_consensus.cc:1240] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:55.605227 11055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1784) took 1979 ms. Trace:
I20260709 12:24:55.605495 11056 raft_consensus.cc:1240] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:55.606362 14342 raft_consensus.cc:3055] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:55.606314 11056 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1793) took 1977 ms. Trace:
I20260709 12:24:55.606876 14342 raft_consensus.cc:740] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:55.605566 11055 rpcz_store.cc:276] 0709 12:24:53.625910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.603951 (+1978041us) service_pool.cc:224] Handling call
0709 12:24:55.604360 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.604966 (+   606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.605135 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.608686 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:55.607299 11056 rpcz_store.cc:276] 0709 12:24:53.628578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.604622 (+1976044us) service_pool.cc:224] Handling call
0709 12:24:55.605104 (+   482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.606016 (+   912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.606254 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.612743 11056 raft_consensus.cc:1240] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 10. Current term is 11. Ops: []
W20260709 12:24:55.614746 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 81310.5us
I20260709 12:24:55.622372 14342 consensus_queue.cc:260] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:55.683591 14819 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.684305 14819 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:55.699759 14342 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:55.720433 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.791574 11056 raft_consensus.cc:1240] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:55.811528 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 195145us
I20260709 12:24:55.818084 10983 raft_consensus.cc:1240] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:55.822384 11056 raft_consensus.cc:1240] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:24:55.822598 14849 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:55.825280 14822 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:55.821015 14329 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.827028 14329 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:55.829219 14329 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:55.830678 10948 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:55.832326 10948 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:55.833597 10948 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:55.833794 14492 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.834494 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:55.829732 14850 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:55.835361 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2281) took 3468 ms. Trace:
I20260709 12:24:55.833702 10983 raft_consensus.cc:1240] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:55.839747 14851 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:55.841508 11058 raft_consensus.cc:1240] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:55.842831 14850 raft_consensus.cc:2749] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:55.843664 14819 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:55.844313 14819 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.844933 14819 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:55.846155 14728 raft_consensus.cc:3055] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:55.846669 14728 raft_consensus.cc:740] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:55.846199 10949 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:55.847705 14728 consensus_queue.cc:260] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:55.849143 14728 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:55.850755 14849 raft_consensus.cc:2749] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:55.851177 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:55.846551 14853 consensus_queue.cc:1059] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:24:55.852620 14853 raft_consensus.cc:3055] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:55.852952 14853 raft_consensus.cc:740] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:55.839365 14492 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:55.855633 14492 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:55.853873 14853 consensus_queue.cc:260] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:55.858167 14853 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:55.858703 14766 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:55.859555 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.859192 14766 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:55.855449 11052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1494) took 2793 ms. Trace:
I20260709 12:24:55.862867 11052 rpcz_store.cc:276] 0709 12:24:53.062474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.062874 (+   400us) service_pool.cc:224] Handling call
0709 12:24:53.083570 (+ 20696us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:54.950374 (+1866804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.855185 (+904811us) spinlock_profiling.cc:243] Waited 1.85 s on lock 0x7b5400188dd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:55.855384 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4266462976}
I20260709 12:24:55.862193 14766 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:55.866233 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.866262 10983 raft_consensus.cc:1240] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:55.866833 14716 consensus_meta.cc:287] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.802s	user 0.015s	sys 0.000s
I20260709 12:24:55.835777 10979 rpcz_store.cc:276] 0709 12:24:52.366819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.940378 (+573559us) service_pool.cc:224] Handling call
0709 12:24:54.852569 (+1912191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:54.874234 (+ 21665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.835120 (+960886us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b540009a450. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:55.835293 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4304664320}
I20260709 12:24:55.876148 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:55.879688 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:55.880537 11672 raft_consensus.cc:2368] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8.
I20260709 12:24:55.880686 14751 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.883245 14751 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:55.887733 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:55.890633 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 2192) took 1289 ms. Trace:
I20260709 12:24:55.891139 11129 rpcz_store.cc:276] 0709 12:24:54.601501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.602288 (+   787us) service_pool.cc:224] Handling call
0709 12:24:55.890376 (+1288088us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b5400068454. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:55.890537 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327954816}
I20260709 12:24:55.872776 14819 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:55.894987 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:55.893492 14751 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:55.896106 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:55.897519 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:55.901837 10948 leader_election.cc:400] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8.
I20260709 12:24:55.902268 10948 leader_election.cc:403] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:55.903028 11057 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:55.905732 10982 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:24:55.906695 14751 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:24:55.907184 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:55.911525 11097 connection.cc:256] RPC call timeout handler was delayed by -3.8487749929995516s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.167s for a response
I20260709 12:24:55.915882 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:55.916821 10978 raft_consensus.cc:2393] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 9: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:55.923463 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:55.924230 10978 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:55.940423 14854 raft_consensus.cc:2749] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:55.940927 14698 consensus_meta.cc:287] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.720s	user 0.018s	sys 0.002s
I20260709 12:24:55.941442 14698 raft_consensus.cc:2749] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:55.951634 10983 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:24:55.952968 11097 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:55.957656 10980 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:55.973954 14797 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:55.975505 10980 raft_consensus.cc:1275] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 12:24:55.962278 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:55.960358 10978 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:55.985419 14819 raft_consensus.cc:2749] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:55.986258 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 57222.5us
I20260709 12:24:55.987797 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:55.987982 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:55.986693 10980 pending_rounds.cc:85] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 3
I20260709 12:24:55.988812 14751 raft_consensus.cc:2749] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 7. Current term is 8.
I20260709 12:24:55.989463 10980 pending_rounds.cc:107] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 8.4
W20260709 12:24:55.989769 14402 consensus_meta.cc:287] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 1.000s	user 0.018s	sys 0.000s
I20260709 12:24:55.989118 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:55.989205 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:56.010844 10977 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:56.011562 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:56.011750 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:56.012527 10977 raft_consensus.cc:2393] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 9: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:56.012704 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:56.013319 10978 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:24:55.989776 10980 raft_consensus.cc:2889] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:56.014746 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2280) took 3650 ms. Trace:
I20260709 12:24:56.015072 10980 rpcz_store.cc:276] 0709 12:24:52.364755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.906600 (+541845us) service_pool.cc:224] Handling call
0709 12:24:52.906881 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.956831 (+3049950us) spinlock_profiling.cc:243] Waited 2.31 s on lock 0x7b5800747ed0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bd400aa 00007f8f8bdc2447 00007f8f8bddafe7 00007f8f8bddc7de 00007f8f8bde6b49 00007f8f8bde7416 00007f8f8bde3d8f 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4
0709 12:24:56.014468 (+ 57637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:56.014675 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5316884224}
I20260709 12:24:56.016381 10980 raft_consensus.cc:1240] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:55.991954 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:55.997790 10982 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:56.001742 11125 raft_consensus.cc:1275] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:24:56.022523 11051 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:24:56.005730 10948 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:56.024942 10978 raft_consensus.cc:1240] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:24:56.004338 11023 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:56.006141 14715 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:56.026614 14715 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:56.026289 10980 raft_consensus.cc:1275] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:56.028959 14715 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:56.006989 14847 consensus_queue.cc:1048] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:56.008414 14813 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:56.030979 14813 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:56.027218 10978 raft_consensus.cc:1240] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:56.035954 11023 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:56.037768 14847 raft_consensus.cc:2749] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:56.038591 14847 raft_consensus.cc:2804] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:56.039054 14847 raft_consensus.cc:697] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:56.039958 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:56.013258 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:56.040759 11680 raft_consensus.cc:2393] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 9: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:56.041002 10977 raft_consensus.cc:2410] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:24:56.025847 10948 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:56.042793 14492 consensus_queue.cc:1048] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:56.043828 14566 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:24:56.022828 14718 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:24:56.044448 10948 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:56.045217 14854 raft_consensus.cc:2749] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:56.023366 11097 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:56.006639 14743 consensus_queue.cc:1059] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:56.046412 14743 raft_consensus.cc:3055] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:56.009060 11055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 539) took 1136 ms. Trace:
I20260709 12:24:56.037211 11023 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
W20260709 12:24:56.049971 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.046854 14743 raft_consensus.cc:740] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:56.044384 14567 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:56.052590 11129 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:24:56.052743 10948 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:56.026203 14709 raft_consensus.cc:2749] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:56.055796 14743 consensus_queue.cc:260] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:56.056650 14751 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:56.057155 14743 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:56.044466 14566 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:56.062476 14566 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:56.056710 14709 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:56.066524 14709 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.066927 14709 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:56.069317 10948 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:56.070850 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:56.074642 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.076140 10948 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:56.075445 14854 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:56.077174 14815 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:56.077732 14815 raft_consensus.cc:697] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:56.078668 14815 consensus_queue.cc:237] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:56.075356 14566 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:56.047487 11055 rpcz_store.cc:276] 0709 12:24:54.873073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.616721 (+743648us) service_pool.cc:224] Handling call
0709 12:24:55.813861 (+197140us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.818876 (+  5015us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:24:55.916107 (+ 97231us) log.cc:844] Serialized 14 byte log entry
0709 12:24:56.008716 (+ 92609us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:56.008769 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:56.008813 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:56.008875 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.008981 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23610,"prepare.queue_time_us":119453,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":23744,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"thread_start_us":117923,"threads_started":2,"wal-append.queue_time_us":48565}
I20260709 12:24:56.082159 14744 consensus_queue.cc:1059] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.757s
I20260709 12:24:56.040015 14847 consensus_queue.cc:237] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:56.083552 14744 raft_consensus.cc:3055] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:56.083936 14744 raft_consensus.cc:740] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:24:56.084357 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:56.084931 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.084791 14744 consensus_queue.cc:260] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:56.086071 14744 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:56.087010 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:56.090068 11055 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
W20260709 12:24:56.089180 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 52046.2us
I20260709 12:24:56.091512 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:56.091535 11023 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:56.097035 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:56.097958 11057 raft_consensus.cc:2410] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:24:56.098735 14751 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:56.099545 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:56.099874 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:56.100405 11057 raft_consensus.cc:2393] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 10: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:56.100494 11060 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 10.
I20260709 12:24:56.102327 11058 raft_consensus.cc:1275] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:56.102638 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:56.102322 10949 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:56.104344 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:56.104537 10949 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:56.105129 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:56.107769 14619 raft_consensus.cc:2804] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:56.106017 11059 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:24:56.105597 14751 raft_consensus.cc:2804] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:56.107527 14709 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:56.108383 11058 raft_consensus.cc:2410] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:24:56.107400 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:56.107790 10949 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:56.106156 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:56.111775 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:56.112713 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:56.113634 11052 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 10.
I20260709 12:24:56.111449 14751 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.116101 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:56.116333 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:56.116778 11023 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:56.120643 10949 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:56.109302 14619 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.148057 10949 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:56.152046 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 128808us
I20260709 12:24:56.152786 11055 raft_consensus.cc:1275] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:24:56.152870 11097 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:56.155053 11025 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:56.157272 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:56.120268 14751 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:56.117444 14708 raft_consensus.cc:2749] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:56.159137 11025 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:56.121678 14797 raft_consensus.cc:2749] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:56.163976 11056 raft_consensus.cc:1275] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:24:56.153367 14619 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:56.165468 11056 pending_rounds.cc:85] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting all ops after (but not including) 5
I20260709 12:24:56.111238 14813 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:56.167450 11056 pending_rounds.cc:107] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:24:56.169605 11056 raft_consensus.cc:2889] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:56.167718 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 51043.8us
I20260709 12:24:56.166929 11129 raft_consensus.cc:1275] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:24:56.170507 11023 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
W20260709 12:24:56.171922 14862 log.cc:927] Time spent T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:24:56.168684 11052 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:24:56.173058 14356 raft_consensus.cc:2804] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:56.174010 14356 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.174170 11098 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:56.156083 14854 raft_consensus.cc:2749] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:56.174463 14356 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:56.160733 14715 raft_consensus.cc:2804] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:56.162350 14342 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:56.163321 14669 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:56.181385 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:56.182353 10949 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:56.182699 11023 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:24:56.166978 14402 raft_consensus.cc:2804] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:56.209478 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:56.207271 11097 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:24:56.218116 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 44159.9us
W20260709 12:24:56.222977 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 54622us
I20260709 12:24:56.206486 14742 raft_consensus.cc:2804] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:56.225026 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:56.210440 14669 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:56.206463 14342 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:56.244263 14342 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:56.224071 11025 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:56.252836 14342 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:56.255868 14342 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:56.229053 14566 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:56.237251 14356 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:56.217777 14402 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:56.259846 11060 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:56.220933 14329 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.270365 14356 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:56.271126 14356 raft_consensus.cc:2804] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:56.271723 14356 raft_consensus.cc:697] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 8 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
W20260709 12:24:56.271804 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 51431.4us
I20260709 12:24:56.261575 14715 raft_consensus.cc:697] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:56.274302 14716 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:56.274070 14715 consensus_queue.cc:237] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:56.274887 11644 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:56.275039 14822 consensus_queue.cc:1048] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:24:56.263999 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 81395.6us
I20260709 12:24:56.265237 14815 raft_consensus.cc:2749] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:24:56.258342 14709 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:56.244170 14669 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:56.267356 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 43701.7us
I20260709 12:24:56.269093 14402 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:56.269891 14813 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:56.274086 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:56.277477 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.277765 10948 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:56.277889 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:56.282500 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:56.304589 11052 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:56.304490 11023 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:56.286293 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:56.295047 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:56.297019 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:56.297780 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:56.302426 11097 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:56.309697 11129 raft_consensus.cc:1275] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:24:56.292685 14446 consensus_meta.cc:287] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 1.078s	user 0.016s	sys 0.000s
I20260709 12:24:56.263103 14742 raft_consensus.cc:697] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:56.311487 11127 raft_consensus.cc:2393] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 11: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:56.274883 14716 raft_consensus.cc:697] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:56.316423 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:56.270629 14329 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:56.322633 11129 raft_consensus.cc:2393] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 9: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:24:56.334889 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.308435 14766 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:56.302007 14784 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
W20260709 12:24:56.340057 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 67229.6us
I20260709 12:24:56.344475 14329 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:56.315152 14356 consensus_queue.cc:237] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:56.346640 14742 consensus_queue.cc:237] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:56.351249 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:56.352411 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:56.352154 11129 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
W20260709 12:24:56.353950 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 79115.5us
W20260709 12:24:56.355304 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.359266 11097 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:56.355046 14566 raft_consensus.cc:2749] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:56.361876 14566 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:56.362335 14566 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.362676 14566 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:56.366878 11679 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.139s	user 0.007s	sys 0.039s
I20260709 12:24:56.353130 14766 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:56.367862 14329 raft_consensus.cc:2804] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:56.355748 14783 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.368352 14329 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:56.368806 14329 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:56.369786 13739 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:56.367352 11679 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.140s	user 0.008s	sys 0.039s
I20260709 12:24:56.341185 14813 consensus_queue.cc:1059] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:24:56.377290 14813 raft_consensus.cc:3055] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:56.377679 14813 raft_consensus.cc:740] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:56.378466 14492 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:56.379107 14492 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:56.380482 11051 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52804 (request call id 542) took 1476 ms (client timeout 1900 ms). Trace:
W20260709 12:24:56.380911 11051 rpcz_store.cc:269] 0709 12:24:54.903988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.422629 (+518641us) service_pool.cc:224] Handling call
0709 12:24:56.380309 (+957680us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54000b6dd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:56.380422 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1315934592}
I20260709 12:24:56.382464 11059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52804 (request call id 545) took 1456 ms. Trace:
W20260709 12:24:56.383070 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 44228.8us
I20260709 12:24:56.349906 14797 consensus_queue.cc:1048] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:24:56.384495 14492 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:56.386757 14830 log.cc:927] Time spent T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.806s	user 0.001s	sys 0.005s
I20260709 12:24:56.386468 14815 consensus_queue.cc:1048] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:56.386317 14783 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:56.351191 14847 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:24:56.390064 14855 log.cc:927] Time spent T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.446s	user 0.000s	sys 0.002s
I20260709 12:24:56.390568 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:56.391299 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2210) took 1249 ms. Trace:
I20260709 12:24:56.390818 14813 consensus_queue.cc:260] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:56.382896 11059 rpcz_store.cc:276] 0709 12:24:54.926057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.471804 (+545747us) service_pool.cc:224] Handling call
0709 12:24:56.382276 (+910472us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b54002cd654. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:56.382399 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1414140288}
I20260709 12:24:56.317417 14446 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:56.392010 13739 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:56.392180 11097 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:24:56.405611 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:56.366662 14716 consensus_queue.cc:237] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:56.399334 14744 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.414176 14744 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:56.416245 14744 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:56.417093 11126 raft_consensus.cc:2410] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 10 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:24:56.419610 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:56.403474 11133 rpcz_store.cc:276] 0709 12:24:55.142243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.178019 (+ 35776us) service_pool.cc:224] Handling call
0709 12:24:55.241094 (+ 63075us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:56.256321 (+1015227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:56.256356 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:56.256947 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 12:24:56.307057 (+ 50110us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:56.307097 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:56.307194 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:56.391038 (+ 83844us) raft_consensus.cc:1685] finished
0709 12:24:56.391056 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.391212 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24920,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":20271,"thread_start_us":49689,"threads_started":1,"wal-append.queue_time_us":94091}
I20260709 12:24:56.422933 14619 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:56.412804 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:56.425335 14619 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:56.435606 11052 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
W20260709 12:24:56.429878 11081 debug-util.cc:398] Leaking SignalData structure 0x7b08002369e0 after lost signal to thread 9802
I20260709 12:24:56.437788 11130 raft_consensus.cc:1240] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:56.408596 14822 consensus_queue.cc:1059] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 12:24:56.438453 11081 debug-util.cc:398] Leaking SignalData structure 0x7b080030c2c0 after lost signal to thread 10916
I20260709 12:24:56.444372 10978 raft_consensus.cc:1240] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:56.403082 14847 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
W20260709 12:24:56.445740 11081 debug-util.cc:398] Leaking SignalData structure 0x7b080026b100 after lost signal to thread 11009
W20260709 12:24:56.448838 11081 debug-util.cc:398] Leaking SignalData structure 0x7b080016d980 after lost signal to thread 11084
I20260709 12:24:56.453682 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:56.454285 10978 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:24:56.455111 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:56.455574 10978 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:24:56.434442 14819 raft_consensus.cc:2749] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:56.460104 10980 raft_consensus.cc:1275] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:56.465799 10979 raft_consensus.cc:1275] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:56.467235 14743 consensus_queue.cc:1048] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:56.468156 11098 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
W20260709 12:24:56.458653 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 45933.2us
I20260709 12:24:56.442327 14464 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.505177 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2291) took 1132 ms. Trace:
I20260709 12:24:56.507905 14356 consensus_queue.cc:1059] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:56.510012 14356 raft_consensus.cc:2804] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:56.510612 14356 raft_consensus.cc:697] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 8 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:56.511571 14356 consensus_queue.cc:237] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:56.469856 14446 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:56.452356 14847 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:56.473102 14685 consensus_meta.cc:287] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 1.365s	user 0.015s	sys 0.004s
I20260709 12:24:56.446534 14329 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:56.505641 10976 rpcz_store.cc:276] 0709 12:24:55.343815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.566068 (+222253us) service_pool.cc:224] Handling call
0709 12:24:55.566446 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:55.617719 (+ 51273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:55.617748 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:55.818629 (+200881us) log.cc:844] Serialized 26 byte log entry
0709 12:24:55.915881 (+ 97252us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:55.915914 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.915980 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:56.389349 (+473369us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:56.457574 (+ 68225us) raft_consensus.cc:1685] finished
0709 12:24:56.457593 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.475882 (+ 18289us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39513,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":124,"spinlock_wait_cycles":254046592,"thread_start_us":136616,"threads_started":2,"wal-append.queue_time_us":113847}
W20260709 12:24:56.527809 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 59762.9us
I20260709 12:24:56.504083 14813 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:56.540860 11679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 752) took 1379 ms. Trace:
I20260709 12:24:56.543803 11098 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:56.541383 11679 rpcz_store.cc:276] 0709 12:24:55.151975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.152135 (+   160us) service_pool.cc:224] Handling call
0709 12:24:55.167585 (+ 15450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.167809 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:24:56.371320 (+1203511us) log.cc:844] Serialized 14 byte log entry
0709 12:24:56.531430 (+160110us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:56.531484 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:56.531528 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:56.531592 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.531722 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44521,"prepare.queue_time_us":64976,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":45657,"thread_start_us":1259080,"threads_started":2}
I20260709 12:24:56.523128 14819 raft_consensus.cc:3055] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:56.474617 14566 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:56.470032 14743 consensus_queue.cc:1059] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 12:24:56.471837 14751 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:56.575495 14751 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:56.562984 11132 raft_consensus.cc:1275] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:56.526345 14783 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:56.578610 14783 raft_consensus.cc:3055] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:56.579067 14783 raft_consensus.cc:740] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:56.580292 14783 consensus_queue.cc:260] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:56.583649 14402 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:56.521003 14464 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:56.588544 14464 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:56.566030 14872 raft_consensus.cc:2749] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:56.554791 14766 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:56.566577 14838 log.cc:927] Time spent T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 1.137s	user 0.007s	sys 0.000s
I20260709 12:24:56.567905 11098 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:56.573226 14566 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:56.578738 14767 consensus_queue.cc:1048] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:56.565259 14871 consensus_queue.cc:1059] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
W20260709 12:24:56.595492 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 127238us
I20260709 12:24:56.601639 11023 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:56.605278 11023 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:56.609400 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:56.563512 14819 raft_consensus.cc:740] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:56.544922 14685 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:56.615782 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:56.603711 14766 raft_consensus.cc:2749] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:56.622431 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:56.627064 11054 raft_consensus.cc:2393] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 11: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:56.627806 14329 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:56.626462 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:56.631685 11132 raft_consensus.cc:2393] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 9: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:56.615947 14715 raft_consensus.cc:2804] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:56.641932 10979 raft_consensus.cc:1275] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:56.642283 14715 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.642736 14715 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:56.643376 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:56.644606 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:56.644897 14815 consensus_queue.cc:1048] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:56.621587 14822 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:56.646418 14822 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.646836 14822 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:56.650359 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:56.650864 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.651264 10979 raft_consensus.cc:1240] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:24:56.628713 14402 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:56.637507 14716 consensus_queue.cc:1048] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:56.653477 14716 consensus_queue.cc:1243] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer bc01179655564f29b83babe396377cbb log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:24:56.619256 14742 consensus_queue.cc:1048] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:24:56.639140 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:56.656930 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:56.658041 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:56.641186 10976 raft_consensus.cc:1275] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:24:56.659672 10976 raft_consensus.cc:1240] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:56.659828 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:56.632956 14669 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:56.651574 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.641378 14847 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:56.661435 13739 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:56.661908 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 126008us
W20260709 12:24:56.662611 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 62235.9us
I20260709 12:24:56.662429 14446 consensus_queue.cc:1059] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:56.660447 11125 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:56.663938 11132 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
W20260709 12:24:56.665729 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 305211us
I20260709 12:24:56.608934 14872 consensus_queue.cc:1048] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:24:56.669454 14716 consensus_queue.cc:1059] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:24:56.671900 14650 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:56.669312 14402 consensus_queue.cc:1059] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.003s
W20260709 12:24:56.672984 11128 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.464s	user 0.014s	sys 0.051s
W20260709 12:24:56.673355 11128 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.464s	user 0.014s	sys 0.051s
W20260709 12:24:56.666833 14858 log.cc:927] Time spent T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.754s	user 0.005s	sys 0.000s
I20260709 12:24:56.678908 14883 consensus_queue.cc:1048] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
W20260709 12:24:56.679993 14859 log.cc:927] Time spent T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.692s	user 0.004s	sys 0.000s
I20260709 12:24:56.672132 14716 raft_consensus.cc:3055] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:56.673278 14402 raft_consensus.cc:3055] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:56.691365 11098 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:56.695143 11081 debug-util.cc:398] Leaking SignalData structure 0x7b0800349d00 after lost signal to thread 11159
I20260709 12:24:56.677091 11097 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:56.696596 11081 debug-util.cc:398] Leaking SignalData structure 0x7b0800321ac0 after lost signal to thread 11160
I20260709 12:24:56.663277 14742 consensus_queue.cc:1048] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:24:56.711488 11097 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:56.713449 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:56.696197 14402 raft_consensus.cc:740] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:56.715101 14402 consensus_queue.cc:260] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:56.716477 14402 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:56.719632 11098 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:24:56.721407 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:56.722615 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:56.723687 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:56.724104 14566 raft_consensus.cc:2749] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:56.726701 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:56.724447 11129 raft_consensus.cc:2410] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:24:56.692776 14716 raft_consensus.cc:740] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:56.728034 11130 raft_consensus.cc:2376] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bc01179655564f29b83babe396377cbb in term 10. Re-sending same reply.
I20260709 12:24:56.730113 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:56.733194 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:56.734719 14669 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:56.736361 14841 log.cc:927] Time spent T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 1.294s	user 0.005s	sys 0.000s
I20260709 12:24:56.736641 14716 consensus_queue.cc:260] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:56.738008 14716 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:56.738466 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2209) took 1605 ms. Trace:
I20260709 12:24:56.738888 11128 rpcz_store.cc:276] 0709 12:24:55.132688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.169737 (+ 37049us) service_pool.cc:224] Handling call
0709 12:24:55.207534 (+ 37797us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:55.208046 (+   512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:55.208084 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:55.208734 (+   650us) log.cc:844] Serialized 52 byte log entry
0709 12:24:56.673850 (+1465116us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:56.698290 (+ 24440us) log.cc:844] Serialized 14 byte log entry
0709 12:24:56.698520 (+   230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:56.698605 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:56.735654 (+ 37049us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:56.738165 (+  2511us) raft_consensus.cc:1685] finished
0709 12:24:56.738263 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.738403 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16411,"prepare.queue_time_us":54211,"raft.queue_time_us":9485,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":8636,"spinlock_wait_cycles":1398471552,"thread_start_us":1464653,"threads_started":1,"wal-append.queue_time_us":224392}
I20260709 12:24:56.740909 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:56.734630 14872 raft_consensus.cc:2749] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:56.744551 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:56.745563 11128 raft_consensus.cc:2393] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 10: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:56.691975 14819 consensus_queue.cc:260] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:56.745218 11130 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 10.
I20260709 12:24:56.748958 11097 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:56.749091 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:56.747076 11125 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
W20260709 12:24:56.750327 11081 debug-util.cc:398] Leaking SignalData structure 0x7b08003411e0 after lost signal to thread 11705
W20260709 12:24:56.750670 11081 debug-util.cc:398] Leaking SignalData structure 0x7b08000c3e20 after lost signal to thread 11706
W20260709 12:24:56.752029 11081 debug-util.cc:398] Leaking SignalData structure 0x7b08001aa5c0 after lost signal to thread 14707
W20260709 12:24:56.752424 11081 debug-util.cc:398] Leaking SignalData structure 0x7b08003253e0 after lost signal to thread 14711
I20260709 12:24:56.751832 11053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1774) took 4104 ms. Trace:
I20260709 12:24:56.741945 11129 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:24:56.753304 11054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52804 (request call id 547) took 1823 ms. Trace:
I20260709 12:24:56.754568 11054 rpcz_store.cc:276] 0709 12:24:54.926748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.592453 (+665705us) service_pool.cc:224] Handling call
0709 12:24:56.750181 (+1157728us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54001879d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:56.750326 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2374496128}
I20260709 12:24:56.744012 14766 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:56.753719 11053 rpcz_store.cc:276] 0709 12:24:52.647875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.648041 (+   166us) service_pool.cc:224] Handling call
0709 12:24:55.474930 (+2826889us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.492895 (+ 17965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:56.750851 (+1257956us) spinlock_profiling.cc:243] Waited 2.83 s on lock 0x7b54002dd050. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:56.751770 (+   919us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6500181504}
I20260709 12:24:56.757318 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:56.758734 11132 raft_consensus.cc:1275] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:56.761384 11129 raft_consensus.cc:1275] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:24:56.760861 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 81525.2us
I20260709 12:24:56.763669 11098 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:56.764729 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:56.746718 14520 raft_consensus.cc:3055] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:56.751379 14813 raft_consensus.cc:2749] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:56.775063 14869 log.cc:927] Time spent T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.309s	user 0.000s	sys 0.002s
I20260709 12:24:56.776448 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:56.778313 11025 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
W20260709 12:24:56.771162 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.760516 14766 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.771503 14815 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.766629 14356 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:56.766877 14520 raft_consensus.cc:740] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:56.772979 14873 consensus_queue.cc:1048] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
W20260709 12:24:56.769361 14842 log.cc:927] Time spent T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 1.339s	user 0.003s	sys 0.002s
I20260709 12:24:56.753297 14872 consensus_queue.cc:1059] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:24:56.779426 11025 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:56.784603 11098 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:56.786883 14815 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:56.781859 14883 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:56.788097 14883 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.788451 14883 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:56.789289 14815 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:56.788982 14520 consensus_queue.cc:260] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:56.790050 14520 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:56.791689 14783 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:56.794451 14878 raft_consensus.cc:2764] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:24:56.783393 14356 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:56.795733 14356 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:56.781679 14766 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:56.796500 11098 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:56.795229 14767 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:56.803725 10983 raft_consensus.cc:1240] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:56.799333 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:24:56.811604 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 120046us
W20260709 12:24:56.815935 14840 log.cc:927] Time spent T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 1.370s	user 0.002s	sys 0.004s
I20260709 12:24:56.816676 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:56.818708 11674 raft_consensus.cc:1275] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:56.819500 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:56.820125 11052 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:56.773277 14822 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:56.822630 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:56.824944 11054 raft_consensus.cc:1275] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:56.800426 14742 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:24:56.822770 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 63446.4us
I20260709 12:24:56.822706 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:56.823120 11051 raft_consensus.cc:1240] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:24:56.827632 11677 raft_consensus.cc:1275] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:56.815768 14895 consensus_queue.cc:1059] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:24:56.836297 14822 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:56.839217 14767 raft_consensus.cc:697] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 9 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:56.810382 14813 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:56.841892 11052 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
W20260709 12:24:56.860457 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 678132us
I20260709 12:24:56.862516 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:56.803109 14650 consensus_queue.cc:1048] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:24:56.863026 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:56.854863 10983 pending_rounds.cc:85] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 2
I20260709 12:24:56.863777 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:56.864634 11128 raft_consensus.cc:2393] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 10: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:56.866452 10949 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:56.863894 10983 pending_rounds.cc:107] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 12:24:56.867720 10983 raft_consensus.cc:2889] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:56.868638 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 590899us
W20260709 12:24:56.872556 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.873196 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2265) took 4650 ms. Trace:
I20260709 12:24:56.873675 14849 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:56.873881 14781 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:56.874282 14849 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:56.874636 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:56.873616 10981 rpcz_store.cc:276] 0709 12:24:52.223080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.223385 (+   305us) service_pool.cc:224] Handling call
0709 12:24:52.227288 (+  3903us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:52.235579 (+  8291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:52.235631 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:52.244789 (+  9158us) log.cc:844] Serialized 26 byte log entry
0709 12:24:52.577111 (+332322us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:56.021039 (+3443928us) spinlock_profiling.cc:243] Waited 9.75 ms on lock 0x7b18003aef40. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cd9e07 00007f8f91b349a9 00007f8f88cf669b 00007f8f88cf493f 00007f8f88cf4455 00007f8f8f7dc3c7 00007f8f8bdee9a7 00007f8f8bdfe0bf 00007f8f8bdfe038
0709 12:24:56.156314 (+135275us) log.cc:844] Serialized 14 byte log entry
0709 12:24:56.773092 (+616778us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:56.872770 (+ 99678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:56.872848 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:56.872907 (+    59us) raft_consensus.cc:1685] finished
0709 12:24:56.872917 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.873032 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":590357,"prepare.queue_time_us":78092,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":582520,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":210,"spinlock_wait_cycles":46242432,"thread_start_us":527190,"threads_started":3,"wal-append.queue_time_us":558391,"wal-append.run_cpu_time_us":3456,"wal-append.run_wall_time_us":1581195}
I20260709 12:24:56.876520 14849 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:56.877096 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:56.877291 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:56.877933 11130 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:56.878298 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:56.878511 14845 log.cc:927] Time spent T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 1.419s	user 0.007s	sys 0.001s
I20260709 12:24:56.880321 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 483) took 3814 ms. Trace:
I20260709 12:24:56.880714 10975 rpcz_store.cc:276] 0709 12:24:53.065787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.332199 (+2266412us) service_pool.cc:224] Handling call
0709 12:24:55.332697 (+   498us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:55.333185 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:55.333218 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:55.333880 (+   662us) log.cc:844] Serialized 26 byte log entry
0709 12:24:55.425349 (+ 91469us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:55.425393 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.425470 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:56.877801 (+1452331us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:56.879997 (+  2196us) raft_consensus.cc:1685] finished
0709 12:24:56.880021 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.880229 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3779,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":7643,"spinlock_wait_cycles":1355988864,"thread_start_us":90960,"threads_started":1,"wal-append.queue_time_us":124952}
I20260709 12:24:56.878027 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:56.882658 14781 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:56.883318 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:56.884526 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:56.883173 10980 raft_consensus.cc:2393] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 10: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:56.873513 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:56.883453 14847 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:56.885082 10979 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:56.890178 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 53187us
I20260709 12:24:56.893687 11644 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:24:56.896420 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 47953.6us
I20260709 12:24:56.899838 11053 raft_consensus.cc:1240] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:56.900664 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:56.901351 10975 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:56.902835 11130 raft_consensus.cc:2410] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:24:56.859745 14742 raft_consensus.cc:697] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:56.873538 14697 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:56.873351 14342 raft_consensus.cc:2804] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:56.868239 14854 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:24:56.917063 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 50710.5us
I20260709 12:24:56.910272 11128 raft_consensus.cc:1240] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:56.922407 10949 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:56.923712 14701 consensus_queue.cc:1048] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:24:56.924114 14698 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:56.924144 14767 consensus_queue.cc:237] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:56.925657 14619 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.908605 14708 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:24:56.926600 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 56706.2us
I20260709 12:24:56.923605 11126 raft_consensus.cc:1275] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:24:56.852487 14715 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:56.928721 10981 raft_consensus.cc:1275] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:56.936049 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:56.932901 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:56.935614 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:56.931881 11645 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:56.908496 14781 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:56.942641 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:56.941129 10949 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:56.895200 14872 consensus_queue.cc:1059] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:24:56.926934 14854 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.927503 14342 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.942206 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:56.895192 14813 consensus_queue.cc:1048] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:24:56.948521 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:56.948822 11055 raft_consensus.cc:1240] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:56.950039 11059 raft_consensus.cc:1240] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:24:56.936091 14780 raft_consensus.cc:2749] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:56.951031 10949 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:56.973081 10949 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:56.973707 11053 raft_consensus.cc:2410] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:24:56.974062 10981 raft_consensus.cc:1275] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:56.929457 14697 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:56.946072 14854 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:56.948431 14871 raft_consensus.cc:2804] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:56.984350 10981 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:24:56.950902 14342 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:56.975414 14751 raft_consensus.cc:2749] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:24:57.040663 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 95079.3us
I20260709 12:24:56.944607 14567 consensus_queue.cc:1048] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:24:56.943253 14698 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:56.943463 14728 consensus_queue.cc:1059] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:24:56.982967 14718 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:56.937871 14619 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:24:56.944059 14883 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:57.056433 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 69987.6us
I20260709 12:24:56.945027 14708 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:57.059314 10981 raft_consensus.cc:1275] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:57.092859 14718 raft_consensus.cc:697] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 10 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
W20260709 12:24:57.104604 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 123524us
W20260709 12:24:57.106647 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 133639us
I20260709 12:24:57.107857 10949 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:57.109840 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 61310.2us
I20260709 12:24:57.111167 10948 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:57.122650 10948 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:57.124243 10949 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:57.128000 13739 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:57.129043 10948 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:57.133139 14853 consensus_queue.cc:1048] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:24:57.136088 14894 consensus_queue.cc:1059] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:24:57.144621 14708 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:57.107021 14781 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:57.148541 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:57.097237 14669 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:24:57.131371 14751 raft_consensus.cc:2749] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:57.132160 14780 raft_consensus.cc:2804] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:57.107733 14744 consensus_queue.cc:1048] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:24:57.057189 14742 consensus_queue.cc:237] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:57.187049 14900 log.cc:927] Time spent T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:24:57.187894 14897 log.cc:927] Time spent T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 12:24:57.192763 14766 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:57.196352 14715 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:57.261958 14766 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:57.208117 14650 raft_consensus.cc:3055] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:57.211134 14685 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:57.216004 14856 log.cc:927] Time spent T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 1.303s	user 0.004s	sys 0.000s
I20260709 12:24:57.269999 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 487) took 2183 ms. Trace:
I20260709 12:24:57.270555 10984 rpcz_store.cc:276] 0709 12:24:55.086377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.532422 (+446045us) service_pool.cc:224] Handling call
0709 12:24:55.532854 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:55.607984 (+ 75130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:55.608017 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:55.810976 (+202959us) log.cc:844] Serialized 26 byte log entry
0709 12:24:55.913541 (+102565us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:55.913583 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.913651 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:57.215203 (+1301552us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:57.269674 (+ 54471us) raft_consensus.cc:1685] finished
0709 12:24:57.269700 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:57.269925 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":45699,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"spinlock_wait_cycles":322159872,"thread_start_us":166351,"threads_started":2,"wal-append.queue_time_us":95399}
I20260709 12:24:57.234938 14619 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:57.177507 14901 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:57.268527 14650 raft_consensus.cc:740] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:57.274798 14650 consensus_queue.cc:260] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:57.289111 14650 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:57.291843 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:57.298175 14698 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:57.252413 14819 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:57.262820 14873 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.272599 14901 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.301362 14901 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:57.302855 14893 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.301362 14873 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:57.303488 14893 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:57.273726 11677 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEARNER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:24:57.225193 14718 consensus_queue.cc:237] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:57.243968 14329 raft_consensus.cc:3055] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:57.303737 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:57.306460 14329 raft_consensus.cc:740] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:57.280543 14883 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:57.310554 11674 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
W20260709 12:24:57.311479 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 378489us
I20260709 12:24:57.313108 11680 raft_consensus.cc:1240] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:57.316329 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:57.335733 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:24:57.340299 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 211309us
I20260709 12:24:57.341408 10948 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:57.340262 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 216100us
I20260709 12:24:57.362357 10979 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:24:57.295128 10975 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:24:57.363793 10948 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:57.371718 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:57.372221 10979 raft_consensus.cc:1275] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:57.368265 11643 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:57.373229 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:57.373770 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 371510us
I20260709 12:24:57.311123 14780 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.374920 11680 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:24:57.362746 14709 raft_consensus.cc:2749] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:57.363240 14356 consensus_meta.cc:287] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.567s	user 0.007s	sys 0.003s
I20260709 12:24:57.401923 14356 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:57.402861 14901 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:57.404021 14356 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:57.405022 14901 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:57.404464 14342 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:57.406404 10981 raft_consensus.cc:2393] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 7: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
W20260709 12:24:57.397372 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 85200.7us
I20260709 12:24:57.408152 14854 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:57.376263 13739 raft_consensus.cc:2804] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:57.305939 14893 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:57.400564 14329 consensus_queue.cc:260] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:57.411571 14906 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.412043 14873 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:57.412482 14906 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:57.412775 14329 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:57.423439 14854 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:57.425748 14906 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:57.334024 14871 raft_consensus.cc:697] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:57.427218 14871 consensus_queue.cc:237] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:57.429306 14780 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:57.436323 11098 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.004s	sys 0.008s
W20260709 12:24:57.436734 11098 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.004s	sys 0.008s
W20260709 12:24:57.436920 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 68728.8us
W20260709 12:24:57.437052 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 543658us
I20260709 12:24:57.439183 11023 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:57.442207 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:57.367921 14853 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:57.371148 14751 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.370896 14708 raft_consensus.cc:2749] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:57.447160 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 92290.4us
I20260709 12:24:57.448000 10949 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:57.449887 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:57.372560 14883 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:57.462633 11643 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:57.459556 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 59801.7us
I20260709 12:24:57.464462 10978 raft_consensus.cc:1275] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:57.466383 11055 raft_consensus.cc:1240] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:57.467068 11057 raft_consensus.cc:1240] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:57.467892 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:57.469576 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:57.470235 11057 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:24:57.468935 11098 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:57.468825 11054 raft_consensus.cc:1275] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:57.468158 11058 raft_consensus.cc:1275] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:57.481196 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:57.481600 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:57.482760 11056 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:24:57.434440 14685 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:57.482425 11060 raft_consensus.cc:2393] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 13: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
W20260709 12:24:57.443506 14895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.002s	sys 0.012s
I20260709 12:24:57.446170 14853 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.446810 14783 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:57.497000 11098 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:57.458482 14849 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:57.447081 14695 consensus_queue.cc:1048] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:24:57.515669 14849 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:57.500519 14492 raft_consensus.cc:3055] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:57.516924 14492 raft_consensus.cc:740] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:57.489563 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:57.502218 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 390330us
I20260709 12:24:57.483759 14766 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.523483 11679 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:24:57.523746 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:57.524525 11126 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
W20260709 12:24:57.514135 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 51571.6us
I20260709 12:24:57.469501 14742 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.501060 14566 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:57.462863 14893 raft_consensus.cc:2749] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:24:57.500895 14895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.007s	sys 0.012s
I20260709 12:24:57.525888 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:57.524565 11130 raft_consensus.cc:1240] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:24:57.531248 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:57.535682 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:57.539418 11128 raft_consensus.cc:2393] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 11: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:57.504421 14873 raft_consensus.cc:2804] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:57.468053 14781 consensus_queue.cc:1048] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
W20260709 12:24:57.547379 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 50498.3us
I20260709 12:24:57.550061 11645 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:24:57.512154 14853 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:57.515671 14783 raft_consensus.cc:697] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:57.500558 14669 consensus_queue.cc:1048] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:24:57.500712 14685 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:57.558465 11133 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 10.
I20260709 12:24:57.485845 14751 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:57.488796 14883 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:57.536810 14849 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:57.566923 11643 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:57.544534 14873 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:57.536496 14813 consensus_queue.cc:1048] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:24:57.538568 14766 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:57.564652 14767 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:57.572013 14695 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.592051 14905 consensus_queue.cc:1059] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:24:57.599640 14905 raft_consensus.cc:3055] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:57.599857 14902 raft_consensus.cc:3055] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:57.600462 14902 raft_consensus.cc:740] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:57.601429 14902 consensus_queue.cc:260] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:57.602571 14902 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:57.604581 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.605878 11643 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:57.606477 14783 consensus_queue.cc:237] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:57.607293 11643 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:57.600076 14905 raft_consensus.cc:740] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:57.612314 14905 consensus_queue.cc:260] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:57.614305 14342 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:57.613634 14905 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:24:57.615221 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 251473us
I20260709 12:24:57.617173 14901 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:57.617605 14901 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:57.617982 14901 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:57.618562 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 170645us
I20260709 12:24:57.619377 10949 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:57.621170 14851 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:57.621706 14851 raft_consensus.cc:697] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 11 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:57.622700 14851 consensus_queue.cc:237] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:57.623481 14698 raft_consensus.cc:2749] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:57.621006 10949 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:57.628870 14766 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:57.629400 14850 raft_consensus.cc:2749] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:57.615437 14921 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:57.630177 14921 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.630553 14921 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:57.555560 14775 consensus_queue.cc:1059] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 12:24:57.633172 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:57.633843 11060 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 13.
I20260709 12:24:57.593510 14893 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:57.635247 11643 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:57.635658 14893 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:57.636090 14893 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:57.625138 14883 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:57.578322 14872 consensus_queue.cc:1048] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:24:57.552866 14492 consensus_queue.cc:260] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:57.638881 14903 raft_consensus.cc:2804] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:57.639176 14492 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:57.639657 14669 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.640300 14669 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:57.621573 14619 raft_consensus.cc:2749] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:57.639472 14903 raft_consensus.cc:697] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:57.643005 14903 consensus_queue.cc:237] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:57.645210 14329 consensus_queue.cc:1059] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:57.646126 14914 consensus_queue.cc:1048] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:57.646289 14695 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:57.647181 11131 raft_consensus.cc:1275] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:57.626848 14751 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:57.652772 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:57.653501 11126 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:57.654506 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 48405.8us
I20260709 12:24:57.658146 10949 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:57.678112 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:57.588882 14873 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:57.680473 11674 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
W20260709 12:24:57.680835 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.682351 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:57.595898 14767 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.648407 14695 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:57.623605 14685 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:57.687359 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:57.687983 11644 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:57.576063 14819 consensus_queue.cc:1048] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 12:24:57.689303 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:24:57.690210 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 55070.9us
I20260709 12:24:57.690496 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:57.684962 11024 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:57.697316 11679 raft_consensus.cc:2393] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 11: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:57.699251 10949 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:57.692206 11025 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:57.638154 14901 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:57.687175 14781 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.728374 11644 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:57.689720 14767 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:57.734488 11679 raft_consensus.cc:1275] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:57.723579 10949 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:57.728782 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:57.700484 14329 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:57.720216 14685 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:57.745496 11126 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:24:57.697829 14849 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:57.750306 11097 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:57.698123 14751 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:57.714637 14854 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:57.720618 14619 raft_consensus.cc:2749] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:57.755668 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:57.769974 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:57.758844 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:57.771085 11055 raft_consensus.cc:2393] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 7: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:57.758981 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:57.772478 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:57.773057 11057 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:57.759734 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:57.746716 11058 raft_consensus.cc:1240] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:24:57.755656 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:57.730365 14850 raft_consensus.cc:2749] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:57.720909 14342 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:57.736033 14895 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:57.765054 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:57.787873 10981 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
I20260709 12:24:57.784164 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:57.765789 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:57.789088 10982 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:24:57.765921 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:57.747206 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:57.789919 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:57.732398 14695 raft_consensus.cc:2749] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:57.776331 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:57.775199 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:57.792722 11055 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
I20260709 12:24:57.794459 10977 pending_rounds.cc:85] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 7
I20260709 12:24:57.794768 10977 pending_rounds.cc:107] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:24:57.777352 11025 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:24:57.778854 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:57.794992 10977 raft_consensus.cc:2889] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:57.795337 10977 pending_rounds.cc:107] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:24:57.795568 10977 raft_consensus.cc:2889] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:57.796057 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:57.796330 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:57.736517 14743 consensus_queue.cc:1048] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:24:57.780447 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:57.798723 11056 raft_consensus.cc:2410] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:24:57.693881 14871 consensus_queue.cc:1059] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:24:57.781457 11097 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:24:57.540611 14742 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:57.782060 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:57.784575 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:57.699268 14872 consensus_queue.cc:1059] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:24:57.746937 14894 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:57.789924 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:57.799546 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:57.802381 14464 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:57.748677 14685 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:57.768132 14709 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.793277 14902 raft_consensus.cc:2749] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:57.782392 14356 raft_consensus.cc:3055] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:57.786721 14697 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:57.774242 14669 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:57.828755 10981 raft_consensus.cc:1240] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:24:57.850171 11054 raft_consensus.cc:2393] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 12: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:57.802515 10948 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:57.740006 14781 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:57.862865 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:57.864130 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:57.865417 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 84042.1us
I20260709 12:24:57.866071 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:57.803534 11098 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:57.868510 10982 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:24:57.792202 10879 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39956 (request call id 178) took 32328 ms (client timeout 15000 ms). Trace:
I20260709 12:24:57.867139 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:57.850867 11674 raft_consensus.cc:2393] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 10: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:57.868279 11673 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:24:57.770614 14718 raft_consensus.cc:2749] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:57.888032 10949 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:57.850574 14701 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.786131 14751 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:57.783910 14566 raft_consensus.cc:697] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 9 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:57.781855 14854 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:57.938278 14917 log.cc:927] Time spent T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.241s	user 0.001s	sys 0.001s
I20260709 12:24:57.790009 14342 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:57.945633 11097 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:57.946939 11058 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 10.
W20260709 12:24:57.952978 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 150512us
W20260709 12:24:57.964418 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 76505us
I20260709 12:24:57.927129 14911 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.927402 14356 raft_consensus.cc:740] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:57.953976 14894 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.957234 11052 raft_consensus.cc:1275] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:24:57.790915 14849 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:57.974296 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 170847us
I20260709 12:24:57.928542 11057 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:24:57.871464 14872 raft_consensus.cc:2749] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:57.941583 14464 raft_consensus.cc:697] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:57.922632 14685 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:57.853255 14851 consensus_queue.cc:1059] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 12:24:57.972829 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:57.989524 11674 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
I20260709 12:24:57.968164 11131 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:24:57.927093 14709 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:57.984846 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:57.996109 10983 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:24:57.956125 14697 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:58.022475 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:58.023185 11131 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:57.958508 14902 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:57.972730 14718 raft_consensus.cc:2749] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:57.982213 10982 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:24:58.052191 10982 raft_consensus.cc:1240] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:58.053503 10982 raft_consensus.cc:1240] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 11 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 10. Current term is 11. Ops: []
W20260709 12:24:58.051290 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 182576us
I20260709 12:24:57.963327 14919 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:58.059900 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:57.987217 14775 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:58.022166 14697 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:58.067600 14697 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:58.067301 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:57.982705 14894 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:58.070971 14342 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:58.075392 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 109337us
I20260709 12:24:58.077607 11131 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:24:58.077929 10983 raft_consensus.cc:1275] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:24:58.078369 10983 pending_rounds.cc:85] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 5
I20260709 12:24:58.078744 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:58.082469 11131 raft_consensus.cc:1240] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:24:58.084760 11674 raft_consensus.cc:1240] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:58.085932 10983 pending_rounds.cc:107] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:24:58.086403 10983 raft_consensus.cc:2889] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:58.081202 10948 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:58.086812 10949 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:57.992942 14928 raft_consensus.cc:2749] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:58.088487 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:24:58.089169 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 99614.1us
I20260709 12:24:58.061939 14901 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:58.056463 14872 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:58.092031 10982 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:58.093943 14851 raft_consensus.cc:2749] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:58.094115 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 105207us
W20260709 12:24:58.198212 14923 log.cc:927] Time spent T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:24:58.095635 11643 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:58.099018 11672 raft_consensus.cc:1240] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:58.096580 10949 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:58.093959 14342 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:58.141089 14464 consensus_queue.cc:237] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:58.150204 14931 log.cc:927] Time spent T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 12:24:58.155318 14709 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:58.243100 14932 log.cc:927] Time spent T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 12:24:58.243392 14941 raft_consensus.cc:2804] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:24:58.243721 14780 consensus_meta.cc:287] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.814s	user 0.010s	sys 0.000s
I20260709 12:24:58.243939 14941 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
W20260709 12:24:58.243013 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 147460us
I20260709 12:24:58.164166 14742 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:58.245622 14941 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:58.248283 14915 log.cc:927] Time spent T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.669s	user 0.003s	sys 0.008s
I20260709 12:24:58.163214 14751 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:58.218052 14685 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:58.250970 11643 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:58.251392 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:58.251959 14948 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:58.252465 14948 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:58.252803 14948 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:58.060734 14902 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:58.254387 14767 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:58.235389 14930 log.cc:927] Time spent T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.298s	user 0.001s	sys 0.000s
I20260709 12:24:58.255489 14902 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:57.986595 14911 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:58.070401 14919 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:58.172330 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 487406us
I20260709 12:24:58.179252 14928 consensus_queue.cc:1059] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:24:58.264341 11024 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:58.265512 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:58.266363 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:58.265605 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:58.157955 14854 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:57.946442 10879 rpcz_store.cc:269] 0709 12:24:25.460807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.461571 (+   764us) service_pool.cc:224] Handling call
0709 12:24:57.781593 (+32320022us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:50.240448 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:50.241159 (+   711us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:50.241210 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:24:50.241228 (+    18us) tablet.cc:662] Decoding operations
0709 12:24:50.242361 (+  1133us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:50.242470 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:50.242498 (+    28us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:24:50.243534 (+  1036us) tablet.cc:701] Row locks acquired
0709 12:24:50.243592 (+    58us) write_op.cc:260] PREPARE: finished
0709 12:24:50.243759 (+   167us) write_op.cc:270] Start()
0709 12:24:50.243899 (+   140us) write_op.cc:276] Timestamp: P: 1783599890243689 usec, L: 0
0709 12:24:50.243917 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:24:50.244613 (+   696us) log.cc:844] Serialized 4424 byte log entry
0709 12:24:51.463711 (+1219098us) spinlock_profiling.cc:243] Waited 40.7 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:51.817934 (+354223us) op_driver.cc:464] REPLICATION: finished
0709 12:24:52.276993 (+459059us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f88cda0ac 00007f8f91b349a9 00007f8f88cf669b 00007f8f88cf493f 00007f8f88cf6c02 00007f8f8f81aef0
0709 12:24:52.667959 (+390966us) write_op.cc:301] APPLY: starting
0709 12:24:52.710910 (+ 42951us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:52.864817 (+153907us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:52.903549 (+ 38732us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:53.045256 (+141707us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:53.045605 (+   349us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:24:53.045655 (+    50us) write_op.cc:312] APPLY: finished
0709 12:24:53.046048 (+   393us) log.cc:844] Serialized 77 byte log entry
0709 12:24:53.305844 (+259796us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:53.316200 (+ 10356us) write_op.cc:454] Released schema lock
0709 12:24:53.336980 (+ 20780us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:53.566478 (+229498us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:53.568212 (+  1734us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2672269,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":790408,"apply.run_cpu_time_us":18986,"apply.run_wall_time_us":856342,"num_ops":10,"prepare.queue_time_us":597040,"prepare.run_cpu_time_us":9841,"prepare.run_wall_time_us":444502,"raft.queue_time_us":109868,"raft.run_cpu_time_us":20660,"raft.run_wall_time_us":1118251,"replication_time_us":1573867,"spinlock_wait_cycles":105401984,"thread_start_us":2378619,"threads_started":5,"wal-append.queue_time_us":1278971,"wal-append.run_cpu_time_us":20649,"wal-append.run_wall_time_us":2882031}]]}
I20260709 12:24:58.206504 14781 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:58.213311 14697 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:58.094973 14356 consensus_queue.cc:260] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:58.171025 14773 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:58.134024 11675 raft_consensus.cc:2393] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 10: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:58.098276 10948 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
W20260709 12:24:58.109205 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:58.225957 14929 log.cc:927] Time spent T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:24:58.231698 11097 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:24:58.095539 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2333) took 1320 ms. Trace:
W20260709 12:24:58.223310 14926 log.cc:927] Time spent T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.354s	user 0.001s	sys 0.000s
I20260709 12:24:58.144821 14566 consensus_queue.cc:237] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:58.234398 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 137884us
W20260709 12:24:58.162001 14921 consensus_meta.cc:287] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.531s	user 0.007s	sys 0.000s
I20260709 12:24:58.235255 14342 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:58.244153 14780 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:58.244625 14936 log.cc:927] Time spent T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
W20260709 12:24:58.145695 14925 log.cc:927] Time spent T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.383s	user 0.001s	sys 0.000s
I20260709 12:24:58.168071 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:57.961979 14701 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:58.256924 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2327) took 1598 ms. Trace:
I20260709 12:24:58.298918 14946 raft_consensus.cc:2749] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:58.252137 14685 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:58.252961 11643 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:58.325003 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 72164.2us
I20260709 12:24:58.325907 11643 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:58.267889 11057 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:58.272065 14919 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:58.274582 11098 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:58.327800 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 53312.3us
I20260709 12:24:58.236893 14718 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:58.222958 14775 raft_consensus.cc:697] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:58.277072 11024 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
W20260709 12:24:58.365515 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 88510.8us
I20260709 12:24:58.366488 11024 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
W20260709 12:24:58.281219 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 183080us
I20260709 12:24:58.367805 10948 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:58.282145 10980 rpcz_store.cc:276] 0709 12:24:56.775391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.895933 (+120542us) service_pool.cc:224] Handling call
0709 12:24:56.896237 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:56.917859 (+ 21622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:56.917897 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:56.966857 (+ 48960us) log.cc:844] Serialized 26 byte log entry
0709 12:24:57.375991 (+409134us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:57.376034 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:57.376119 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:58.095320 (+719201us) raft_consensus.cc:1685] finished
0709 12:24:58.095341 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:58.095479 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21169,"raft.queue_time_us":27298,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":121,"thread_start_us":333546,"threads_started":1,"wal-append.queue_time_us":595845}
I20260709 12:24:58.369423 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:58.284046 14928 raft_consensus.cc:3055] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:58.284539 14773 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:58.285221 14356 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:58.285918 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:58.281147 14883 raft_consensus.cc:2749] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:58.280932 14781 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:24:58.286788 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 55158us
I20260709 12:24:58.287796 14697 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:58.288332 14947 consensus_queue.cc:1059] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:24:58.290825 14849 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:58.293133 14492 consensus_meta.cc:287] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.653s	user 0.011s	sys 0.000s
I20260709 12:24:58.293964 14854 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:58.440347 14893 consensus_meta.cc:287] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.802s	user 0.000s	sys 0.011s
I20260709 12:24:58.296990 14850 raft_consensus.cc:3055] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:58.298874 11130 raft_consensus.cc:1275] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:58.300333 10982 raft_consensus.cc:1275] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:24:58.301518 10949 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:24:58.286044 14873 consensus_meta.cc:287] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.596s	user 0.008s	sys 0.001s
I20260709 12:24:58.281402 14767 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:58.286811 14896 raft_consensus.cc:3055] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:58.322758 10976 rpcz_store.cc:276] 0709 12:24:56.658409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.676762 (+ 18353us) service_pool.cc:224] Handling call
0709 12:24:56.699081 (+ 22319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:56.891167 (+192086us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:56.891196 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:56.894608 (+  3412us) log.cc:844] Serialized 26 byte log entry
0709 12:24:57.210535 (+315927us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b18003df000. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cd9e07 00007f8f91b349a9 00007f8f88cf669b 00007f8f88cf493f 00007f8f88cf6c02 00007f8f8b97e20b 00007f8f8b983d23 00007f8f8b9840d1 00007f8f8bd9fa0f
0709 12:24:57.370435 (+159900us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:57.370749 (+   314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:57.370961 (+   212us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:58.247576 (+876615us) spinlock_profiling.cc:243] Waited 5.94 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:58.256694 (+  9118us) raft_consensus.cc:1685] finished
0709 12:24:58.256714 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:58.256866 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":188557,"raft.queue_time_us":192870,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":13434,"spinlock_wait_cycles":16381696,"thread_start_us":159411,"threads_started":1,"wal-append.queue_time_us":622487}
I20260709 12:24:58.331290 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:58.308432 14342 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:58.364547 10979 raft_consensus.cc:1240] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:24:58.284188 14911 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:58.373917 10980 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
W20260709 12:24:58.318029 14853 consensus_meta.cc:287] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.748s	user 0.008s	sys 0.004s
I20260709 12:24:58.260293 14872 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:58.432523 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 106710us
I20260709 12:24:58.536244 14701 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:58.437139 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 70762.5us
I20260709 12:24:58.281329 14783 consensus_queue.cc:1059] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:24:58.481878 14893 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:58.442688 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:24:58.444334 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 76633.7us
I20260709 12:24:58.539047 11051 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:24:58.540506 14464 raft_consensus.cc:3055] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:58.538565 14780 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:58.538892 14853 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:58.364255 14902 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:58.449537 11057 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:24:58.538664 14911 consensus_queue.cc:1048] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
W20260709 12:24:58.446883 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 117297us
I20260709 12:24:58.544011 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:58.294909 13739 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:58.362605 14329 raft_consensus.cc:2749] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:58.544401 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:58.310534 14921 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:58.545763 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:58.546545 14921 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:58.547746 11674 raft_consensus.cc:2393] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 12: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:58.548496 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:58.548926 14872 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:58.549242 11130 raft_consensus.cc:2393] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 12: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:58.463980 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2342) took 1180 ms. Trace:
I20260709 12:24:58.439774 14945 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:58.481202 14850 raft_consensus.cc:740] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:58.433333 14943 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:58.550412 14945 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:58.550850 14943 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:58.552688 14945 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:58.553050 14943 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:58.442659 14402 raft_consensus.cc:2749] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:58.444867 14898 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.553761 13739 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:58.500145 14946 consensus_queue.cc:1048] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 12:24:58.440596 14903 raft_consensus.cc:2749] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:58.501458 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 200008us
I20260709 12:24:58.433712 14928 raft_consensus.cc:740] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:58.503082 11681 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:24:58.506549 14700 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:58.562922 10975 raft_consensus.cc:1240] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:58.443807 14718 raft_consensus.cc:697] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 11 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:58.451660 14851 raft_consensus.cc:2749] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:58.557780 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:58.553951 14898 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:58.554793 10984 rpcz_store.cc:276] 0709 12:24:57.283608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.299032 (+ 15424us) service_pool.cc:224] Handling call
0709 12:24:57.299441 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:57.446458 (+147017us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:57.446490 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:57.484372 (+ 37882us) log.cc:844] Serialized 26 byte log entry
0709 12:24:57.545753 (+ 61381us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:57.545801 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:57.545878 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:58.463714 (+917836us) raft_consensus.cc:1685] finished
0709 12:24:58.463738 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:58.463904 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":288275,"raft.queue_time_us":143328,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":14706,"thread_start_us":27923,"threads_started":1,"wal-append.queue_time_us":188303}
I20260709 12:24:58.560962 11024 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:58.553560 14773 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:58.453177 14781 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:58.518539 14709 raft_consensus.cc:2749] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:58.566828 14751 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:58.553882 14775 consensus_queue.cc:237] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:58.518833 14873 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:58.550881 14850 consensus_queue.cc:260] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:58.562546 14697 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.563190 14700 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:58.558017 14780 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:24:58.577412 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.516907 14896 raft_consensus.cc:740] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:58.580752 11673 raft_consensus.cc:1240] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:58.582446 11024 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:58.540926 14464 raft_consensus.cc:740] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:58.585932 14402 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:58.607586 14697 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:58.612767 14780 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:58.618569 14464 consensus_queue.cc:260] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:58.620034 14464 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:58.620573 14780 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:58.620844 14948 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:58.621713 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:58.607537 14700 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:58.622503 11673 raft_consensus.cc:2393] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 11: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:58.623306 11675 raft_consensus.cc:1240] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:58.561987 14783 consensus_queue.cc:1048] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:24:58.616595 14697 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:58.622134 14743 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.608282 14854 consensus_queue.cc:1059] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:24:58.629596 13739 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:58.631995 14743 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:58.637256 11645 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:58.632411 14356 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:58.638640 14356 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:58.629350 14701 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:58.633023 14928 consensus_queue.cc:260] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:58.641227 14701 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:58.642006 14943 consensus_queue.cc:1059] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:24:58.625563 14894 consensus_meta.cc:287] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.001s
I20260709 12:24:58.640823 14356 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:58.624840 14941 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:58.632314 14911 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:58.633549 14878 raft_consensus.cc:3055] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:58.643501 14945 consensus_queue.cc:1059] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:24:58.645915 14743 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:58.646549 14492 raft_consensus.cc:2749] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:58.596275 14751 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:58.649693 11024 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:58.651844 13739 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:58.634970 14797 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:58.663192 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:58.664326 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:58.664624 11130 raft_consensus.cc:1240] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:24:58.663204 11024 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:58.664755 10976 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:24:58.666304 14783 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:58.666450 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:58.666800 14783 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:58.667177 10976 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:58.667655 11644 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:58.667744 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:58.667915 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:58.668474 14938 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:58.669370 11673 raft_consensus.cc:1275] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:24:58.669978 14402 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.667235 14783 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:58.670570 14402 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:58.673213 14402 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:58.675184 14883 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.676008 10976 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
I20260709 12:24:58.675726 14883 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:58.676330 14402 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.676821 14402 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:58.677570 11057 raft_consensus.cc:1275] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:58.678001 11059 raft_consensus.cc:1240] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:58.678618 11051 raft_consensus.cc:1240] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:58.678856 14883 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:58.679181 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:58.679723 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:58.679909 11059 raft_consensus.cc:2393] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 12: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:58.679909 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:58.680927 11675 raft_consensus.cc:1240] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:58.679934 11051 raft_consensus.cc:1275] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:58.682384 14402 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:58.682462 11677 raft_consensus.cc:1240] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:58.684473 14402 consensus_queue.cc:1048] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:58.689971 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:58.684960 14883 consensus_queue.cc:1059] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:24:58.654865 14878 raft_consensus.cc:740] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:58.685446 14743 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:58.651244 14894 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:58.655066 14718 consensus_queue.cc:237] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:58.697780 14893 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:58.698652 14853 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:58.699234 14939 consensus_queue.cc:1059] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:58.699486 14446 raft_consensus.cc:3055] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:58.687183 14911 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:58.700788 14878 consensus_queue.cc:260] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:58.614770 14896 consensus_queue.cc:260] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:58.707711 14945 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.663836 14905 consensus_queue.cc:1048] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:24:58.708624 14872 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:58.710157 11098 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:58.744328 11098 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:58.711592 11677 raft_consensus.cc:1240] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:58.712280 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:58.718978 13739 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.720419 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:58.708070 14913 raft_consensus.cc:3055] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:24:58.742604 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 66725.1us
I20260709 12:24:58.745814 13739 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
W20260709 12:24:58.745225 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 76374.7us
I20260709 12:24:58.712929 14851 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:58.749622 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:58.749697 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:58.694244 14744 consensus_queue.cc:1059] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:24:58.720273 14954 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:58.736635 14446 raft_consensus.cc:740] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:58.739040 14566 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.756590 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:58.712395 14783 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:58.758145 11051 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:24:58.746181 14873 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:58.756500 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:58.755163 14766 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:58.748315 14883 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.764183 11057 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:24:58.766255 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:58.767108 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:58.747277 14913 raft_consensus.cc:740] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:58.775477 13739 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:58.776480 11644 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:58.780843 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:58.781827 11677 raft_consensus.cc:2393] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 13: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:58.747087 14872 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:58.755852 14958 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:58.792161 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:58.749362 14945 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:58.755061 14851 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:58.785919 14775 consensus_queue.cc:1059] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:24:58.802894 14700 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:58.805249 14700 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:58.806243 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:58.815137 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 66165.1us
I20260709 12:24:58.780786 14898 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:58.786598 14873 raft_consensus.cc:2749] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:24:58.826900 14446 consensus_queue.cc:260] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:58.816900 11023 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:24:58.784245 14781 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:58.819707 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:58.763275 14566 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:58.759766 14954 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:58.810451 14464 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.778779 14492 consensus_queue.cc:1059] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:24:58.773236 14883 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:58.791597 14958 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:58.838759 14971 raft_consensus.cc:3055] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:58.783089 14871 consensus_queue.cc:1048] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:24:58.819146 14853 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.848346 14961 consensus_queue.cc:1048] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:24:58.843961 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:58.851994 14895 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:58.852509 14895 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:58.853016 11681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 763) took 1196 ms. Trace:
I20260709 12:24:58.853405 11681 rpcz_store.cc:276] 0709 12:24:57.656214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.656353 (+   139us) service_pool.cc:224] Handling call
0709 12:24:57.686728 (+ 30375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:58.558598 (+871870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.852762 (+294164us) spinlock_profiling.cc:243] Waited 776 ms on lock 0x7b54001b17d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:58.852954 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1785258752}
I20260709 12:24:58.854411 11097 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:58.842615 14971 raft_consensus.cc:740] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:58.855700 11097 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:58.855839 14971 consensus_queue.cc:260] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:58.857239 14813 raft_consensus.cc:2804] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:58.857967 14902 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:58.858604 14902 raft_consensus.cc:697] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:58.859537 14902 consensus_queue.cc:237] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:58.838840 14937 consensus_queue.cc:1059] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 12:24:58.857631 14813 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:58.863013 14813 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:58.779109 11057 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:24:58.850833 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:58.864939 10981 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:58.865967 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:58.866541 14872 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:58.867245 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:58.854492 14853 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:58.868656 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:58.869426 10981 raft_consensus.cc:2393] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 11: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:58.869149 14895 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:58.869552 14853 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:58.870723 14783 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:58.873569 14940 log.cc:927] Time spent T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.723s	user 0.004s	sys 0.000s
I20260709 12:24:58.873863 14954 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:58.850543 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:58.875522 10976 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:58.870635 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2343) took 1586 ms. Trace:
I20260709 12:24:58.876137 10975 rpcz_store.cc:276] 0709 12:24:57.283854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.371322 (+ 87468us) service_pool.cc:224] Handling call
0709 12:24:57.418475 (+ 47153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:58.563461 (+1144986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.870418 (+306957us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54001a0c54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:58.870579 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2631467392}
I20260709 12:24:58.864298 11057 raft_consensus.cc:606] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:58.877969 11057 raft_consensus.cc:614] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:58.876495 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:58.883026 10976 raft_consensus.cc:2368] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 8. Current term is 9.
I20260709 12:24:58.884290 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:58.885529 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:58.876181 14566 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:58.897796 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:58.898655 10975 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:24:58.877396 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:58.836524 14898 raft_consensus.cc:2749] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:58.900305 10981 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
W20260709 12:24:58.875958 14934 log.cc:927] Time spent T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.696s	user 0.003s	sys 0.008s
I20260709 12:24:58.903378 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 501) took 1137 ms. Trace:
I20260709 12:24:58.906615 14895 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:58.907996 14945 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:58.843098 14958 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:58.846385 14446 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:58.915416 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:58.926985 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:58.917481 10975 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:24:58.864912 14911 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:24:58.924911 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 174423us
I20260709 12:24:58.912441 10977 rpcz_store.cc:276] 0709 12:24:57.766083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.793910 (+ 27827us) service_pool.cc:224] Handling call
0709 12:24:57.794287 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:57.823184 (+ 28897us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:57.823214 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:57.823706 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 12:24:58.057790 (+234084us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:58.057822 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.057889 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:58.872857 (+814968us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:58.876605 (+  3748us) raft_consensus.cc:1685] finished
0709 12:24:58.876625 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:58.903315 (+ 26690us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43715840,"thread_start_us":118620,"threads_started":1,"wal-append.queue_time_us":220406}
I20260709 12:24:58.930765 11098 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:58.929296 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:58.927631 10981 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:24:58.931731 10975 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:58.924645 14766 raft_consensus.cc:697] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 12 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:58.898418 14751 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:58.908877 14883 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:58.841800 14464 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:58.867180 14872 consensus_queue.cc:1059] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:24:58.943498 14851 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:58.944273 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2250) took 1293 ms. Trace:
I20260709 12:24:58.946643 14928 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:58.948872 14743 raft_consensus.cc:2749] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:58.949747 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:58.902338 14342 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:58.951841 11052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1523) took 1502 ms. Trace:
I20260709 12:24:58.955111 11098 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:58.955862 14969 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:58.981508 11098 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:58.956429 11059 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:24:58.982405 11059 raft_consensus.cc:606] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:58.985978 11098 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:58.975131 11127 rpcz_store.cc:276] 0709 12:24:57.650838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.651815 (+   977us) service_pool.cc:224] Handling call
0709 12:24:57.652183 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:57.738279 (+ 86096us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:57.738312 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:57.750926 (+ 12614us) log.cc:844] Serialized 26 byte log entry
0709 12:24:57.877234 (+126308us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:57.877283 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:57.877364 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:58.875287 (+997923us) spinlock_profiling.cc:243] Waited 8.81 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:58.943969 (+ 68682us) raft_consensus.cc:1685] finished
0709 12:24:58.943994 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:58.944207 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64110,"raft.queue_time_us":58763,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":4406,"spinlock_wait_cycles":20263680,"thread_start_us":105361,"threads_started":1,"wal-append.queue_time_us":306101}
I20260709 12:24:58.957489 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:58.978982 11052 rpcz_store.cc:276] 0709 12:24:57.449214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.449811 (+   597us) service_pool.cc:224] Handling call
0709 12:24:57.481318 (+ 31507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:57.972195 (+490877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.951565 (+979370us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b5400300cd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:58.951754 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1072451456}
I20260709 12:24:58.989354 11680 raft_consensus.cc:1240] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 9. Current term is 10. Ops: []
W20260709 12:24:58.990697 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.963793 14718 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:58.974377 14905 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.997597 10976 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:24:58.999490 10975 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:24:59.000095 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:58.998811 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:59.004719 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:58.986841 14872 raft_consensus.cc:2749] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:59.008211 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:59.006608 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:59.008857 11681 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:24:59.008937 11057 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:24:59.009151 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:59.006757 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:59.007519 14907 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:59.010577 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:59.012431 11134 raft_consensus.cc:2393] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 10: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:59.013286 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:59.013554 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:59.013890 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1575) took 1247 ms. Trace:
I20260709 12:24:59.014828 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:59.014336 10983 rpcz_store.cc:276] 0709 12:24:57.766651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.996871 (+230220us) service_pool.cc:224] Handling call
0709 12:24:58.067949 (+ 71078us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:58.093498 (+ 25549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.013640 (+920142us) spinlock_profiling.cc:243] Waited 7.95 ms on lock 0x7b540022a954. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:59.013827 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18292992}
I20260709 12:24:59.015511 11057 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:24:58.937780 14766 consensus_queue.cc:237] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:59.017714 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:59.030936 11130 raft_consensus.cc:1275] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:24:59.031459 11130 pending_rounds.cc:85] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 7
I20260709 12:24:59.031670 11130 pending_rounds.cc:107] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:24:59.031903 11130 raft_consensus.cc:2889] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:59.042414 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:59.042965 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:59.043756 11128 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
I20260709 12:24:59.044708 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:59.014317 14907 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:59.001801 14905 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:59.003055 14813 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:59.065228 10981 raft_consensus.cc:1275] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:59.002480 14718 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:59.067178 10981 raft_consensus.cc:1240] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 10. Current term is 12. Ops: [10.9-10.9]
I20260709 12:24:59.068828 10983 raft_consensus.cc:1240] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:59.070036 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:59.072476 10975 raft_consensus.cc:1275] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:59.061492 14619 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:59.080250 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:59.079802 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:59.077936 11098 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:59.081310 11057 raft_consensus.cc:2393] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 11: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:24:59.083017 11098 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:59.083720 14945 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:59.084133 14945 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:59.084522 14945 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:59.045173 14974 raft_consensus.cc:2749] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:59.066030 14907 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:59.088563 11057 raft_consensus.cc:1275] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:24:59.091203 14464 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:59.085551 14619 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:59.089514 14566 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:59.093772 14566 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:59.094620 14978 log.cc:927] Time spent T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:24:59.095094 14619 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:59.096019 14566 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:59.096944 11053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 556) took 1632 ms. Trace:
I20260709 12:24:59.097314 11053 rpcz_store.cc:276] 0709 12:24:57.464806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.464993 (+   187us) service_pool.cc:224] Handling call
0709 12:24:57.489779 (+ 24786us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:57.590315 (+100536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:57.590351 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:57.590400 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:57.590444 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.096706 (+1506262us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b54003011d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:59.096751 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:59.096886 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230708992}
I20260709 12:24:59.076639 14906 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:59.098443 14906 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:59.099593 11133 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 1893) took 2409 ms (client timeout 1821 ms). Trace:
W20260709 12:24:59.100028 11133 rpcz_store.cc:269] 0709 12:24:56.689634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.726452 (+ 36818us) service_pool.cc:224] Handling call
0709 12:24:59.099366 (+2372914us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b540012eb54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:59.099480 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1911318912}
I20260709 12:24:59.100653 14906 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:59.082031 14872 raft_consensus.cc:2804] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:59.102957 11125 raft_consensus.cc:1275] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:59.103449 14718 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:59.082695 14976 consensus_queue.cc:1048] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:24:59.101285 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:59.105690 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:59.104614 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2244) took 2199 ms. Trace:
I20260709 12:24:59.113057 11125 rpcz_store.cc:276] 0709 12:24:56.905225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.923257 (+ 18032us) service_pool.cc:224] Handling call
0709 12:24:59.102588 (+2179331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:59.103369 (+   781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.104419 (+  1050us) spinlock_profiling.cc:243] Waited 2.17 s on lock 0x7b540012eb50. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:24:59.104553 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4986264320}
I20260709 12:24:59.114805 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:59.115118 10975 raft_consensus.cc:1275] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:24:59.115557 11059 raft_consensus.cc:1240] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:59.115944 11125 raft_consensus.cc:2410] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:24:59.101348 14872 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:59.118274 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:59.120025 11675 raft_consensus.cc:2393] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 9: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:59.122888 11133 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:59.124608 14974 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:59.125010 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:59.125151 14974 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:59.125797 14958 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:59.123780 14902 consensus_queue.cc:1048] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:24:59.128315 14958 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:59.120206 14872 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:59.129652 11127 raft_consensus.cc:1240] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:59.122504 14342 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:59.135775 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:59.118153 14905 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:59.150905 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:59.160204 10975 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4"
dest_uuid: "bc01179655564f29b83babe396377cbb"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:41958
I20260709 12:24:59.161167 10975 raft_consensus.cc:606] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:59.161623 10975 raft_consensus.cc:614] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:59.167228 11133 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:24:59.126425 14938 consensus_queue.cc:1059] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:24:59.178721 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:59.179875 11059 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:59.186213 10975 raft_consensus.cc:1240] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:59.190207 14767 raft_consensus.cc:3055] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:59.190802 14767 raft_consensus.cc:740] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:59.191762 14767 consensus_queue.cc:260] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:59.197043 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.199977 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:59.207274 10975 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:24:59.202165 14566 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:59.203138 14813 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:59.219173 11053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:24:59.221223 11674 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 13. Current term is 14. Ops: []
I20260709 12:24:59.233107 11643 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:59.252123 11059 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:24:59.255923 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:59.254525 11098 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:59.257244 11053 raft_consensus.cc:606] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:24:59.257912 11053 raft_consensus.cc:614] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:59.256608 11672 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:59.259644 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:24:59.260442 11679 raft_consensus.cc:2393] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 14: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:24:59.263016 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:59.244016 14767 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:59.245630 14871 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:59.275542 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:24:59.220727 14566 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:59.262822 14958 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:59.287617 11054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1528) took 1311 ms. Trace:
I20260709 12:24:59.288092 11054 rpcz_store.cc:276] 0709 12:24:57.976113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.976584 (+   471us) service_pool.cc:224] Handling call
0709 12:24:57.991885 (+ 15301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:57.992264 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:57.992293 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:58.060123 (+ 67830us) log.cc:844] Serialized 26 byte log entry
0709 12:24:59.166586 (+1106463us) spinlock_profiling.cc:243] Waited 6.21 ms on lock 0x7b18003f4f00. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cd9e07 00007f8f91b349a9 00007f8f88cf669b 00007f8f88cf493f 00007f8f88cf6c02 00007f8f8b97e20b 00007f8f8b983d23 00007f8f8b9840d1 00007f8f8bd9fa0f
0709 12:24:59.256444 (+ 89858us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:59.256493 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.256571 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:59.287247 (+ 30676us) raft_consensus.cc:1685] finished
0709 12:24:59.287275 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:59.287537 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":883,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":32435,"spinlock_wait_cycles":14289664,"thread_start_us":88738,"threads_started":1,"wal-append.queue_time_us":1218384}
I20260709 12:24:59.293882 11672 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:24:59.245628 14967 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:24:59.320288 11678 raft_consensus.cc:1240] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 9. Current term is 10. Ops: [7.9-9.10]
I20260709 12:24:59.321151 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2345) took 2036 ms. Trace:
I20260709 12:24:59.321604 10979 rpcz_store.cc:276] 0709 12:24:57.284416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.373136 (+ 88720us) service_pool.cc:224] Handling call
0709 12:24:57.373442 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:58.516347 (+1142905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.320933 (+804586us) spinlock_profiling.cc:243] Waited 991 ms on lock 0x7b54001abdd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:59.321095 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2278616960}
W20260709 12:24:59.322991 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.326907 14953 raft_consensus.cc:3055] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:59.327454 14953 raft_consensus.cc:740] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:59.306054 14961 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:59.334573 11643 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:59.334797 14961 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:59.304495 14871 raft_consensus.cc:697] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:59.306298 14939 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.358742 14939 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:59.315905 14958 raft_consensus.cc:697] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:59.339124 14974 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:24:59.348846 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.361377 14958 consensus_queue.cc:237] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:59.362838 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:59.363375 14871 consensus_queue.cc:237] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:59.364892 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:59.365783 11126 raft_consensus.cc:2393] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 9: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:59.366544 14742 raft_consensus.cc:3055] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:59.356231 14878 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:59.367461 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:59.368114 11126 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:24:59.349540 14851 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.347234 11097 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:59.341585 14937 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:59.371781 11097 leader_election.cc:400] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Vote denied by peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777) with higher term. Message: Invalid argument: T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 8. Current term is 9.
I20260709 12:24:59.372541 11097 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:59.352962 11678 raft_consensus.cc:1275] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:24:59.373895 11678 pending_rounds.cc:85] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Aborting all ops after (but not including) 7
I20260709 12:24:59.374127 11678 pending_rounds.cc:107] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:24:59.374758 11678 raft_consensus.cc:2889] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:59.376601 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:59.379487 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.381345 10949 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:59.377247 10981 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:24:59.382527 11681 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
W20260709 12:24:59.384147 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.388890 10949 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:59.384148 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:59.427716 10981 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:24:59.386499 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:59.429777 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:59.345563 14566 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:59.468618 14961 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:59.468888 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:59.369181 14851 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:59.469609 10981 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 13.
I20260709 12:24:59.470638 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:59.471681 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:59.472638 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:59.473639 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:59.386848 14766 consensus_queue.cc:1059] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 12:24:59.397585 14937 raft_consensus.cc:697] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:59.475975 14937 consensus_queue.cc:237] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:59.431463 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:59.478919 10976 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:24:59.479861 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:59.353824 14701 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:59.480852 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:59.481009 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:59.481402 10976 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:59.374522 14946 raft_consensus.cc:2749] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:59.485513 10979 raft_consensus.cc:2393] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 11: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:24:59.484961 14851 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:59.488165 14948 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:24:59.491497 14957 log.cc:927] Time spent T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.832s	user 0.003s	sys 0.001s
W20260709 12:24:59.496601 14928 consensus_meta.cc:287] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.514s	user 0.006s	sys 0.009s
I20260709 12:24:59.497644 14939 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:59.499279 14971 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:59.366997 14742 raft_consensus.cc:740] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:59.374671 14894 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:59.436231 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:59.348169 14945 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:59.382583 14619 raft_consensus.cc:2749] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:59.517627 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:24:59.519332 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 202692us
I20260709 12:24:59.519564 10977 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:24:59.476043 14449 raft_consensus.cc:3055] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:59.475266 14854 raft_consensus.cc:2749] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:59.530360 10981 raft_consensus.cc:1240] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:59.374915 14974 raft_consensus.cc:2749] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:59.535820 14945 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:59.518538 14907 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:59.549073 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:59.555979 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:24:59.383255 14356 consensus_queue.cc:1048] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.142s
I20260709 12:24:59.403944 14872 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:59.514389 14946 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:59.560748 11052 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 13. Current term is 14. Ops: []
I20260709 12:24:59.567672 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1579) took 1773 ms. Trace:
I20260709 12:24:59.568106 10982 rpcz_store.cc:276] 0709 12:24:57.794079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.054193 (+260114us) service_pool.cc:224] Handling call
0709 12:24:58.054529 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:58.481910 (+427381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.567382 (+1085472us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b5400382054. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:24:59.567585 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85940096}
I20260709 12:24:59.570219 11132 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:59.525460 14449 raft_consensus.cc:740] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:59.550851 14849 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:59.581856 10976 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:24:59.592103 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2354) took 1310 ms. Trace:
W20260709 12:24:59.593044 14956 log.cc:927] Time spent T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.934s	user 0.002s	sys 0.000s
I20260709 12:24:59.594403 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1581) took 1731 ms. Trace:
I20260709 12:24:59.594786 10978 rpcz_store.cc:276] 0709 12:24:57.862594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.456911 (+594317us) service_pool.cc:224] Handling call
0709 12:24:58.457322 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:58.457576 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:58.457602 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:58.541821 (+ 84219us) log.cc:844] Serialized 26 byte log entry
0709 12:24:58.661282 (+119461us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:58.661309 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.661363 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:59.592512 (+931149us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:59.594094 (+  1582us) raft_consensus.cc:1685] finished
0709 12:24:59.594134 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:59.594338 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3634048,"thread_start_us":119110,"threads_started":1,"wal-append.queue_time_us":117094}
I20260709 12:24:59.602291 14849 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:59.604604 14849 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:59.606374 14907 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:59.618855 14449 consensus_queue.cc:260] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:59.620607 14449 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:59.623135 14742 consensus_queue.cc:260] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:59.624382 14742 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:59.627971 14954 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:59.628350 14402 raft_consensus.cc:3055] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:59.628602 14954 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:59.629133 14969 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:59.629606 14933 log.cc:927] Time spent T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 1.481s	user 0.003s	sys 0.004s
I20260709 12:24:59.628952 14402 raft_consensus.cc:740] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:59.592661 10984 rpcz_store.cc:276] 0709 12:24:58.281828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.596132 (+314304us) service_pool.cc:224] Handling call
0709 12:24:58.609649 (+ 13517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:58.627367 (+ 17718us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:58.627405 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:58.635605 (+  8200us) log.cc:844] Serialized 26 byte log entry
0709 12:24:59.199634 (+564029us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b18003deca0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cd9e07 00007f8f91b349a9 00007f8f88cf669b 00007f8f88cf493f 00007f8f88cf6c02 00007f8f8b97e20b 00007f8f8b983d23 00007f8f8b9840d1 00007f8f8bd9fa0f
0709 12:24:59.369873 (+170239us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:59.369944 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.370011 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:59.591689 (+221678us) raft_consensus.cc:1685] finished
0709 12:24:59.591721 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:59.592020 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1110,"raft.queue_time_us":1271,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":16432,"spinlock_wait_cycles":2592000,"thread_start_us":170003,"threads_started":1,"wal-append.queue_time_us":933730}
I20260709 12:24:59.643883 11132 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
I20260709 12:24:59.646055 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:24:59.646778 11681 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
I20260709 12:24:59.651321 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2247) took 2039 ms. Trace:
I20260709 12:24:59.652907 11129 rpcz_store.cc:276] 0709 12:24:57.611477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.613959 (+  2482us) service_pool.cc:224] Handling call
0709 12:24:57.614366 (+   407us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:24:57.693150 (+ 78784us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:57.693183 (+    33us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:24:57.720797 (+ 27614us) log.cc:844] Serialized 78 byte log entry
0709 12:24:57.993397 (+272600us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:58.059582 (+ 66185us) log.cc:844] Serialized 14 byte log entry
0709 12:24:58.059783 (+   201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.059855 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:58.270046 (+210191us) spinlock_profiling.cc:243] Waited 32.7 ms on lock 0x7b1800411a00. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cf7522 00007f8f88cf97c1 00007f8f88cf9779 00007f8f88cf9709 00007f8f88cf96d1 00007f8f88cf89cd 0000000000388634 0000000000388479 00007f8f88cda83a
0709 12:24:58.703526 (+433480us) spinlock_profiling.cc:243] Waited 5.5 ms on lock 0x7b4800061a58. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f90d0daa1 00007f8f90d04b37 00007f8f90d049ca 00007f8f90dfc26f 00007f8f90dfbf37 00007f8f90e1055c 00007f8f90e10508 00007f8f90e10488 00007f8f90e10443 00007f8f90e0f6ec 00007f8f8fd39a96
0709 12:24:59.628989 (+925463us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:24:59.651064 (+ 22075us) raft_consensus.cc:1685] finished
0709 12:24:59.651087 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:59.651255 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68776,"prepare.queue_time_us":78487,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":2268,"raft.queue_time_us":158423,"raft.run_cpu_time_us":5165,"raft.run_wall_time_us":1010480,"spinlock_wait_cycles":127158144,"thread_start_us":225407,"threads_started":1,"wal-append.queue_time_us":360135}
I20260709 12:24:59.575139 14946 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:59.660588 10948 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:24:59.671320 11128 raft_consensus.cc:1240] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:59.672492 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:59.673275 11128 raft_consensus.cc:2393] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 11: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:24:59.675763 11127 raft_consensus.cc:1240] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:24:59.677165 11127 raft_consensus.cc:1275] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:24:59.680074 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:59.653268 14872 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:59.652911 14907 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:24:59.685037 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 349082us
I20260709 12:24:59.664448 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:59.671555 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:59.684459 11128 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:24:59.629684 14969 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:59.687214 11129 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:59.698801 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:24:59.707002 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 318161us
I20260709 12:24:59.695329 14685 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:24:59.708422 10949 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:59.726960 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:59.725478 11025 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:24:59.695709 14849 raft_consensus.cc:2764] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:24:59.729676 10949 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:24:59.733021 14854 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:59.734225 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:59.737087 11127 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:24:59.737704 14650 consensus_queue.cc:1048] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:59.738188 14851 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:59.738479 14960 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:59.738973 14960 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:59.739321 14960 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:59.739488 10949 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:59.740309 14851 raft_consensus.cc:2804] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:59.740792 14851 raft_consensus.cc:697] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 11 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:24:59.741653 14851 consensus_queue.cc:237] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:59.703462 14939 consensus_queue.cc:1059] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:24:59.696331 14894 consensus_queue.cc:1048] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:24:59.698923 14914 consensus_queue.cc:1048] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:24:59.696563 14907 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:59.746049 11097 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:59.747984 14974 raft_consensus.cc:2804] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:59.748389 14974 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:59.748728 14974 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:59.749703 11097 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:59.750439 11643 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:59.751154 14872 raft_consensus.cc:2749] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:59.751278 11097 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:59.752149 14872 raft_consensus.cc:2749] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:59.752959 11097 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:59.753783 14945 raft_consensus.cc:2804] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:59.754192 14945 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:24:59.754554 14945 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:59.757570 14813 consensus_queue.cc:1048] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:59.759581 11643 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:59.759820 14913 consensus_queue.cc:260] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:59.760612 11643 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:59.761075 14913 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:59.761385 14921 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:59.761761 14921 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:59.762084 14921 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:59.762841 10984 raft_consensus.cc:1240] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 12:24:59.763432 14981 log.cc:927] Time spent T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.826s	user 0.003s	sys 0.000s
I20260709 12:24:59.764896 14961 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:59.765642 14961 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:59.769656 10981 raft_consensus.cc:1275] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:24:59.771713 14954 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:24:59.773840 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:59.774401 10981 raft_consensus.cc:1240] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 9. Current term is 10. Ops: [7.9-9.10]
I20260709 12:24:59.775987 14954 consensus_queue.cc:1059] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:59.776309 14945 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:59.776937 14954 raft_consensus.cc:3055] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:59.777292 14954 raft_consensus.cc:740] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:59.778172 14954 consensus_queue.cc:260] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:59.779008 14945 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:59.779376 14954 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:59.769909 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:59.731451 14685 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:59.786691 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:59.774576 11132 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:24:59.785373 11643 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:24:59.790545 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:59.790522 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:59.792774 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:59.793465 11132 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:24:59.794353 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:59.735034 14854 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:24:59.795051 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 57556.5us
I20260709 12:24:59.796747 11643 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:59.799358 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:59.800191 10978 raft_consensus.cc:2368] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 8. Current term is 9.
I20260709 12:24:59.801142 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:59.803707 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.805792 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:59.806990 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:59.807644 10978 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:24:59.808526 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:59.815672 10978 raft_consensus.cc:2410] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:24:59.812448 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:24:59.817303 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:59.820716 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.683882 14402 consensus_queue.cc:260] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:59.738051 14619 consensus_queue.cc:1048] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:24:59.820313 11132 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:24:59.823727 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:24:59.824111 11097 leader_election.cc:400] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Vote denied by peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777) with higher term. Message: Invalid argument: T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 8. Current term is 9.
I20260709 12:24:59.824438 11097 leader_election.cc:403] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:24:59.825444 10976 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:59.779361 14969 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:59.831037 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:24:59.829285 11097 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:24:59.831888 11132 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
I20260709 12:24:59.796257 14849 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.833293 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:24:59.834486 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:24:59.812714 14945 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:59.797562 14854 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:59.818063 14914 raft_consensus.cc:2804] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:59.813854 14894 raft_consensus.cc:2749] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:24:59.852434 10976 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:24:59.830611 14701 raft_consensus.cc:2749] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777) with higher term. Message: Invalid argument: T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 8. Current term is 9.
I20260709 12:24:59.822929 14813 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:24:59.834947 11132 raft_consensus.cc:1275] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:24:59.863655 11097 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:24:59.870313 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 102916us
I20260709 12:24:59.870887 15014 consensus_queue.cc:1059] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:24:59.871912 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 59860.3us
I20260709 12:24:59.837380 14969 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:59.838464 14849 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:24:59.877163 14878 consensus_meta.cc:287] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.510s	user 0.008s	sys 0.002s
I20260709 12:24:59.877833 14878 raft_consensus.cc:2804] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:59.878350 14878 raft_consensus.cc:697] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:24:59.878453 14813 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:59.879252 14878 consensus_queue.cc:237] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:59.829576 14767 consensus_queue.cc:1048] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:24:59.882222 14969 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:59.880947 15014 raft_consensus.cc:3055] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:59.882623 14969 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:59.832571 14566 consensus_queue.cc:1059] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:24:59.883005 15014 raft_consensus.cc:740] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:24:59.883265 14914 raft_consensus.cc:697] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:24:59.864099 14945 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:24:59.882709 14960 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:59.904058 14685 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:59.923085 15014 consensus_queue.cc:260] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:59.945538 15014 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:59.904037 14974 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:24:59.908548 14967 consensus_queue.cc:1059] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:25:00.019727 15023 raft_consensus.cc:3055] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:00.020196 15023 raft_consensus.cc:740] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:00.021099 15023 consensus_queue.cc:260] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:00.024981 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 161399us
W20260709 12:24:59.986483 15006 log.cc:927] Time spent T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:24:59.987857 14960 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:24:59.991807 14921 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:24:59.993125 15007 log.cc:927] Time spent T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:25:00.003355 14945 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:00.006258 14974 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:00.011682 14941 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:00.013952 14766 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.039399 14766 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:00.041630 14766 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:24:59.981328 14914 consensus_queue.cc:237] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:00.027149 10975 raft_consensus.cc:3055] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:00.042685 10975 raft_consensus.cc:740] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:00.043603 10975 consensus_queue.cc:260] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:00.044689 10975 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:00.031332 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:00.048645 14896 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:00.054314 14953 consensus_queue.cc:260] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:00.055740 14953 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:00.058362 10948 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.145.194:44483 timed out after 1.516s (SENT) [suppressed 13 similar messages]
I20260709 12:25:00.059250 14850 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:00.059576 11130 raft_consensus.cc:2410] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 14 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 12:25:00.063108 11677 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:25:00.064677 11677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41774 (request call id 606) took 1066 ms. Trace:
I20260709 12:25:00.065037 11677 rpcz_store.cc:276] 0709 12:24:58.998336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.998526 (+   190us) service_pool.cc:224] Handling call
0709 12:25:00.064455 (+1065929us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400592c54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:00.064576 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2439905536}
I20260709 12:25:00.029775 14813 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:00.067409 14921 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:00.044790 15001 log.cc:927] Time spent T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.362s	user 0.001s	sys 0.000s
I20260709 12:25:00.070880 10980 raft_consensus.cc:1275] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:00.071195 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:00.082852 10979 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:00.070089 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:00.084429 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:00.084847 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.038349 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:00.054844 15023 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:00.074916 10949 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:00.080749 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:00.093411 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:00.032366 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 114321us
I20260709 12:25:00.093278 10949 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:00.093676 11131 raft_consensus.cc:1275] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:25:00.030962 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 144215us
I20260709 12:25:00.097344 14960 consensus_queue.cc:1048] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:00.094352 11023 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:00.100401 15024 raft_consensus.cc:993] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7: : Instructing follower 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:25:00.100929 15024 raft_consensus.cc:1081] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Signalling peer 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:25:00.101697 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:00.102331 15014 raft_consensus.cc:2804] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:00.102762 15014 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:00.103112 15014 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:00.102511 11055 raft_consensus.cc:2393] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 14: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
W20260709 12:25:00.107561 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.108250 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:00.107219 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:00.113277 11055 raft_consensus.cc:2410] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:25:00.114619 11677 raft_consensus.cc:1240] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:00.115784 11056 raft_consensus.cc:2368] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 10. Current term is 11.
W20260709 12:25:00.117225 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.106545 11023 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:00.119346 10949 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:00.154661 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:00.155426 11060 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:00.125699 11055 raft_consensus.cc:1240] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 10. Current term is 12. Ops: []
I20260709 12:25:00.118398 11054 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:25:00.157554 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:00.129385 10975 raft_consensus.cc:1275] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:25:00.165623 10975 pending_rounds.cc:85] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 6
I20260709 12:25:00.165904 10975 pending_rounds.cc:107] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:25:00.166177 10975 raft_consensus.cc:2889] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:00.156358 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:00.169719 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:00.167945 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:00.183665 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:00.183923 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:00.184737 11054 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:25:00.185757 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:00.182024 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:00.188943 10981 raft_consensus.cc:2393] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 11: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:00.071928 14907 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:00.170641 11024 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:00.182853 11678 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:25:00.202162 10979 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 14.
I20260709 12:25:00.193675 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:00.212641 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:00.213161 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:00.213420 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:00.214252 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:00.112352 14945 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.213315 11051 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 13.
I20260709 12:25:00.217181 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:00.218448 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:00.220712 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:00.224813 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:00.112793 15020 raft_consensus.cc:2804] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:00.228039 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:00.228789 11054 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
W20260709 12:25:00.230659 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 124508us
I20260709 12:25:00.232347 11023 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:00.235296 11055 raft_consensus.cc:2393] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 12: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:00.092723 14854 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:00.241700 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:00.230880 11644 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:00.187904 14851 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:00.240648 11052 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:25:00.236294 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:00.243127 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:00.246706 11055 raft_consensus.cc:2393] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 10: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:00.247185 11054 raft_consensus.cc:2410] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:25:00.247697 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:00.252103 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:00.250774 11644 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:00.248672 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:00.183075 14913 consensus_queue.cc:1048] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 12:25:00.231258 15020 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:00.288452 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:00.230079 14873 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.289184 11058 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:25:00.224187 15024 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:25:00.299671 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 43980.1us
W20260709 12:25:00.303133 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 70864.2us
W20260709 12:25:00.299731 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 49068.7us
I20260709 12:25:00.242501 14700 raft_consensus.cc:2749] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:00.301311 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 182007us
I20260709 12:25:00.241858 14907 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.314816 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:00.316486 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.317287 11644 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:00.318979 10979 raft_consensus.cc:1275] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:00.319346 10975 raft_consensus.cc:1240] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:00.316355 11052 raft_consensus.cc:2410] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:25:00.284250 14449 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:00.234485 14945 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:00.330610 11677 raft_consensus.cc:1240] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:00.315218 14784 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:00.302589 14893 raft_consensus.cc:2749] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:00.322570 10881 catalog_manager.cc:5697] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 5 to 6, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 6 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:00.326596 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:00.355006 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:00.335479 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.299520 15020 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:00.301695 11054 raft_consensus.cc:1275] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:00.327342 15037 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:00.356932 11052 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
W20260709 12:25:00.323745 14942 log.cc:927] Time spent T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 2.174s	user 0.003s	sys 0.037s
I20260709 12:25:00.402804 11051 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:25:00.330199 14356 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.501245 14356 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:00.501597 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:00.502511 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 177892us
I20260709 12:25:00.503149 11051 raft_consensus.cc:1275] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:00.330817 15036 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:00.329433 15024 raft_consensus.cc:697] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:25:00.409730 15029 log.cc:927] Time spent T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:25:00.316092 14873 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:00.323449 14907 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:00.339087 14914 raft_consensus.cc:2749] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:00.417045 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:00.417882 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.497567 14851 raft_consensus.cc:697] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 9 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:00.358848 15037 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:00.356186 15025 consensus_queue.cc:1059] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:25:00.432003 11060 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
W20260709 12:25:00.432642 15027 log.cc:927] Time spent T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:25:00.435380 14945 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:00.525857 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:00.380858 14872 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:00.448863 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.450932 11678 raft_consensus.cc:1275] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:00.452451 10983 raft_consensus.cc:1275] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:25:00.528780 10983 pending_rounds.cc:85] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 5
I20260709 12:25:00.529071 10983 pending_rounds.cc:107] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:25:00.529320 10983 raft_consensus.cc:2889] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:00.453891 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:00.359489 14969 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:00.493634 14718 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:00.379253 10881 catalog_manager.cc:5697] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 6 to 7, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 7 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:00.505017 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:00.515882 14356 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:00.507799 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 190606us
I20260709 12:25:00.514796 10948 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:00.353902 14784 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:00.523409 11051 raft_consensus.cc:1275] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:00.439235 14854 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:00.530356 11672 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
W20260709 12:25:00.544425 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.578698 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:00.593640 10975 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:25:00.503490 11023 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:00.631338 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:00.522855 15037 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:00.596886 11098 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
W20260709 12:25:00.602789 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 88074.5us
W20260709 12:25:00.595537 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.632220 11678 raft_consensus.cc:2410] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:25:00.632717 11053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:53272 (request call id 29) took 1423 ms. Trace:
W20260709 12:25:00.636910 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:00.651127 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:00.651850 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 55063.3us
I20260709 12:25:00.636451 10948 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:25:00.654772 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 151386us
I20260709 12:25:00.524735 15014 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:00.658663 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:00.637454 11053 rpcz_store.cc:276] 0709 12:24:59.205891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.206219 (+   328us) service_pool.cc:224] Handling call
0709 12:25:00.629410 (+1423191us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b54002dee54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bdde853 00007f8f90dac60a 00007f8f8a3327d4 00007f8f8a332762 00007f8f8a332691 00007f8f8a33260c 00007f8f8a3318c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:00.629531 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85947648}
I20260709 12:25:00.653062 11098 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:00.663897 10881 catalog_manager.cc:5697] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 3 to 5, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 5 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:00.629112 14850 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:00.523278 15036 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:00.601711 14718 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:00.629858 14784 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:00.631428 15047 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:00.674762 11098 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:00.593461 14872 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:00.660658 14700 raft_consensus.cc:2764] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:25:00.689437 11057 raft_consensus.cc:1240] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:00.602736 14945 consensus_queue.cc:1059] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 12:25:00.636129 15042 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:00.688084  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:25:00.668603 15053 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:00.676834 14854 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.697945 11023 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:00.669881 14947 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:00.690084 11098 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:00.686285 10881 catalog_manager.cc:5697] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 5 to 8, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 8 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:00.680186 14356 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:00.707034  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:00.671460 15045 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:25:00.824635 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 134663us
W20260709 12:25:00.824925 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 127084us
I20260709 12:25:00.850840 14873 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:00.676985 15040 consensus_queue.cc:1048] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.151s
W20260709 12:25:00.865291 14896 consensus_meta.cc:287] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.816s	user 0.009s	sys 0.000s
I20260709 12:25:00.865900 11673 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:00.650395 15024 consensus_queue.cc:237] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:00.694300 15047 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:00.825382 14854 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:00.876461 14854 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:00.877103 14854 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:00.878675 14907 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:00.879504 14907 consensus_queue.cc:1048] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:00.680572 14850 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:00.882244 15045 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:00.884814 15045 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:00.677584 14851 consensus_queue.cc:237] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:00.892360 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:00.877594 14854 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:00.702836 15036 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:00.931137 15023 consensus_meta.cc:287] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.819s	user 0.011s	sys 0.000s
I20260709 12:25:00.893157 11053 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:25:00.777895 15053 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:00.888608 14685 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.936198 10881 catalog_manager.cc:5697] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:00.891934 14850 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:00.779438 14947 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:00.888936 15025 raft_consensus.cc:2804] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:25:00.890739 15039 log.cc:927] Time spent T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
W20260709 12:25:00.937745 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 111071us
I20260709 12:25:00.891131 14945 raft_consensus.cc:2749] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:00.964046 11673 raft_consensus.cc:1275] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:00.966650 14896 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.919843 15040 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.980799 14947 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:00.943981 15036 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:01.028389 15047 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:01.035498 10881 catalog_manager.cc:5697] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 2 to 6, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 6 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:00.981155 15025 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:00.952278 15053 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:01.042691 10881 catalog_manager.cc:5697] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:00.694569 14911 raft_consensus.cc:2749] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:00.987466 14871 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.052161 15025 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:01.058508 15054 log.cc:927] Time spent T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 12:25:01.059481 15052 log.cc:927] Time spent T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:25:01.060365  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:01.063141 15037 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:01.065766 15037 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:01.067644 15020 consensus_meta.cc:287] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.653s	user 0.006s	sys 0.004s
I20260709 12:25:01.046541 15058 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.999949 14850 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:01.038566 14872 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:01.040956 15047 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:00.973649 14685 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:01.009506 14896 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:01.101372 14896 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:01.079500 14871 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:01.039016 15036 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:01.046996 14464 consensus_queue.cc:1059] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:25:01.034566 15040 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:01.118348 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:01.119207 11053 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
I20260709 12:25:01.091019 14718 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:01.124416 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 296842us
I20260709 12:25:01.127156 10881 catalog_manager.cc:5697] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 2 to 7, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 7 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:01.126849 11098 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:01.129236 11644 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:01.131933 11098 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
W20260709 12:25:01.134990 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 356477us
I20260709 12:25:01.087354 15020 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:01.121398 15014 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:01.091874 14850 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:01.137765 14911 raft_consensus.cc:2804] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:01.139569 11098 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:01.126930 15044 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.088114 15058 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:01.133664 14872 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:01.105420 15047 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:01.141808 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:01.143081 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.125432 15038 raft_consensus.cc:3055] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:01.146266 10881 catalog_manager.cc:5697] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:01.140111 14945 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:01.167248 11125 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
W20260709 12:25:01.168615 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 161461us
I20260709 12:25:01.172807 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:01.173393 11023 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:01.174484 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:01.175052 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:01.159942 14911 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:01.176673 14911 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:01.177487 15066 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:01.178213 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:01.178047 15066 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:01.180277 15066 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:01.180781 15066 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.180862 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:01.181236 15066 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:01.159783 15059 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:01.186232 15059 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:01.186679 15059 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:01.186956 15040 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:01.187534 15066 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:01.187835 15058 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:01.167160 15044 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:01.189200 14850 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:01.168071 14872 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:01.190088 14872 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:01.190668 15044 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:01.159670 15041 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.191596 15041 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:01.194231 15041 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:01.184621 15047 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:01.196983 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.143411 14685 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:01.203176 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.204205 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:01.205256 11098 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:01.204887 11051 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:25:01.169410 14854 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:01.166471 15042 raft_consensus.cc:697] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:01.169140 15038 raft_consensus.cc:740] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:25:01.253875 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 52180.7us
I20260709 12:25:01.168524 15065 raft_consensus.cc:2804] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:01.185881 15025 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:01.257588 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:01.258037 15025 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:01.256155 15065 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:01.263211 15065 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:01.263844 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:01.264240 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:01.265130 10980 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
W20260709 12:25:01.267899 15004 log.cc:927] Time spent T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 1.585s	user 0.015s	sys 0.006s
I20260709 12:25:01.268502 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:01.269851 10975 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:25:01.265897 15036 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:01.271111 15030 log.cc:927] Time spent T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.971s	user 0.001s	sys 0.018s
I20260709 12:25:01.212174 15040 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:01.271138 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:25:01.273739 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 74701.8us
I20260709 12:25:01.261696 15075 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:01.278800 14695 raft_consensus.cc:3055] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:01.279268 14695 raft_consensus.cc:740] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:25:01.282227 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 75879us
W20260709 12:25:01.262838 14784 consensus_meta.cc:287] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.566s	user 0.006s	sys 0.003s
I20260709 12:25:01.272822 10979 raft_consensus.cc:1240] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:01.284744 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:01.288002 11098 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:01.286229 15036 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:01.262279 15059 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:01.289259 15036 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:01.252856 15024 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.288887 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:01.292294 10980 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:25:01.292457 15036 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:01.291615 15024 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:01.295217 15025 consensus_queue.cc:1059] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:01.293623 10975 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:01.297796 14849 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:01.298658 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:01.299701 15038 consensus_queue.cc:260] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:01.280130 14695 consensus_queue.cc:260] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:01.302621 11644 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:01.304277 11023 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:01.305270 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:01.321633 10975 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:25:01.295598 15024 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:01.259267 15070 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.252761 14945 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:01.291435 15059 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:01.310552 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 98636.9us
I20260709 12:25:01.316910 14854 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:01.318288 10984 raft_consensus.cc:1240] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:25:01.281805 15040 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:01.342746 15040 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:01.344728 14854 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:01.322052 10976 raft_consensus.cc:1240] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:01.347084 14854 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:01.307938 14784 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:01.331413 15070 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:01.352113 15070 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:01.353561 11052 raft_consensus.cc:1240] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:01.326064 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:01.322026 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:01.326253 10980 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:25:01.312201 15075 raft_consensus.cc:697] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:01.336448 11126 raft_consensus.cc:1275] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:25:01.324918 15038 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:01.355695 11126 pending_rounds.cc:85] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 8
W20260709 12:25:01.337587 10948 leader_election.cc:336] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Timed out: RequestConsensusVote RPC to 127.9.145.194:44483 timed out after 1.698s (SENT)
I20260709 12:25:01.338349 15020 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:01.338692 15042 consensus_queue.cc:237] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:01.341673 14767 raft_consensus.cc:3055] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:01.327227 14695 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:01.349977 14784 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:01.356005 11126 pending_rounds.cc:107] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:25:01.374289 11126 raft_consensus.cc:2889] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:01.374748 11126 pending_rounds.cc:107] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:25:01.374994 11126 raft_consensus.cc:2889] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:01.375437 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:01.336751 14402 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:01.355535 10979 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:25:01.349472 14871 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:01.349473 14872 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:01.362920 15075 consensus_queue.cc:237] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:01.322635 14947 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:01.331343 14945 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:01.327558 15041 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:01.356369 10948 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:01.369565 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:01.388144 11054 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
I20260709 12:25:01.329659 15044 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:01.337456 15074 raft_consensus.cc:2749] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:01.388332 15041 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:01.389531 15041 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:01.389945 14872 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:01.390631 11644 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:01.384498 15040 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:01.391994 14871 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:01.392222 11051 raft_consensus.cc:2393] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 13: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:01.392498 14871 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:01.392966 14871 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:01.395394 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 107477us
I20260709 12:25:01.372081 14767 raft_consensus.cc:740] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:01.322521 14911 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:01.378901 15020 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:01.396809 11098 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:01.399242 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 61689.2us
I20260709 12:25:01.404430 10979 raft_consensus.cc:1275] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:01.402474 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:01.404395 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:25:01.407275 10948 leader_election.cc:336] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Timed out: RequestConsensusVote RPC to 127.9.145.194:44483 timed out after 1.727s (SENT)
I20260709 12:25:01.407721 11098 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:01.404551 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 72940.1us
I20260709 12:25:01.394560 15044 raft_consensus.cc:697] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:01.418757 15044 consensus_queue.cc:237] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:01.409341 11645 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:01.423550 15072 raft_consensus.cc:2804] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:01.424027 15072 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:01.424400 15072 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:01.410032 14911 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:01.410184 14872 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:01.410562 15077 raft_consensus.cc:2749] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:01.411791 11098 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:01.401975 14854 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:01.412261 14919 consensus_queue.cc:1048] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:01.434608 11681 raft_consensus.cc:1240] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:01.405036 15020 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:01.408672 15074 raft_consensus.cc:2749] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:01.429795 14743 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.430392 14948 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:01.436846 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1613) took 1642 ms. Trace:
I20260709 12:25:01.439323 11057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 580) took 1270 ms. Trace:
W20260709 12:25:01.442792 15032 log.cc:927] Time spent T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 1.104s	user 0.005s	sys 0.003s
I20260709 12:25:01.432267 14872 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:01.454142 11057 rpcz_store.cc:276] 0709 12:25:00.169299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.306304 (+137005us) service_pool.cc:224] Handling call
0709 12:25:00.306761 (+   457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.695355 (+388594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.439066 (+743711us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b54000b6dd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:01.439261 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":879586560}
I20260709 12:25:01.461556 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:01.453841 10982 rpcz_store.cc:276] 0709 12:24:59.794752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.395412 (+1600660us) service_pool.cc:224] Handling call
0709 12:25:01.395745 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.395954 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:01.396195 (+   241us) log.cc:844] Serialized 14 byte log entry
0709 12:25:01.436363 (+ 40168us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:01.436415 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:01.436469 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.436656 (+   187us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:01.436782 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1409,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":370,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"thread_start_us":39783,"threads_started":1}
I20260709 12:25:01.457069 11677 raft_consensus.cc:1240] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:25:01.454321 15065 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:01.466861 14961 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.458633 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:01.467528 14961 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:01.468205 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:01.468806 11053 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:25:01.469625 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:01.467011 15065 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:01.470145 11053 raft_consensus.cc:2376] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bc01179655564f29b83babe396377cbb in term 11. Re-sending same reply.
I20260709 12:25:01.471002 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:01.471268 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:01.471693 11053 raft_consensus.cc:2393] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 11: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:01.472157 14961 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:01.458591 14743 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:01.476671 14743 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:01.473647 10948 leader_election.cc:336] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Timed out: RequestConsensusVote RPC to 127.9.145.194:44483 timed out after 1.839s (SENT)
I20260709 12:25:01.477603 14767 consensus_queue.cc:260] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:01.488736 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:01.489451 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:01.490183 10982 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:01.494217 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:01.499029 11098 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:01.487838 14767 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:01.503234 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:01.508271 11060 raft_consensus.cc:2393] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 10: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:01.510470 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:01.510686 11098 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:01.484498 14945 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:01.488665 15036 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:01.519933 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:01.520601 11675 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:01.504851 14872 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.519788 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:01.512871 15065 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:01.531025 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:01.532766 11060 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:01.533298 11672 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:25:01.534703 11098 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:01.512310 15047 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:01.518424 14919 raft_consensus.cc:2804] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:01.543351 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1618) took 1515 ms. Trace:
I20260709 12:25:01.540004 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:01.518050 15040 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:01.547974 11060 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:25:01.543753 10978 rpcz_store.cc:276] 0709 12:25:00.028075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.028243 (+   168us) service_pool.cc:224] Handling call
0709 12:25:00.028641 (+   398us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:00.029075 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:00.029104 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:00.032257 (+  3153us) log.cc:844] Serialized 52 byte log entry
0709 12:25:00.211419 (+179162us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:25:00.211469 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.211558 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:01.442179 (+1230621us) spinlock_profiling.cc:243] Waited 6.76 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:25:01.536213 (+ 94034us) raft_consensus.cc:1685] finished
0709 12:25:01.536234 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:01.543279 (+  7045us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":660,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":4201,"spinlock_wait_cycles":15552896,"thread_start_us":144828,"threads_started":1,"wal-append.queue_time_us":216981}
I20260709 12:25:01.514410 15074 consensus_queue.cc:1059] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:25:01.556288 11056 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
I20260709 12:25:01.549713 11098 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:01.558660 10978 raft_consensus.cc:1240] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:01.560631 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:01.561750 11054 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 13.
I20260709 12:25:01.562981 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:01.564054 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:01.564695 11054 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:25:01.565531 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:01.566640 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:01.540953 14945 raft_consensus.cc:2804] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:01.567335 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:01.568128 11060 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:01.523159 15036 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:01.542786 14919 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:01.570079 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:01.571712 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:01.572717 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:01.579941 11060 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
W20260709 12:25:01.580461 15033 log.cc:927] Time spent T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 1.159s	user 0.011s	sys 0.000s
I20260709 12:25:01.581173 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:01.581895 11060 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:25:01.582477 11674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 786) took 1512 ms. Trace:
I20260709 12:25:01.536618 14872 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:01.560297 15065 raft_consensus.cc:2804] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:01.583654 14947 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:01.583230 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:01.585106 14872 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:01.585246 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:01.585800 10948 leader_election.cc:336] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Timed out: RequestConsensusVote RPC to 127.9.145.194:44483 timed out after 1.516s (SENT)
I20260709 12:25:01.583335 15065 raft_consensus.cc:697] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:01.587680 15065 consensus_queue.cc:237] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:01.587848 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:01.575664 15036 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:01.599321 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:01.614295 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.581331 11675 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:25:01.558509 14685 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:01.635808 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.582866 11674 rpcz_store.cc:276] 0709 12:25:00.069639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.069750 (+   111us) service_pool.cc:224] Handling call
0709 12:25:00.070080 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:00.071465 (+  1385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:00.071493 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:00.071922 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 12:25:00.251603 (+179681us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:00.251649 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.251720 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:01.579862 (+1328142us) spinlock_profiling.cc:243] Waited 5.89 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:25:01.582179 (+  2317us) raft_consensus.cc:1685] finished
0709 12:25:01.582200 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:01.582420 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73052,"raft.queue_time_us":954,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":5996,"spinlock_wait_cycles":13537024,"thread_start_us":179270,"threads_started":1,"wal-append.queue_time_us":250943}
I20260709 12:25:01.545118 15047 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:01.571910 14919 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:01.662772 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:01.572598 14945 raft_consensus.cc:697] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:01.703860 14872 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.704444 14872 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:01.706651 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:01.708001 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:01.709152 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:01.718237 11054 raft_consensus.cc:2410] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:25:01.742537 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:01.743548 11057 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:01.744755 11677 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
W20260709 12:25:01.748349 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.666889 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:01.777422 11672 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEARNER]: Advancing to term 11
W20260709 12:25:01.809010 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.666229 15040 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:01.676769 14903 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:01.674647 14961 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:01.863371 11130 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 2273) took 2181 ms (client timeout 1672 ms). Trace:
W20260709 12:25:01.868186 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 72770us
W20260709 12:25:01.876590 11130 rpcz_store.cc:269] 0709 12:24:59.682301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.786411 (+104110us) service_pool.cc:224] Handling call
0709 12:25:01.863107 (+2076696us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b5400067054. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:01.863293 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":616915840}
I20260709 12:25:01.885146 11672 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 LEARNER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:25:01.892243 15047 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:01.903271 14945 consensus_queue.cc:237] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:01.907508 14872 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:01.911113 15053 consensus_meta.cc:287] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.841s	user 0.011s	sys 0.000s
I20260709 12:25:01.911753 15053 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:01.913007 10981 raft_consensus.cc:1240] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:01.663285 14685 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:01.915185 14961 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:01.917667 14961 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:01.863097 15072 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:01.920751 15072 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:01.746265 14871 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:01.928521 14871 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:01.930994 14695 consensus_meta.cc:287] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.000s
I20260709 12:25:01.932199 11060 raft_consensus.cc:2410] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:25:01.668663 15041 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:01.939451 15041 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:01.941175 10978 raft_consensus.cc:1275] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:25:01.888149 14903 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:01.949586 14903 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:01.950417 11681 raft_consensus.cc:1240] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:25:01.963081 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:01.963917 11125 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:01.982298 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:01.984321 11133 raft_consensus.cc:1240] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:01.860387 15036 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.979370 11057 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
I20260709 12:25:01.875228 15082 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:01.989391 11131 raft_consensus.cc:1240] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:01.974997 14947 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:01.978291 11127 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:36582
I20260709 12:25:01.995226 11127 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:01.995671 11127 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:01.997915 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:02.001407 11125 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:02.003046 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:01.889228 15040 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:02.014830 11057 raft_consensus.cc:2410] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:25:02.007119 15053 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:01.997972 14947 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:01.994885 15082 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:02.024096 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:02.031167 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:25:02.032357 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.033293 11025 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:01.992326 15036 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:02.037415 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:02.037760 11025 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:02.040544 14967 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.041200 11025 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:02.042148 14967 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:02.042487 14960 raft_consensus.cc:2749] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:02.043308 15014 raft_consensus.cc:3055] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:02.043771 15014 raft_consensus.cc:740] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:02.044381 14967 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:02.044734 15014 consensus_queue.cc:260] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:02.045235 11025 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:02.046432 14742 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:02.046854 14742 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:02.047206 14742 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:02.047082 14960 consensus_queue.cc:1048] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:02.049657 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:02.050472 14402 raft_consensus.cc:2804] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:02.050935 14946 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:02.053200 11025 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:02.032015 15005 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:02.045296 11058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1561) took 1889 ms. Trace:
I20260709 12:25:02.050935 14402 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:02.054164 15005 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:02.054895 14402 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:02.056710 15005 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:02.057705 14960 raft_consensus.cc:2749] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:02.058617 15038 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:02.059094 15038 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:02.059460 15038 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:02.060248 15082 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:02.058650 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:02.062256 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:02.062901 11131 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
I20260709 12:25:02.064842 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:02.066152 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:02.071708 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:02.067164 11055 raft_consensus.cc:1240] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:02.072804 11055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1841) took 1928 ms. Trace:
I20260709 12:25:02.030652 14695 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.074014 14695 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:02.076618 14695 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:02.054515 11058 rpcz_store.cc:276] 0709 12:25:00.155715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.320425 (+164710us) service_pool.cc:224] Handling call
0709 12:25:00.326166 (+  5741us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.331348 (+  5182us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:00.357722 (+ 26374us) log.cc:844] Serialized 14 byte log entry
0709 12:25:00.506845 (+149123us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:00.506898 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:00.506958 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.045041 (+1538083us) spinlock_profiling.cc:243] Waited 4.94 ms on lock 0x7b5400300cd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:02.045104 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:02.045235 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27580,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":212,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":154,"spinlock_wait_cycles":11392640,"thread_start_us":148772,"threads_started":1,"wal-append.queue_time_us":148810,"wal-append.run_cpu_time_us":1097,"wal-append.run_wall_time_us":1003327}
I20260709 12:25:02.077872 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:02.078706 11058 raft_consensus.cc:2393] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 10: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:02.079566 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:02.080127 11058 raft_consensus.cc:2376] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bc01179655564f29b83babe396377cbb in term 12. Re-sending same reply.
I20260709 12:25:02.081032 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:02.082264 11053 raft_consensus.cc:2376] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bc01179655564f29b83babe396377cbb in term 11. Re-sending same reply.
I20260709 12:25:02.084955 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:02.066576 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:02.086843 11059 raft_consensus.cc:2410] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 12:25:02.087324 11059 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1845) took 1942 ms (client timeout 1984 ms). Trace:
W20260709 12:25:02.087713 11059 rpcz_store.cc:269] 0709 12:25:00.144907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.034968 (+1890061us) service_pool.cc:224] Handling call
0709 12:25:02.087256 (+ 52288us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:02.088923 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:02.073135 11055 rpcz_store.cc:276] 0709 12:25:00.143914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.035054 (+1891140us) service_pool.cc:224] Handling call
0709 12:25:02.040417 (+  5363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:02.072490 (+ 32073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.072738 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:02.091434 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:02.092388 11055 raft_consensus.cc:2393] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 11: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:02.093390 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:02.094123 11055 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:25:02.095570 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:02.097317 11058 raft_consensus.cc:1275] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:02.097996 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:02.104149 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:02.104858 10982 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:25:02.105786 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:02.106789 10982 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:25:02.106007 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:02.107595 10978 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:02.108494 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:02.109483 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:02.110152 10981 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:25:02.111748 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:02.112571 10982 raft_consensus.cc:2393] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 11: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
W20260709 12:25:02.114050 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.106997 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:02.117537 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:02.118747 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:02.119346 10982 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:25:02.117944 11673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 774) took 3447 ms. Trace:
I20260709 12:25:02.119969 11673 rpcz_store.cc:276] 0709 12:24:58.670608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.673269 (+  2661us) service_pool.cc:224] Handling call
0709 12:24:58.673597 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.984973 (+2311376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.117670 (+1132697us) spinlock_profiling.cc:243] Waited 2.19 s on lock 0x7b54004f47d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:02.117851 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5041525120}
I20260709 12:25:02.120752 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:02.121886 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:25:02.125411 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.128106 10980 raft_consensus.cc:1275] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:02.130950 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:02.131805 10977 raft_consensus.cc:2393] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 9: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:02.122498 10982 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:25:02.134132 15040 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:02.135267 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:02.136034 10979 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:25:02.140473 11023 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:02.142771 10978 raft_consensus.cc:1240] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:02.141916 11023 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:02.069147 14356 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.103348 15014 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:02.152490 14356 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:02.155218 14356 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:02.069870 15053 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.155989 15053 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:02.146370 11643 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:02.158457 14967 raft_consensus.cc:2804] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:02.159325 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:02.159947 11131 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:02.120200 15081 raft_consensus.cc:3055] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:02.151572 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:02.166074 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:02.167665 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:02.162473 15053 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:02.176561 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:02.177299 11677 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:02.171708 11023 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:02.174156 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:02.174763 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:02.173868 14967 raft_consensus.cc:697] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:02.157462 15038 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:02.111471 15047 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.168803 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:02.180912 10978 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
I20260709 12:25:02.184736 11060 raft_consensus.cc:2368] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12.
I20260709 12:25:02.175767 15070 consensus_queue.cc:1048] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:25:02.186522 14967 consensus_queue.cc:237] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:02.158386 14947 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:02.184082 11127 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:02.188429 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:02.163108 15081 raft_consensus.cc:740] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:02.166755 15040 raft_consensus.cc:2804] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:02.202867 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:02.217598 10979 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:02.170194 14871 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:02.209251 10978 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:25:02.219578 10982 raft_consensus.cc:1275] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:02.214071 11131 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
I20260709 12:25:02.139463 14742 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:02.220858 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:02.166589 15093 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:25:02.227491 15036 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:02.252091 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:02.252827 11129 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
I20260709 12:25:02.259260 10949 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:02.260844 10949 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:02.257501 11643 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:02.217234 15040 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:02.195281 15047 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:02.275704 11059 raft_consensus.cc:1275] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:02.275897 10981 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
W20260709 12:25:02.235615 14919 consensus_meta.cc:287] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.003s
I20260709 12:25:02.182317 14695 consensus_queue.cc:1059] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:25:02.236932 15081 consensus_queue.cc:260] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:02.240522 14742 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:02.246606 14464 raft_consensus.cc:2804] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:02.247885 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:02.252737 14871 raft_consensus.cc:697] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:02.264998 11643 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:02.227442 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:02.319160 10979 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:25:02.278473 10978 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
W20260709 12:25:02.324442 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 59527.1us
I20260709 12:25:02.264580 15036 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:02.321733 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:02.262776 15063 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.250768 11127 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:02.274999 10871 maintenance_manager.cc:419] P 67a911ac695143c380a7065b971eb9b7: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033823
I20260709 12:25:02.275022 15040 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:02.277482 14849 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:02.367692 11643 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:02.369186 11643 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:02.274497 15038 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:02.310810 15070 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:02.375100 11647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.028s	sys 0.083s
W20260709 12:25:02.376523 11647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.028s	sys 0.083s
I20260709 12:25:02.324625 14464 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:02.382390 14464 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:02.394441 14871 consensus_queue.cc:237] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:02.399454 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.407480 15047 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:02.408361 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:02.409152 11057 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:25:02.410159 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:02.410815 11057 raft_consensus.cc:3055] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:02.411108 11057 raft_consensus.cc:740] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:02.411849 11057 consensus_queue.cc:260] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:02.412724 11057 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:25:02.330564 15072 raft_consensus.cc:2804] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:02.413646 15072 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:02.414007 15072 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:02.329406 15036 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:02.418512 15036 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:02.422554 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:02.423305 11131 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:25:02.424285 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:02.425021 11131 raft_consensus.cc:2393] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 11: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:02.426302 15093 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:02.372475 15082 raft_consensus.cc:2804] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:02.425832 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:02.328438 15081 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:02.317238 14919 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:02.441226 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:02.442708 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:02.445003 11127 raft_consensus.cc:2393] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 8: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:02.445693 11131 raft_consensus.cc:2368] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 10. Current term is 11.
I20260709 12:25:02.446755 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:02.447467 11131 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:25:02.455843 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:02.432365 15047 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.453864 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:02.373624 15063 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:02.460368 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 395322us
I20260709 12:25:02.373878 14913 consensus_queue.cc:1048] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 12:25:02.461211 11127 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 10.
W20260709 12:25:02.459645 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 288017us
I20260709 12:25:02.472822 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:02.473562 11127 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:25:02.474545 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:02.475664 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:02.476368 11127 raft_consensus.cc:2393] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 8: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:02.484817 11057 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
W20260709 12:25:02.470530 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 408470us
I20260709 12:25:02.470495 11131 raft_consensus.cc:2368] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 10. Current term is 11.
I20260709 12:25:02.440788 14402 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:02.468963 15070 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.511667 11023 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:02.507831 11131 raft_consensus.cc:1275] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:02.509779 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:02.510051 11127 raft_consensus.cc:1275] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:02.469358 15093 raft_consensus.cc:697] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:02.470152 15082 raft_consensus.cc:697] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:25:02.527256 11134 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.029s	sys 0.070s
W20260709 12:25:02.530943 11134 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.030s	sys 0.070s
I20260709 12:25:02.508878 11097 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:02.540666 11097 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:02.462828 15047 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:02.508360 14872 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.518829 15021 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.483937 14695 consensus_queue.cc:1048] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
W20260709 12:25:02.568806 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.547243 15065 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:02.559165 14849 raft_consensus.cc:697] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 9 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:02.583861 11055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1583) took 1074 ms. Trace:
I20260709 12:25:02.594537 11055 rpcz_store.cc:276] 0709 12:25:01.509896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.094847 (+584951us) service_pool.cc:224] Handling call
0709 12:25:02.095184 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:02.102639 (+  7455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:02.102672 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:02.103190 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 12:25:02.459036 (+355846us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:02.459084 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.459159 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:02.583623 (+124464us) raft_consensus.cc:1685] finished
0709 12:25:02.583645 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:02.583796 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6959,"raft.queue_time_us":12188,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":5424,"thread_start_us":338836,"threads_started":1,"wal-append.queue_time_us":404488}
I20260709 12:25:02.585883 14402 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:02.568030 14872 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:02.570706 15021 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:02.559779 14947 consensus_queue.cc:1048] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:25:02.549703 15066 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:02.608906 14464 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:02.609403 15072 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:02.587200 14969 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:02.527426 15070 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:02.610320 15093 consensus_queue.cc:237] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:02.611387 14464 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:02.614323 15082 consensus_queue.cc:237] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:02.616449 15063 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:02.617161 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:02.651690 10979 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:25:02.617348 14919 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:02.613549 15040 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:02.574805 15038 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:25:02.618579 15098 log.cc:927] Time spent T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:25:02.631136 11130 raft_consensus.cc:1275] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:02.550321 11097 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:02.632565 11681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41774 (request call id 622) took 1194 ms. Trace:
I20260709 12:25:02.659139 11681 rpcz_store.cc:276] 0709 12:25:01.437783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.437945 (+   162us) service_pool.cc:224] Handling call
0709 12:25:01.438334 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:01.950928 (+512594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.632210 (+681282us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b54006315d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:02.632485 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1176953216}
I20260709 12:25:02.639914 15021 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:02.640846 15047 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:02.644573 14849 consensus_queue.cc:237] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:02.647104 15070 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:02.649444 14872 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:02.655687 15038 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:02.653293 11643 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:25:02.663039 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 113041us
W20260709 12:25:02.652993 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 141397us
I20260709 12:25:02.661201 14919 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:02.685477 15038 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:02.656690 15036 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:02.689147 11097 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:02.727707 11097 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:02.731657 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:25:02.734870 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.735162 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:02.736950 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:02.737563 10981 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:02.748235 11054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1868) took 1184 ms. Trace:
I20260709 12:25:02.748699 11054 rpcz_store.cc:276] 0709 12:25:01.563324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.572544 (+  9220us) service_pool.cc:224] Handling call
0709 12:25:02.747994 (+1175450us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b5400188dd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:02.748161 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":324286720}
W20260709 12:25:02.750200 11056 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1854) took 2537 ms (client timeout 2001 ms). Trace:
W20260709 12:25:02.750636 11056 rpcz_store.cc:269] 0709 12:25:00.213059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.215235 (+  2176us) service_pool.cc:224] Handling call
0709 12:25:02.749983 (+2534748us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54003205d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:02.750128 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3015929728}
W20260709 12:25:02.762385 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.764772 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2376) took 3566 ms. Trace:
I20260709 12:25:02.765266 10983 rpcz_store.cc:276] 0709 12:24:59.198481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.201370 (+  2889us) service_pool.cc:224] Handling call
0709 12:24:59.201697 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.529805 (+1328108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.764487 (+2234682us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54000da554. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:02.764696 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2875527424}
W20260709 12:25:02.771586 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 44095.5us
I20260709 12:25:02.719252 15118 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:02.726969 15076 raft_consensus.cc:2804] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:02.779595 11097 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:02.781649 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:02.785670 10980 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:02.726748 14960 consensus_queue.cc:1048] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:25:02.829156 10980 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:02.782869 10981 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:25:02.820127 11097 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:02.771364 14967 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.771062 14342 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:02.726413 14402 consensus_queue.cc:1059] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:25:02.777689 15065 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:02.781611 15118 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:02.785379 15076 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:02.849187 14907 raft_consensus.cc:2749] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:02.842206 14967 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:02.854614 11051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52804 (request call id 585) took 1531 ms. Trace:
I20260709 12:25:02.855158 11051 rpcz_store.cc:276] 0709 12:25:01.323224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.325780 (+  2556us) service_pool.cc:224] Handling call
0709 12:25:02.854399 (+1528619us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b54003007d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:02.854543 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86030080}
I20260709 12:25:02.855810 15040 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:02.856436 14967 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:02.851083 11097 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:02.849381 14402 raft_consensus.cc:3055] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:02.857440 14402 raft_consensus.cc:740] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:02.858301 14402 consensus_queue.cc:260] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:02.859526 14402 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:02.863744 11644 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:02.866055 14905 consensus_queue.cc:1059] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:02.867074 14905 raft_consensus.cc:2749] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:02.867568 15063 raft_consensus.cc:3055] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:02.868032 15063 raft_consensus.cc:740] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:02.868888 15063 consensus_queue.cc:260] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:02.870159 15063 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:02.861913 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.843070 14342 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:02.874856 11097 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:02.875233 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.836237 14947 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:02.841572 15065 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:02.882567 15021 raft_consensus.cc:2804] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:25:02.883601 15116 log.cc:927] Time spent T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:25:02.848745 15076 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:02.886415 14953 consensus_queue.cc:1059] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:25:02.887540 15123 log.cc:927] Time spent T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:25:02.888680 14685 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:02.890869 11053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1880) took 1324 ms. Trace:
I20260709 12:25:02.924577 11053 rpcz_store.cc:276] 0709 12:25:01.566485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.030894 (+464409us) service_pool.cc:224] Handling call
0709 12:25:02.890683 (+859789us) spinlock_profiling.cc:243] Waited 50.4 ms on lock 0x7b5400348354. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:02.890809 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115923712}
I20260709 12:25:02.891587 11058 raft_consensus.cc:1275] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:25:02.925040 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 44920.4us
I20260709 12:25:02.880270 11097 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:02.877439 14907 raft_consensus.cc:2749] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:02.899498 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:02.928472 11681 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:25:02.929461 14342 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:02.930341 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:02.900403 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:02.891587 15036 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:02.905794 15115 log.cc:927] Time spent T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:25:02.845610 15118 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:02.910982 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:02.936110 11677 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 10: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:02.837742 15119 consensus_queue.cc:1048] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:25:02.914919 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:02.908560 15021 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:02.918433 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:02.917738 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:25:02.924100 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.938422 11672 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 LEARNER]: Advancing to term 12
I20260709 12:25:02.875527 14969 consensus_queue.cc:1048] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:25:02.938145 11678 raft_consensus.cc:2393] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 13: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:02.927320 11024 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:02.931504 11060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41294 (request call id 1584) took 1361 ms. Trace:
I20260709 12:25:02.931782 10981 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:25:02.881295 14947 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:02.939754 11060 rpcz_store.cc:276] 0709 12:25:01.570375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.071410 (+501035us) service_pool.cc:224] Handling call
0709 12:25:02.931294 (+859884us) spinlock_profiling.cc:243] Waited 86.7 ms on lock 0x7b54003719d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:02.931436 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":199465344}
I20260709 12:25:02.940343 14947 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:02.909742 15065 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:02.943356 11024 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:02.944270 14695 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:02.944712 14695 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:02.945065 14695 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:02.946374 15021 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:02.939960 14960 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:02.938447 14907 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.950361 14907 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:02.951371 15072 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:02.937898 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:02.952600 14907 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:02.937510 14971 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:02.952895 11133 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:25:02.955515 14953 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:02.956056 14953 raft_consensus.cc:697] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:02.957075 11025 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:02.956889 14953 consensus_queue.cc:237] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:02.958339 11025 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:02.960250 14967 consensus_queue.cc:1059] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:02.953437 14971 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:02.961405 14967 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:02.961772 14700 raft_consensus.cc:3055] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:02.962834 14971 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:02.985745 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:02.986537 11056 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:25:02.987851 15074 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:02.988070 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:02.933992 15014 consensus_queue.cc:1048] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:25:02.988431 15074 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:02.963853 11052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1573) took 2297 ms. Trace:
I20260709 12:25:02.990253 15066 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.989621 11052 rpcz_store.cc:276] 0709 12:25:00.666334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.666507 (+   173us) service_pool.cc:224] Handling call
0709 12:25:00.666853 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.354118 (+687265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.963610 (+1609492us) spinlock_profiling.cc:243] Waited 686 ms on lock 0x7b54002de454. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:02.963792 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1578750336}
I20260709 12:25:02.990839 15066 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:02.991312 14969 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.991811 14969 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:02.993021 15066 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:02.993790 14969 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:02.972436 15103 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:02.973381 10981 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:25:02.975169 10949 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:02.979218 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:03.014463 11059 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:03.015065 10949 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:03.017040 10949 leader_election.cc:400] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 10. Current term is 11.
I20260709 12:25:03.017310 10949 leader_election.cc:403] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:02.976347 14700 raft_consensus.cc:740] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:03.019057 10949 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:03.019518 14700 consensus_queue.cc:260] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:02.980202 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:03.020201 10949 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:03.020762 11060 raft_consensus.cc:2393] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 8: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:03.021111 15114 raft_consensus.cc:2804] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:02.960594 14685 raft_consensus.cc:2749] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:02.980964 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:02.982079 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:03.022557 11051 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:25:02.984746 11672 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEARNER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:02.994006 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:03.023965 11125 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:03.025023 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:03.025493 11098 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:02.995005 15074 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:02.995950 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:03.021548 10949 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:02.997398 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:03.031890 11127 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:03.032557 10949 leader_election.cc:400] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 10. Current term is 11.
I20260709 12:25:03.032955 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:03.032968 10949 leader_election.cc:403] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:03.033722 11127 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
W20260709 12:25:02.999903 15121 log.cc:927] Time spent T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:25:02.651433  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:02.960507 14947 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:03.040102 11098 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:03.021626 15047 raft_consensus.cc:2804] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:03.011849 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 68594.6us
I20260709 12:25:03.011782 11133 raft_consensus.cc:2393] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 8: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:03.018296 15036 raft_consensus.cc:2749] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:03.017854 15053 raft_consensus.cc:2749] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:03.018378 14342 raft_consensus.cc:2749] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 10. Current term is 11.
I20260709 12:25:03.025933 11125 raft_consensus.cc:2410] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:25:03.052284 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:03.054486 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:03.055888 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:03.057080 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:02.997133 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:02.998090 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:03.057952 11131 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:03.035231 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:03.031170 11130 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:03.035909 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:03.044206 11098 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:03.060907 11127 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:03.005405 15076 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:03.083653 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:03.047798 11024 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:03.083778 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:03.084573 11672 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:25:03.084777 11024 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:03.036507 15066 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.021564 15114 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:03.089690 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:03.090492 11126 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:03.067183 11051 raft_consensus.cc:1275] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:03.069242 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:03.060578 11128 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:25:03.051149 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:03.092252 11060 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:25:03.038476 15005 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:03.043859 14700 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:03.022864 14969 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:03.036728 14945 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:03.089314 11134 raft_consensus.cc:1240] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:03.065289 11059 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:25:03.113709 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:03.099335 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:03.114699 11125 raft_consensus.cc:2393] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 8: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:03.045327 14967 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.012776 15038 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:03.041646 15074 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:03.102027 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:03.086953 14960 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.120507 11133 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:03.106796 15121 log.cc:927] Time spent T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:25:02.985878 15118 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:03.102085 11053 raft_consensus.cc:2393] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 12: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:03.104007 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:03.105620 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 208443us
I20260709 12:25:03.048820 14971 consensus_queue.cc:1059] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 12:25:03.116498 11127 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:03.114462 11128 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
I20260709 12:25:03.046731 15047 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:03.045931 15108 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:25:03.119450 15075 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:03.086287 15021 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:03.030484 15103 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:03.122901 11126 raft_consensus.cc:2410] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:25:03.104983 15130 raft_consensus.cc:2804] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:03.102236 11131 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:25:03.105780 15005 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.102989 15114 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:03.139842 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:03.141476 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:03.143812 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:03.115691 14919 raft_consensus.cc:2749] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:03.119052 11125 raft_consensus.cc:1275] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:25:03.043331 14619 consensus_queue.cc:1048] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:25:03.146008 14907 raft_consensus.cc:2804] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:03.158556 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:03.137771 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:03.193097 11053 raft_consensus.cc:2393] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 10: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:03.105542 15036 consensus_queue.cc:1048] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.032s
W20260709 12:25:03.166777 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 286577us
I20260709 12:25:03.117722 14969 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:03.152293 15075 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.175576 11133 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
I20260709 12:25:03.175751 11131 raft_consensus.cc:1240] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:03.204571 11131 raft_consensus.cc:1240] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:03.205591 11125 raft_consensus.cc:1240] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:03.123606 14967 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:03.176622 11673 raft_consensus.cc:1240] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:03.103619 15066 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:03.179260 10948 leader_election.cc:336] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Timed out: RequestConsensusVote RPC to 127.9.145.194:44483 timed out after 1.591s (SENT)
I20260709 12:25:03.181210 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:03.157574 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:03.207901 10948 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:03.208984 10948 connection.cc:256] RPC call timeout handler was delayed by -1.2118371030001072s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
W20260709 12:25:03.209600 10948 leader_election.cc:336] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Timed out: RequestConsensusVote RPC to 127.9.145.194:44483 timed out after 1.507s (SENT)
I20260709 12:25:03.144769 15047 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:03.136937 15074 raft_consensus.cc:697] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:03.195639 11130 raft_consensus.cc:1240] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []
W20260709 12:25:03.194157 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 132906us
I20260709 12:25:03.122083 15122 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:03.133272 14960 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:03.209980 10948 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:03.180862 15005 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:03.120415 14945 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:03.207901 15075 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:03.224038 14967 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:03.225862 15066 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:03.276496 11058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1864) took 1729 ms. Trace:
I20260709 12:25:03.284729 11058 rpcz_store.cc:276] 0709 12:25:01.547160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.098976 (+551816us) service_pool.cc:224] Handling call
0709 12:25:02.891240 (+792264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:02.925411 (+ 34171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.276278 (+350867us) spinlock_profiling.cc:243] Waited 792 ms on lock 0x7b5400348350. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:03.276429 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1821274496}
I20260709 12:25:03.226580 11128 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:03.202342 15117 log.cc:927] Time spent T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.361s	user 0.003s	sys 0.001s
W20260709 12:25:03.234001 10948 connection.cc:256] RPC call timeout handler was delayed by -1.1703061049997814s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
W20260709 12:25:03.316442 10948 connection.cc:256] RPC call timeout handler was delayed by -1.1337915980002435s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17300000000000001s for a response
W20260709 12:25:03.316865 10948 connection.cc:256] RPC call timeout handler was delayed by -1.076524614000391s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1801s for a response
W20260709 12:25:03.235127 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 150441us
I20260709 12:25:03.318574 11024 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:03.319916 11024 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:03.245057 15020 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:03.260335 15120 log.cc:927] Time spent T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.407s	user 0.000s	sys 0.001s
I20260709 12:25:03.261770 15081 raft_consensus.cc:3055] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:03.287302 14947 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:03.272284 15093 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:03.307654 15136 log.cc:927] Time spent T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:25:03.323038 10948 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:03.235961 14342 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:03.336762 10948 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:03.328879 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:03.331728 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:25:03.334640 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 297335us
I20260709 12:25:03.340226 10948 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:03.345014 11025 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:03.215497 14849 raft_consensus.cc:2749] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:03.350879 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:03.370639 11052 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:25:03.351529 11643 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:03.353669 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:03.372467 11051 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:03.359335 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:03.377175 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.379127 11025 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:03.380620 11025 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:03.330735 14967 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:03.389556 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:03.330222 15119 raft_consensus.cc:2749] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:03.399847 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:03.334080 15082 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.334381 15081 raft_consensus.cc:740] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:03.405952 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:03.407825 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:03.351004 15020 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:03.408833 11059 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 14.
I20260709 12:25:03.352620 15053 raft_consensus.cc:2764] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:25:03.416838 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:03.417634 11053 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:03.338210 15025 consensus_queue.cc:1059] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 12:25:03.395681 14905 raft_consensus.cc:2804] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:03.441676 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:03.407002 15104 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:03.444991 15104 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.350579 14619 consensus_queue.cc:1048] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
W20260709 12:25:03.446415 15134 log.cc:927] Time spent T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:25:03.446960 15104 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:03.448305 15131 log.cc:927] Time spent T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 12:25:03.449355 14695 consensus_meta.cc:287] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.504s	user 0.007s	sys 0.000s
I20260709 12:25:03.446703 14619 raft_consensus.cc:2749] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:03.450198 15053 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:03.450917 15053 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:03.459708 15081 consensus_queue.cc:260] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:03.461081 15081 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:03.445230 15021 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:03.461474 15104 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:03.418583 15136 log.cc:927] Time spent T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:25:03.516520 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 301578us
I20260709 12:25:03.548434 11051 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
I20260709 12:25:03.347077 15093 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:03.570528 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.412223 15076 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:03.418300 15119 raft_consensus.cc:2749] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:03.571769 11098 leader_election.cc:400] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12.
I20260709 12:25:03.574954 11098 leader_election.cc:403] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:25:03.419072 14784 raft_consensus.cc:2804] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:03.562575 11644 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:03.449824 14695 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:03.585220 11128 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:03.453152 15053 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:03.412407 15082 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:03.510701 14907 raft_consensus.cc:697] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:03.407754 14849 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.164s
I20260709 12:25:03.586491 14784 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:03.612174 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 271975us
I20260709 12:25:03.610360 11098 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:03.629172 10948 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:03.630879 10948 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:03.623011 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 60525.1us
W20260709 12:25:03.637753 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.638196 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:03.638214 10948 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:03.639204 11130 raft_consensus.cc:2393] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 11: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:03.643441 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:03.644162 10981 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:25:03.646611 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:03.651060 11098 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:03.651430 10948 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:03.650449 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:03.603736 15119 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.597793 14947 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:03.600485 15072 raft_consensus.cc:2749] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:03.624460 15021 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12.
I20260709 12:25:03.602069 15038 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:03.610247 15118 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:03.652796 11098 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:03.659749 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:03.483088 15074 consensus_queue.cc:237] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:03.663532 10978 raft_consensus.cc:2393] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 10: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:03.618778 14953 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:03.660629 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:03.618427 14919 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:03.637159 14784 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:03.661150 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:03.662941 10948 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:03.682320 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:03.652870 14969 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:03.664970 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:03.666265 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:03.666484 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:03.661948 15160 raft_consensus.cc:2749] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:03.655092 14971 consensus_queue.cc:1059] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:25:03.669107 15093 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:03.670918 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:03.713919 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:03.714569 10978 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:25:03.715399 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:03.716096 11097 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:03.680486 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:03.717159 11051 raft_consensus.cc:2393] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 12: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:03.650189 15053 raft_consensus.cc:2804] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:03.717922 15053 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:03.718360 15053 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:03.718905 10949 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:03.609702 15063 consensus_queue.cc:1059] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:25:03.722966 15063 raft_consensus.cc:3055] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:03.723346 15063 raft_consensus.cc:740] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:03.724180 15063 consensus_queue.cc:260] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:03.685860 10976 raft_consensus.cc:2368] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12.
I20260709 12:25:03.725867 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:03.726603 10976 raft_consensus.cc:2393] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 11: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:03.727316 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:25:03.664628 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 284083us
I20260709 12:25:03.684643 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:03.652733 15020 raft_consensus.cc:2749] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:03.672217 14619 raft_consensus.cc:2749] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:03.705368 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:03.691501 11129 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:25:03.706899 11057 raft_consensus.cc:1275] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:03.707679 11052 raft_consensus.cc:1240] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:03.732146 10983 raft_consensus.cc:1240] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:25:03.708545 11134 raft_consensus.cc:1275] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:03.663348 14905 raft_consensus.cc:697] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:25:03.711000 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 48134.4us
I20260709 12:25:03.738515 10948 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:03.670054 15118 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.692428 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:03.659060 15066 raft_consensus.cc:2804] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:03.690816 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:03.742241 11025 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:03.653180 15145 consensus_queue.cc:1048] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 12:25:03.709180 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:03.663872 15103 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:03.728267 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:25:03.736570 15147 log.cc:927] Time spent T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 12:25:03.739899 10984 raft_consensus.cc:2393] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 8: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:03.731392 15020 raft_consensus.cc:2749] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:03.742514 10980 raft_consensus.cc:1275] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:03.745021 11025 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:03.660373 15119 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:03.716511 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:03.737033 15157 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.751544 10948 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:03.732210 14619 raft_consensus.cc:2804] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:03.662444 14947 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:03.773018 14619 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:03.774379 14619 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:03.774938 14947 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:03.755707 11129 raft_consensus.cc:1275] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:03.757383 11097 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:03.689872 15151 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:03.769162 14872 raft_consensus.cc:2804] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:25:03.779946 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.739223 14960 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:03.689033 14919 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:03.780941 10948 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:03.743808 15066 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.782035 11097 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:03.692430 14953 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:03.786661 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:03.737321 15140 consensus_queue.cc:1048] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 12:25:03.797744 11130 raft_consensus.cc:1275] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:03.747025 14907 consensus_queue.cc:237] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:03.799372 15119 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:03.800863 15119 consensus_queue.cc:1059] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:03.783905 15152 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:03.803022 11051 raft_consensus.cc:1275] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:03.802634 15152 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:03.804100 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:03.804555 14971 raft_consensus.cc:2804] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:03.804957 14971 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:03.788842 15021 raft_consensus.cc:2749] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:03.782464 15151 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.784447 15157 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:03.806576 15151 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:03.765269 15076 raft_consensus.cc:3055] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:03.816527 15076 raft_consensus.cc:740] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:03.796465 15159 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:03.796626 14849 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:03.818985 14849 raft_consensus.cc:697] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:03.785470 14872 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:03.820065 14849 consensus_queue.cc:237] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:03.820565 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:03.821497 11052 raft_consensus.cc:2410] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:25:03.802518 15161 consensus_queue.cc:1048] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:25:03.820084 14872 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:03.824440 15053 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:03.825755 15005 consensus_meta.cc:287] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.541s	user 0.005s	sys 0.002s
I20260709 12:25:03.797149 15104 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:03.806155 15164 raft_consensus.cc:3055] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:03.796069 11645 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:03.779807 15148 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:03.746174 15154 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:03.805374 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:03.793848 10948 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:03.819208 15150 log.cc:927] Time spent T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:25:03.805303 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:03.856550 11056 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:03.746110 15118 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:03.813802 15157 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:03.805341 14971 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:03.794445 15066 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:03.817447 15076 consensus_queue.cc:260] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:03.826486 14905 consensus_queue.cc:237] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:03.766827 14945 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:03.832934 10976 raft_consensus.cc:2410] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:25:03.838917 11053 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
W20260709 12:25:03.849934 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 53945.5us
I20260709 12:25:03.780068 15144 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:03.864941 11645 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:03.787195 14700 consensus_meta.cc:287] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.672s	user 0.005s	sys 0.005s
W20260709 12:25:03.854691 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 60920.9us
I20260709 12:25:03.867183 10948 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:03.868875 10948 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:03.855194 15020 raft_consensus.cc:2749] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:03.830490 15159 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:03.812120 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:03.849042 15164 raft_consensus.cc:740] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:03.801788 15119 consensus_queue.cc:1059] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:25:03.855871 15154 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.828176 14695 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:03.864873 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 74431.4us
I20260709 12:25:03.810160 11057 raft_consensus.cc:1240] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 12. Current term is 13. Ops: []
W20260709 12:25:03.858462 15075 consensus_meta.cc:287] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.539s	user 0.009s	sys 0.000s
I20260709 12:25:03.853305 14449 raft_consensus.cc:2749] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:03.875352 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:03.789212 15103 raft_consensus.cc:2749] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:25:03.876534 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 157690us
I20260709 12:25:03.902925 10949 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:03.861769 15148 raft_consensus.cc:697] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:03.924822 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:03.810448 14947 consensus_queue.cc:1048] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:25:03.796329 15142 consensus_queue.cc:1059] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:25:03.923491 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:03.933101 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:03.909113 15160 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:03.935982 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:03.936677 11126 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:25:03.938024 11025 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:03.924063 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:03.906912 11097 leader_election.cc:400] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Vote denied by peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777) with higher term. Message: Invalid argument: T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12.
I20260709 12:25:03.890295 15104 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.940640 11097 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:03.882910 11098 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:03.907230 15065 consensus_meta.cc:287] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.966s	user 0.007s	sys 0.004s
I20260709 12:25:03.854795 15005 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:03.925130 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:03.929697 10980 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:25:03.877391 15163 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:03.945034 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:25:03.923494 15150 log.cc:927] Time spent T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:25:03.906703 15076 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:03.949630 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 66783.2us
I20260709 12:25:03.890749 15154 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:03.877439 14893 consensus_queue.cc:1048] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
W20260709 12:25:03.959595 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 90785.9us
I20260709 12:25:03.951552 15145 raft_consensus.cc:2749] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:03.926059 15020 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:03.959923 15169 raft_consensus.cc:3055] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:03.978941 15169 raft_consensus.cc:740] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:03.979878 15169 consensus_queue.cc:260] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:03.935324 15053 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:03.981161 15169 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:03.982276 15053 consensus_queue.cc:1048] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:25:03.984052 15114 consensus_meta.cc:287] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.789s	user 0.010s	sys 0.000s
I20260709 12:25:03.984536 15114 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:03.985677 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:25:03.996994 15047 consensus_meta.cc:287] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.762s	user 0.007s	sys 0.002s
I20260709 12:25:03.960282 11097 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:03.970685 10948 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:04.000911 11097 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:04.001422 10948 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:03.988076 15114 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:03.989692 11057 raft_consensus.cc:1275] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:03.906286 15075 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:03.990455 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.991705 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:03.992039 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:04.013742 11097 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:03.944206 15160 consensus_queue.cc:1059] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:25:03.993867 14953 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:04.014731 14953 raft_consensus.cc:2804] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:04.015141 14953 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:04.015527 14953 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:03.997582 11134 raft_consensus.cc:1275] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:03.907409 15144 raft_consensus.cc:2749] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:04.016839 10979 raft_consensus.cc:2393] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 12: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:03.968802 15119 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:04.017822 15144 raft_consensus.cc:2764] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:25:03.963217 15155 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:04.019472 15155 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:04.019924 15155 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:04.018965 15119 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:04.021428 15119 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:03.971525 11023 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:04.008613 10948 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:04.024888 10948 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:03.890144 15093 consensus_queue.cc:1048] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.061s
W20260709 12:25:03.984086 15156 log.cc:927] Time spent T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:25:03.947616 15163 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:03.982825 14402 consensus_meta.cc:287] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 1.123s	user 0.013s	sys 0.000s
W20260709 12:25:04.037039 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 65592.4us
I20260709 12:25:03.986743 15170 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
W20260709 12:25:03.976788 15135 log.cc:927] Time spent T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.795s	user 0.000s	sys 0.001s
I20260709 12:25:04.043054 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:04.069460 15172 raft_consensus.cc:2804] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:04.031196 15148 consensus_queue.cc:237] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:03.890595 15159 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:04.012247 14945 raft_consensus.cc:2749] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:04.101059 11126 raft_consensus.cc:2393] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 12: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:25:04.032099 15108 consensus_meta.cc:287] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.855s	user 0.007s	sys 0.003s
I20260709 12:25:03.951730 15104 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:03.950987 15065 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:04.111824 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 154321us
I20260709 12:25:04.038743 15163 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:04.064568 15122 consensus_meta.cc:287] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.830s	user 0.007s	sys 0.002s
I20260709 12:25:04.107035 15170 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:04.126034 11097 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:04.062268 15153 raft_consensus.cc:2749] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:04.071413 15114 raft_consensus.cc:3055] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:04.013196 15047 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:04.031510 14947 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 12:25:04.133838 11060 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 10.
I20260709 12:25:04.105058 14907 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.122563 15108 raft_consensus.cc:2749] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 10. Current term is 11.
I20260709 12:25:04.148494 11132 raft_consensus.cc:1240] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:25:04.100829 15172 raft_consensus.cc:697] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:03.971613 15151 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:04.135064 15157 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.071136 14784 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:04.031165 15144 consensus_queue.cc:1048] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 12:25:04.135681 14945 raft_consensus.cc:2749] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:04.140245 15122 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:04.104532 14619 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:04.200166 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 173111us
I20260709 12:25:04.142956 15114 raft_consensus.cc:740] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:04.006989 15164 consensus_queue.cc:260] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:04.067948 15146 consensus_queue.cc:1048] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.128s
I20260709 12:25:04.206482 11058 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
W20260709 12:25:04.172712 15057 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.003s	sys 0.014s
I20260709 12:25:04.168195 14969 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:25:04.208441 11130 raft_consensus.cc:1240] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:25:04.200107 15118 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:04.214816 10981 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:25:04.168416 14919 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:04.209465 15108 raft_consensus.cc:2749] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:04.143633 15154 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:04.214038 15057 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.009s	sys 0.014s
I20260709 12:25:04.225888 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:04.196826 15155 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:04.199963 14872 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:04.199437 15157 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:04.226605 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:04.235841 10980 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:04.172220 14907 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:04.237402 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:04.238137 10977 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:04.238672 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:04.239521 10980 raft_consensus.cc:2393] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 10: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
W20260709 12:25:04.228282 15081 consensus_meta.cc:287] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.767s	user 0.009s	sys 0.003s
I20260709 12:25:04.243819 11131 raft_consensus.cc:2393] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 15: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:04.242920 10980 raft_consensus.cc:1240] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:04.230947 15005 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:04.249925 10984 raft_consensus.cc:1240] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:04.251096 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:04.251649 10984 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:04.252643 10980 raft_consensus.cc:1240] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:25:04.254388 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:25:04.254781 15179 log.cc:927] Time spent T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:25:04.255455 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:04.259351 15166 raft_consensus.cc:3055] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:04.259904 15166 raft_consensus.cc:740] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:04.260315 15159 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:04.260776 15166 consensus_queue.cc:260] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:04.262127 15104 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:04.248291 15172 consensus_queue.cc:237] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:04.263859 15176 log.cc:927] Time spent T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
W20260709 12:25:04.264657 15177 log.cc:927] Time spent T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:25:04.231642 15181 raft_consensus.cc:2749] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:04.271148 10984 raft_consensus.cc:2410] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:25:04.283475 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:04.285686 10980 raft_consensus.cc:1240] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:04.284641 15047 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:04.280735 14464 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.287675 14619 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:04.287842 14464 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:04.262575 15065 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:04.280997 15144 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:25:04.290498 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:04.293990 11127 raft_consensus.cc:2393] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 8: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:04.252444 15075 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:04.298472 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:04.296489 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:04.233220 15114 consensus_queue.cc:260] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:04.297662 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 94327.2us
I20260709 12:25:04.309127 10980 raft_consensus.cc:1275] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:04.248226 15178 consensus_queue.cc:1048] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:25:04.305143 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:04.340834 10948 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:04.343039 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:04.343358 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:04.346125 11057 raft_consensus.cc:1240] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:25:04.340845 14464 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:04.348543 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:04.349347 11057 raft_consensus.cc:2393] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 10: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:04.350435 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:04.351155 11051 raft_consensus.cc:2368] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 11. Current term is 12.
I20260709 12:25:04.352751 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:04.353004 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:04.298849 15166 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:04.356417 11057 raft_consensus.cc:1240] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 12:25:04.357849 11023 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:04.358354 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:04.339890 14849 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.364441 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:04.365659 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:04.369388 11023 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:04.365926 15014 consensus_queue.cc:1059] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:25:04.372336 11023 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:04.372570 15014 raft_consensus.cc:2749] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:04.373291 15014 raft_consensus.cc:3055] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:04.373646 15014 raft_consensus.cc:740] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:04.372381 11058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52804 (request call id 590) took 1044 ms. Trace:
I20260709 12:25:04.374773 11058 rpcz_store.cc:276] 0709 12:25:03.327991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.328582 (+   591us) service_pool.cc:224] Handling call
0709 12:25:04.372212 (+1043630us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b54001892d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:04.372322 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1996219776}
I20260709 12:25:04.376200 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:04.358770 14784 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:04.374136 15161 consensus_queue.cc:1059] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:25:04.374270 14742 raft_consensus.cc:2749] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:04.362376 15005 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:04.401121 15005 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:04.402112 10982 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.854s	user 0.011s	sys 0.000s
W20260709 12:25:04.402483 10982 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.854s	user 0.011s	sys 0.000s
W20260709 12:25:04.407836 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.409554 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:04.411715 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:04.412508 11677 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:04.413738 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:04.414486 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:04.415161 11681 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:04.397351 15014 consensus_queue.cc:260] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:04.399066 15188 log.cc:927] Time spent T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:25:04.399959 15184 log.cc:927] Time spent T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:25:04.433799 11055 raft_consensus.cc:1240] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:04.434427 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:04.436075 11057 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:04.437139 15164 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:04.438462 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:04.440768 15108 raft_consensus.cc:2749] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:04.445627 15161 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.447216 15161 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:04.448050 14971 consensus_meta.cc:287] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.578s	user 0.008s	sys 0.001s
I20260709 12:25:04.448523 14971 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:04.449851 15161 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:04.450459 14907 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:04.451041 14872 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:04.452549 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:04.452711 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:04.453186 11055 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:04.421456 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 542) took 2154 ms. Trace:
I20260709 12:25:04.414528 11674 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:04.426590 15160 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:04.425911 15141 log.cc:927] Time spent T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.854s	user 0.002s	sys 0.000s
I20260709 12:25:04.367300 15151 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:04.453217 11058 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:04.366380 14905 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.429032 15163 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:04.457162 15157 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:04.454003 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:04.474849 11057 raft_consensus.cc:2393] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 12: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:04.462566 11673 raft_consensus.cc:1240] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:25:04.468964 11055 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:25:04.469188 11681 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:04.453773 10982 rpcz_store.cc:276] 0709 12:25:02.266589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.270676 (+  4087us) service_pool.cc:224] Handling call
0709 12:25:02.271037 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:02.271266 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:02.548078 (+276812us) log.cc:844] Serialized 14 byte log entry
0709 12:25:03.976212 (+1428134us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:25:04.421098 (+444886us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:04.421165 (+    67us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:04.421209 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.421281 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:04.421399 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18209,"prepare.queue_time_us":316327,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":24301,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":133,"spinlock_wait_cycles":31059712,"thread_start_us":2082516,"threads_started":2,"wal-append.queue_time_us":574166}
I20260709 12:25:04.471160 15151 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.464802 15154 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:04.471496 15155 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:04.474409 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 159050us
I20260709 12:25:04.493121 11644 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:04.480532 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:04.367424 14700 raft_consensus.cc:2804] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:04.482005 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:04.477552 14342 consensus_meta.cc:287] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 1.128s	user 0.006s	sys 0.006s
I20260709 12:25:04.459710 15005 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:04.500499 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:25:04.500711 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 126607us
I20260709 12:25:04.502990 11680 raft_consensus.cc:1240] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:04.371214 14849 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:04.499303 15118 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:04.502278 14700 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:04.465854 14953 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:04.502830 14342 raft_consensus.cc:2749] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:04.477910 15151 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:04.514633 15118 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:04.476727 14905 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:04.573648 15163 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:04.537977 11023 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:04.579483 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:04.631814 11133 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:04.631692 10980 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
W20260709 12:25:04.633810 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 95957.3us
I20260709 12:25:04.547948 14700 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:04.639842 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:04.642565 11053 raft_consensus.cc:1275] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:25:04.652278 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:04.652570 11057 raft_consensus.cc:1240] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:04.645915 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:04.654042 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:04.657794 11055 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
W20260709 12:25:04.637398 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 142957us
I20260709 12:25:04.660236 11644 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:04.658720 10982 raft_consensus.cc:1240] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:25:04.648614 10977 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:04.648667 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:04.662037 10984 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:25:04.646559 11133 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
I20260709 12:25:04.588785 15118 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:04.638218 15040 consensus_queue.cc:1048] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:25:04.664045 15163 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:04.665424 11644 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:04.663931 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:04.666714 15190 log.cc:927] Time spent T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 12:25:04.682466 15057 raft_consensus.cc:2749] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:04.665395 11645 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:04.683418 15057 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:04.688469 11672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41762 (request call id 800) took 1273 ms. Trace:
I20260709 12:25:04.688930 11672 rpcz_store.cc:276] 0709 12:25:03.414621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.415397 (+   776us) service_pool.cc:224] Handling call
0709 12:25:04.688266 (+1272869us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b5400583754. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:04.688406 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1833166208}
W20260709 12:25:04.695501 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.577452 14971 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:04.658835 14928 raft_consensus.cc:3055] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:04.698942 14928 raft_consensus.cc:740] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:04.699860 14928 consensus_queue.cc:260] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:04.690840 14700 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:04.700913 14928 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:04.702852 14700 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:04.673051 14948 consensus_queue.cc:1059] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:04.673743 15170 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:04.704494 15163 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:04.676174 15169 consensus_meta.cc:287] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.695s	user 0.026s	sys 0.000s
I20260709 12:25:04.676771 14893 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:04.677314 14905 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:04.636674 15198 raft_consensus.cc:2749] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:04.668342 14849 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:04.712172 11058 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 15.
I20260709 12:25:04.675720 15151 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:04.731719 11023 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:04.703020 14953 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:04.760331 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:04.761122 10977 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:04.713629 14971 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:04.729938 15119 consensus_meta.cc:287] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.708s	user 0.010s	sys 0.012s
W20260709 12:25:04.832964 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 101323us
I20260709 12:25:04.739032 14742 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.838291 11023 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:04.737311 15163 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:04.885474 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 281028us
I20260709 12:25:04.833120 15130 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:04.843598 15104 raft_consensus.cc:2804] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:04.895826 11130 raft_consensus.cc:1240] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12. Ops: []
W20260709 12:25:04.896347 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 64388.3us
I20260709 12:25:04.898888 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:04.899812 11130 raft_consensus.cc:2410] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:25:04.902807 10948 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:04.904320 10948 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:04.917516 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:04.889030 15146 raft_consensus.cc:2804] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:04.893911 15196 log.cc:927] Time spent T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.382s	user 0.001s	sys 0.000s
I20260709 12:25:04.890024 15160 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:04.836025 14971 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:04.889786 14947 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:04.846800 15172 consensus_queue.cc:1059] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:25:04.846062 15119 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:04.897156 15130 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:05.045296 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 141032us
I20260709 12:25:04.873245 14742 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:04.919133 15066 consensus_meta.cc:287] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 1.044s	user 0.016s	sys 0.005s
I20260709 12:25:04.916486 15104 raft_consensus.cc:697] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:04.914222 15005 consensus_queue.cc:1059] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:25:04.926293 15208 raft_consensus.cc:3055] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:04.928711 15170 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:05.060906 15204 log.cc:927] Time spent T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:25:05.060752 15170 consensus_queue.cc:1059] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:04.924065 14784 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:05.061888 14784 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:05.063637 14742 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:05.064229 14784 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:04.855652 10977 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
W20260709 12:25:05.064981 15205 log.cc:927] Time spent T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 12:25:05.065889 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1655) took 1398 ms. Trace:
I20260709 12:25:05.066321 10983 rpcz_store.cc:276] 0709 12:25:03.667852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.734995 (+ 67143us) service_pool.cc:224] Handling call
0709 12:25:03.735254 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.737566 (+  2312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:03.737597 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:03.737636 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:03.737666 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:05.065640 (+1327974us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b540022a954. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:05.065691 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:05.065834 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4885760}
W20260709 12:25:05.003338 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 109609us
W20260709 12:25:04.998718 15185 log.cc:927] Time spent T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 12:25:05.001098 15164 consensus_meta.cc:287] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.563s	user 0.014s	sys 0.017s
I20260709 12:25:04.949977 15198 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.995198 15075 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.998967 15057 raft_consensus.cc:697] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:05.074808 15104 consensus_queue.cc:237] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:05.075736 15057 consensus_queue.cc:237] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:05.060274 15208 raft_consensus.cc:740] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:25:05.033150 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.068768 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:05.079208 11672 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:05.049083 15169 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.069557 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 634) took 2148 ms. Trace:
W20260709 12:25:05.048211 15203 log.cc:927] Time spent T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:25:05.074846 15198 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:05.075978 15075 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:05.038899 15146 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:05.037403 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:05.047076 14849 raft_consensus.cc:2749] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:05.070462 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58414 (request call id 644) took 1378 ms. Trace:
I20260709 12:25:05.081646 11132 rpcz_store.cc:276] 0709 12:25:02.921493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.923660 (+  2167us) service_pool.cc:224] Handling call
0709 12:25:02.924041 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:04.171559 (+1247518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:05.069271 (+897712us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400374954. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:05.069489 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2815319296}
W20260709 12:25:05.065840 15200 log.cc:927] Time spent T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 12:25:05.087126 11130 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:25:05.101586 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:05.059598 14971 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:05.031702 15152 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:05.088779 11131 rpcz_store.cc:276] 0709 12:25:03.692062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.692184 (+   122us) service_pool.cc:224] Handling call
0709 12:25:05.070228 (+1378044us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b5400067054. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:05.070393 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1155461376}
I20260709 12:25:05.048017 14947 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:05.100134 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:05.103111 11130 raft_consensus.cc:1240] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:05.107506 11132 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:05.108657 11130 raft_consensus.cc:1240] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:05.111435 11130 raft_consensus.cc:1240] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:05.115840 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:05.088404 15146 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:05.052546 15066 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:05.083158 15169 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:05.137440 11132 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:05.121866 15082 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:05.143324 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:05.145793 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:05.146875 11678 raft_consensus.cc:1275] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:05.147536 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:05.147874 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:05.148346 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:05.150435 11673 raft_consensus.cc:1275] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:05.101233 15208 consensus_queue.cc:260] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:05.152948 11674 raft_consensus.cc:1240] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:25:05.145699 15119 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:05.156096 15198 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:05.154801 15219 consensus_queue.cc:1059] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:25:05.157475 15211 raft_consensus.cc:3055] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:05.157912 15211 raft_consensus.cc:740] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:05.161273 15211 consensus_queue.cc:260] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:05.162811 15211 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:05.165328 15118 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:05.167693 15169 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:05.172113 15118 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:05.168860 14947 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:05.169413 15075 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:05.170476 15066 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:05.177256 15163 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:05.167979 15206 log.cc:927] Time spent T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:25:05.168901 15208 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:05.173564 15130 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:05.180950 15146 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:05.181372 15130 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:05.183359 15146 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:05.172715 15166 consensus_meta.cc:287] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.809s	user 0.008s	sys 0.012s
I20260709 12:25:05.046494 10948 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:05.230623 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1660) took 1128 ms. Trace:
I20260709 12:25:05.231410 10979 rpcz_store.cc:276] 0709 12:25:03.923336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.924877 (+  1541us) service_pool.cc:224] Handling call
0709 12:25:05.051553 (+1126676us) spinlock_profiling.cc:243] Waited 74.5 ms on lock 0x7b54001a0c54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:05.051731 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171375360}
W20260709 12:25:05.241119 11098 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.006s	sys 0.003s
W20260709 12:25:05.241765 11098 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.006s	sys 0.003s
I20260709 12:25:05.251816 11129 raft_consensus.cc:1240] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:25:05.262871 11132 raft_consensus.cc:1275] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:25:05.263437 11132 pending_rounds.cc:85] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 7
I20260709 12:25:05.263747 11132 pending_rounds.cc:107] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:25:05.264140 11132 raft_consensus.cc:2889] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:05.242398 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 536524us
I20260709 12:25:05.265625 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:05.266784 11098 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:05.268359 11098 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:05.268559 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:05.270836 11130 raft_consensus.cc:1240] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:05.270978 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:05.271813 10977 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:05.266921 10982 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:05.274354 11024 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
W20260709 12:25:05.277928 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 231388us
I20260709 12:25:05.279146 11023 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:05.279610 10948 leader_election.cc:400] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 11. Current term is 12.
I20260709 12:25:05.280045 10948 leader_election.cc:403] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 12:25:05.280659 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.283124 11024 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:05.284344 11098 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:05.285923 11059 raft_consensus.cc:1275] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:25:05.285852 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:05.287184 11058 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 10.
I20260709 12:25:05.294528 11059 raft_consensus.cc:1240] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:25:05.285758 11024 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:05.274386 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:05.297049 10977 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:05.300776 11023 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:05.303022 11051 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
I20260709 12:25:05.303519 11024 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:05.308435 11024 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
W20260709 12:25:05.311813 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:05.313602 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 166038us
I20260709 12:25:05.314610 14971 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:05.315645 14971 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:05.314669 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:05.319161 11673 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:05.320922 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:05.321290 14784 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.322206 14784 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:05.323853 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:05.325330 14784 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:05.326195 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:05.326720 11675 raft_consensus.cc:2393] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 15: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:05.326424 14784 raft_consensus.cc:2804] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:05.327286 14784 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:05.322268 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:05.328065 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:05.329636 14685 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:05.330771 14685 raft_consensus.cc:2804] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:25:05.335253 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 47482.4us
I20260709 12:25:05.336419 11098 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:05.325335 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:05.327718 14784 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:05.327390 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:05.353637 10977 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
W20260709 12:25:05.352854 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 44675.2us
I20260709 12:25:05.354393 15065 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.358934 15065 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:05.348479 14971 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:05.353307 11023 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:05.366262 14849 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.367197 14849 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:05.367425 14941 consensus_queue.cc:1059] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:05.369213 11673 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:05.373638 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:25:05.374184 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 94990.7us
I20260709 12:25:05.375140 11678 raft_consensus.cc:2393] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 12: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:05.377095 11674 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:05.363723 15119 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:05.379467 15119 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:05.380003 15119 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:05.380934 14849 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:05.381788 14685 raft_consensus.cc:697] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:05.382838 15227 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:05.383261 11677 raft_consensus.cc:2410] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:25:05.384636 15226 raft_consensus.cc:2749] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 11. Current term is 12.
I20260709 12:25:05.385644 15226 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:25:05.386291 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 84241.7us
I20260709 12:25:05.386523 14872 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:05.386833 14742 raft_consensus.cc:2804] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:05.387274 14742 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:05.387346 15164 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:05.387681 14742 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:05.388367 15157 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:05.388962 15157 raft_consensus.cc:697] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:05.390488 15157 consensus_queue.cc:237] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:05.391456 11060 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1896) took 2250 ms (client timeout 2239 ms). Trace:
W20260709 12:25:05.392055 11060 rpcz_store.cc:269] 0709 12:25:03.141007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.141193 (+   186us) service_pool.cc:224] Handling call
0709 12:25:05.391059 (+2249866us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b54003e0654. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:05.391258 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1987674496}
I20260709 12:25:05.392768 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:25:05.394043 11126 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 2321) took 1582 ms (client timeout 2101 ms). Trace:
I20260709 12:25:05.394518 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:25:05.395304 11128 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 2309) took 2270 ms (client timeout 1746 ms). Trace:
W20260709 12:25:05.395886 11128 rpcz_store.cc:269] 0709 12:25:03.125054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.132555 (+  7501us) service_pool.cc:224] Handling call
0709 12:25:05.394942 (+2262387us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b5400067554. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:05.395115 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77996288}
I20260709 12:25:05.389139 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1638) took 1743 ms. Trace:
I20260709 12:25:05.390406 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 2440) took 1042 ms. Trace:
I20260709 12:25:05.365406 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:05.400283 15075 consensus_queue.cc:1059] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:25:05.394603 11126 rpcz_store.cc:269] 0709 12:25:03.811352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.944737 (+133385us) service_pool.cc:224] Handling call
0709 12:25:05.393606 (+1448869us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b5400106b54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:05.393839 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":284407040}
I20260709 12:25:05.402818 15152 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:05.403872 15130 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:05.400489 10980 rpcz_store.cc:276] 0709 12:25:04.348347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.375904 (+ 27557us) service_pool.cc:224] Handling call
0709 12:25:05.389978 (+1014074us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b540028aad4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:05.390218 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":585944448}
I20260709 12:25:05.405004 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:05.399544 10981 rpcz_store.cc:276] 0709 12:25:03.645170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.646357 (+  1187us) service_pool.cc:224] Handling call
0709 12:25:05.388803 (+1742446us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b5400334354. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:05.388969 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1280027520}
I20260709 12:25:05.392489 11059 raft_consensus.cc:1240] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:05.406828 15227 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:05.383285 14685 consensus_queue.cc:237] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:05.409685 15163 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:05.410755 11132 raft_consensus.cc:2393] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 15: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:05.411785 15066 consensus_queue.cc:1048] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:05.403118 15170 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:05.413177 15170 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:05.413910 15225 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:05.414883 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:05.414021 15065 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:05.406708 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:05.412392 11680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 804) took 1002 ms. Trace:
I20260709 12:25:05.395278 11675 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:25:05.417996 11680 rpcz_store.cc:276] 0709 12:25:04.409514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.410842 (+  1328us) service_pool.cc:224] Handling call
0709 12:25:04.411214 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:04.509944 (+ 98730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:05.411912 (+901968us) spinlock_profiling.cc:243] Waited 91.6 ms on lock 0x7b5400500fd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:05.412196 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210612608}
I20260709 12:25:05.404584 15130 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:05.409744 15227 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:05.399910 15005 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.462854 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:05.455026 11681 raft_consensus.cc:2368] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 10. Current term is 11.
I20260709 12:25:05.460502 11674 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 10.
I20260709 12:25:05.465988 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:05.464025 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:05.470436 15221 consensus_queue.cc:1048] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:25:05.470825 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:05.472265 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:05.399268 15148 consensus_queue.cc:1059] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.113s
W20260709 12:25:05.478209 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 142042us
I20260709 12:25:05.484184 15226 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:05.486927 15226 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:05.468986 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:05.412294 14849 consensus_queue.cc:1059] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:25:05.453044 15130 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:05.504876 14872 raft_consensus.cc:697] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:05.507279 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:05.472251 14947 raft_consensus.cc:2749] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:05.501996 11132 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:05.513852 15075 raft_consensus.cc:3055] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:05.514514 15075 raft_consensus.cc:740] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:05.515983 15075 consensus_queue.cc:260] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:05.518747 11677 raft_consensus.cc:1240] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:05.503695 11023 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:05.517962 15075 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:05.536481 15226 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.537547 15226 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:05.538632 15170 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:05.540436 15226 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:05.541257 15174 log.cc:927] Time spent T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 1.574s	user 0.012s	sys 0.000s
I20260709 12:25:05.551818 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:05.552663 11678 raft_consensus.cc:2393] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 12: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:05.536504 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:05.537343 15169 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:05.563905 14742 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:05.570212 11127 raft_consensus.cc:1240] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 12:25:05.506384 14872 consensus_queue.cc:237] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:05.593189 11126 raft_consensus.cc:1275] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:25:05.524863 15005 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:05.594411 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.561599 15164 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.596769 15163 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.551280 15066 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:05.595273 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:05.560837 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:06.557698 11130 raft_consensus.cc:2376] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12. Re-sending same reply.
I20260709 12:25:06.246974 11676 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 10.
W20260709 12:25:06.283818 11097 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 2.688s (SENT) [suppressed 27 similar messages]
I20260709 12:25:05.598650 11126 pending_rounds.cc:85] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 4
I20260709 12:25:06.562884 11126 pending_rounds.cc:107] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:25:06.381158 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1959) took 2597 ms. Trace:
W20260709 12:25:06.397882 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.563369 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:06.409763 15245 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:06.564755 15245 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:06.419107 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:06.419296 10977 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:06.565320 15122 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.420168 15246 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:06.566498 15246 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:06.567808 15260 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.568413 15260 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:06.568797 15246 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:06.421088 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:06.569689 10975 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 13.
I20260709 12:25:06.570839 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:06.571498 10975 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:25:06.422820 10976 raft_consensus.cc:1240] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:06.426577 15243 consensus_queue.cc:1059] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:06.428643 10949 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:06.566125 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:25:06.563081 11676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41784 (request call id 669) took 1242 ms (client timeout 1605 ms). Trace:
I20260709 12:25:06.429944 15249 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.578997 15260 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:06.578879 15249 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:06.583411 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 1.22448e+06us
I20260709 12:25:06.584189 15249 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:06.584936 11024 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:06.586350 15245 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:06.586809 11058 raft_consensus.cc:1240] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:06.467062 15253 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:06.588321 15253 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:06.590622 15253 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:06.467718 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:06.475791 11051 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1909) took 2123 ms (client timeout 1980 ms). Trace:
W20260709 12:25:06.591742 11051 rpcz_store.cc:269] 0709 12:25:04.352279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.352480 (+   201us) service_pool.cc:224] Handling call
0709 12:25:06.475493 (+2123013us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b54002788d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:06.475693 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2036485376}
I20260709 12:25:06.480252 11128 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:06.593528 14464 raft_consensus.cc:2804] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:06.594126 14464 raft_consensus.cc:697] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:06.595175 14464 consensus_queue.cc:237] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:06.494664 15257 consensus_queue.cc:1048] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:06.496773 15258 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:06.599501 15258 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:06.508212 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:06.602679 11059 raft_consensus.cc:2393] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 9: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:06.522230 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:06.604022 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:06.534621 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:06.535729 11134 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.957s	user 0.015s	sys 0.002s
W20260709 12:25:06.605108 11134 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.027s	user 0.015s	sys 0.003s
I20260709 12:25:06.605520 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:06.537038 10983 raft_consensus.cc:1275] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:06.606307 11133 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:25:06.607179 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:06.541512 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:05.638878 14742 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:06.411625 14849 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.724413 14849 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:05.657511 14872 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:06.727548 14872 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:06.438853 15036 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:06.731490 15036 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:05.633852 15066 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:05.643507 15119 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:06.778650 15119 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:05.643024 15005 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:06.442900 15053 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:06.782709 15053 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:06.353757 15149 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.666213 14402 raft_consensus.cc:3055] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:05.632771 15164 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:06.792302 15164 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:05.615229 15169 raft_consensus.cc:697] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 15 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:06.794790 15169 consensus_queue.cc:237] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:06.411103 15170 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.523860 15144 raft_consensus.cc:3055] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:06.800024 15144 raft_consensus.cc:740] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:06.801170 15144 consensus_queue.cc:260] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:05.634763 15163 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:06.804768 15163 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:06.053716 15038 raft_consensus.cc:3055] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:06.407826 15161 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.807045 15161 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:05.650440 15130 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:06.426512 14907 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:06.824004 14907 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:06.414506 15160 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:06.827320 15160 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:06.829651 15160 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:05.647356 14784 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:06.356781 15020 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.389s	user 0.018s	sys 0.024s
I20260709 12:25:05.616355 15152 raft_consensus.cc:697] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 12 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:06.444938 15158 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:05.997238 15211 raft_consensus.cc:3055] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:06.404829 15224 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.410909 15226 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.844918 15152 consensus_queue.cc:237] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:06.845808 15226 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:06.847069 10976 raft_consensus.cc:1275] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:06.847985 15226 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:06.409782 15229 raft_consensus.cc:3055] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:06.844923 15224 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:06.849205 15229 raft_consensus.cc:740] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:05.638082 15225 raft_consensus.cc:2749] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:06.550076 15259 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:06.851665 15259 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:06.853957 15259 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:06.553139 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 79265.1us
I20260709 12:25:06.576831 11126 raft_consensus.cc:2889] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:06.565351 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:06.563290 11129 rpcz_store.cc:276] 0709 12:25:03.783446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.783615 (+   169us) service_pool.cc:224] Handling call
0709 12:25:03.783977 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:05.252650 (+1468673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:06.380764 (+1128114us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b5400106654. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:06.381066 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3371298176}
I20260709 12:25:06.432883 15250 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.843130 15158 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:06.856604 15250 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:06.435286 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:06.857147 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:25:06.578456 11676 rpcz_store.cc:269] 0709 12:25:05.321073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.325698 (+  4625us) service_pool.cc:224] Handling call
0709 12:25:06.562867 (+1237169us) spinlock_profiling.cc:243] Waited 904 ms on lock 0x7b5400447854. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:06.562975 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2079997184}
I20260709 12:25:06.581043 10982 raft_consensus.cc:2393] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 10: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:06.581537 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:25:06.578487 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 150016us
I20260709 12:25:06.610639 15246 consensus_queue.cc:1059] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:06.610639 11025 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:06.605858 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 663) took 1072 ms. Trace:
I20260709 12:25:06.613636 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:06.859623 10977 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:25:06.601878 15258 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:06.861315 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:06.860327 11134 rpcz_store.cc:276] 0709 12:25:05.533300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.533479 (+   179us) service_pool.cc:224] Handling call
0709 12:25:05.538999 (+  5520us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:05.559959 (+ 20960us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:05.559995 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:05.577784 (+ 17789us) log.cc:844] Serialized 26 byte log entry
0709 12:25:06.605504 (+1027720us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:06.605541 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:06.605607 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:06.605650 (+    43us) raft_consensus.cc:1685] finished
0709 12:25:06.605661 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:06.605789 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8629,"raft.queue_time_us":20967,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":93,"thread_start_us":1027280,"threads_started":1,"wal-append.queue_time_us":60891,"wal-append.run_cpu_time_us":2052,"wal-append.run_wall_time_us":1003493}
I20260709 12:25:06.862516 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:06.863339 11134 raft_consensus.cc:2410] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:25:06.864154 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:06.614861 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 2342) took 1047 ms. Trace:
I20260709 12:25:06.864953 11130 rpcz_store.cc:276] 0709 12:25:05.531991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.546985 (+ 14994us) service_pool.cc:224] Handling call
0709 12:25:06.579748 (+1032763us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:06.866068 15270 raft_consensus.cc:2749] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:06.615558 15243 raft_consensus.cc:3055] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:06.616048 15187 raft_consensus.cc:2749] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:06.866777 15243 raft_consensus.cc:740] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:06.864069 10948 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:06.566118 15122 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:06.869161 10948 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:06.617189 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:06.861967 11679 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:06.865367 10949 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:06.621079 11128 raft_consensus.cc:2410] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:25:06.871121 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 2343) took 1309 ms. Trace:
I20260709 12:25:06.607714 11133 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:06.622892 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:25:06.624528 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:06.864967 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 254469us
I20260709 12:25:06.626180 11055 raft_consensus.cc:1275] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:06.628806 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:06.628041 10975 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:25:06.632251 15265 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:06.634318 10979 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.159s	user 0.030s	sys 0.023s
I20260709 12:25:06.635622 15057 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:06.639410 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 355703us
I20260709 12:25:06.642423 15252 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.643383 14464 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.876107 15057 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:06.877096 14464 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:06.878364 15151 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.878660 15057 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:06.879263 14464 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:06.880100 15228 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.880604 15228 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:06.643620 15248 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.651980 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:25:06.665050 11132 consensus_meta.cc:287] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 1.096s	user 0.005s	sys 0.014s
I20260709 12:25:06.646874 15253 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:06.881659 15248 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:06.674983 15266 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:06.882208 11132 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:25:06.882926 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58414 (request call id 662) took 1438 ms. Trace:
I20260709 12:25:06.882763 15266 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:06.883306 11132 rpcz_store.cc:276] 0709 12:25:05.444449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.446856 (+  2407us) service_pool.cc:224] Handling call
0709 12:25:06.882858 (+1436002us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:06.882968 15253 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:06.884210 15246 raft_consensus.cc:3055] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:06.884661 15246 raft_consensus.cc:740] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:06.885228 15266 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:06.673600 11677 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEARNER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:06.875238 15258 raft_consensus.cc:2764] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:25:06.882627 15252 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:06.688843 11131 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.186s	user 0.015s	sys 0.019s
I20260709 12:25:06.686162 15221 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:06.887457 11131 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.388s	user 0.016s	sys 0.020s
I20260709 12:25:06.695530 14742 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:06.695530 15267 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.888041 14742 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:06.888437 15267 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:06.862542 15251 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.889294 15151 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:06.703828 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:06.890012 15251 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:06.738293 15036 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:06.739418 15114 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:06.890745 15267 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:06.707289 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 1.25527e+06us
I20260709 12:25:06.891470 15151 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:06.892055 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:06.892913 11055 raft_consensus.cc:2393] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 12: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:06.883828 15250 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:06.740736 15066 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:06.739576 14849 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:06.742692 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 1964) took 2619 ms. Trace:
I20260709 12:25:06.894505 11127 rpcz_store.cc:276] 0709 12:25:04.123351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.301870 (+178519us) service_pool.cc:224] Handling call
0709 12:25:05.397129 (+1095259us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:05.594292 (+197163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:06.741609 (+1147317us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b5400106b54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:06.742478 (+   869us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400106b50. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:06.742622 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2914434176}
I20260709 12:25:06.896533 15253 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:06.897274 14849 raft_consensus.cc:2749] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:06.763230 10880 catalog_manager.cc:5697] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:06.751969 15014 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:06.888993 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:06.898773 11676 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:06.898998 11643 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:25:06.899351 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.887627 15221 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:06.900475 15092 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:25:06.767869 10881 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41106 (request call id 281) took 41429 ms (client timeout 15000 ms). Trace:
W20260709 12:25:06.769394 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.770496 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:06.772079 15181 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:06.772105 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:06.772343 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:06.898921 10880 catalog_manager.cc:5697] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:06.773746 15268 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:06.774290 10981 raft_consensus.cc:1275] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:06.775378 14695 raft_consensus.cc:2804] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:06.785686 15053 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:06.785910 15149 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:06.891362 11056 raft_consensus.cc:2393] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 15: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:06.787657 14402 raft_consensus.cc:740] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:06.787546 15119 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:06.914654 11133 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:25:06.797696 15170 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:06.904735 15268 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:06.918601 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:06.919552 15248 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:06.920150 15170 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:06.812477 15161 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:06.815457 15130 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:06.867805 15243 consensus_queue.cc:260] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:06.813105 15144 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:06.921705 15243 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:06.920055 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:06.924296 11132 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 10.
I20260709 12:25:06.905040 15228 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:06.925309 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:06.822630 15063 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:06.926347 15252 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:06.920392 15268 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:06.923658 15149 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:06.927474 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:06.928731 15251 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:06.929111 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:06.830757 14907 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:06.838076 14784 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:06.926014 11132 raft_consensus.cc:2368] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 10. Current term is 11.
W20260709 12:25:06.840706 15020 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.873s	user 0.019s	sys 0.025s
I20260709 12:25:06.930789 15020 raft_consensus.cc:697] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 9 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:06.931136 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:06.931849 15020 consensus_queue.cc:237] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:06.857931 15224 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:06.843185 15160 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.905817 15245 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:06.844110 15211 raft_consensus.cc:740] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:06.850208 15229 consensus_queue.cc:260] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:06.853860 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:06.870606 11059 raft_consensus.cc:2393] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 12: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:06.618985 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:06.871367 11128 rpcz_store.cc:276] 0709 12:25:05.585802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.594849 (+  9047us) service_pool.cc:224] Handling call
0709 12:25:06.871058 (+1276209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:06.862562 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2339) took 1331 ms. Trace:
I20260709 12:25:06.947147 11126 rpcz_store.cc:276] 0709 12:25:05.530827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.532240 (+  1413us) service_pool.cc:224] Handling call
0709 12:25:05.562022 (+ 29782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:06.862310 (+1300288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:06.862506 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:06.871798 11057 raft_consensus.cc:2393] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 14: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
W20260709 12:25:06.874977 10979 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.400s	user 0.030s	sys 0.023s
I20260709 12:25:06.879694 15265 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:06.669668 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:06.666783 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:06.886778 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:06.890569 11052 raft_consensus.cc:2393] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 12: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:06.736804 14872 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:06.746002 10870 maintenance_manager.cc:643] P 67a911ac695143c380a7065b971eb9b7: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 4.308s	user 0.131s	sys 0.111s Metrics: {"bytes_written":29740,"cfile_init":1,"dirs.queue_time_us":48460,"dirs.run_cpu_time_us":403,"dirs.run_wall_time_us":1142,"drs_written":1,"lbm_read_time_us":446,"lbm_reads_lt_1ms":4,"lbm_write_time_us":20648,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":28,"peak_mem_usage":0,"rows_written":63,"thread_start_us":118066,"threads_started":2,"wal-append.queue_time_us":92541}
I20260709 12:25:06.765136 15182 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:06.958899 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2449) took 1696 ms. Trace:
I20260709 12:25:06.882146 15158 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:06.893837 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:06.903223 11681 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 11: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:06.904376 11680 raft_consensus.cc:1240] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:25:06.907004 11129 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:06.961514 11053 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:06.914620 11127 raft_consensus.cc:1275] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:06.806284 15038 raft_consensus.cc:740] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:06.905584 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2334) took 2000 ms. Trace:
I20260709 12:25:06.916364 11134 raft_consensus.cc:2410] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:25:06.875510 15259 consensus_queue.cc:1059] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:25:06.914330 14742 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:06.917755 15119 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:06.883811 15187 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:06.920311 11025 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:06.930352 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:06.935352 11054 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:25:06.950030 11677 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:25:06.904209 10880 catalog_manager.cc:5697] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 8 to 10, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 10 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:06.954803 14342 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:06.955153 11060 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:06.955837 15229 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:06.956912 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:06.957501 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:06.888370 11125 raft_consensus.cc:1240] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:06.957449 11673 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:06.905761 15249 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.958202 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:06.963325 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 94270.4us
I20260709 12:25:06.967952 11676 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
W20260709 12:25:06.968554 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:06.978720 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 85286.8us
I20260709 12:25:06.980054 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:06.905746 14695 raft_consensus.cc:697] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:06.970232 11679 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:06.904302 14969 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:06.982890 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:06.902032 15221 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:06.966814 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:06.885682 15246 consensus_queue.cc:260] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:06.971575 15250 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.982759 11128 raft_consensus.cc:1275] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 12:25:06.964270 14464 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:06.934620 15160 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:25:06.934968 15245 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:06.902766 15181 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:06.967156 15066 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.002296 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:06.988571 10948 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:07.002666 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:06.959338 10979 rpcz_store.cc:276] 0709 12:25:05.252530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.254275 (+  1745us) service_pool.cc:224] Handling call
0709 12:25:05.254960 (+   685us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:05.348988 (+ 94028us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:05.349016 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:05.447249 (+ 98233us) log.cc:844] Serialized 26 byte log entry
0709 12:25:06.948425 (+1501176us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:06.948473 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:06.948562 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:06.948611 (+    49us) raft_consensus.cc:1685] finished
0709 12:25:06.948623 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:06.948766 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6622,"raft.queue_time_us":128306,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":322,"thread_start_us":1554612,"threads_started":2,"wal-append.queue_time_us":154722,"wal-append.run_cpu_time_us":4646,"wal-append.run_wall_time_us":1176443}
I20260709 12:25:06.995467 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:06.993923 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:06.994907 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:06.996662 11128 pending_rounds.cc:85] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 5
I20260709 12:25:07.006146 11128 pending_rounds.cc:107] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:25:07.006464 11128 raft_consensus.cc:2889] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:07.009598 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.003275 10982 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:25:06.967218 11131 rpcz_store.cc:276] 0709 12:25:04.905547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.108792 (+203245us) service_pool.cc:224] Handling call
0709 12:25:05.109074 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:05.109287 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:05.452863 (+343576us) log.cc:844] Serialized 14 byte log entry
0709 12:25:06.905164 (+1452301us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:06.905232 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:06.905304 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:06.905390 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:06.905517 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":249523,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":96,"raft.queue_time_us":793,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"thread_start_us":1717890,"threads_started":2,"wal-append.queue_time_us":158570,"wal-append.run_cpu_time_us":1253,"wal-append.run_wall_time_us":1001394}
I20260709 12:25:07.015333 10983 raft_consensus.cc:2393] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 9: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:06.987675 15092 raft_consensus.cc:2764] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:25:07.027971 10975 raft_consensus.cc:2393] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 9: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:07.028995 11051 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 13.
I20260709 12:25:06.990350 10880 catalog_manager.cc:5697] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 8 to 10, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 10 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:07.033430 11052 raft_consensus.cc:2410] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:25:07.001860 14742 raft_consensus.cc:2749] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:07.043929 15040 consensus_queue.cc:1059] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:25:07.044430 14695 consensus_queue.cc:237] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:07.045027 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:06.976320 11053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:07.050412 10880 catalog_manager.cc:5697] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 9 to 11, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 11 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:07.054854 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:06.983537 14342 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:07.057289 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:07.063349 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:06.983577 15182 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:07.063635 10980 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:07.043957 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:25:07.063371 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 143163us
I20260709 12:25:07.067905 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.070071 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.076013 10982 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 11: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:07.013572 15249 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:07.058074 15170 raft_consensus.cc:2749] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:07.080519 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:07.014485 15250 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:07.078816 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 90329.4us
I20260709 12:25:07.085408 10984 raft_consensus.cc:2393] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 12: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
W20260709 12:25:07.086977 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 95673.4us
I20260709 12:25:07.038667 14464 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:07.004323 14969 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:07.089663 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.048231 15066 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:07.091924 11057 raft_consensus.cc:1240] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:25:07.100186 10948 leader_election.cc:400] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 10. Current term is 11.
I20260709 12:25:07.100653 10948 leader_election.cc:403] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:07.100735 10977 raft_consensus.cc:2393] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 11: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
W20260709 12:25:07.101763 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.087368 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.095249 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:07.103655 10983 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:06.902273 10881 rpcz_store.cc:269] 0709 12:24:25.340657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.384776 (+ 44119us) service_pool.cc:224] Handling call
0709 12:25:06.767599 (+41382823us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:01.286932 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:01.287576 (+   644us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:01.287627 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:25:01.287654 (+    27us) tablet.cc:662] Decoding operations
0709 12:25:01.289007 (+  1353us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:01.289139 (+   132us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:01.289167 (+    28us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:25:01.291202 (+  2035us) tablet.cc:701] Row locks acquired
0709 12:25:01.291264 (+    62us) write_op.cc:260] PREPARE: finished
0709 12:25:01.291447 (+   183us) write_op.cc:270] Start()
0709 12:25:01.291595 (+   148us) write_op.cc:276] Timestamp: P: 1783599901291376 usec, L: 0
0709 12:25:01.291629 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 12:25:01.292910 (+  1281us) log.cc:844] Serialized 3631 byte log entry
0709 12:25:01.463968 (+171058us) op_driver.cc:464] REPLICATION: finished
0709 12:25:01.979806 (+515838us) write_op.cc:301] APPLY: starting
0709 12:25:01.987533 (+  7727us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:02.006755 (+ 19222us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:02.006923 (+   168us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:02.232158 (+225235us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:02.232541 (+   383us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:25:02.232607 (+    66us) write_op.cc:312] APPLY: finished
0709 12:25:02.232997 (+   390us) log.cc:844] Serialized 71 byte log entry
0709 12:25:02.233220 (+   223us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:02.233356 (+   136us) write_op.cc:454] Released schema lock
0709 12:25:02.233427 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:02.233978 (+   551us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:02.234013 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":392501,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":311283,"apply.run_cpu_time_us":5571,"apply.run_wall_time_us":358830,"num_ops":9,"prepare.queue_time_us":8872,"prepare.run_cpu_time_us":61524,"prepare.run_wall_time_us":121936,"raft.queue_time_us":38926,"raft.run_cpu_time_us":72340,"raft.run_wall_time_us":104641,"replication_time_us":172178,"thread_start_us":245115,"threads_started":4,"wal-append.queue_time_us":129363,"wal-append.run_cpu_time_us":17016,"wal-append.run_wall_time_us":1813612}]]}
I20260709 12:25:07.038491 15268 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:25:07.098304 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.106835 10982 raft_consensus.cc:2393] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 12: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:07.106953 15118 consensus_queue.cc:1048] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 12:25:07.091104 15038 consensus_queue.cc:260] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:07.108268 15038 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:07.108399 15255 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.104483 15266 consensus_queue.cc:1048] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:25:07.108994 15255 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:07.110826 11025 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:07.112119 11643 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:07.113121 15255 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:07.118520 15119 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:07.118363 10880 catalog_manager.cc:5697] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 5 to 8, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 8 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:07.120209 10880 catalog_manager.cc:5697] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:07.097249 10979 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:25:07.125527 15160 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:07.126959 15181 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:07.127262 15122 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:07.128713 15249 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:07.104646 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 137283us
I20260709 12:25:07.131126 14969 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:07.132613 15250 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:07.134888 14464 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:07.136075 11053 raft_consensus.cc:606] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:07.136479 11053 raft_consensus.cc:614] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:07.137857 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:07.138500 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:07.139153 11128 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
I20260709 12:25:07.140439 10984 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:07.141482 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.054466 15211 consensus_queue.cc:260] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:07.128969 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 49709.5us
I20260709 12:25:07.130014 11673 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:07.129946 11098 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:07.214427 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.220849 10980 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:25:07.142091 10984 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:07.223881 10977 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:25:07.224097 10975 raft_consensus.cc:1240] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:25:07.158159 10979 raft_consensus.cc:1275] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:25:07.132869 15265 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:07.237329 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.238207 10980 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:25:07.237458 11644 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:07.096303 15072 consensus_queue.cc:1048] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.138s
W20260709 12:25:07.243520 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.157652 15266 raft_consensus.cc:2764] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:25:07.144107 15170 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 10. Current term is 11.
I20260709 12:25:07.248869 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:07.249670 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.250411 10975 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:07.247682 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 137017us
I20260709 12:25:07.252177 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.252889 10977 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:07.250761 10984 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:25:07.255338 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.257756 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.256451 10948 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:07.254360 10880 catalog_manager.cc:5697] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 6 to 9, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 9 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:07.224444 15250 raft_consensus.cc:2749] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:07.242123 15211 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.269145 11643 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:07.246382 14969 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:07.254632 15272 log.cc:927] Time spent T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:25:07.274654 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.278710 15163 raft_consensus.cc:2749] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:07.281279 10982 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:25:07.281663 10880 catalog_manager.cc:5697] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 2 to 9, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 9 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:07.275702 10975 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:07.278431 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:25:07.278311 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 53246.2us
W20260709 12:25:07.279377 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 149544us
I20260709 12:25:07.279477 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.280167 10980 raft_consensus.cc:2393] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 12: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
W20260709 12:25:07.283659 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.268306 15038 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.283054 10871 maintenance_manager.cc:419] P 67a911ac695143c380a7065b971eb9b7: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8628 bytes on disk
I20260709 12:25:07.321125 11098 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:07.304229 10984 raft_consensus.cc:2376] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11. Re-sending same reply.
I20260709 12:25:07.321974 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.329345 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.326814 11643 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:07.330467 10982 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:07.330520 10979 raft_consensus.cc:2410] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:25:07.283815 14969 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:07.332276 15279 consensus_queue.cc:1048] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 12:25:07.333308 11672 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
W20260709 12:25:07.334440 15277 log.cc:927] Time spent T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:25:07.335158 10977 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:25:07.336345 15182 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:07.337093 10880 catalog_manager.cc:5697] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 9 to 10, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 10 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:07.338447 11098 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:07.339615 10981 raft_consensus.cc:2410] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:25:07.339285 10880 catalog_manager.cc:5697] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:07.339963 11098 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:07.341182 15082 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.340675 10880 catalog_manager.cc:5697] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 2 to 6, term changed from 6 to 8, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:07.341832 10978 raft_consensus.cc:1240] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 9 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:07.341672 15082 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:07.240489 15221 consensus_queue.cc:1175] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7518bdeb78f24e67a530754ae48547eb" responder_term: 9 status { last_received { term: 8 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:25:07.325106 15181 raft_consensus.cc:2749] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:25:07.344092 15260 consensus_queue.cc:1175] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bc01179655564f29b83babe396377cbb" responder_term: 8 status { last_received { term: 8 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 8 index: 9 } }
W20260709 12:25:07.346664 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 97132.5us
I20260709 12:25:07.328287 15280 raft_consensus.cc:2749] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:07.336475 11060 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:25:07.348690 10975 raft_consensus.cc:1275] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:07.350175 10980 raft_consensus.cc:1240] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:07.358300 15163 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:07.358994 15163 raft_consensus.cc:697] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:07.358799 10870 maintenance_manager.cc:643] P 67a911ac695143c380a7065b971eb9b7: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.012s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":303,"lbm_reads_lt_1ms":4}
I20260709 12:25:07.360110 15163 consensus_queue.cc:237] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:07.358521 15158 raft_consensus.cc:3055] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:07.362759 15158 raft_consensus.cc:740] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:07.363744 15158 consensus_queue.cc:260] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:07.366178 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 150667us
W20260709 12:25:07.371244 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.343391 14969 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:07.279170 15164 consensus_queue.cc:1059] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:25:07.396618 15040 raft_consensus.cc:3055] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:07.397083 15040 raft_consensus.cc:740] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:07.375972 15158 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:07.376730 14402 consensus_queue.cc:260] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:07.356454 14907 raft_consensus.cc:2749] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:07.353010 15250 raft_consensus.cc:2749] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:07.356624 15249 consensus_queue.cc:1048] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:25:07.388979 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.391845 10982 raft_consensus.cc:1275] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:07.393890 11023 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:07.394728 14464 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:07.349464 15251 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:07.403035 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.412987 10983 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:07.424216 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.327916 15038 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:07.435732 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:07.436412 10979 raft_consensus.cc:1275] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:07.434820 10975 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:07.441118 11023 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:07.441917 10948 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
W20260709 12:25:07.444749 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:07.443588 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 103766us
I20260709 12:25:07.444950 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:07.452016 11673 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:25:07.453374 11023 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:07.433758 10880 catalog_manager.cc:5697] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 8 to 12, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 12 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:07.455777 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 53023.9us
I20260709 12:25:07.458983 11023 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:07.461071 15130 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:07.445890 14784 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:07.441330 15119 raft_consensus.cc:2749] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:07.442920 15187 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:07.444540 15280 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.465893 11023 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:07.467042 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:07.403708 15040 consensus_queue.cc:260] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:07.461984 14402 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:07.485524 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.472903 14871 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.502789 14871 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:07.505321 15082 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:07.505914 15246 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:07.507889 11672 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41774 (request call id 632) took 2366 ms (client timeout 2097 ms). Trace:
W20260709 12:25:07.508347 11672 rpcz_store.cc:269] 0709 12:25:05.142025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.142189 (+   164us) service_pool.cc:224] Handling call
0709 12:25:07.507648 (+2365459us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b540021e3d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:07.507802 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4556279552}
I20260709 12:25:07.510342 14871 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:07.511754 14742 raft_consensus.cc:2804] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:07.512223 14742 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:07.512595 14742 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.466475 15224 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:25:07.472436 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 47394us
I20260709 12:25:07.471077 10880 catalog_manager.cc:5697] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 1 to 7, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 7 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:07.494288 11023 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:07.464781 15014 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:07.492950 11675 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:25:07.521121 11023 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:07.472489 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.510301 15225 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.518991 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.522989 10880 catalog_manager.cc:5697] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 6 to 8, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 8 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:07.470248 15130 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.522225 15014 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.526283 10948 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:07.468464 15243 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:07.470477 14784 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:07.522653 10976 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:25:07.460829 15268 consensus_queue.cc:1059] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:25:07.527494 10984 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:25:07.532369 15251 consensus_queue.cc:1048] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:07.535038 11023 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:07.542960 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 75759.1us
I20260709 12:25:07.538357 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2425) took 3288 ms. Trace:
I20260709 12:25:07.519618 15224 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.527019 15252 raft_consensus.cc:2804] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:07.549885 11702 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4560 after lost signal to thread 9802
W20260709 12:25:07.580703 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 62263.5us
I20260709 12:25:07.583633 10948 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
W20260709 12:25:07.584685 11702 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4de0 after lost signal to thread 10916
W20260709 12:25:07.585707 11702 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4e80 after lost signal to thread 11009
W20260709 12:25:07.585945 11702 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4f40 after lost signal to thread 11010
I20260709 12:25:07.534471 15130 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:07.577750 10978 rpcz_store.cc:276] 0709 12:25:04.245635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.245747 (+   112us) service_pool.cc:224] Handling call
0709 12:25:04.246018 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:07.342294 (+3096276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:07.529171 (+186877us) spinlock_profiling.cc:243] Waited 3.05 s on lock 0x7b540035eb54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:07.534052 (+  4881us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7010524928}
W20260709 12:25:07.589283 11702 debug-util.cc:398] Leaking SignalData structure 0x7b080010c1e0 after lost signal to thread 11084
W20260709 12:25:07.587306 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 52332.9us
I20260709 12:25:07.535831 15014 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:07.590307 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.564046 14784 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:07.591481 11702 debug-util.cc:398] Leaking SignalData structure 0x7b080019c520 after lost signal to thread 11085
I20260709 12:25:07.592166 10984 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:07.576694 15187 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:07.533370 15225 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:07.537400 15245 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:07.535485 15274 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:25:07.596174 11702 debug-util.cc:398] Leaking SignalData structure 0x7b08002518a0 after lost signal to thread 11159
I20260709 12:25:07.595841 10880 catalog_manager.cc:5697] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 2 to 9. New cstate: current_term: 9 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:07.588788 15040 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:07.593948 15289 log.cc:927] Time spent T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:25:07.586690 15252 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:07.609336 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.526423 15280 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:07.608462 10880 catalog_manager.cc:5697] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 2 to 10. New cstate: current_term: 10 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:07.603134 15038 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:07.602059 11644 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:07.588241 15224 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:07.604696 11702 debug-util.cc:398] Leaking SignalData structure 0x7b080040a2c0 after lost signal to thread 11160
I20260709 12:25:07.633581 11055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 614) took 1004 ms. Trace:
I20260709 12:25:07.603721 15243 raft_consensus.cc:2749] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:07.642199 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:25:07.644135 11702 debug-util.cc:398] Leaking SignalData structure 0x7b08001acc20 after lost signal to thread 11705
W20260709 12:25:07.644472 11702 debug-util.cc:398] Leaking SignalData structure 0x7b0800059040 after lost signal to thread 11706
I20260709 12:25:07.644565 10984 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
W20260709 12:25:07.645470 11702 debug-util.cc:398] Leaking SignalData structure 0x7b0800409c20 after lost signal to thread 15174
I20260709 12:25:07.646463 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.647109 10983 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:25:07.636233 11644 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:07.652777 11644 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:07.653863 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 70276.1us
I20260709 12:25:07.641259 10880 catalog_manager.cc:5697] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 5 to 9, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 9 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:07.641214 11055 rpcz_store.cc:276] 0709 12:25:06.628876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.990358 (+361482us) service_pool.cc:224] Handling call
0709 12:25:07.021043 (+ 30685us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:07.135599 (+114556us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:07.135633 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:07.135676 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:07.135706 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:07.628992 (+493286us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54003011d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:07.633364 (+  4372us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:07.633515 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262962432}
I20260709 12:25:07.611486 15252 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:07.659710 11098 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:07.657744 10880 catalog_manager.cc:5697] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 3 to 6, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 6 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:07.643126 15072 raft_consensus.cc:2749] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:07.662411 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 128474us
I20260709 12:25:07.648531 14464 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:07.656836 14871 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:07.657855 15082 raft_consensus.cc:2749] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:07.673087 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.673749 10983 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:25:07.665416 11644 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:07.679589 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 88371.5us
W20260709 12:25:07.683638 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.686299 11025 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:07.688068 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.667665 15251 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:07.668217 14464 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.670876 14871 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:07.713666 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 79465.4us
I20260709 12:25:07.717267 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:25:07.717869 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.718384 10983 raft_consensus.cc:2393] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 12: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:07.722052 14402 consensus_queue.cc:1048] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:07.697561 15211 raft_consensus.cc:2749] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:07.715427 14464 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:07.717952 14871 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:07.734493 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:07.769531 10976 raft_consensus.cc:2376] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8. Re-sending same reply.
I20260709 12:25:07.765969 10983 raft_consensus.cc:1275] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:25:07.770658 15229 consensus_meta.cc:287] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.782s	user 0.010s	sys 0.001s
I20260709 12:25:07.739534 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.771271 10983 raft_consensus.cc:1240] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:07.742503 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.771809 11098 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:07.772615 10979 raft_consensus.cc:2410] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:25:07.765846 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.743322 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.744102 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.774379 10978 raft_consensus.cc:2393] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 9: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:07.744817 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:07.714476 14742 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:07.750907 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 85573.5us
I20260709 12:25:07.765242 15066 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:07.766587 15225 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:07.766803 15251 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.734285 15268 raft_consensus.cc:2749] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:07.767707 15280 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:07.767963 15014 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:07.768415 14342 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:07.770529 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:07.735739 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:07.773595 11098 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:07.775247 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:07.783221 10977 raft_consensus.cc:1275] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
W20260709 12:25:07.785588 15290 log.cc:927] Time spent T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:25:07.786226 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:07.788020 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:07.825374 11675 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
I20260709 12:25:07.774228 15249 raft_consensus.cc:2749] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:07.788986 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:07.790820 14742 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:07.804603 15209 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.828408 15209 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:07.829551 15092 consensus_queue.cc:1059] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:07.830241 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.831146 10984 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:25:07.831702 15209 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:07.718619 15274 raft_consensus.cc:697] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:07.833302 15274 consensus_queue.cc:237] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:07.836484 15187 raft_consensus.cc:2749] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:07.816027 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.793897 14871 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:07.839053 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.840027 14871 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:07.840281 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.819743 10977 pending_rounds.cc:85] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 6
I20260709 12:25:07.773514 14784 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:07.819947 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.842183 10979 raft_consensus.cc:2410] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:25:07.842414 11097 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:07.843154 15245 consensus_queue.cc:1048] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:07.843550 15130 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:07.845662 15130 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:07.808569 15251 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:07.848155 15251 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:07.849359 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 169351us
I20260709 12:25:07.848513 15014 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:07.845213 14784 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:07.855144 15066 raft_consensus.cc:2749] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:07.855470 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 81927.3us
I20260709 12:25:07.856465 11098 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:07.857635 15152 raft_consensus.cc:2804] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:07.821563 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:07.858049 15152 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.858456 15152 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.816401 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:07.831393 15092 raft_consensus.cc:3055] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:07.795651 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.859890 15092 raft_consensus.cc:740] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:25:07.807817 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.859906 11673 raft_consensus.cc:2376] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bc01179655564f29b83babe396377cbb in term 10. Re-sending same reply.
I20260709 12:25:07.841394 10977 pending_rounds.cc:107] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:25:07.861929 10977 raft_consensus.cc:2889] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:07.862524 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.858461 11128 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 13.
I20260709 12:25:07.863027 11097 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:07.828378 15221 consensus_queue.cc:1048] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:25:07.828392 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:07.866493 10976 raft_consensus.cc:2410] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:25:07.817333 11024 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:07.862788 15038 raft_consensus.cc:3055] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:07.840567 15224 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:07.821810 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:07.871255 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.872488 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.868948 14464 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:07.874914 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.875703 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.872665 10948 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:07.876621 10980 raft_consensus.cc:2393] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 11: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:07.879050 14969 consensus_queue.cc:1059] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:07.860837 15092 consensus_queue.cc:260] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:07.879844 11058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 615) took 1249 ms. Trace:
I20260709 12:25:07.880131 15066 raft_consensus.cc:3055] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:07.880514 15066 raft_consensus.cc:740] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:07.880936 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.881733 10984 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 11: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:07.881361 15066 consensus_queue.cc:260] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:07.870168 15038 raft_consensus.cc:740] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:07.883184 11131 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:25:07.883651 15038 consensus_queue.cc:260] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:07.884706 15038 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:07.885094 11097 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:07.885928 11097 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:07.886353 14907 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:07.886866 14907 raft_consensus.cc:697] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:07.887204 11097 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:25:07.890421 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 73162.8us
I20260709 12:25:07.890765 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:07.892695 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:07.893266 11643 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:07.895074 14464 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:07.888437 11058 rpcz_store.cc:276] 0709 12:25:06.630507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.027705 (+397198us) service_pool.cc:224] Handling call
0709 12:25:07.045876 (+ 18171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:07.877930 (+832054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:07.877960 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:07.878003 (+    43us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:07.878040 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:07.879600 (+  1560us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b54001879d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:07.879646 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:07.879786 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111489,"raft.queue_time_us":113115,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"spinlock_wait_cycles":1587372288}
I20260709 12:25:07.901166 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:07.895234 10948 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:07.906361 11643 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:07.901062 14872 raft_consensus.cc:2804] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:07.893604 15245 raft_consensus.cc:2804] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:07.897085 15251 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:07.896935 15249 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:07.899091 15181 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:07.896046 15122 raft_consensus.cc:2804] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:07.896875 15082 raft_consensus.cc:2749] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:07.914304 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 64194.2us
I20260709 12:25:07.915588 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:07.927950 10982 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:07.916222 11024 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:07.911645 15158 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.887784 14907 consensus_queue.cc:237] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:07.879240 15252 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:07.915040 11645 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:07.925724 15181 raft_consensus.cc:697] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 10 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:07.926158 15187 raft_consensus.cc:2804] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:07.939524 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 240949us
I20260709 12:25:07.922994 15278 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:07.951819 15130 raft_consensus.cc:2804] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:07.929445 11024 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:07.915612 11643 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:07.923027 15245 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:07.931687 11025 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:07.924635 15249 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.971907 15249 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:07.926999 15092 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:07.926005 15251 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:07.955063 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 96976.7us
I20260709 12:25:07.914903 14872 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.990162 14872 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.961117 15158 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:07.992746 15158 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:07.952049 15122 raft_consensus.cc:697] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:25:07.966348 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 79192.4us
W20260709 12:25:07.971210 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 55677us
I20260709 12:25:07.962679 15280 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:25:07.974870 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 45487.2us
I20260709 12:25:07.975095 14464 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:08.006567 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:08.006898 14464 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.007388 14464 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:07.961946 15187 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:07.982200 15251 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:07.982802 11098 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:07.984277 15252 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:07.986404 15181 consensus_queue.cc:237] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:07.986177 15082 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:25:07.987766 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 56176.3us
I20260709 12:25:07.988287 15268 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:07.974493 15152 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:07.990162 15224 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:08.039093 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 56418.3us
I20260709 12:25:08.019295 15038 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.009117 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:08.013702 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:07.973681 15245 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:07.974678 15130 raft_consensus.cc:697] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:08.018587 11057 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:08.044377 11057 raft_consensus.cc:606] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:08.044764 11057 raft_consensus.cc:614] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:08.019266 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:08.045382 11051 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:08.018646 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:08.045899 11673 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:08.024950 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:08.046993 11055 raft_consensus.cc:2410] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 12:25:08.026531 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 71865.7us
I20260709 12:25:08.025319 11644 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:08.002300 15280 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.996053 11097 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:07.973587 15014 consensus_queue.cc:1048] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:25:08.016184 15187 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.970081 11023 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:08.053000 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 83001.8us
W20260709 12:25:08.053977 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 58022.3us
I20260709 12:25:08.021291 15082 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.050153 14464 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:08.055655 11098 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:08.036635 15309 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:08.056567 11098 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:08.058646 11025 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:08.057858 15082 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:08.067660 15038 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:08.076821 15038 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:08.077366 15122 consensus_queue.cc:237] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:08.052800 15280 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:08.068985 11097 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:08.081591 14464 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:08.054363 15163 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:08.055830 15224 raft_consensus.cc:2804] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:08.093075 11673 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:08.088433 11098 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:08.065572 15303 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:08.094973 15303 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.095356 15303 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:08.097566 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.099517 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:08.100827 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:08.101399 10975 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:25:08.065377 14969 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:08.101578 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:25:08.107998 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:08.110426 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.110347 10982 raft_consensus.cc:2410] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:25:08.110909 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:08.111490 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:08.112175 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:08.109381 10984 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:25:08.112553 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:08.110879 10975 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:08.077375 15152 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:08.085016 15298 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:08.118243 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:08.118875 10984 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:08.113684 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:08.120059 10982 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:08.124435 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 55501.1us
I20260709 12:25:08.065922 15268 consensus_queue.cc:1048] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:25:08.090157 15224 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:08.111152 15158 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.128461 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:08.128368 11024 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:08.109146 14969 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.122079 11023 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:08.134900 11675 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:08.136777 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:08.143987 10982 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:08.156303 11051 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 14.
I20260709 12:25:08.120425 15298 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.157907 11023 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:08.159049 11023 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
W20260709 12:25:08.135532 15312 log.cc:927] Time spent T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:25:08.108448 14907 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:08.164909 11023 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:08.165748 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:08.166656 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 57536.1us
I20260709 12:25:08.171676 10976 raft_consensus.cc:1275] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:08.136427 15224 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:08.173879 11644 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:08.161859 15250 raft_consensus.cc:2749] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:08.137218 15152 consensus_queue.cc:1048] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:25:08.150825 14969 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:08.156579 15274 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:08.192292 14402 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.160465 14695 raft_consensus.cc:2749] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:08.194437 14402 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:08.162781 15309 raft_consensus.cc:2804] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:25:08.183835 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 95450.1us
I20260709 12:25:08.162631 15252 raft_consensus.cc:2804] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:08.162997 15298 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:08.184227 15014 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:08.204804 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:08.204111 11051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:08.202313 11098 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:08.156912 15158 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:08.195356 15118 raft_consensus.cc:2749] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:08.208264 11025 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:08.134876 15130 consensus_queue.cc:237] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:08.211385 14402 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:08.200130 15274 raft_consensus.cc:697] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:08.204159 15066 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:08.224663 15268 raft_consensus.cc:2749] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:08.225466 15268 consensus_queue.cc:1048] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:08.214242 15014 raft_consensus.cc:697] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:08.200433 15252 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.228993 14402 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:25:08.232602 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 107436us
I20260709 12:25:08.192123 15092 consensus_queue.cc:1048] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
W20260709 12:25:08.224530 15317 log.cc:927] Time spent T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:25:08.234575 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:08.206869 15309 raft_consensus.cc:697] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 8 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:08.250564 11681 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:08.249567 15250 raft_consensus.cc:2804] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:08.259989 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:08.235714 15252 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:08.265359 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:08.293828 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.248837 11097 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
W20260709 12:25:08.274916 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 84057.3us
I20260709 12:25:08.280589 15309 consensus_queue.cc:237] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:08.283195 15187 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:08.312273 11675 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 16.
I20260709 12:25:08.257612 15250 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:08.315059 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 99795.3us
I20260709 12:25:08.319490 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:08.320063 11131 raft_consensus.cc:1275] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:08.320255 11053 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
W20260709 12:25:08.322028 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 111861us
W20260709 12:25:08.306525 15317 log.cc:927] Time spent T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:25:08.328861 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:08.331492 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:08.331982 11060 raft_consensus.cc:1240] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:08.251678 15014 consensus_queue.cc:237] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:08.318840 15310 log.cc:927] Time spent T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:25:08.308867 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:08.339355 11057 raft_consensus.cc:1240] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:08.337452 11053 raft_consensus.cc:1240] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:08.254225 15319 consensus_queue.cc:1059] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 12:25:08.366514 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:08.367619 11058 raft_consensus.cc:2393] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 10: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:08.368788 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:08.371047 15319 raft_consensus.cc:3055] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:08.371510 15319 raft_consensus.cc:740] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:08.372401 15319 consensus_queue.cc:260] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:08.373595 14907 raft_consensus.cc:2749] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:08.319491 15250 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:08.374908 15315 log.cc:927] Time spent T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 12:25:08.377010 15187 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:08.309610 15249 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:08.377688 15187 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.378784 15187 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:08.373044 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:08.383667 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:08.388381 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 139620us
I20260709 12:25:08.304220 11644 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:08.426865 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:08.314988 14342 consensus_queue.cc:1059] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:25:08.373669 15319 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:08.431222 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 127099us
I20260709 12:25:08.430130 11132 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:25:08.338796 15251 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:08.439484 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:08.464061 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 62610.5us
I20260709 12:25:08.465133 11097 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:08.469857 14464 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:08.476573 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:08.477623 11053 raft_consensus.cc:2393] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 11: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:08.479017 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:08.334704 15274 consensus_queue.cc:237] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:08.471789 11054 raft_consensus.cc:1275] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:08.482568 14402 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.467617 15119 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:08.490805 14402 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:08.493414 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:08.494131 11057 raft_consensus.cc:1240] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:25:08.494680 11053 raft_consensus.cc:2393] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 12: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:08.578563 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:08.470114 15325 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:08.589745 10949 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:08.597923 11053 raft_consensus.cc:1240] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 12. Current term is 14. Ops: [12.10-12.10]
I20260709 12:25:08.600286 10949 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:08.606071 10949 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:08.608587 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:08.611042 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:08.612056 11132 raft_consensus.cc:2393] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 13: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:08.590950 15268 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.620332 10984 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:08.621417 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:08.622080 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:08.627755 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:08.628996 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:08.630119 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:08.630551 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:08.631237 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:08.631956 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:08.632362 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:08.633008 11052 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 10.
I20260709 12:25:08.633131 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:08.633831 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:08.634533 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:08.634784 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.621728 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:08.608383 14342 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:08.711853 14342 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:08.712345 14342 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:08.711848 11133 raft_consensus.cc:2393] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 13: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:08.716133 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:08.610031 15325 raft_consensus.cc:697] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:08.720273 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:08.721052 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:08.721932 11054 raft_consensus.cc:2393] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 9: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
W20260709 12:25:08.722113 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 116138us
I20260709 12:25:08.723995 11134 raft_consensus.cc:2393] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 9: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:08.577157 15119 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:08.729041 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:08.729799 11052 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
I20260709 12:25:08.732863 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:25:08.726488 15317 log.cc:927] Time spent T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:25:08.792078 11132 raft_consensus.cc:1275] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:08.792282 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:08.790906 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:08.794183 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:08.796077 11126 raft_consensus.cc:1275] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 12:25:08.805383 11126 pending_rounds.cc:85] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 8
I20260709 12:25:08.806319 11126 pending_rounds.cc:107] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:25:08.808362 11126 raft_consensus.cc:2889] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:08.813970 11052 raft_consensus.cc:1240] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 12:25:08.817296 11134 raft_consensus.cc:1240] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:08.727710 15324 raft_consensus.cc:2749] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:08.790910 15181 raft_consensus.cc:3055] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:08.711468 15268 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:08.826004 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:08.798741 15187 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:08.811679 15229 raft_consensus.cc:2749] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:08.838936 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:08.838857 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:08.840381 11673 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:25:08.834602 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:08.818816 15082 consensus_meta.cc:287] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.744s	user 0.010s	sys 0.000s
W20260709 12:25:08.810457 15326 log.cc:927] Time spent T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.323s	user 0.005s	sys 0.004s
I20260709 12:25:08.811376 15327 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:08.826536 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 359761us
I20260709 12:25:08.838091 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:08.839622 11052 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
I20260709 12:25:08.843114 11053 raft_consensus.cc:2393] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 13: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:08.844946 11134 raft_consensus.cc:1275] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:08.853817 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:08.827674 15249 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:08.854251 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:08.857865 11673 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:08.858552 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:08.876727 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:08.877997 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:08.879155 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:08.830834 15181 raft_consensus.cc:740] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:08.880632 15181 consensus_queue.cc:260] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:08.881969 15181 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:08.851732 15327 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:08.862150 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:08.842605 15187 raft_consensus.cc:2749] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:08.884544 15187 consensus_queue.cc:1048] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:08.885869 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:08.871658 11097 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:08.874878 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:08.876927 11680 raft_consensus.cc:1240] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:25:08.876494 11677 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
W20260709 12:25:08.840627 15328 log.cc:927] Time spent T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.413s	user 0.000s	sys 0.001s
I20260709 12:25:08.887382 11097 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:08.888572 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:08.871030 11679 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 6.
I20260709 12:25:08.893556 11678 raft_consensus.cc:1240] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:25:08.892987 11052 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
W20260709 12:25:08.894784 10947 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.006s	sys 0.026s
W20260709 12:25:08.897058 10947 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.006s	sys 0.026s
W20260709 12:25:08.875900 15066 consensus_meta.cc:287] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.655s	user 0.011s	sys 0.000s
I20260709 12:25:08.892701 15152 raft_consensus.cc:2749] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:08.846355 15082 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:08.861445 15324 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:25:08.900285 10948 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:08.872169 14871 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.872377 15251 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:08.897009 11097 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:08.899009 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:08.901172 15303 consensus_meta.cc:287] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.805s	user 0.008s	sys 0.004s
I20260709 12:25:08.916738 10948 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:08.917578 11128 raft_consensus.cc:2410] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:25:08.894507 15249 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:08.923435 15119 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:08.915807 15280 consensus_meta.cc:287] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.810s	user 0.010s	sys 0.000s
I20260709 12:25:08.920789 15344 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.939450 11097 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:08.929625 15330 log.cc:927] Time spent T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.331s	user 0.001s	sys 0.000s
I20260709 12:25:08.929952 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:08.932157 11675 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
W20260709 12:25:08.950071 14969 consensus_meta.cc:287] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.747s	user 0.011s	sys 0.000s
I20260709 12:25:08.922876 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:08.907951 14871 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:08.893565 15325 consensus_queue.cc:237] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:08.945971 11052 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
W20260709 12:25:08.949455 15331 log.cc:927] Time spent T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 12:25:08.933043 10948 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:08.977597 11051 raft_consensus.cc:606] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:08.936770 15345 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:08.949431 15250 consensus_meta.cc:287] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.574s	user 0.005s	sys 0.005s
I20260709 12:25:08.986429 15250 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:08.988355 15224 consensus_meta.cc:287] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.792s	user 0.008s	sys 0.002s
W20260709 12:25:08.988693 15319 consensus_meta.cc:287] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.526s	user 0.004s	sys 0.004s
I20260709 12:25:08.961719 14969 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:08.980597 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:08.991102 14969 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:08.991894 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:08.992733 11132 raft_consensus.cc:2368] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 12. Current term is 13.
I20260709 12:25:08.993635 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:08.994372 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:08.995591 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:08.996632 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:08.997627 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:08.961364 15082 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:08.998623 11131 raft_consensus.cc:2393] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 11: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:25:08.976693 15252 consensus_meta.cc:287] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.661s	user 0.010s	sys 0.000s
I20260709 12:25:08.999974 15252 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:09.002008 11055 raft_consensus.cc:2393] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 9: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:08.999599 11125 raft_consensus.cc:1240] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:09.003438 11131 raft_consensus.cc:1240] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:08.931398 15066 raft_consensus.cc:2749] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:08.933900 15303 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:09.013988 15303 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:08.951682 15245 consensus_meta.cc:287] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.892s	user 0.012s	sys 0.000s
I20260709 12:25:09.014837 15245 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:08.991256 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:09.016157 11130 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:25:09.016983 15245 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:09.017105 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:09.018446 15268 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:08.988840 15224 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:09.019779 11129 raft_consensus.cc:1240] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:09.020525 11054 raft_consensus.cc:2393] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 12: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:09.021644 15224 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:08.991371 15158 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:08.988829 15250 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:09.002696 15181 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:25:08.959477 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:08.965270 15337 log.cc:927] Time spent T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:25:08.966150 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:08.968827 14871 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:08.938936 15280 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:08.977510 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 44560.5us
W20260709 12:25:08.982996 15335 log.cc:927] Time spent T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 12:25:08.983314 15333 log.cc:927] Time spent T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.122s	user 0.001s	sys 0.001s
I20260709 12:25:08.946165 15344 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:08.960803 15342 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.980039 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:08.976857 15341 raft_consensus.cc:2749] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:09.041095 11132 raft_consensus.cc:2393] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 10: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:25:09.005134 15334 log.cc:927] Time spent T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.205s	user 0.004s	sys 0.000s
I20260709 12:25:09.005623 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:09.004998 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:09.043561 11052 raft_consensus.cc:2393] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 13: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
W20260709 12:25:08.999550 15298 consensus_meta.cc:287] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.785s	user 0.011s	sys 0.000s
I20260709 12:25:09.044430 15298 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:09.046597 15298 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:09.010682 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 287347us
I20260709 12:25:09.011035 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:09.047995 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.961789 15229 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:09.005064 15252 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:09.011778 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:09.027218 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.048202 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:09.055559 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:09.031332 11053 raft_consensus.cc:2393] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 11: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:09.022653 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:09.033505 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:09.057850 11129 raft_consensus.cc:2410] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:25:09.034816 11025 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:09.049569 10981 raft_consensus.cc:1275] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:09.056632 11126 raft_consensus.cc:1275] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:09.060591 15252 consensus_queue.cc:1048] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:09.061592 15280 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:09.062193 14402 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:09.059830 11025 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:09.063431 10984 raft_consensus.cc:1275] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:09.030462 15181 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:08.999594 14872 consensus_meta.cc:287] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.985s	user 0.008s	sys 0.004s
I20260709 12:25:09.049674 11133 raft_consensus.cc:2393] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 13: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:09.054190 15344 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:09.059716 15297 raft_consensus.cc:2749] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:09.062887 15342 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:09.138892 11678 raft_consensus.cc:1275] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:09.140188 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:09.064213 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:09.033247 10948 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:09.145717 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 112526us
I20260709 12:25:09.141888 10977 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:25:09.151901 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:09.152791 11675 raft_consensus.cc:2393] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 13: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:09.065546 11053 raft_consensus.cc:1240] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:09.067956 11025 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:09.048295 10980 raft_consensus.cc:1275] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:09.068629 15268 raft_consensus.cc:2749] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:25:09.155752 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 87875us
I20260709 12:25:09.071486 11052 raft_consensus.cc:1275] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:09.072144 11060 raft_consensus.cc:1240] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:09.029240 14342 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:09.076164 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:09.158061 11025 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:09.074817 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:09.159714 10975 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:09.160090 10981 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:09.076362 11024 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:09.161818 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 85582.9us
W20260709 12:25:09.163497 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.164595 11025 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:09.171116 10948 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:09.172544 10948 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:09.175364 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.181036 14402 raft_consensus.cc:2749] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:09.182451 11025 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:09.187345 14342 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:09.188251 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:09.188651 14402 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:09.187295 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:09.209048 10979 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:25:09.187047 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:09.138805 15342 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:09.221405 11133 raft_consensus.cc:2368] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 10. Current term is 11.
I20260709 12:25:09.223493 11677 raft_consensus.cc:1275] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:25:09.233580 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 51230.4us
I20260709 12:25:09.181440 15224 raft_consensus.cc:2804] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:09.249004 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 200481us
I20260709 12:25:09.186559 15229 raft_consensus.cc:2804] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:09.180455 15344 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:09.250056 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:09.304013 11134 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
I20260709 12:25:09.277163 15341 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.304951 15341 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:09.276364 15252 consensus_queue.cc:1048] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:25:09.276185 15229 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:09.310515 15229 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:09.186587 15354 raft_consensus.cc:2804] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:09.318912 15354 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:09.319367 15354 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:09.225800 11675 raft_consensus.cc:1275] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:09.140087 14872 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:09.079350 15181 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:09.186441 15297 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:09.186710 15038 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:09.252799 14342 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.474987 15341 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:09.224704 11674 raft_consensus.cc:1275] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:09.173949 10948 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:09.255488 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:09.478793 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:25:09.479066 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 305179us
I20260709 12:25:09.479669 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:09.480110 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:09.237021 10975 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:09.278240 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:09.481278 10979 raft_consensus.cc:2410] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:25:09.278569 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.481853 10982 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:09.469879 10981 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:25:09.220533 15209 consensus_queue.cc:1059] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 12:25:09.288153 15249 raft_consensus.cc:2749] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:09.289191 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:09.252952 15224 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:09.302691 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:09.458433 10949 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:09.493439 15224 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:09.493665 11126 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
I20260709 12:25:09.494772 11133 raft_consensus.cc:2393] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 9: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:25:09.423954 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 172679us
I20260709 12:25:09.499183 11025 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:09.235052 15345 raft_consensus.cc:2749] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:09.467043 14872 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:09.457307 11127 raft_consensus.cc:1240] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:25:09.471462 15298 consensus_queue.cc:1048] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:09.472225 15291 consensus_queue.cc:1048] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:09.509651 15082 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.511463 15082 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:09.513684 15082 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:09.515036 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:09.515856 11053 raft_consensus.cc:1275] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:25:09.462437 15181 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:09.517939 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:09.467957 15066 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:09.459065 15342 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:09.480461 10976 raft_consensus.cc:2393] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 13: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:09.186347 15211 consensus_queue.cc:1048] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 12:25:09.479765 15344 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:09.483028 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:09.483294 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:09.474979 14342 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:09.485176 10948 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:09.491093 11134 raft_consensus.cc:1275] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:09.491834 15225 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.492328 15325 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.497766 10982 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
I20260709 12:25:09.481992 11098 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:09.497675 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:09.541836 11132 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:09.504395 11675 raft_consensus.cc:1275] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:09.505427 15293 raft_consensus.cc:2749] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:09.505998 15252 consensus_queue.cc:1048] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:09.506934 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:09.508118 15158 raft_consensus.cc:2749] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:09.508777 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:09.509522 15092 raft_consensus.cc:3055] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:09.532097 10981 raft_consensus.cc:2393] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 9: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:09.532474 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:09.531613 10980 raft_consensus.cc:1240] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12. Ops: []
W20260709 12:25:09.535305 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 55351.6us
I20260709 12:25:09.537606 15268 consensus_queue.cc:1048] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:25:09.538707 15357 log.cc:927] Time spent T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:25:09.556317 15354 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:09.517014 15297 raft_consensus.cc:697] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:09.558830 15297 consensus_queue.cc:237] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:09.530568 15181 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:09.545156 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 63229.1us
I20260709 12:25:09.546489 10979 raft_consensus.cc:2393] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 11: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:09.547824 10983 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 14
W20260709 12:25:09.550216 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.550233 14342 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:09.551620 10948 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:09.572019 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.572829 14342 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.575974 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:09.534547 15344 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:09.573386 14342 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:09.582819 10979 raft_consensus.cc:1275] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:09.576190 11098 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:09.539958 15345 raft_consensus.cc:2749] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:09.547643 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:09.591598 10982 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 14.
I20260709 12:25:09.547394 15092 raft_consensus.cc:740] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:09.585929 11098 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:09.576782 11129 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
W20260709 12:25:09.597827 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 139464us
I20260709 12:25:09.598693 10949 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:09.552560 14872 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:09.580972 15352 consensus_queue.cc:1059] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:25:09.586409 14907 consensus_queue.cc:1059] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 12:25:09.601841 10949 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:09.618724 15279 consensus_queue.cc:1048] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:09.540802 15082 consensus_queue.cc:1048] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:25:09.616568 10981 raft_consensus.cc:1240] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 12. Current term is 13. Ops: [11.6-12.7]
I20260709 12:25:09.615929 15345 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:09.553439 15342 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:09.610878 15355 log.cc:927] Time spent T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:25:09.586300 15344 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:09.614832 15229 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:09.531293 15066 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:09.638252 11132 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
I20260709 12:25:09.622493 15341 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:09.539746 15350 consensus_queue.cc:1048] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:25:09.578086 15158 raft_consensus.cc:2749] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:09.639690 15224 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:09.594321 10983 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 14.
W20260709 12:25:09.655009 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 53221.1us
I20260709 12:25:09.597327 15249 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:09.718122 10977 raft_consensus.cc:1240] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:09.718532 15249 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:09.718988 15249 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:09.656577 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 60467.5us
I20260709 12:25:09.656980 11023 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:09.722251 10978 raft_consensus.cc:1240] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:09.722355 14464 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:25:09.725884 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 69028us
I20260709 12:25:09.727375 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2349) took 1471 ms. Trace:
I20260709 12:25:09.722987 14464 raft_consensus.cc:697] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:09.721302 10983 raft_consensus.cc:1240] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 10. Current term is 11. Ops: []
W20260709 12:25:09.685256 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 141649us
I20260709 12:25:09.598069 14342 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:09.548534 15325 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:09.548249 15225 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:09.585228 14695 consensus_queue.cc:1048] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
W20260709 12:25:09.704277 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 102415us
I20260709 12:25:09.585309 15181 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:09.707506 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 169953us
I20260709 12:25:09.739629 14342 consensus_queue.cc:1048] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:09.740367 10949 leader_election.cc:400] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 10. Current term is 11.
I20260709 12:25:09.698691 15038 raft_consensus.cc:2749] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:09.746122 11645 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:09.655994 15298 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:09.640893 15291 consensus_queue.cc:1048] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 12:25:09.706275 15354 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:09.732441 10948 leader_election.cc:336] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Timed out: RequestConsensusVote RPC to 127.9.145.194:44483 timed out after 1.617s (SENT)
I20260709 12:25:09.702555 15360 raft_consensus.cc:2749] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:09.727835 11125 rpcz_store.cc:276] 0709 12:25:08.255584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.256113 (+   529us) service_pool.cc:224] Handling call
0709 12:25:08.256474 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:09.004592 (+748118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:09.717419 (+712827us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b5400032ad4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:09.727298 (+  9879us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1708519296}
I20260709 12:25:09.737394 11051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:53272 (request call id 32) took 1528 ms. Trace:
I20260709 12:25:09.745424 14402 consensus_queue.cc:1059] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:25:09.749876 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:09.751513 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:09.763092 11131 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:09.709988 15341 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:09.754441 11645 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:09.754803 11678 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:25:09.754462 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:09.767843 11098 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:09.756767 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:09.761796 14464 consensus_queue.cc:237] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:09.773151 11023 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:09.774330 11134 raft_consensus.cc:2393] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 9: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:09.758811 10948 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:09.759310 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:09.762725 11051 rpcz_store.cc:276] 0709 12:25:08.196825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.196996 (+   171us) service_pool.cc:224] Handling call
0709 12:25:09.724894 (+1527898us) spinlock_profiling.cc:243] Waited 772 ms on lock 0x7b54001888d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bdde853 00007f8f90dac60a 00007f8f8a3327d4 00007f8f8a332762 00007f8f8a332691 00007f8f8a33260c 00007f8f8a3318c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:09.724998 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1775702272}
I20260709 12:25:09.704475 14872 consensus_queue.cc:1059] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:25:09.775722 11643 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:09.763581 11133 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:25:09.763257 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:09.765318 11681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41762 (request call id 833) took 1552 ms (client timeout 1951 ms). Trace:
I20260709 12:25:09.777050 14402 raft_consensus.cc:3055] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:09.777927 14402 raft_consensus.cc:740] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:09.778733 11025 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:09.779394 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.780961 10949 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:09.705368 15092 consensus_queue.cc:260] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:09.777171 11681 rpcz_store.cc:269] 0709 12:25:08.212654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.212788 (+   134us) service_pool.cc:224] Handling call
0709 12:25:09.765157 (+1552369us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b540064fad4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:09.765263 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26656512}
I20260709 12:25:09.782891 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:09.783162 11643 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
W20260709 12:25:09.783391 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 51013.6us
I20260709 12:25:09.783856 14342 raft_consensus.cc:2749] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:09.788311 10948 leader_election.cc:336] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Timed out: RequestConsensusVote RPC to 127.9.145.194:44483 timed out after 1.980s (SENT)
I20260709 12:25:09.789402 11056 raft_consensus.cc:1240] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:09.791682 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:09.792941 11130 raft_consensus.cc:2368] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 12. Current term is 13.
I20260709 12:25:09.769867 15341 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:09.791086 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:09.765873 15369 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:09.769505 14907 raft_consensus.cc:3055] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:09.788884 10948 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:09.800064 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:09.811185 11125 raft_consensus.cc:2393] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 10: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:09.776679 15279 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:09.804090 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:09.776010 15371 raft_consensus.cc:3055] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:09.769666 15352 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:09.807713 15325 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:09.809207 15327 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:09.814603 11054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1934) took 1180 ms. Trace:
I20260709 12:25:09.818325 11054 rpcz_store.cc:276] 0709 12:25:08.629975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.727132 (+ 97157us) service_pool.cc:224] Handling call
0709 12:25:09.810639 (+1083507us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b54002dda54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:09.810782 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":519675264}
I20260709 12:25:09.819655 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:09.820356 11054 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
I20260709 12:25:09.820348 15376 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:09.821587 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:09.789463 15211 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:09.814955 15279 raft_consensus.cc:697] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:09.760149 15298 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:09.823428 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:09.810643 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:09.843034 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 55543us
I20260709 12:25:09.788482 15297 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:09.823993 11054 raft_consensus.cc:2410] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:25:09.846246 11056 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 14.
I20260709 12:25:09.847324 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:09.825505 10949 leader_election.cc:400] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 12. Current term is 13.
I20260709 12:25:09.845580 11130 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:25:09.790428 15345 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:09.830175 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:09.783052 15354 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:09.833909 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 58502.7us
I20260709 12:25:09.838692 14342 raft_consensus.cc:2749] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:09.834272 15252 raft_consensus.cc:2804] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:09.804813 15369 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:09.840466 15279 consensus_queue.cc:237] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:09.835734 15211 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:09.796315 15221 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:09.810629 14907 raft_consensus.cc:740] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:09.824169 15371 raft_consensus.cc:740] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:09.835626 15352 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:09.843875 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:09.891888 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:09.827267 11051 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 10.
I20260709 12:25:09.828691 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:09.848608 10949 leader_election.cc:403] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:09.852219 15252 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:09.858484 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:09.860122 15181 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:09.852198 14872 raft_consensus.cc:3055] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:09.866743 15363 consensus_queue.cc:1048] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:25:09.869465 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 81190us
I20260709 12:25:09.845602 15374 consensus_queue.cc:1059] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:25:09.881727 15221 raft_consensus.cc:697] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:25:09.907326 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 81990.8us
I20260709 12:25:09.883364 15224 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:09.886410 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:09.886270 14907 consensus_queue.cc:260] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:09.846067 15360 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.888530 11059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 625) took 1880 ms. Trace:
W20260709 12:25:09.912225 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 124637us
I20260709 12:25:09.890000 10976 raft_consensus.cc:1240] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:09.905934 10948 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:09.903837 15362 log.cc:927] Time spent T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:25:09.897753 11130 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:25:09.920722 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:09.849784 15345 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:09.897176 11125 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
I20260709 12:25:09.904021 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:09.912642 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:09.911026 14342 raft_consensus.cc:2749] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 12. Current term is 13.
I20260709 12:25:09.855552 15369 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:09.869092 15211 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:09.932436 11129 raft_consensus.cc:1275] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:09.904692 15252 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:09.888844 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 114734us
I20260709 12:25:09.918805 10948 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:09.904723 14872 raft_consensus.cc:740] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:09.890764 15119 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.924899 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:09.903613 15370 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.920456 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:09.948266 11678 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:25:09.926630 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:09.924443 15082 consensus_queue.cc:1059] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:25:09.913933 15181 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.928561 14907 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:09.930011 15332 log.cc:927] Time spent T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 1.335s	user 0.014s	sys 0.000s
W20260709 12:25:09.930866 11128 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58414 (request call id 690) took 2035 ms (client timeout 1743 ms). Trace:
I20260709 12:25:09.930763 15371 consensus_queue.cc:260] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:09.914669 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:09.940320 11681 raft_consensus.cc:1240] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:09.856210 15354 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:09.914290 15297 raft_consensus.cc:697] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:09.959993 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:09.944523 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:09.915355 11059 rpcz_store.cc:276] 0709 12:25:08.008307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.008434 (+   127us) service_pool.cc:224] Handling call
0709 12:25:08.022080 (+ 13646us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:08.081424 (+ 59344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:08.081454 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:08.098615 (+ 17161us) log.cc:844] Serialized 26 byte log entry
0709 12:25:08.365909 (+267294us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b18002a9040. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cd9e07 00007f8f91b349a9 00007f8f88cf669b 00007f8f88cf493f 00007f8f88cf6c02 00007f8f8b97e20b 00007f8f8b983d23 00007f8f8b9840d1 00007f8f8bd9fa0f
0709 12:25:08.469631 (+103722us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:08.469676 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:08.966866 (+497190us) spinlock_profiling.cc:243] Waited 6.76 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:25:09.888180 (+921314us) spinlock_profiling.cc:243] Waited 53.8 ms on lock 0x7b54003205d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:09.888227 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:09.888281 (+    54us) raft_consensus.cc:1685] finished
0709 12:25:09.888299 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:09.888441 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5148,"raft.queue_time_us":5505,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":4420,"spinlock_wait_cycles":162268544,"thread_start_us":103500,"threads_started":1,"wal-append.queue_time_us":517505}
I20260709 12:25:09.956935 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:09.958129 11128 rpcz_store.cc:269] 0709 12:25:07.896099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.896479 (+   380us) service_pool.cc:224] Handling call
0709 12:25:09.930610 (+2034131us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540012d254. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:09.930787 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2313838464}
W20260709 12:25:09.958384 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 109690us
I20260709 12:25:09.925935 15158 raft_consensus.cc:2749] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:09.925838 15345 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:09.906775 15341 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:09.970875 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:09.972733 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:09.973379 11051 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:09.974462 11023 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:09.976116 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:09.976241 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:09.976796 11130 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:25:09.957062 15066 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:09.979429 10979 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:09.941357 15225 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:09.984046 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:09.985914 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:09.986405 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:09.986600 11051 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:09.987318 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:09.988073 11128 raft_consensus.cc:2393] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 10: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:25:09.991355 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 74691.8us
I20260709 12:25:10.003760 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:10.003922 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:10.000964 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:10.010833 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:09.925400 15360 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:09.963943 15119 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:09.981388 15371 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:10.018182 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:09.963531 15181 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:10.021754 11131 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:25:10.021831 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:09.992101 15082 raft_consensus.cc:3055] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:09.996399 15225 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:09.982362 15268 consensus_queue.cc:1048] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:25:09.960812 15370 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:09.997764 15388 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:10.033288 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:10.032424 11060 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:25:10.042053 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:10.043409 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:10.044715 11051 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:10.043850 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:10.024894 15375 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.046725 11128 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
I20260709 12:25:10.026151 15082 raft_consensus.cc:740] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:25:10.049103 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 116020us
W20260709 12:25:10.057282 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.032316 15298 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:10.069490 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:10.070354 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:10.071071 11130 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:25:10.067435 11098 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:10.069607 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 95232.7us
I20260709 12:25:10.035821 15388 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.072613 11023 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:10.065526 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:10.077842 14464 raft_consensus.cc:2804] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:10.073089 10949 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:10.069074 11645 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:10.078316 11023 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:10.078414 14464 raft_consensus.cc:697] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:10.077862 11128 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
I20260709 12:25:10.079692 10949 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:09.998836 15221 consensus_queue.cc:237] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:10.086189 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:09.910847 15038 raft_consensus.cc:2955] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Committing config change with OpId 10.7: config changed from index 2 to 7, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:10.109588 11059 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:10.114239 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:10.115964 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:10.111258 15158 raft_consensus.cc:2804] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:10.118316 15119 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:10.121371 15382 log.cc:927] Time spent T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:25:10.123826 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:10.126760 15352 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:10.126526 15252 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:10.132320 15344 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:10.133086 15385 raft_consensus.cc:2804] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:10.066177 15066 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:25:10.170305 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 102940us
I20260709 12:25:10.087435 15388 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:10.111991 15363 raft_consensus.cc:2804] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:10.116335 15298 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:10.113862 14464 consensus_queue.cc:237] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:10.171337 11098 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:10.083750 15249 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:10.059056 15375 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:10.181679 11056 raft_consensus.cc:2393] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 10: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:10.149492 15158 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.058211 15297 consensus_queue.cc:237] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:10.183311 10975 raft_consensus.cc:2393] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 13: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:10.168655 15385 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.177758 11098 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:10.191766 14342 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:10.194306 14342 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:10.198361 14342 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:10.190832 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 198348us
I20260709 12:25:10.195515 11132 raft_consensus.cc:2368] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 13. Current term is 14.
I20260709 12:25:10.204429 11060 raft_consensus.cc:1275] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:25:10.219759 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 300980us
I20260709 12:25:10.220134 11052 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:10.213539 15211 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:10.223038 15211 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:10.173491 15352 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:25:10.189291 15158 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:10.231879 11057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 1917) took 1792 ms. Trace:
W20260709 12:25:10.228847 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 270352us
I20260709 12:25:10.236004 11057 rpcz_store.cc:276] 0709 12:25:08.462074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.469725 (+  7651us) service_pool.cc:224] Handling call
0709 12:25:08.483431 (+ 13706us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:08.494579 (+ 11148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.231539 (+1736960us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b54002783d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:10.231801 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23971200}
I20260709 12:25:10.191483 15385 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:10.174651 15066 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:10.187548 15363 raft_consensus.cc:697] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:10.182359 15298 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:10.225984 15354 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:10.274804 10979 raft_consensus.cc:2410] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:25:10.172832 15082 consensus_queue.cc:260] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:10.300163 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.244525 14342 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:10.454173 11673 raft_consensus.cc:1240] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:10.488812 14342 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:10.268141 15252 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:10.265990 15394 raft_consensus.cc:2749] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:10.278405 15181 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:10.618829 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:10.631927 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 454187us
I20260709 12:25:10.633059 11098 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:10.642633 15376 consensus_meta.cc:287] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.820s	user 0.005s	sys 0.007s
I20260709 12:25:10.643764 15376 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:10.645146 11130 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:10.645494 15376 raft_consensus.cc:2749] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:10.653663 11130 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
W20260709 12:25:10.653694 15377 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.024s	sys 0.074s
W20260709 12:25:10.654824 15377 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.024s	sys 0.074s
I20260709 12:25:10.661651 15376 raft_consensus.cc:2749] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:10.663749 15377 raft_consensus.cc:2749] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:10.489975 15360 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:10.663399 15376 consensus_queue.cc:1048] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:10.689366 15396 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:10.587024 15354 consensus_queue.cc:1059] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.107s
I20260709 12:25:10.682301 15187 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:10.687278 15082 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:10.713632 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.694665 15370 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:10.710647 15396 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:10.717412 15395 log.cc:927] Time spent T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.489s	user 0.001s	sys 0.000s
I20260709 12:25:10.737521 15411 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.737578 15401 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:10.790421 15411 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:10.720670 15363 consensus_queue.cc:237] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:10.791057 15401 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:10.793308 15401 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:10.760313 14907 consensus_meta.cc:287] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.795s	user 0.004s	sys 0.005s
I20260709 12:25:10.796175 15411 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:10.771116 15399 log.cc:927] Time spent T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:25:10.727710 15187 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:10.813251 15187 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:10.819103 15298 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:10.714811 15344 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:10.716194 15249 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:10.728672 15354 consensus_queue.cc:1243] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [LEADER]: Peer c979ef00e0ad4157b49ebbdc13ce7cd7 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 12:25:10.854172 15345 consensus_meta.cc:287] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.875s	user 0.008s	sys 0.003s
W20260709 12:25:10.860883 15279 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.001s	sys 0.007s
W20260709 12:25:10.888022 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 255047us
I20260709 12:25:10.889346 11098 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:10.905421 10948 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.002s	sys 0.009s
W20260709 12:25:10.905929 10948 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.002s	sys 0.010s
W20260709 12:25:10.906293 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 685025us
I20260709 12:25:10.907055 10948 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:10.908839 11128 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.009s	sys 0.009s
W20260709 12:25:10.909262 11128 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.009s	sys 0.009s
I20260709 12:25:10.910148 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2388) took 1158 ms. Trace:
I20260709 12:25:10.910609 11128 rpcz_store.cc:276] 0709 12:25:09.751704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.107955 (+356251us) service_pool.cc:224] Handling call
0709 12:25:10.121462 (+ 13507us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:10.178213 (+ 56751us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:10.178254 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:10.184901 (+  6647us) log.cc:844] Serialized 52 byte log entry
0709 12:25:10.909709 (+724808us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:10.909763 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.909841 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:10.909892 (+    51us) raft_consensus.cc:1685] finished
0709 12:25:10.909904 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:10.910065 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":509290,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":47159,"thread_start_us":763902,"threads_started":2,"wal-append.queue_time_us":505766}
W20260709 12:25:10.912334 11097 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.002s	sys 0.008s
W20260709 12:25:10.912806 11097 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.003s	sys 0.008s
W20260709 12:25:10.913130 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 675684us
W20260709 12:25:10.914340 11643 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.006s	sys 0.010s
W20260709 12:25:10.914721 11643 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.006s	sys 0.010s
W20260709 12:25:10.915045 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 711606us
I20260709 12:25:10.917357 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:10.930642 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2512) took 1883 ms. Trace:
I20260709 12:25:10.931031 10984 rpcz_store.cc:276] 0709 12:25:09.047412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.048549 (+  1137us) service_pool.cc:224] Handling call
0709 12:25:09.048821 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:09.063754 (+ 14933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.930409 (+1866655us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b54000cdfd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:10.930587 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32897920}
W20260709 12:25:10.932431 11055 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41294 (request call id 1643) took 2614 ms (client timeout 2488 ms). Trace:
W20260709 12:25:10.933147 11055 rpcz_store.cc:269] 0709 12:25:08.317550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.317817 (+   267us) service_pool.cc:224] Handling call
0709 12:25:10.932195 (+2614378us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b54002788d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:10.932357 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1539937664}
I20260709 12:25:10.908494 10948 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:10.880199 15279 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.002s	sys 0.007s
I20260709 12:25:10.935840 10948 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:10.879561 15066 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:10.902989 15291 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:10.938539 15419 log.cc:927] Time spent T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:25:10.932389 15344 raft_consensus.cc:2749] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:10.941126 15187 raft_consensus.cc:2804] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:10.938539 15370 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:10.961192 15187 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.961082 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2382) took 1212 ms. Trace:
I20260709 12:25:10.940385 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:10.966300 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1717) took 1712 ms. Trace:
I20260709 12:25:11.063073 10984 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:11.062693 11129 rpcz_store.cc:276] 0709 12:25:09.748205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.748484 (+   279us) service_pool.cc:224] Handling call
0709 12:25:09.932111 (+183627us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:09.932895 (+   784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.960848 (+1027953us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b540012d250. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:10.961014 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":421579520}
I20260709 12:25:10.956333 15291 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:10.936136 15413 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
W20260709 12:25:10.959749 15369 consensus_meta.cc:287] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 1.000s	user 0.009s	sys 0.003s
I20260709 12:25:10.874917 15345 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:10.945823 15260 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.954643 15066 consensus_queue.cc:1059] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:25:10.960119 15404 consensus_queue.cc:1059] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 12:25:11.061605 11051 raft_consensus.cc:1240] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:11.064702 10980 rpcz_store.cc:276] 0709 12:25:09.253988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.254132 (+   144us) service_pool.cc:224] Handling call
0709 12:25:09.254506 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:09.550610 (+296104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.965998 (+1415388us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b540022ae54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:10.966229 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":634032896}
I20260709 12:25:11.072480 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:11.073632 15420 raft_consensus.cc:2749] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:11.073764 15260 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:10.940851 15181 consensus_queue.cc:1059] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.135s
I20260709 12:25:11.076049 15260 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
W20260709 12:25:11.068578 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 179324us
I20260709 12:25:11.077714 11098 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:11.067278 15187 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:11.077105 10980 raft_consensus.cc:2393] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 11: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
W20260709 12:25:11.069172 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 133406us
I20260709 12:25:11.080435 11128 raft_consensus.cc:1275] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:11.082774 10948 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:11.081964 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2389) took 1330 ms. Trace:
I20260709 12:25:11.084338 11128 rpcz_store.cc:276] 0709 12:25:09.751933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.950677 (+1198744us) service_pool.cc:224] Handling call
0709 12:25:11.080059 (+129382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.081717 (+  1658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.081908 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.085713 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:11.086567 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:11.087201 11674 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 10.
I20260709 12:25:11.087410 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:11.087836 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:11.088899 15408 raft_consensus.cc:2804] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:11.092830 15408 raft_consensus.cc:697] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 10 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:11.093715 15408 consensus_queue.cc:237] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:11.095992 15158 consensus_meta.cc:287] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.847s	user 0.007s	sys 0.003s
I20260709 12:25:11.096488 15158 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:11.088788 15420 raft_consensus.cc:3055] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:11.097684 10976 raft_consensus.cc:2393] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 12: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:11.097366 15420 raft_consensus.cc:740] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:11.069927 15370 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:11.076282 15181 raft_consensus.cc:3055] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:11.070780 15413 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:11.104161 15181 raft_consensus.cc:740] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:11.104605 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:11.105091 15181 consensus_queue.cc:260] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:11.106029 15413 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:11.106361 15181 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:11.111546 15092 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:11.076907 15369 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:11.114269 15370 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:11.114845 11672 raft_consensus.cc:2393] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 13: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:11.115746 15369 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:11.116362 15369 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:11.116902 15369 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:11.114375 11059 raft_consensus.cc:1240] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:11.120674 14342 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.089229 10980 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
W20260709 12:25:11.081874 15388 consensus_meta.cc:287] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.891s	user 0.011s	sys 0.000s
I20260709 12:25:11.090754 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:11.103385 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:11.122447 11675 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
I20260709 12:25:11.122570 11674 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
I20260709 12:25:11.076907 15344 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:11.121271 14342 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:11.123726 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1732) took 1343 ms. Trace:
I20260709 12:25:11.125705 15398 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:11.126802 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:11.126778 10979 rpcz_store.cc:276] 0709 12:25:09.780328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.791429 (+ 11101us) service_pool.cc:224] Handling call
0709 12:25:11.123515 (+1332086us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54000d9b54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:11.123669 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423009024}
I20260709 12:25:11.129218 10980 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
I20260709 12:25:11.080102 15279 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:11.131153 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.130978 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:11.132575 10980 raft_consensus.cc:2393] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 12: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:11.133374 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:11.137526 10980 raft_consensus.cc:2410] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 12:25:11.120211 15385 consensus_meta.cc:287] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.849s	user 0.009s	sys 0.000s
W20260709 12:25:11.145361 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.116298 15158 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:11.161032 10984 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 15.
I20260709 12:25:11.163184 11058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1665) took 1239 ms. Trace:
I20260709 12:25:11.165894 15385 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:11.185287 15402 log.cc:927] Time spent T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:25:11.138052 15405 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.171386 11058 rpcz_store.cc:276] 0709 12:25:09.923538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.120171 (+196633us) service_pool.cc:224] Handling call
0709 12:25:10.120475 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:10.508250 (+387775us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:25:10.674023 (+165773us) log.cc:844] Serialized 14 byte log entry
0709 12:25:11.067866 (+393843us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:11.067922 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:11.067974 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.162943 (+ 94969us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b54001883d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:11.162991 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:11.163126 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109745,"prepare.queue_time_us":165155,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":112808,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":4452,"spinlock_wait_cycles":891017984,"thread_start_us":283486,"threads_started":1,"wal-append.queue_time_us":428433}
I20260709 12:25:11.163132 15291 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:11.163530 15377 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.163702 11056 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1951) took 1397 ms. Trace:
W20260709 12:25:11.164558 10975 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1722) took 1907 ms (client timeout 2199 ms). Trace:
I20260709 12:25:11.165294 15066 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:11.129069 15344 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.162017 15279 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:11.207197 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:11.207960 10979 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:25:11.198628 14342 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:11.202711 10948 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
W20260709 12:25:11.200740 10975 rpcz_store.cc:269] 0709 12:25:09.256757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.485108 (+228351us) service_pool.cc:224] Handling call
0709 12:25:11.164370 (+1679262us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b5400173754. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:11.164503 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1534754048}
I20260709 12:25:11.199977 11056 rpcz_store.cc:276] 0709 12:25:09.765836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.847030 (+ 81194us) service_pool.cc:224] Handling call
0709 12:25:11.163500 (+1316470us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b5400371ed4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:11.163640 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":761855744}
I20260709 12:25:11.210146 14342 raft_consensus.cc:2804] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:11.210696 14342 raft_consensus.cc:697] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 9 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:11.187077 15408 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:11.188293 15249 raft_consensus.cc:2749] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:25:11.243281 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 165642us
I20260709 12:25:11.244130 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:11.244843 10975 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
I20260709 12:25:11.245112 11098 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:11.206259 15344 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:11.247481 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:11.251276 11681 raft_consensus.cc:2393] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 12: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:11.247709 14342 consensus_queue.cc:237] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:11.247231 11098 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:11.211050 15401 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.248631 11678 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:25:11.126827 15388 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:11.229915 15403 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:11.261883 11098 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:11.270913 15415 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:11.271553 15415 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.271937 15415 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:11.273602 15418 log.cc:927] Time spent T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 12:25:11.274752 15416 log.cc:927] Time spent T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:25:11.276001 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1725) took 2018 ms. Trace:
I20260709 12:25:11.276461 10978 rpcz_store.cc:276] 0709 12:25:09.257455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.557912 (+300457us) service_pool.cc:224] Handling call
0709 12:25:09.722038 (+164126us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:09.722738 (+   700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.275729 (+1552991us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54000d8c50. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:11.275928 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":376578816}
I20260709 12:25:11.250542 15404 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:11.138809 15398 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:11.223642 15066 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:11.302580 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:11.303206 11679 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:11.266069 15249 raft_consensus.cc:2749] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:11.309058 10983 raft_consensus.cc:1240] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 12. Current term is 13. Ops: [11.6-12.7]
I20260709 12:25:11.204468 15405 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:11.250813 15396 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:11.277809 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:11.210176 15377 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:11.298516 15404 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.248553 15408 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:11.319661 10978 raft_consensus.cc:2393] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 13: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
W20260709 12:25:11.311510 15371 consensus_meta.cc:287] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 1.282s	user 0.014s	sys 0.002s
I20260709 12:25:11.325682 15411 raft_consensus.cc:3055] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:11.325994 15409 consensus_queue.cc:1048] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:25:11.298086 15345 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:11.296804 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:11.328589 15404 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:11.333015 15411 raft_consensus.cc:740] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:11.334465 15369 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:11.335424 15398 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:11.265384 15401 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:11.338821 10975 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
W20260709 12:25:11.320874 15038 consensus_meta.cc:287] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 1.102s	user 0.013s	sys 0.004s
I20260709 12:25:11.328058 15377 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:11.292768 15403 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:11.320544 15225 consensus_meta.cc:287] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 1.287s	user 0.017s	sys 0.000s
I20260709 12:25:11.301316 15187 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:11.293275 11024 connection.cc:256] RPC call timeout handler was delayed by -1.320718401999784s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19510000000000002s for a response
I20260709 12:25:11.349637 15291 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.383023 15415 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:11.358070 11679 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:11.374958 11097 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:11.386782 15398 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:11.386832 15377 raft_consensus.cc:2804] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:11.294965 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:11.375718 11643 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:11.387665 15398 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:11.388024 15377 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:11.389307 11643 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:11.393805 11643 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:11.387567 11097 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:11.362742 15422 log.cc:927] Time spent T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:25:11.364485 15401 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:11.366019 15381 raft_consensus.cc:3055] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:25:11.394166 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 125837us
I20260709 12:25:11.367306 15229 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:11.395246 11643 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:11.367376 15066 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:11.358629 15396 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:11.414919 11098 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:11.415499 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:11.416074 15415 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:11.418432 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:11.416482 15278 raft_consensus.cc:2804] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:11.419139 14907 consensus_queue.cc:1059] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:11.419416 15403 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:11.419816 15396 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:11.390323 15119 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:11.364073 15405 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:11.421516 15066 consensus_queue.cc:1059] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:11.414124 15325 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:11.363590 15411 consensus_queue.cc:260] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:11.424198 15398 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:11.414454 15381 raft_consensus.cc:740] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
W20260709 12:25:11.418278 10948 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.145.196:42197 timed out after 1.847s (SENT) [suppressed 38 similar messages]
I20260709 12:25:11.428268 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 709) took 1661 ms. Trace:
I20260709 12:25:11.394407 15291 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:11.429250 15428 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:11.431288 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2390) took 1679 ms. Trace:
I20260709 12:25:11.433250 15371 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.470501 15371 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:11.472848 15371 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:11.419787 15387 raft_consensus.cc:2804] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:11.473615 11676 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
I20260709 12:25:11.473775 15428 raft_consensus.cc:697] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:11.474886 15428 consensus_queue.cc:237] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:11.458505 15429 raft_consensus.cc:2804] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:11.478250 15411 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:11.478771 15429 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:11.479238 15429 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:11.483954 15365 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:11.484428 15363 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.484977 15387 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:11.485523 15387 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:11.489538 11673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41774 (request call id 657) took 1580 ms. Trace:
I20260709 12:25:11.489974 11673 rpcz_store.cc:276] 0709 12:25:09.908919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.910145 (+  1226us) service_pool.cc:224] Handling call
0709 12:25:09.910501 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:10.465327 (+554826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.489238 (+1023911us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b540021e3d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:11.489440 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1249776000}
I20260709 12:25:11.490772 15396 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:11.397080 15377 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:11.497545 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1718) took 2243 ms. Trace:
I20260709 12:25:11.484997 15363 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:11.498682 15381 consensus_queue.cc:260] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:11.499729 15381 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:11.501452 15361 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.468155 15325 raft_consensus.cc:697] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:11.502525 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:11.442178 15370 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.504526 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:11.504431 15370 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:11.505349 10983 raft_consensus.cc:2410] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 13 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:25:11.498027 10977 rpcz_store.cc:276] 0709 12:25:09.254291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.254404 (+   113us) service_pool.cc:224] Handling call
0709 12:25:09.254703 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:09.718681 (+463978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.497268 (+1778587us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b5400382054. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:11.497471 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1065277824}
I20260709 12:25:11.506300 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:11.506913 10983 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:11.508140 15370 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:11.394464 15293 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.419305 15425 raft_consensus.cc:2749] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:11.455600 15181 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:11.456282 15435 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.458505 15119 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:11.441489 15278 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.459460 11679 raft_consensus.cc:2955] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Committing config change with OpId 10.7: config changed from index 2 to 7, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:11.468545 11129 rpcz_store.cc:276] 0709 12:25:09.752155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.068777 (+1316622us) service_pool.cc:224] Handling call
0709 12:25:11.069132 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:11.087213 (+ 18081us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:11.087247 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:11.125870 (+ 38623us) log.cc:844] Serialized 26 byte log entry
0709 12:25:11.265176 (+139306us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:11.265225 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.265304 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:11.431033 (+165729us) raft_consensus.cc:1685] finished
0709 12:25:11.431070 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:11.431214 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13118,"raft.queue_time_us":59463,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":30498,"thread_start_us":138842,"threads_started":1,"wal-append.queue_time_us":294992}
I20260709 12:25:11.465091 11134 raft_consensus.cc:1240] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 12. Current term is 13. Ops: [12.6-12.6]
W20260709 12:25:11.466774 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 48530.9us
I20260709 12:25:11.513648 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:11.509212 15181 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:11.515920 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:11.516458 15278 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:11.517225 15181 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:11.484066 15291 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:11.519591 10977 raft_consensus.cc:1240] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:25:11.520120 15119 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:11.522679 15376 consensus_queue.cc:1059] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:11.524315 15376 consensus_queue.cc:1059] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:11.525207 15376 raft_consensus.cc:3055] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:11.525583 15376 raft_consensus.cc:740] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:11.466565 11128 rpcz_store.cc:276] 0709 12:25:09.767142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.120600 (+1353458us) service_pool.cc:224] Handling call
0709 12:25:11.131166 (+ 10566us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:11.131515 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:11.131548 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:11.132083 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 12:25:11.371964 (+239881us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:11.372007 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.372082 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:11.428020 (+ 55938us) raft_consensus.cc:1685] finished
0709 12:25:11.428042 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:11.428200 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10965,"raft.queue_time_us":7411,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":25835,"thread_start_us":146442,"threads_started":1,"wal-append.queue_time_us":218333}
I20260709 12:25:11.502008 15361 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:11.527158 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:11.503846 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:11.528388 15361 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:11.509099 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:11.508929 15293 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:11.529572 15435 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:11.530982 15293 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:11.529120 10975 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:11.532821 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:11.533226 11097 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:11.527436 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:11.533725 11129 raft_consensus.cc:2410] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:25:11.534571 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 2012) took 1762 ms. Trace:
I20260709 12:25:11.443574 15249 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:11.534996 11134 rpcz_store.cc:276] 0709 12:25:09.772158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.464497 (+1692339us) service_pool.cc:224] Handling call
0709 12:25:11.464849 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:11.534261 (+ 69412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.534503 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.531049 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 2392) took 1641 ms. Trace:
I20260709 12:25:11.543533 11130 rpcz_store.cc:276] 0709 12:25:09.889830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.083008 (+193178us) service_pool.cc:224] Handling call
0709 12:25:11.530884 (+1447876us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b540012cd54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:11.530988 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1127064320}
I20260709 12:25:11.536072 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:11.536597 10977 raft_consensus.cc:1275] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:11.536801 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:11.528621 10978 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:25:11.390354 15225 raft_consensus.cc:2749] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:11.537778 10983 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:25:11.539939 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2378) took 2700 ms. Trace:
I20260709 12:25:11.433732 15344 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:11.519830 15384 log.cc:927] Time spent T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 1.444s	user 0.009s	sys 0.018s
I20260709 12:25:11.584745 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 590) took 2303 ms. Trace:
I20260709 12:25:11.531905 15363 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:11.585095 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:11.567106 15394 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:11.585996 15394 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.586406 15394 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:11.566640 11127 rpcz_store.cc:276] 0709 12:25:08.839532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.839740 (+   208us) service_pool.cc:224] Handling call
0709 12:25:08.853236 (+ 13496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:09.516598 (+663362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.539647 (+2023049us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b5400373a54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:11.539868 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1154633984}
I20260709 12:25:11.570313 15386 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.572151 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:11.682792 10981 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:11.683616 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:11.684597 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:11.574631 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:11.576479 14402 consensus_queue.cc:260] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:11.578069 11645 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:11.579593 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:11.579432 15404 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:11.580528 11132 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 2381) took 1838 ms (client timeout 1998 ms). Trace:
W20260709 12:25:11.690424 11132 rpcz_store.cc:269] 0709 12:25:09.745440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.756487 (+ 11047us) service_pool.cc:224] Handling call
0709 12:25:11.580314 (+1823827us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b5400324e54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:11.580461 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":965860224}
I20260709 12:25:11.574482 15420 consensus_queue.cc:260] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:11.565491 15249 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:11.502945 15325 consensus_queue.cc:237] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:11.565963 15293 consensus_queue.cc:1048] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:25:11.658835 15376 consensus_queue.cc:260] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:11.682906 15361 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.565562 15387 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:11.565809 15403 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.585481 15429 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:11.549475 15398 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.680281 11673 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:25:11.680827 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:11.651831 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:11.585150 10982 rpcz_store.cc:276] 0709 12:25:09.281618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.592387 (+310769us) service_pool.cc:224] Handling call
0709 12:25:09.592788 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:09.762146 (+169358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:09.762179 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:09.783549 (+ 21370us) log.cc:844] Serialized 26 byte log entry
0709 12:25:09.860138 (+ 76589us) spinlock_profiling.cc:243] Waited 6.26 ms on lock 0x7b4800002dd8. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f90d0daa1 00007f8f90d04b37 00007f8f90d049ca 00007f8f90dfc26f 00007f8f90dfbf37 00007f8f90e1055c 00007f8f90e10508 00007f8f90e10488 00007f8f90e10443 00007f8f90e0f6ec 00007f8f8fd39a96
0709 12:25:09.919602 (+ 59464us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:09.919644 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.460495 (+1540851us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54001a1154. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:11.460560 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:11.519245 (+ 58685us) spinlock_profiling.cc:243] Waited 8.85 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:25:11.584490 (+ 65245us) raft_consensus.cc:1685] finished
0709 12:25:11.584518 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:11.584679 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2461,"raft.run_cpu_time_us":2317,"raft.run_wall_time_us":90914,"spinlock_wait_cycles":423267328,"thread_start_us":97063,"threads_started":1,"wal-append.queue_time_us":208300}
I20260709 12:25:11.717710 11130 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:25:11.715085 11133 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:25:11.593403 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:11.674672 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:11.687325 11680 raft_consensus.cc:2410] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 12:25:11.692663 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 114685us
I20260709 12:25:11.718652 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:11.694926 10979 raft_consensus.cc:1240] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:11.694832 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:11.719574 15092 raft_consensus.cc:2749] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:11.720072 15412 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.720001 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:11.720975 11130 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:11.691226 15386 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:11.722391 15398 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:11.724275 15386 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:11.724649 15398 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:11.699090 11128 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:25:11.701807 10981 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:25:11.719515 11132 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:11.726455 10982 raft_consensus.cc:2393] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 11: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:11.703192 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:25:11.708580 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.610155 15377 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:11.484697 15365 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:11.718885 11127 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:11.684321 11134 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
I20260709 12:25:11.592581 15119 consensus_queue.cc:1048] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.061s
W20260709 12:25:11.725471 11680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41774 (request call id 658) took 1816 ms (client timeout 2224 ms). Trace:
W20260709 12:25:11.744814 11680 rpcz_store.cc:269] 0709 12:25:09.909229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.909344 (+   115us) service_pool.cc:224] Handling call
0709 12:25:11.579426 (+1670082us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b5800004598. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90daa0a0 00007f8f90da9984 00007f8f8a3246d4 00007f8f8a324662
0709 12:25:11.725409 (+145983us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2554112}
W20260709 12:25:11.727842 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.728343 11130 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 13.
W20260709 12:25:11.749504 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.730232 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 707) took 2179 ms. Trace:
I20260709 12:25:11.717696 15420 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:11.733698 11024 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:11.735148 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:11.726950 10975 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:11.732735 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:11.752458 11645 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:11.758961 11645 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:11.750749 11126 rpcz_store.cc:276] 0709 12:25:09.551141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.551824 (+   683us) service_pool.cc:224] Handling call
0709 12:25:09.552161 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:09.734808 (+182647us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:09.734838 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:09.734879 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:09.734912 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.729960 (+1995048us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b5400066b54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:11.730010 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:11.730175 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":419562368}
I20260709 12:25:11.713989 15435 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:11.734318 15376 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:11.771145 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:11.771929 11060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:11.772552 11060 raft_consensus.cc:606] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:11.772609 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:11.775858 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:11.770303 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:11.746171 11134 raft_consensus.cc:1240] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:25:11.756422 11132 raft_consensus.cc:2393] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 11: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:11.768498 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 711) took 1841 ms. Trace:
I20260709 12:25:11.834064 11126 rpcz_store.cc:276] 0709 12:25:09.927056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.767658 (+1840602us) service_pool.cc:224] Handling call
0709 12:25:11.767979 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.768178 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:11.768207 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:11.768247 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:11.768283 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.768335 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:11.768441 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.835950 11126 raft_consensus.cc:2955] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Committing config change with OpId 10.7: config changed from index 2 to 7, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:11.716063 15361 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:11.787235 15370 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:11.796595 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:11.796018 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:11.719832 15403 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:11.805800 10975 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:11.831633 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 2016) took 2043 ms. Trace:
I20260709 12:25:11.849443 11134 rpcz_store.cc:276] 0709 12:25:09.788698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.745557 (+1956859us) service_pool.cc:224] Handling call
0709 12:25:11.745917 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:11.831269 (+ 85352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.831557 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.839962 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:11.789106 15428 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:11.743053 15412 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:11.749807 15386 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:25:11.806728 15381 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.808670 15411 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.860551 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:11.861372 11673 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:11.860630 11132 raft_consensus.cc:1240] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:11.866487 10975 raft_consensus.cc:1240] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:11.868388 11680 raft_consensus.cc:1275] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:25:11.845980 15360 raft_consensus.cc:3055] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:11.872704 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:11.874752 11132 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:11.848397 14871 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:11.879297 10975 raft_consensus.cc:1240] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:25:11.859472 15437 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:11.856289 15370 raft_consensus.cc:697] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:11.911638 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:11.912659 11131 raft_consensus.cc:2410] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:25:11.873844 15360 raft_consensus.cc:740] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:11.926286 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:11.864390 15428 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:11.869377 15381 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:11.894835 15437 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.926430 11132 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
I20260709 12:25:11.930632 15361 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:11.931173 15429 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:11.958964 15437 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:11.932813 15412 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:11.934548 15403 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:11.935252 15377 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:11.935523 14871 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:11.935966 15249 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:11.871718 15411 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:11.941723 15436 log.cc:927] Time spent T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
W20260709 12:25:11.943110 15430 log.cc:927] Time spent T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:25:11.943461 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:25:11.944015 15439 log.cc:927] Time spent T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:25:11.946452 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:11.948074 15370 consensus_queue.cc:237] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:11.950037 10978 raft_consensus.cc:1275] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:25:11.953037 11127 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:25:11.912698 15344 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:11.956447 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:12.006834 11134 raft_consensus.cc:1275] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:12.007712 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:11.907831 15278 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:11.928364 15404 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:12.000600 11131 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:25:11.994240 14871 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:12.008975 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:12.009202 11132 raft_consensus.cc:2393] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 13: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:12.052448 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:12.005815 15038 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.053849 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:12.053256 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 169282us
I20260709 12:25:12.058125 11131 raft_consensus.cc:2393] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 11: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:25:12.056447 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 214256us
I20260709 12:25:12.000209 14907 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:12.060851 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:12.067250 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:12.068120 11127 raft_consensus.cc:2393] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 11: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:12.011559 15365 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:12.071642 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:12.051560 10975 raft_consensus.cc:2955] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Committing config change with OpId 10.7: config changed from index 2 to 7, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:12.073210 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 17 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:12.074069 11131 raft_consensus.cc:2410] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 17 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 12:25:12.072256 11127 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:25:12.076224 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:12.081295 11127 raft_consensus.cc:2393] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 9: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:12.002486 15360 consensus_queue.cc:260] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:12.092381 15385 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:12.094063 10984 raft_consensus.cc:1275] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:12.096388 15408 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:12.107352 15278 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
I20260709 12:25:12.109484 15327 consensus_queue.cc:1059] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:12.110409 15327 consensus_queue.cc:1243] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:25:12.114656 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 601) took 1197 ms. Trace:
I20260709 12:25:12.115097 10976 rpcz_store.cc:276] 0709 12:25:10.916929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.917096 (+   167us) service_pool.cc:224] Handling call
0709 12:25:12.114450 (+1197354us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54000da054. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:12.114592 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":412916480}
I20260709 12:25:12.085201 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:12.130194 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:12.130820 11127 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:25:12.132078 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:12.118047 10948 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:12.132943 11127 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:12.133539 10948 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:12.135766 10978 raft_consensus.cc:1275] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:12.135068 10948 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:12.061915 15038 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:12.139673 10948 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:12.060560 14907 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:12.142760 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:12.143229 11672 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41774 (request call id 659) took 2233 ms (client timeout 1610 ms). Trace:
W20260709 12:25:12.144487 11672 rpcz_store.cc:269] 0709 12:25:09.909519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.919095 (+  9576us) service_pool.cc:224] Handling call
0709 12:25:12.143019 (+2223924us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400592c54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:12.143163 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2653129984}
I20260709 12:25:12.147863 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:12.148778 11131 raft_consensus.cc:2393] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 12: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:12.152253 11127 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:25:12.153523 11645 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
W20260709 12:25:12.139456 15452 log.cc:927] Time spent T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.085s	user 0.000s	sys 0.003s
W20260709 12:25:12.138240 15446 log.cc:927] Time spent T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.135s	user 0.000s	sys 0.003s
I20260709 12:25:12.157364 11127 raft_consensus.cc:1275] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:25:12.138204 15361 raft_consensus.cc:2804] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:12.138587 15408 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:12.162686 11127 raft_consensus.cc:1275] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:12.147176 15225 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:12.142964 15344 raft_consensus.cc:2804] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:12.154230 15360 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:12.163338 15408 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.186482 15408 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:12.191941 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:12.166671 11131 raft_consensus.cc:1240] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:25:12.159783 15278 raft_consensus.cc:2804] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:12.195350 15415 raft_consensus.cc:3055] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:25:12.166682 15453 log.cc:927] Time spent T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:25:12.167006 15411 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:12.167346 15447 log.cc:927] Time spent T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:25:12.167797 15381 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:12.160138 15361 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:12.170419 15344 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:12.175742 14907 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:12.179296 15428 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:12.205798 11127 raft_consensus.cc:1275] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:12.215867 11131 raft_consensus.cc:1275] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:12.195351 15278 raft_consensus.cc:697] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:12.221391 14342 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.221926 15361 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:12.222383 15344 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:12.220156 15375 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:12.228926 14342 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:12.195863 15415 raft_consensus.cc:740] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:12.206013 14871 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:12.248160 14871 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:12.239233 15278 consensus_queue.cc:237] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:12.251405 11132 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
I20260709 12:25:12.381189 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2391) took 2570 ms. Trace:
I20260709 12:25:12.381688 11130 rpcz_store.cc:276] 0709 12:25:09.811298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.747799 (+1936501us) service_pool.cc:224] Handling call
0709 12:25:11.748145 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:11.748550 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:25:11.748583 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:11.749083 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 12:25:11.954731 (+205648us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:11.954771 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.954856 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:12.380941 (+426085us) raft_consensus.cc:1685] finished
0709 12:25:12.380964 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:12.381113 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":941,"raft.queue_time_us":104,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":6763,"thread_start_us":145473,"threads_started":1,"wal-append.queue_time_us":251743}
I20260709 12:25:12.384251 14342 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:12.249969 15225 raft_consensus.cc:697] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 11 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:12.393101 15470 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:12.393751 15470 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:12.395993 15470 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:12.401111 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:12.401810 11056 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:25:12.402505 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:12.404270 11054 raft_consensus.cc:1240] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:25:12.406857 11058 raft_consensus.cc:1240] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:12.379025 15038 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:12.408244 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:12.411532 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.419147 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:12.420240 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:12.421150 11059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1659) took 2543 ms. Trace:
I20260709 12:25:12.421574 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:12.422361 11125 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
I20260709 12:25:12.421553 11059 rpcz_store.cc:276] 0709 12:25:09.865029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.144316 (+279287us) service_pool.cc:224] Handling call
0709 12:25:10.157192 (+ 12876us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.118283 (+961091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.408350 (+1290067us) spinlock_profiling.cc:243] Waited 957 ms on lock 0x7b54003e0b54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:12.408502 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2200803584}
I20260709 12:25:12.427248 11125 raft_consensus.cc:1240] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:12.427867 15269 consensus_queue.cc:1059] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:12.425832 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:12.428665 15269 consensus_queue.cc:1243] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer bc01179655564f29b83babe396377cbb log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:25:12.429049 11134 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:12.429224 15269 raft_consensus.cc:3055] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:12.429585 15269 raft_consensus.cc:740] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:12.428606 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:12.430011 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:12.438730 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:12.439476 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:12.440613 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:12.441285 11130 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
I20260709 12:25:12.249082 15415 consensus_queue.cc:260] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:12.442835 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:12.444407 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:12.445024 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:12.446470 11054 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:12.443928 15341 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:12.452263 11051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1664) took 2538 ms. Trace:
I20260709 12:25:12.452373 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:12.452806 11051 rpcz_store.cc:276] 0709 12:25:09.913968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.136816 (+222848us) service_pool.cc:224] Handling call
0709 12:25:10.152044 (+ 15228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.071720 (+919676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.452018 (+1380298us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b54002dda54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:12.452203 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2091310848}
I20260709 12:25:12.458794 15415 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:12.462278 15388 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:12.462715 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:12.463876 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:12.464296 15463 log.cc:927] Time spent T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 12:25:12.464576 11052 raft_consensus.cc:2393] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 11: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:12.466796 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:12.467824 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:12.468292 11054 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:25:12.474416 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:12.474987 15437 consensus_meta.cc:287] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.003s
I20260709 12:25:12.475134 11059 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:25:12.468549 11052 raft_consensus.cc:2410] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:25:12.476459 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:12.477589 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:12.523888 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:12.475207 15394 consensus_meta.cc:287] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.888s	user 0.009s	sys 0.003s
I20260709 12:25:12.478513 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:12.499035 15400 consensus_queue.cc:1059] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:12.500763 11098 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:12.538199 11060 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:12.525588 11025 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:12.430797 15269 consensus_queue.cc:260] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:12.504498 15225 consensus_queue.cc:237] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:12.543633 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:12.544402 11059 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:12.491410 11051 raft_consensus.cc:1240] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:12.483282 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:12.499925 10979 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 12:25:12.547312 10979 pending_rounds.cc:85] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 10
I20260709 12:25:12.547608 10979 pending_rounds.cc:107] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 12:25:12.547847 10979 raft_consensus.cc:2889] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:12.522954 11134 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 13.
I20260709 12:25:12.526657 15388 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:12.527711 11053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 636) took 2793 ms. Trace:
I20260709 12:25:12.527894 15344 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:12.529201 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.564852 11024 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:12.479060 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:12.475454 15437 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:12.530153 11678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41784 (request call id 704) took 1426 ms (client timeout 1609 ms). Trace:
I20260709 12:25:12.531901 15409 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.532326 15375 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.531172 15361 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:12.533612 11055 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:12.522639 15342 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:12.533989 11056 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:25:12.535187 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:12.535480 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2394) took 1028 ms. Trace:
W20260709 12:25:12.567620 11678 rpcz_store.cc:269] 0709 12:25:11.104167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.104341 (+   174us) service_pool.cc:224] Handling call
0709 12:25:12.529954 (+1425613us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54006757d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:12.530065 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329650944}
I20260709 12:25:12.536160 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2534) took 1011 ms. Trace:
I20260709 12:25:12.536347 14464 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:12.533488 15449 log.cc:927] Time spent T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.534s	user 0.003s	sys 0.000s
I20260709 12:25:12.532270 11097 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:25:12.537374 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 228940us
W20260709 12:25:12.636327 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 104145us
I20260709 12:25:12.567747 15420 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:12.637056 11097 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:12.581149 15363 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:12.563591 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 62918.1us
I20260709 12:25:12.587491 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:12.564869 15293 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:12.572091 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:12.558593 11053 rpcz_store.cc:276] 0709 12:25:09.734293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.734422 (+   129us) service_pool.cc:224] Handling call
0709 12:25:09.734790 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:09.869167 (+134377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:09.869198 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:09.869701 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 12:25:10.025278 (+155577us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:10.143709 (+118431us) log.cc:844] Serialized 14 byte log entry
0709 12:25:10.143988 (+   279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.203206 (+ 59218us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b1800270b20. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cf73f3 00007f8f88cf97c1 00007f8f88cf9779 00007f8f88cf9709 00007f8f88cf96d1 00007f8f88cf89cd 0000000000388634 0000000000388479 00007f8f88cda83a
0709 12:25:12.527394 (+2324188us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54001879d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:12.527446 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:12.527490 (+    44us) raft_consensus.cc:1685] finished
0709 12:25:12.527501 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:12.527647 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3257,"prepare.queue_time_us":92184,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":4585,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":6298,"spinlock_wait_cycles":342774528,"thread_start_us":201278,"threads_started":2,"wal-append.queue_time_us":237669,"wal-append.run_cpu_time_us":2034,"wal-append.run_wall_time_us":1006730}
I20260709 12:25:12.571368 11126 rpcz_store.cc:276] 0709 12:25:11.506801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.835241 (+328440us) service_pool.cc:224] Handling call
0709 12:25:11.835602 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.835819 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:11.948739 (+112920us) log.cc:844] Serialized 14 byte log entry
0709 12:25:12.534821 (+586082us) log.cc:844] Serialized 14 byte log entry
0709 12:25:12.535102 (+   281us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:12.535150 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:12.535195 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.535260 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:12.535415 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1852,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":5423,"thread_start_us":577111,"threads_started":2,"wal-append.queue_time_us":457558}
I20260709 12:25:12.651444 11057 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:12.592357 10975 rpcz_store.cc:276] 0709 12:25:11.524841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.043025 (+518184us) service_pool.cc:224] Handling call
0709 12:25:12.043368 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:12.051437 (+  8069us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:12.157380 (+105943us) log.cc:844] Serialized 14 byte log entry
0709 12:25:12.535288 (+377908us) log.cc:844] Serialized 14 byte log entry
0709 12:25:12.535781 (+   493us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:12.535835 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:12.535891 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.535962 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:12.536084 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":259,"raft.queue_time_us":506,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":17480,"spinlock_wait_cycles":21120000,"thread_start_us":376139,"threads_started":1,"wal-append.queue_time_us":312598}
I20260709 12:25:12.651872 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:12.652769 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:12.653640 10975 raft_consensus.cc:2410] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:25:12.594676 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:12.640319 11023 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:12.488364 15408 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:12.641465 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:12.643138 10976 raft_consensus.cc:1240] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:12.658023 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:12.658974 11052 raft_consensus.cc:2393] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 13: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:12.643304 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:12.643935 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:12.644179 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:25:12.660914 10949 leader_election.cc:336] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 2.011s (SENT)
I20260709 12:25:12.661134 10984 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:12.637827 14464 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:12.647710 11098 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:12.584741 15269 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:12.550613 15394 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:12.580766 11675 raft_consensus.cc:1240] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:25:12.661374 10980 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:12.663398 11060 raft_consensus.cc:2393] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 11: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:12.663673 11127 raft_consensus.cc:2410] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:25:12.564947 15388 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:12.664777 11098 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:12.662346 10949 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:12.666486 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:12.682976 10978 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:25:12.686990 14464 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:12.689677 10949 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:12.649276 15400 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:12.583282 15375 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:12.690491 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 106501us
I20260709 12:25:12.690562 14342 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:12.659364 15376 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:12.583406 15409 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:12.682962 15420 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:12.696910 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:12.710381 11052 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
I20260709 12:25:12.592002 15122 consensus_queue.cc:1048] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.089s
I20260709 12:25:12.660365 15360 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.718235 15360 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:12.718732 15437 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:12.719183 15361 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:12.719846 15361 raft_consensus.cc:2749] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:12.720424 15361 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.700470 11025 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:12.720853 15361 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:12.702737 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:12.757886 10983 raft_consensus.cc:2393] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 15: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:12.703353 11053 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:12.704873 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:12.698616 15400 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:12.667559 15470 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:12.646211 15414 consensus_queue.cc:1048] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
W20260709 12:25:12.705211 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 65240us
I20260709 12:25:12.690054 15411 raft_consensus.cc:2749] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:12.721192 15375 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:12.722546 11025 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:12.722884 15344 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:12.724670 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:12.725617 15437 raft_consensus.cc:2749] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:12.768031 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 45558.6us
I20260709 12:25:12.768905 11025 leader_election.cc:400] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 13. Current term is 14.
I20260709 12:25:12.769172 15408 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:12.712173 14907 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:12.768818 15437 raft_consensus.cc:2749] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:12.729324 15360 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:12.733173 11057 raft_consensus.cc:2410] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:25:12.771976 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:12.772265 15394 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:12.772709 11057 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:25:12.703487 14872 consensus_queue.cc:260] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:12.701615 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:12.773661 11060 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:12.701229 14695 raft_consensus.cc:2804] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:12.774310 14695 raft_consensus.cc:697] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:12.774217 15454 consensus_queue.cc:1059] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:12.775557 15454 raft_consensus.cc:3055] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:12.775965 15454 raft_consensus.cc:740] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:12.775436 14695 consensus_queue.cc:237] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:12.777900 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:12.759063 10978 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:12.780514 15470 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:12.782857 15470 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:12.783774 15420 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:12.784353 15420 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:12.787014 10980 raft_consensus.cc:1275] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:25:12.788067 15420 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:12.773820 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:12.788774 11025 leader_election.cc:403] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:12.790354 15435 raft_consensus.cc:2749] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 13. Current term is 14.
W20260709 12:25:12.791855 10948 leader_election.cc:336] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Timed out: RequestConsensusVote RPC to 127.9.145.194:44483 timed out after 1.555s (SENT)
I20260709 12:25:12.790428 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:12.762531 14342 raft_consensus.cc:2749] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:12.793982 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:12.794709 11132 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 6.
I20260709 12:25:12.703933 15279 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:12.696177 11098 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:12.789811 11025 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:12.770002 14907 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:12.728140 15409 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:12.794001 11053 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
W20260709 12:25:12.805708 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 109599us
I20260709 12:25:12.821316 11098 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:12.822661 15428 raft_consensus.cc:3055] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:12.823107 15428 raft_consensus.cc:740] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:12.823375 15381 raft_consensus.cc:2804] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:12.823859 15381 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.824273 15381 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:12.817443 11025 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:12.830446 15477 raft_consensus.cc:2749] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:12.831374 14907 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:12.836540 15437 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:12.837087 15437 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:12.837491 15437 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:12.838527 10948 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:12.841054 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 713) took 1308 ms. Trace:
I20260709 12:25:12.861413 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:12.861774 11129 rpcz_store.cc:276] 0709 12:25:11.532325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.193062 (+660737us) service_pool.cc:224] Handling call
0709 12:25:12.839460 (+646398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:12.839642 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:12.839665 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:12.839703 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:12.839731 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.839781 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:12.840848 (+  1067us) spinlock_profiling.cc:243] Waited 646 ms on lock 0x7b5400030a50. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:12.840978 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1485702016}
I20260709 12:25:12.838560 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 2409) took 1317 ms. Trace:
I20260709 12:25:12.862654 11060 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 13.
I20260709 12:25:12.847692 15361 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:12.764415 15400 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:12.848557 11059 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 13.
I20260709 12:25:12.848837 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:12.851498 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:25:12.853399 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 272200us
I20260709 12:25:12.867408 11024 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:12.868305 15396 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:12.868775 15396 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.869127 15396 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:12.866597 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:12.874963 11059 raft_consensus.cc:2393] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 13: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:12.822788 11098 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:12.863811 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:12.820374 15394 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:12.862917 11133 rpcz_store.cc:276] 0709 12:25:11.521547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.527195 (+  5648us) service_pool.cc:224] Handling call
0709 12:25:12.838366 (+1311171us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b5400030a54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:12.838491 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":415802624}
I20260709 12:25:12.806604 15181 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:12.876096 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 17 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:12.876609 15409 raft_consensus.cc:2749] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:12.876890 15181 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:12.878036 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:12.879177 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:12.879752 15181 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:12.880195 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:25:12.878055 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 55362.2us
I20260709 12:25:12.880645 11060 raft_consensus.cc:2393] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 13: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:12.881278 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:12.881377 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:12.882570 11644 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:12.883153 11098 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:12.883489 15278 raft_consensus.cc:2749] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:12.884018 14907 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:12.884567 14907 raft_consensus.cc:697] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 12 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:12.884683 11098 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:12.885877 15420 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:12.885548 14907 consensus_queue.cc:237] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:12.886510 15420 raft_consensus.cc:697] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:12.887519 15420 consensus_queue.cc:237] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:12.889089 11644 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:12.889773 11098 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:12.889909 15278 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:12.790387 15209 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 12:25:12.893333 11059 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:12.898245 11059 raft_consensus.cc:606] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
W20260709 12:25:12.898131 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 59662us
I20260709 12:25:12.903950 10948 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:12.902549 11059 raft_consensus.cc:614] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:12.864555 15187 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:12.932811 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:12.933894 11059 raft_consensus.cc:2393] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 13: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:12.934957 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:12.936165 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:12.937271 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:12.937817 11059 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:12.912513 10948 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:12.939239 10948 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:12.940514 10948 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:12.941223 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:12.942080 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:12.944564 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.944623 14342 raft_consensus.cc:2804] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:12.945801 14342 raft_consensus.cc:697] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 13 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:12.941377 10948 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:12.947918 11133 raft_consensus.cc:2393] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 11: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:12.942087 11129 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
I20260709 12:25:12.946789 14342 consensus_queue.cc:237] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:12.941239 15470 raft_consensus.cc:2764] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:25:12.905556 15181 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:12.932930 15411 raft_consensus.cc:2804] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:12.823983 15428 consensus_queue.cc:260] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:12.950582 15408 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:12.932221 15375 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:12.943068 15361 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:12.948453 15471 raft_consensus.cc:2749] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:25:12.968307 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 328045us
I20260709 12:25:12.963161 15411 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:12.962312 15293 raft_consensus.cc:697] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:25:12.987902 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.977960  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:25:12.987999 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 298419us
I20260709 12:25:13.007107 10949 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:12.974046 15408 raft_consensus.cc:697] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 13 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:12.979094 15428 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:12.975230 15375 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:12.986974 15411 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:12.990211 15187 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.017277 11059 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:12.979717 15477 consensus_queue.cc:1059] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:25:13.017791 10949 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:13.038240 14402 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:13.009214 15376 raft_consensus.cc:697] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:12.987437 15038 consensus_queue.cc:1059] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:25:13.040601 11098 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:13.041661 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:12.980604 15381 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:13.046486 10949 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:13.050064 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:13.050985 11059 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:25:13.052605 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:13.056062 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:13.049144 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:13.011229 15361 raft_consensus.cc:2749] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:13.039896 15396 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:13.059648 15363 raft_consensus.cc:3055] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:13.061861 10949 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:13.039779 15187 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:13.087867 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:13.032764 15225 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:13.073750 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:13.088470 10949 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:13.015374 15470 consensus_queue.cc:1059] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:25:13.093313 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2530) took 1569 ms. Trace:
I20260709 12:25:13.093701 10979 rpcz_store.cc:276] 0709 12:25:11.523913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.934125 (+410212us) service_pool.cc:224] Handling call
0709 12:25:11.934439 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:12.548334 (+613895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.093058 (+544724us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b540022b854. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:13.093249 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1299672832}
I20260709 12:25:13.096570 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:13.085649 15119 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.099960 11057 raft_consensus.cc:1240] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 10. Current term is 11. Ops: [10.11-10.11]
W20260709 12:25:13.097756 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 60750.4us
I20260709 12:25:13.047183 15181 raft_consensus.cc:2749] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:13.098415 11060 raft_consensus.cc:2393] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 14: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:13.085853 15363 raft_consensus.cc:740] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:13.102809 11057 raft_consensus.cc:1275] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:13.076768 15375 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:13.099552 10949 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:13.103971 14402 consensus_queue.cc:1048] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:13.075249 15483 raft_consensus.cc:2804] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:13.089141 15360 raft_consensus.cc:2749] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:13.086552 15415 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:13.046200 15480 consensus_queue.cc:1048] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:25:13.112783 10949 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:13.092309 15408 consensus_queue.cc:237] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:13.130196 11675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 850) took 1930 ms. Trace:
I20260709 12:25:13.107141 11059 raft_consensus.cc:1275] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:13.107306 11057 raft_consensus.cc:1240] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:13.139027 11675 rpcz_store.cc:276] 0709 12:25:11.199386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.199509 (+   123us) service_pool.cc:224] Handling call
0709 12:25:12.143198 (+943689us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:12.667197 (+523999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.968855 (+301658us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b5400592c54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:13.129950 (+161095us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b5400592c50. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:13.130129 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3056814592}
I20260709 12:25:13.146952 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:13.151651 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:13.152626 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 43939.2us
W20260709 12:25:13.124644 15476 log.cc:927] Time spent T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:25:13.117229 15381 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:13.104874 15342 raft_consensus.cc:2749] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:13.154974 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:13.128886 15187 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:13.074434 15293 consensus_queue.cc:237] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:13.140101 15470 raft_consensus.cc:2749] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:13.270747 11059 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:13.277930 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 124988us
W20260709 12:25:13.244423 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.095289 15225 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:13.145295 15483 raft_consensus.cc:697] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:13.287978 15483 consensus_queue.cc:237] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:13.151387 15415 raft_consensus.cc:697] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
W20260709 12:25:13.291105 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 178412us
I20260709 12:25:13.106542 15119 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:13.158546 15360 raft_consensus.cc:2749] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:13.116571 15411 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:13.298281 10949 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:13.324267 10949 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:13.116833 15375 consensus_queue.cc:1048] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.160s
I20260709 12:25:13.118938 15481 consensus_queue.cc:1048] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.171s
I20260709 12:25:13.382198 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:13.383375 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:13.384008 10977 raft_consensus.cc:2376] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10. Re-sending same reply.
I20260709 12:25:13.343115 15187 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:13.348706 15225 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:13.350508 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:13.351159 15470 raft_consensus.cc:2804] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:13.351655 15415 consensus_queue.cc:237] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:13.354159 10949 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:13.295058 15492 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.364099 15381 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:13.262612 15344 consensus_queue.cc:1048] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.150s
I20260709 12:25:13.370561 11052 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:25:13.376837 15387 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:13.380506 15493 log.cc:927] Time spent T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.272s	user 0.000s	sys 0.000s
I20260709 12:25:13.381420 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:13.382994 10982 raft_consensus.cc:2393] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 13: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
W20260709 12:25:13.386723 10978 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.015s	sys 0.013s
I20260709 12:25:13.123982 15376 consensus_queue.cc:237] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:13.388010 10980 raft_consensus.cc:1240] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 12. Current term is 13. Ops: []
W20260709 12:25:13.413398 10978 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.016s	sys 0.013s
W20260709 12:25:13.423134 15437 consensus_meta.cc:287] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.585s	user 0.007s	sys 0.005s
I20260709 12:25:13.423641 15437 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:13.426316 11057 raft_consensus.cc:1240] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 11. Current term is 12. Ops: []
W20260709 12:25:13.429597 15400 consensus_meta.cc:287] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.534s	user 0.009s	sys 0.001s
I20260709 12:25:13.276019 15363 consensus_queue.cc:260] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:13.430976 15492 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:13.433434 15492 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:13.435997 15486 log.cc:927] Time spent T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.313s	user 0.001s	sys 0.001s
I20260709 12:25:13.437907 15361 raft_consensus.cc:3055] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:13.438395 15361 raft_consensus.cc:740] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:13.439242 15361 consensus_queue.cc:260] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:13.440518 15361 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:13.442229 15381 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:13.444738 15381 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:13.445154 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:13.446499 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:13.388835 11058 raft_consensus.cc:2393] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 11: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:13.389884 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:13.453488 10981 raft_consensus.cc:2393] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 9: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:13.453756 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:13.454320 11058 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:25:13.455044 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:13.357462 11059 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:25:13.390509 10949 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:13.373752 15411 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:13.394227 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:13.457350 11055 raft_consensus.cc:1240] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:25:13.457479 10977 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:13.459235 11098 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:13.460400 11098 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:13.467976 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 77546.1us
I20260709 12:25:13.468806 10949 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:13.391918 15360 raft_consensus.cc:2749] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:13.477735 10981 raft_consensus.cc:1275] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:13.480592 10977 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:13.391033 15470 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:13.483246 10977 raft_consensus.cc:1240] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:13.486068 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.485867 10949 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:13.489599 15344 raft_consensus.cc:2804] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:13.489646 15408 consensus_queue.cc:1059] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:13.490240 15344 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:13.490655 15344 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:13.491742 10949 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:13.492307 14342 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:13.493046 14342 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.493386 14342 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:13.470134 15400 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:13.497702 15400 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:13.498327 15470 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:13.483916 15381 raft_consensus.cc:2804] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:13.502888 15381 raft_consensus.cc:697] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:13.507134 11023 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:13.508414 11023 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:13.509380 10982 raft_consensus.cc:1240] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:13.483556 15492 raft_consensus.cc:2804] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:13.511969 15209 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.512221 15492 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.512300 15297 raft_consensus.cc:2804] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:13.512667 15492 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:13.513418 15413 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:13.513862 15413 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.512696 15209 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:13.514695 14695 consensus_queue.cc:1048] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:13.516542 14695 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:13.512993 15297 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.518281 15297 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:13.518767 15454 consensus_queue.cc:260] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:13.519847 15454 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:13.520351 15492 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:13.520845 15209 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:13.503907 15381 consensus_queue.cc:237] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:13.522578 15492 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:13.425915 15437 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:13.514232 15413 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:13.550238 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.536480 15225 raft_consensus.cc:2804] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:13.509845 11023 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:13.566720 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 56931us
I20260709 12:25:13.568650 11023 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:13.531165 14342 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:13.532264 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:13.490742 15408 raft_consensus.cc:3055] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:13.527052 10949 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:13.570147 15408 raft_consensus.cc:740] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
W20260709 12:25:13.571255 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 44266.6us
I20260709 12:25:13.571153 15408 consensus_queue.cc:260] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:13.572549 15408 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:13.572758 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:13.574505 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:13.576195 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:13.577723 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:13.581774 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:13.582517 14342 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:13.510161 15394 consensus_queue.cc:1175] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" responder_term: 11 status { last_received { term: 10 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:25:13.585069 10984 raft_consensus.cc:2393] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 14: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:13.582522 11129 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:25:13.535923 15400 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.610172 10981 raft_consensus.cc:1240] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:13.611280 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:13.614266 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:13.615461 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:13.609707 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:13.524509 15298 consensus_queue.cc:1059] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 12:25:13.635926 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:13.636790 10978 raft_consensus.cc:2393] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 13: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:13.584040 15481 raft_consensus.cc:2804] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:13.605607 15435 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:13.650590 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:25:13.644485 15502 log.cc:927] Time spent T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:25:13.605863 15225 raft_consensus.cc:697] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 9 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:13.635373 15376 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.663123 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:13.665759 10978 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:13.652927 10981 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
I20260709 12:25:13.668004 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:13.610905 15480 consensus_queue.cc:1059] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:25:13.695096 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:13.609056 15365 consensus_queue.cc:1048] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:25:13.606151 15437 consensus_queue.cc:1059] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:25:13.617630 15400 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:13.702206 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:13.736127 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:13.660019 15481 raft_consensus.cc:697] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:13.738206 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:13.739111 10981 raft_consensus.cc:2410] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:25:13.740814 10981 raft_consensus.cc:1275] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:13.780166 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:13.745290 15495 log.cc:927] Time spent T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.376s	user 0.001s	sys 0.002s
I20260709 12:25:13.781356 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:13.785959 11126 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
I20260709 12:25:13.787035 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:13.783914 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:13.788575 11128 raft_consensus.cc:2410] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:25:13.672793 15376 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:13.784616 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:13.744627 15187 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:13.794566 11680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 857) took 2003 ms. Trace:
I20260709 12:25:13.794888 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:13.796684 11125 raft_consensus.cc:2393] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 13: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:13.795991 11680 rpcz_store.cc:276] 0709 12:25:11.791072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.791207 (+   135us) service_pool.cc:224] Handling call
0709 12:25:11.808789 (+ 17582us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.870430 (+ 61641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.790923 (+1920493us) spinlock_profiling.cc:243] Waited 59.2 ms on lock 0x7b54006801d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:13.794497 (+  3574us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136122112}
W20260709 12:25:13.797736 15491 log.cc:927] Time spent T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.426s	user 0.005s	sys 0.001s
I20260709 12:25:13.798300 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:13.799557 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:13.800645 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:13.801561 10977 raft_consensus.cc:2410] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:25:13.804422 11051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41294 (request call id 1702) took 1309 ms. Trace:
I20260709 12:25:13.804867 11051 rpcz_store.cc:276] 0709 12:25:12.495419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.850080 (+354661us) service_pool.cc:224] Handling call
0709 12:25:13.804190 (+954110us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b54003dde54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:13.804353 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2021707648}
I20260709 12:25:13.806416 11053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1961) took 1336 ms. Trace:
I20260709 12:25:13.806846 11053 rpcz_store.cc:276] 0709 12:25:12.470128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.651580 (+181452us) service_pool.cc:224] Handling call
0709 12:25:13.806223 (+1154643us) spinlock_profiling.cc:243] Waited 50.8 ms on lock 0x7b5400300cd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:13.806350 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116940032}
I20260709 12:25:13.793177 15420 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.816398 15420 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:13.817752 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:13.818516 11129 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 13.
I20260709 12:25:13.818740 15420 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:13.792955 15428 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.820303 15428 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:13.821689 14872 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:13.822464 15428 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:13.672598 15225 consensus_queue.cc:237] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:13.825057 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:13.825826 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:13.827083 11126 raft_consensus.cc:2376] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bc01179655564f29b83babe396377cbb in term 13. Re-sending same reply.
I20260709 12:25:13.828286 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:13.829232 11126 raft_consensus.cc:2410] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 12:25:13.834337 15500 log.cc:927] Time spent T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 12:25:13.835053 11126 raft_consensus.cc:1240] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:13.835836 11097 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:13.840322 11097 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:13.841187 14872 raft_consensus.cc:2749] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:13.841573 11097 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:13.841897 14872 raft_consensus.cc:2804] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:13.844683 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:13.845780 11130 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:25:13.847399 11097 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:13.847841 14872 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:13.848098 15428 raft_consensus.cc:2749] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:13.848582 11125 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:13.849761 15400 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:13.851315 15408 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.851974 15408 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:13.852892 14872 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:13.856619 15408 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:13.856328 15344 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:13.855055 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:13.863962 10978 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:13.862018 10949 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:13.865319 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:13.778869 15224 consensus_queue.cc:1059] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.119s
W20260709 12:25:13.903877 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:13.908340 15505 log.cc:927] Time spent T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:25:13.908833 15454 raft_consensus.cc:3055] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:13.779558 15415 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:13.912456 11131 raft_consensus.cc:2393] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 10: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:13.907128 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:25:13.913154 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 51243.4us
I20260709 12:25:13.918915 15484 raft_consensus.cc:2804] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:13.859195 15411 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.921164 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:13.922454 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:13.924177 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:13.865984 10978 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:13.935020 10979 raft_consensus.cc:2393] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 12: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:13.909287 15454 raft_consensus.cc:740] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:25:13.962033 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.867642 11097 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:13.954798 10984 raft_consensus.cc:1240] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:13.955506 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:13.974149 15428 raft_consensus.cc:2749] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:13.974479 10980 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:13.975701 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:13.976912 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:13.977741 10980 raft_consensus.cc:2410] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:25:13.919543 15484 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:13.813656 15297 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:13.783044 15293 consensus_queue.cc:1048] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.129s
I20260709 12:25:13.858717 15408 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.867087 15483 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
W20260709 12:25:13.996644 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 129091us
I20260709 12:25:13.788669 15437 consensus_queue.cc:1048] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.149s
I20260709 12:25:13.988830 11056 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1694) took 1546 ms. Trace:
I20260709 12:25:13.920039 15411 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:13.936170 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:14.010250 10979 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:25:13.844187 15470 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:14.002503 11097 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:13.973027 15435 raft_consensus.cc:697] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:25:14.005618 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.006245 11059 raft_consensus.cc:2393] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 10: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:14.004727 11056 rpcz_store.cc:276] 0709 12:25:12.442407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.891333 (+448926us) service_pool.cc:224] Handling call
0709 12:25:12.891709 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:12.897415 (+  5706us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:12.897443 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:12.901232 (+  3789us) log.cc:844] Serialized 26 byte log entry
0709 12:25:13.094907 (+193675us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:13.095637 (+   730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.095838 (+   201us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:13.551979 (+456141us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:25:13.979974 (+427995us) raft_consensus.cc:1685] finished
0709 12:25:13.979996 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:13.988757 (+  8761us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":668,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":11198,"spinlock_wait_cycles":27195264,"thread_start_us":134366,"threads_started":1,"wal-append.queue_time_us":421765}
I20260709 12:25:13.982743 15361 raft_consensus.cc:2804] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:13.985482 15484 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:13.935657 15415 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:14.023813 11132 raft_consensus.cc:1240] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:14.004823 15408 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:14.032475 15408 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:14.027160 11097 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:14.034319 15381 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:14.034675 15435 consensus_queue.cc:237] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:14.035838 15470 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:14.007239 15119 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:14.038035 11097 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:14.037568 10975 raft_consensus.cc:1240] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 11. Current term is 12. Ops: []
W20260709 12:25:14.043200 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 426919us
I20260709 12:25:14.007408 15409 consensus_queue.cc:1048] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:25:14.006644 15483 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:13.981668 15481 consensus_queue.cc:237] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:14.047070 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 299983us
I20260709 12:25:14.047132 11097 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:14.048667 11133 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:25:14.050704 15470 consensus_queue.cc:1059] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:14.051623 15470 raft_consensus.cc:3055] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:14.029440 15454 consensus_queue.cc:260] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:14.058702 15344 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:14.058945 15297 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:14.061460 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:14.063899 11052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 1976) took 1590 ms. Trace:
I20260709 12:25:14.064544 15376 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:14.066663 11056 raft_consensus.cc:3055] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:14.067077 11056 raft_consensus.cc:740] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:14.067809 11056 consensus_queue.cc:260] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:14.069095 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:14.052019 15470 raft_consensus.cc:740] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
W20260709 12:25:14.071669 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.071959 11056 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:14.064350 11052 rpcz_store.cc:276] 0709 12:25:12.473726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.711217 (+237491us) service_pool.cc:224] Handling call
0709 12:25:14.063675 (+1352458us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b54000b72d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:14.063825 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1385283456}
I20260709 12:25:14.080125 11054 raft_consensus.cc:1275] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:14.047727 15428 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:14.082311 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:14.075834 15413 consensus_meta.cc:287] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.504s	user 0.015s	sys 0.005s
W20260709 12:25:14.078368 15509 log.cc:927] Time spent T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 12:25:14.082170 15488 log.cc:927] Time spent T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.959s	user 0.008s	sys 0.000s
I20260709 12:25:14.051712 15415 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:14.105409 15119 consensus_queue.cc:1048] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:14.088106 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:14.090847 10979 raft_consensus.cc:1240] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:14.106719 15470 consensus_queue.cc:260] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:14.108039 15470 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:14.108188 10979 raft_consensus.cc:1240] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:14.082253 15409 raft_consensus.cc:2749] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:14.085412 10978 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
W20260709 12:25:14.152591 11127 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 2036) took 1725 ms (client timeout 2239 ms). Trace:
W20260709 12:25:14.153101 11127 rpcz_store.cc:269] 0709 12:25:12.426939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.428330 (+  1391us) service_pool.cc:224] Handling call
0709 12:25:14.151230 (+1722900us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b5400032d54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:14.152507 (+  1277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":523832704}
I20260709 12:25:14.155648 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:14.156579 10978 raft_consensus.cc:2393] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 10: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:25:14.157269 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.097179 11056 raft_consensus.cc:1275] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:25:14.102051 15122 consensus_queue.cc:1048] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:14.102432 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:14.088173 15413 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:14.085516 11097 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:14.158823 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 73383.7us
I20260709 12:25:14.084247 15428 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:14.159569 15428 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:14.162389 15415 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:14.162921 15415 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:14.163285 15415 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:14.164774 11052 raft_consensus.cc:2393] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 11: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:14.175661 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:14.176605 10978 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:25:14.178359 10978 raft_consensus.cc:1275] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:25:14.181648 10978 pending_rounds.cc:85] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 6
I20260709 12:25:14.158186 11056 pending_rounds.cc:85] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting all ops after (but not including) 8
I20260709 12:25:14.142987 10948 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:14.190735 10978 pending_rounds.cc:107] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 9.7
W20260709 12:25:14.186383 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.191663 11056 pending_rounds.cc:107] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:25:14.192072 11056 raft_consensus.cc:2889] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:14.187528 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.188169 15413 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:14.191108 10978 raft_consensus.cc:2889] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:14.200100 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:14.201815 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:14.203024 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:14.210456 11097 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:25:14.213485 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 70600.7us
I20260709 12:25:14.203668 10978 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
W20260709 12:25:14.209652 15513 log.cc:927] Time spent T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.100s	user 0.003s	sys 0.002s
I20260709 12:25:14.226413 11097 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:14.220096 15408 raft_consensus.cc:2804] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:14.220279 15376 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.222573 15409 raft_consensus.cc:2804] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:14.261693 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:14.262501 10981 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:14.221073 15360 consensus_queue.cc:1048] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:25:14.233615 15374 raft_consensus.cc:2804] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:14.236759 15408 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:14.282912 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:14.283428 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:14.284077 11673 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 6.
I20260709 12:25:14.285516 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:14.286698 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:14.287302 11679 raft_consensus.cc:1275] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:14.265539 15409 raft_consensus.cc:697] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:14.290836 11023 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:14.292013 11680 raft_consensus.cc:1240] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:14.271644 15374 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:14.294586 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:25:14.295549 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.246640 15376 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:14.338088 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:14.338863 11677 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:25:14.338932 14402 raft_consensus.cc:2804] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:14.339437 14402 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:14.339985 14402 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:14.298486 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:14.279359 15408 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:14.297827 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:14.339346 10981 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:14.341614 11678 raft_consensus.cc:2393] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 9: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
W20260709 12:25:14.296209 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 67478us
I20260709 12:25:14.276590 15435 consensus_queue.cc:1059] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:25:14.345731 11675 raft_consensus.cc:2393] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 13: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:14.288574 15341 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.345896 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:14.346873 11672 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:14.375836 11130 raft_consensus.cc:1275] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:25:14.376341 11130 pending_rounds.cc:85] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 12
I20260709 12:25:14.376645 11130 pending_rounds.cc:107] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 13.13
I20260709 12:25:14.376940 11130 raft_consensus.cc:2889] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:14.377316 11130 pending_rounds.cc:107] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 12:25:14.377856 11130 raft_consensus.cc:2889] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:14.382972 14402 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:14.295903 15374 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:14.425763 14402 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:14.339640 15507 log.cc:927] Time spent T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:25:14.342136 15492 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:14.343201 15526 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.446463 11672 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 13.
I20260709 12:25:14.296247 15480 consensus_queue.cc:1059] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.099s
W20260709 12:25:14.442687 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 75017.3us
I20260709 12:25:14.431937 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:25:14.393970 14872 consensus_meta.cc:287] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.538s	user 0.009s	sys 0.004s
I20260709 12:25:14.378357 15525 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.373222 15297 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
W20260709 12:25:14.451188 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 112242us
I20260709 12:25:14.451866 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:14.384842 15341 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:14.455991 15524 log.cc:927] Time spent T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 12:25:14.457774 15341 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:14.346997 15514 consensus_queue.cc:1048] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 12:25:14.458968 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:14.452983 11023 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:14.467553 14402 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:14.470952 14402 raft_consensus.cc:697] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:14.427304 15538 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:14.473627 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 92188.6us
W20260709 12:25:14.474810 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.471839 14402 consensus_queue.cc:237] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:14.388475 15484 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:14.468727 15381 raft_consensus.cc:2749] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:14.485003 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:14.485714 11675 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:14.488108 10981 raft_consensus.cc:1240] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:14.449117 15539 consensus_queue.cc:1048] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:25:14.452206 14872 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:14.498921 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:14.469692 15297 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:14.508433 11127 raft_consensus.cc:1240] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:14.515282 11127 raft_consensus.cc:1240] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:14.460558 15525 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:14.519760 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:14.449762 15409 consensus_queue.cc:237] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:14.452510 15526 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:14.529742 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.531749 11127 raft_consensus.cc:1240] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:14.534266 11678 raft_consensus.cc:2393] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 11: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:14.478958 15538 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:14.526253 15523 log.cc:927] Time spent T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
I20260709 12:25:14.546885 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:14.547165 11675 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:25:14.551002 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:25:14.552058 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.562572 15388 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:14.610534 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:14.611496 11675 raft_consensus.cc:2393] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 12: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:14.593379 15546 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.596465 15376 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:14.632964 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:25:14.618353 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 337289us
I20260709 12:25:14.607867 15547 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.596916 15341 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:14.641793 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:14.642781 11675 raft_consensus.cc:2410] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:25:14.652731 15350 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.653339 15350 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:14.659860 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:14.660589 11672 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 16.
I20260709 12:25:14.663473 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:25:14.640545 15531 log.cc:927] Time spent T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.254s	user 0.004s	sys 0.009s
W20260709 12:25:14.642959 15494 log.cc:927] Time spent T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 1.519s	user 0.008s	sys 0.014s
W20260709 12:25:14.665933 15551 log.cc:927] Time spent T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:25:14.668614 15530 log.cc:927] Time spent T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.212s	user 0.003s	sys 0.006s
I20260709 12:25:14.650357 15341 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:14.684755 15341 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:14.670806 15557 consensus_queue.cc:1059] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:14.664288 15350 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:14.671692 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:14.672385 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:14.673826 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:14.691181 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:14.674894 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:14.693778 11680 raft_consensus.cc:2410] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 12:25:14.690143 15533 log.cc:927] Time spent T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.178s	user 0.000s	sys 0.011s
I20260709 12:25:14.671031 15538 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:14.676432 15541 log.cc:927] Time spent T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.147s	user 0.005s	sys 0.008s
W20260709 12:25:14.660897 15543 log.cc:927] Time spent T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.124s	user 0.006s	sys 0.008s
W20260709 12:25:14.698670 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.701509 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:14.641063 15481 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:14.679615 15484 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:14.733299 15361 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:14.734125 15361 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:14.741634 11057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 653) took 1870 ms. Trace:
I20260709 12:25:14.742123 11057 rpcz_store.cc:276] 0709 12:25:12.871564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.148436 (+276872us) service_pool.cc:224] Handling call
0709 12:25:13.148726 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:13.426767 (+278041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:14.741369 (+1314602us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54002774d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:14.741564 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":637898496}
I20260709 12:25:14.743893 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:14.744616 10978 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:14.745638 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:14.745930 11023 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:14.746958 15298 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:14.747391 15298 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:14.747762 15298 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:14.645671 15547 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:14.753079 15547 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:14.641739 15546 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:14.753618 15552 consensus_queue.cc:1059] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:25:14.724030 11059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41294 (request call id 1714) took 1192 ms. Trace:
W20260709 12:25:14.727578 15470 consensus_meta.cc:287] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.619s	user 0.010s	sys 0.000s
I20260709 12:25:14.726306 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 618) took 1134 ms. Trace:
I20260709 12:25:14.727690 15408 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:14.730839 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:25:14.771339 15490 log.cc:927] Time spent T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 1.655s	user 0.003s	sys 0.007s
I20260709 12:25:14.771848 15408 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:14.772218 10979 raft_consensus.cc:1275] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:14.773813 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2549) took 2129 ms. Trace:
W20260709 12:25:14.774382 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.777297 15411 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:14.774250 10983 rpcz_store.cc:276] 0709 12:25:12.643956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.778897 (+134941us) service_pool.cc:224] Handling call
0709 12:25:12.779242 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:12.779611 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:12.779640 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:12.780073 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 12:25:13.006281 (+226208us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:13.006325 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.006411 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:14.770780 (+1764369us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:25:14.773478 (+  2698us) raft_consensus.cc:1685] finished
0709 12:25:14.773501 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:14.773708 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3774,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":82,"spinlock_wait_cycles":67694976,"thread_start_us":208251,"threads_started":1,"wal-append.queue_time_us":335302}
I20260709 12:25:14.783820 10983 raft_consensus.cc:1240] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:14.731787 15363 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:14.756911 15415 consensus_meta.cc:287] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.593s	user 0.004s	sys 0.008s
I20260709 12:25:14.790138 15415 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:14.719235 14872 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:14.754055 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.794222 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:14.794451 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:14.757802 15552 raft_consensus.cc:3055] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:14.795709 15552 raft_consensus.cc:740] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:14.796547 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:14.796614 15552 consensus_queue.cc:260] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:14.760836 11059 rpcz_store.cc:276] 0709 12:25:13.531861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.531998 (+   137us) service_pool.cc:224] Handling call
0709 12:25:14.723824 (+1191826us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b54003142d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:14.723965 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1002718464}
I20260709 12:25:14.768512 10975 rpcz_store.cc:276] 0709 12:25:13.592186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.594874 (+  2688us) service_pool.cc:224] Handling call
0709 12:25:13.595210 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:14.043481 (+448271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:14.726014 (+682533us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b5400333454. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:14.726239 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1016861056}
I20260709 12:25:14.798085 11125 raft_consensus.cc:1240] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:14.731086 15526 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:14.731395 15481 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:14.796802 10978 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:14.801841 11132 raft_consensus.cc:1240] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:25:14.802404 15413 consensus_queue.cc:1059] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:14.802922 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:14.803068 15478 raft_consensus.cc:3055] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:25:14.724424 15428 consensus_meta.cc:287] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.564s	user 0.006s	sys 0.003s
I20260709 12:25:14.803498 15478 raft_consensus.cc:740] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:14.803740 15428 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:14.804774 11130 raft_consensus.cc:1240] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:14.805117 15481 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:14.806309 11055 raft_consensus.cc:1275] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:14.800011 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:14.809455 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:14.810091 11125 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:25:14.798237 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:14.810717 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:14.811465 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:14.812562 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:14.813597 11132 raft_consensus.cc:2393] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 9: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:14.815284 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:14.815723 15478 consensus_queue.cc:260] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:14.816752 15478 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:14.818720 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 620) took 1220 ms. Trace:
I20260709 12:25:14.819111 10977 rpcz_store.cc:276] 0709 12:25:13.598738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.609407 (+ 10669us) service_pool.cc:224] Handling call
0709 12:25:14.818513 (+1209106us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b5400228b54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:14.818648 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":381176704}
I20260709 12:25:14.824267 10948 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:14.830029 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:14.831991 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:14.832600 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:14.833216 11060 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:25:14.823549 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:14.823666 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:14.828143 11679 raft_consensus.cc:1275] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:14.834924 11060 raft_consensus.cc:1275] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:14.834203 11132 raft_consensus.cc:2393] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 9: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:14.833498 10977 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:14.836877 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:14.837515 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:14.838474 11060 raft_consensus.cc:2410] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:25:14.720870 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 61072.5us
I20260709 12:25:14.839792 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:14.840600 11053 raft_consensus.cc:2368] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 11. Current term is 12.
I20260709 12:25:14.841032 11125 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 12: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:14.841485 10978 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:14.842134 11128 raft_consensus.cc:2410] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:25:14.842823 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:14.845757 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:14.839181 10977 raft_consensus.cc:1275] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:14.849109 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:14.854125 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 2415) took 1068 ms. Trace:
I20260709 12:25:14.854629 11128 rpcz_store.cc:276] 0709 12:25:13.785667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.823394 (+1037727us) service_pool.cc:224] Handling call
0709 12:25:14.854024 (+ 30630us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:14.851533 10948 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:14.855201 11051 raft_consensus.cc:1275] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:14.855990 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:14.857189 11128 raft_consensus.cc:2410] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:25:14.858301 11025 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
W20260709 12:25:14.851178 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 186798us
I20260709 12:25:14.861028 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:14.850337 11056 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
W20260709 12:25:14.866519 11643 connection.cc:256] RPC call timeout handler was delayed by -2.2224069530002453s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1889s for a response
I20260709 12:25:14.867080 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:14.867920 11672 raft_consensus.cc:2376] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bc01179655564f29b83babe396377cbb in term 13. Re-sending same reply.
W20260709 12:25:14.868027 11643 connection.cc:256] RPC call timeout handler was delayed by -1.2315495059997374s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16790000000000002s for a response
W20260709 12:25:14.868414 11643 connection.cc:256] RPC call timeout handler was delayed by -1.1325495060000321s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1789s for a response
I20260709 12:25:14.756279 15546 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:14.868698 11643 connection.cc:256] RPC call timeout handler was delayed by -1.0588750960000652s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18580000000000002s for a response
I20260709 12:25:14.869587 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:14.866364 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:14.866442 14464 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:14.871367 10948 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:14.876807 11643 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:14.878454 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:14.879220 11128 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:14.870940 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:14.879938 11125 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:14.880282 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:14.881434 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:14.883601 11643 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:14.886006 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:14.887142 11025 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:14.822546 15428 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:14.892447 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:14.894079 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:14.841753 15481 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.896621 14464 consensus_queue.cc:1059] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:25:14.896670 11675 raft_consensus.cc:2393] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 13: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:14.894758 11128 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
I20260709 12:25:14.884706 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:14.901459 11645 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:14.895648 15552 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:14.851825 15415 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:14.871722 15394 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.872040 15413 raft_consensus.cc:2749] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:14.872349 15547 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:14.897879 15521 log.cc:927] Time spent T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.623s	user 0.002s	sys 0.001s
I20260709 12:25:14.921510 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:14.871505 15501 raft_consensus.cc:2804] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:14.934924 14402 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.887727 15539 raft_consensus.cc:2749] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:14.939102 14402 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:14.948729 11052 raft_consensus.cc:1275] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:14.893559 15225 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:14.946496 10979 raft_consensus.cc:1240] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:14.900780 15516 raft_consensus.cc:2804] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:14.801205 15374 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:14.869359 15470 consensus_queue.cc:1048] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 12:25:14.878154 15437 consensus_queue.cc:1048] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:25:14.966487 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:14.967351 11675 raft_consensus.cc:2393] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 9: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:14.878485 15497 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.091s
I20260709 12:25:14.968452 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:14.902724 15561 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:14.968353 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 101164us
W20260709 12:25:14.970955 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 75785.7us
I20260709 12:25:14.955372 15415 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:14.972577 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 71214.1us
I20260709 12:25:14.973338 10977 raft_consensus.cc:1240] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:14.976905 11098 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:14.980340 11098 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:14.963426 15516 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:14.947781 15501 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:14.985463 11025 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:14.985740 11098 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:14.986822 11025 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:14.983273 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:14.966774 15429 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:25:14.988968 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 105459us
I20260709 12:25:14.919664 15481 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:14.992771 11643 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:14.937887 15394 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:15.001379 11098 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:15.004590 11025 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:14.977883 15409 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.982285 15539 raft_consensus.cc:2804] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:14.953701 15547 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:15.008996 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:15.009158 11025 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:15.033283 11643 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:14.987687 15501 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:14.988113 15516 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:15.038175 11643 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:14.991784 15435 raft_consensus.cc:2804] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:14.988860 15428 raft_consensus.cc:2749] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:15.034767 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 137772us
I20260709 12:25:14.981480 15517 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 12:25:15.047533 11060 raft_consensus.cc:2410] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 15 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:25:15.033164 15539 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:15.005236 15487 raft_consensus.cc:2749] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:15.067562 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:15.049762 15388 raft_consensus.cc:2749] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:15.055511 11679 raft_consensus.cc:1240] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:15.009873 15480 raft_consensus.cc:2749] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:15.010277 15350 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:15.056792 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:15.035766 11025 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:15.046399 15526 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:15.011011 11098 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:15.047784 15557 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:14.983286 14872 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:15.054728 15435 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:15.078631 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 67684.7us
I20260709 12:25:15.083029 11098 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:15.080587 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:15.080976 11132 raft_consensus.cc:1275] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:15.085270 11679 raft_consensus.cc:2393] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 13: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:15.086843 15481 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:15.070175 15361 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:14.983397 15415 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:15.094437 10983 raft_consensus.cc:1240] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:15.093546 15298 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:15.096772 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 61091.5us
I20260709 12:25:15.099887 11025 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:15.095343 11675 raft_consensus.cc:1240] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:15.031878 15562 consensus_queue.cc:1059] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.100s
I20260709 12:25:15.033978 15409 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:15.069775 15539 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:14.981988 15561 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:15.103632 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.099315 11098 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:15.122232 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.122550 11098 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:15.106060 15415 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:15.107729 11057 raft_consensus.cc:2410] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:25:15.095446 15560 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:15.104427 11025 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:15.097286 15435 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:15.113584 11125 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:15.107079 15396 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:15.118844 15437 raft_consensus.cc:2749] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:15.105926 15535 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:15.094619 15361 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:15.134956 11025 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:15.139174 15572 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:15.099820 15487 raft_consensus.cc:2749] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:15.101810 15481 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:15.147841 11681 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:25:15.154162 11025 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:15.081431 15569 consensus_queue.cc:1059] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 12:25:15.162395 11675 raft_consensus.cc:1240] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:15.178404 15575 raft_consensus.cc:2749] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:15.182579 15298 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:15.183338 15537 raft_consensus.cc:2749] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:15.184650 15565 log.cc:927] Time spent T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 12:25:15.185753 15564 log.cc:927] Time spent T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:25:15.186921 15394 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:15.142930 15388 raft_consensus.cc:2749] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:15.159127 15396 raft_consensus.cc:2749] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:15.191255 15350 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:15.197688 15561 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:15.202679 15567 log.cc:927] Time spent T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
W20260709 12:25:15.204290 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 50237.5us
I20260709 12:25:15.205835 15396 raft_consensus.cc:2749] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:15.206632 15396 consensus_queue.cc:1048] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:15.207406 15409 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:15.222889 15547 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:15.223634 15374 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:15.146793 15535 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.225055 15535 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:15.229586 15574 log.cc:927] Time spent T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:25:15.155548 15408 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:15.148495 14872 raft_consensus.cc:2749] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:15.253266 14872 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:15.253943 14872 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:15.141568 15560 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:15.205947 11025 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:15.262009 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 56145.9us
I20260709 12:25:15.264189 15478 consensus_queue.cc:1059] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:15.271924 15437 raft_consensus.cc:2804] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:15.273322 15437 raft_consensus.cc:697] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:15.275620 14695 raft_consensus.cc:3055] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:15.276136 14695 raft_consensus.cc:740] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:15.275645 10948 leader_election.cc:400] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 11. Current term is 12.
I20260709 12:25:15.277344 10948 leader_election.cc:403] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:25:15.276602 15437 consensus_queue.cc:237] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:15.277952 15361 raft_consensus.cc:2749] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 11. Current term is 12.
I20260709 12:25:15.277872 15484 consensus_queue.cc:1048] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:15.273352 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:15.283483 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:15.283725 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 735) took 1140 ms. Trace:
I20260709 12:25:15.275894 15225 consensus_queue.cc:1048] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:25:15.284125 11127 rpcz_store.cc:276] 0709 12:25:14.143791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.518061 (+374270us) service_pool.cc:224] Handling call
0709 12:25:14.518378 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:14.533599 (+ 15221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.283481 (+749882us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b540012c854. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:15.283666 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26743168}
I20260709 12:25:15.285427 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:15.295526 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:15.295714 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:15.299130 15562 raft_consensus.cc:3055] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:15.299602 15562 raft_consensus.cc:740] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:15.300349 11127 raft_consensus.cc:2393] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 13: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:15.303010 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:15.248121 15501 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:15.305755 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.316817 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:25:15.323948 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:15.325804 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 203321us
I20260709 12:25:15.326758 11098 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:15.293718 15560 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:15.335580 11098 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:15.337100 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:15.337802 11678 raft_consensus.cc:2393] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 13: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:15.344025 11098 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:15.348266 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 60857.9us
I20260709 12:25:15.352401 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:15.343928 15411 raft_consensus.cc:2749] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:15.340696 15428 raft_consensus.cc:2749] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:15.339847 15361 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:15.364997 11098 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:15.367376 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 225371us
I20260709 12:25:15.370308 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:15.349922 15409 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:15.371091 11059 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 15.
I20260709 12:25:15.375036 11024 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:15.375430 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:15.377107 11024 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:15.378010 11644 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:15.382539 11024 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:15.386298 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:25:15.394634 11098 leader_election.cc:336] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Timed out: RequestConsensusVote RPC to 127.9.145.196:42197 timed out after 2.224s (SENT)
I20260709 12:25:15.395165 11098 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:15.396592 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:15.399456 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:15.339350 15562 consensus_queue.cc:260] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:15.398075 15482 raft_consensus.cc:2749] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:15.407953 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2424) took 1620 ms. Trace:
I20260709 12:25:15.408380 11130 rpcz_store.cc:276] 0709 12:25:13.787908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.379255 (+591347us) service_pool.cc:224] Handling call
0709 12:25:14.442354 (+ 63099us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:14.805139 (+362785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.407715 (+602576us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b5400068454. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:15.407891 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":833026944}
I20260709 12:25:15.409576 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:15.374656 15409 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.394091 15411 raft_consensus.cc:2804] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:15.394311 15570 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:15.393770 15396 raft_consensus.cc:2749] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:15.438287 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 60355.4us
I20260709 12:25:15.444747 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:15.384757 15487 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:25:15.374248 15361 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:15.405025 15428 raft_consensus.cc:2749] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:15.435454 15409 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:15.474597 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:15.436486 15411 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.439281 14872 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:15.493465 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:15.498023 11059 raft_consensus.cc:1275] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:15.499734 11059 raft_consensus.cc:1275] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:25:15.504674 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:15.488745 15552 consensus_meta.cc:287] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.552s	user 0.006s	sys 0.006s
I20260709 12:25:15.507581 11127 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 10.
I20260709 12:25:15.512056 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:15.491133 15411 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:15.518636 15557 raft_consensus.cc:2749] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:15.508868 14907 consensus_queue.cc:1048] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:25:15.512950 14872 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:25:15.529271 15579 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:15.529817 15579 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.530223 15579 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:15.530768 15588 log.cc:927] Time spent T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:25:15.532958 15361 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:15.535773 15516 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:15.537134 15501 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:15.538542 15587 log.cc:927] Time spent T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:25:15.541046 15481 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:15.575165 11678 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
W20260709 12:25:15.583663 15598 log.cc:927] Time spent T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:25:15.584481 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:15.564225 15435 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:15.586457 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:15.587821 15435 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:15.587944 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:15.589313 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:15.546021 15535 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:15.593151 15535 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:15.594205 15516 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:15.597244 15187 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:15.589653 15409 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:15.597851 15187 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:15.589534 15539 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:15.598242 15411 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:15.602269 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:15.602726 15409 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:15.603144 15539 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:15.603288 11677 raft_consensus.cc:1240] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:15.561729 15579 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:15.605656 11677 raft_consensus.cc:1240] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:15.605993 15579 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:15.609462 11676 raft_consensus.cc:1275] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:15.612205 15411 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:15.663539 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.666955 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2572) took 1577 ms. Trace:
I20260709 12:25:15.668066 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 2588) took 1143 ms. Trace:
I20260709 12:25:15.668534 10978 rpcz_store.cc:276] 0709 12:25:14.524285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.745402 (+221117us) service_pool.cc:224] Handling call
0709 12:25:15.667641 (+922239us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b5400333e54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:15.667851 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63949568}
I20260709 12:25:15.667625 10976 rpcz_store.cc:276] 0709 12:25:14.088977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.089473 (+   496us) service_pool.cc:224] Handling call
0709 12:25:14.089833 (+   360us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:14.090229 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:14.090282 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:14.110542 (+ 20260us) log.cc:844] Serialized 52 byte log entry
0709 12:25:14.378355 (+267813us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:14.429751 (+ 51396us) log.cc:844] Serialized 14 byte log entry
0709 12:25:14.659387 (+229636us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b18004b1180. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cd9e07 00007f8f91b349a9 00007f8f88cf669b 00007f8f88cf493f 00007f8f88cf4455 00007f8f8bddc060 00007f8f8bdee716 00007f8f8bdff287 00007f8f8bdff208
0709 12:25:14.860750 (+201363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:14.860828 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:15.592529 (+731701us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b18004b1180. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cf73f3 00007f8f88cf97c1 00007f8f88cf9779 00007f8f88cf9709 00007f8f88cf96d1 00007f8f88cf89cd 0000000000388634 0000000000388479 00007f8f88cda83a
0709 12:25:15.666249 (+ 73720us) raft_consensus.cc:1685] finished
0709 12:25:15.666323 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:15.666707 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41579,"prepare.queue_time_us":51192,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":2357,"raft.queue_time_us":51538,"raft.run_cpu_time_us":1101,"raft.run_wall_time_us":50188,"spinlock_wait_cycles":30328320,"thread_start_us":410953,"threads_started":2,"wal-append.queue_time_us":332242}
I20260709 12:25:15.674252 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2583) took 1434 ms. Trace:
I20260709 12:25:15.700212 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:15.675631 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2561) took 2295 ms. Trace:
I20260709 12:25:15.677217 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2590) took 1152 ms. Trace:
I20260709 12:25:15.678823 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 617) took 2088 ms. Trace:
W20260709 12:25:15.681190 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.684326 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:15.686403 11059 raft_consensus.cc:1240] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:15.602980 11672 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:15.691037 11127 raft_consensus.cc:2368] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 11. Current term is 12.
I20260709 12:25:15.692863 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:15.693156 15187 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:15.696753 15435 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.699277 15484 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:15.708446 15560 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.718083 15435 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:15.718667 15484 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:15.723204 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:15.724025 11128 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:15.725445 15484 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:15.718710 10979 raft_consensus.cc:2393] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 9: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:15.719360 15560 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:15.731827 15501 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:15.732623 15409 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:15.733542 11125 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:15.733880 15409 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:15.703325 10983 rpcz_store.cc:276] 0709 12:25:14.524766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.785376 (+260610us) service_pool.cc:224] Handling call
0709 12:25:14.791913 (+  6537us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:15.094901 (+302988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.676663 (+581762us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b540009b354. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:15.677008 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":695304064}
I20260709 12:25:15.739926 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:15.741065 11127 raft_consensus.cc:2368] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 11. Current term is 12.
I20260709 12:25:15.709141 11672 raft_consensus.cc:1275] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:15.709688 15187 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:15.710685 15225 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.750495 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:15.711660 15361 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.751456 15575 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:15.751709 15361 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:15.714551 15602 consensus_queue.cc:1059] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:15.753682 15602 raft_consensus.cc:3055] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:15.753973 15560 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:15.754149 15602 raft_consensus.cc:740] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:15.755008 11677 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:15.755944 15602 consensus_queue.cc:260] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:15.737954 15409 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:15.759285 15409 consensus_queue.cc:1059] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:25:15.760224 11133 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 2040) took 1980 ms (client timeout 1756 ms). Trace:
I20260709 12:25:15.760444 15361 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:15.751164 15225 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:15.764487 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 736) took 1112 ms. Trace:
I20260709 12:25:15.764904 15225 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:15.755961 15435 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:15.757863 15602 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:15.771023 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:15.776628 15408 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:15.777312 15408 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:15.778738 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:15.779187 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:15.779673 11059 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:15.780918 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:25:15.760754 11133 rpcz_store.cc:269] 0709 12:25:13.779741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.779887 (+   146us) service_pool.cc:224] Handling call
0709 12:25:15.759891 (+1980004us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54000dd754. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:15.760045 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":615704832}
I20260709 12:25:15.792659 15481 consensus_queue.cc:1059] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:15.703903 10984 rpcz_store.cc:276] 0709 12:25:13.590547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.591226 (+   679us) service_pool.cc:224] Handling call
0709 12:25:13.591616 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:13.973953 (+382337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.678194 (+1704241us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b540035f054. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:15.678613 (+   419us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":834721664}
I20260709 12:25:15.702240 10981 rpcz_store.cc:276] 0709 12:25:14.239948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.348247 (+108299us) service_pool.cc:224] Handling call
0709 12:25:14.348552 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:14.488575 (+140023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.673649 (+1185074us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400229f54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:15.674024 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320532352}
I20260709 12:25:15.784343 11126 rpcz_store.cc:276] 0709 12:25:14.652091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.678312 (+ 26221us) service_pool.cc:224] Handling call
0709 12:25:15.762482 (+1084170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:15.763021 (+   539us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:15.763058 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:15.763135 (+    77us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:15.763180 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.763294 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:15.764064 (+   770us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54000dd750. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:15.764224 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2492253952}
I20260709 12:25:15.806306 10976 raft_consensus.cc:1275] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
W20260709 12:25:15.759356 11131 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 2046) took 1973 ms (client timeout 2477 ms). Trace:
I20260709 12:25:15.702955 10982 rpcz_store.cc:276] 0709 12:25:13.380416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.400063 (+ 19647us) service_pool.cc:224] Handling call
0709 12:25:13.400355 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:13.509794 (+109439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.675091 (+2165297us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54000d9b54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:15.675429 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":250310400}
I20260709 12:25:15.806838 10976 pending_rounds.cc:85] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 9
I20260709 12:25:15.811537 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:15.732857 15501 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:15.813269 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:15.814538 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:15.815578 15501 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:15.816208 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:15.816977 11024 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:15.752362 15575 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:15.823758 15374 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:15.824553 15575 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:15.825387 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:15.826617 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:15.827010 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:15.758452 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:15.828727 11130 raft_consensus.cc:2393] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 15: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:15.829557 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:15.830821 15477 raft_consensus.cc:3055] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:15.831310 15477 raft_consensus.cc:740] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:15.832657 15477 consensus_queue.cc:260] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:15.835526 11126 raft_consensus.cc:1275] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:15.836383 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2440) took 1032 ms. Trace:
I20260709 12:25:15.836757 11126 rpcz_store.cc:276] 0709 12:25:14.804378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.834376 (+1029998us) service_pool.cc:224] Handling call
0709 12:25:15.834924 (+   548us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:15.836027 (+  1103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.836296 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:15.813903 11133 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:15.838743 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:15.839726 10981 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:25:15.841645 15437 raft_consensus.cc:3055] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:15.827908 11132 raft_consensus.cc:2393] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 12: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:25:15.843490 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.829118 15482 consensus_queue.cc:1059] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:25:15.817149 11127 raft_consensus.cc:2368] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 11. Current term is 12.
I20260709 12:25:15.850697 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:15.807106 11131 rpcz_store.cc:269] 0709 12:25:13.785539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.800393 (+ 14854us) service_pool.cc:224] Handling call
0709 12:25:15.758903 (+1958510us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b5400032ad4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:15.759156 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255617792}
I20260709 12:25:15.833915 15477 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:15.858435 11059 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 16.
I20260709 12:25:15.861686 10979 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:15.810492 10976 pending_rounds.cc:107] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:25:15.864995 10976 raft_consensus.cc:2889] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:15.870724 11125 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:25:15.760663 15409 consensus_queue.cc:1243] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer c979ef00e0ad4157b49ebbdc13ce7cd7 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:25:15.858578 15437 raft_consensus.cc:740] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:15.882211 15470 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:15.883066 15470 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:15.898603 15482 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:15.899164 15482 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.899597 15482 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:15.901069 14402 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:15.901799 14402 raft_consensus.cc:3055] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:25:15.902629 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:15.904665 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 54434.6us
I20260709 12:25:15.905360 15297 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:15.906894 11127 raft_consensus.cc:1240] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 10. Current term is 11. Ops: []
W20260709 12:25:15.874065 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 57344.5us
I20260709 12:25:15.912523 14402 raft_consensus.cc:740] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:15.920468 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:15.923151 10977 raft_consensus.cc:1275] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:15.923260 14402 consensus_queue.cc:260] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:15.925652 14402 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:15.928479 11132 raft_consensus.cc:1240] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:15.929256 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 739) took 1055 ms. Trace:
I20260709 12:25:15.931475 15429 raft_consensus.cc:3055] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:15.931962 15429 raft_consensus.cc:740] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:15.933172 15429 consensus_queue.cc:260] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:15.937657 15483 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:15.939342 11676 raft_consensus.cc:1240] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:15.947081 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.929667 11132 rpcz_store.cc:276] 0709 12:25:14.874283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.873538 (+999255us) service_pool.cc:224] Handling call
0709 12:25:15.928191 (+ 54653us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:15.928958 (+   767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.929172 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:15.920894 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:15.947526 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2448) took 1066 ms. Trace:
I20260709 12:25:15.963137 11127 rpcz_store.cc:276] 0709 12:25:14.841021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.863092 (+1022071us) service_pool.cc:224] Handling call
0709 12:25:15.906576 (+ 43484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:15.907362 (+   786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.907549 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:15.929128 15397 raft_consensus.cc:3055] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:15.966702 15397 raft_consensus.cc:740] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:25:15.946313 15536 log.cc:927] Time spent T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 1.491s	user 0.000s	sys 0.007s
I20260709 12:25:15.979291 10981 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
W20260709 12:25:15.994671 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.998981 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:15.946043 15408 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:16.023114 11125 raft_consensus.cc:1275] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:16.029381 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 742) took 1034 ms. Trace:
I20260709 12:25:16.029774 11125 rpcz_store.cc:276] 0709 12:25:14.989935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.919824 (+929889us) service_pool.cc:224] Handling call
0709 12:25:15.967972 (+ 48148us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:16.023704 (+ 55732us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.023956 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:16.032819 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:16.031972 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2441) took 1224 ms. Trace:
I20260709 12:25:16.035737 11126 rpcz_store.cc:276] 0709 12:25:14.804636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.837732 (+1033096us) service_pool.cc:224] Handling call
0709 12:25:15.871717 (+ 33985us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:16.022932 (+151215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:16.022969 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:16.028473 (+  5504us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:16.028517 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.028583 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:16.028711 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:16.034904 11059 raft_consensus.cc:1275] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:16.041620 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:16.043345 11132 raft_consensus.cc:1240] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:16.045368 11132 raft_consensus.cc:1275] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:16.046298 15607 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:16.047183 15607 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:16.043045 11057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41294 (request call id 1715) took 1249 ms. Trace:
I20260709 12:25:16.049832 15607 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:16.045861 11052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 664) took 1407 ms. Trace:
W20260709 12:25:16.059476 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 277893us
I20260709 12:25:16.059746 15570 consensus_queue.cc:1059] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:16.060540 14464 consensus_queue.cc:1059] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:25:16.043273 15471 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.061075 15570 raft_consensus.cc:3055] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:16.061579 15570 raft_consensus.cc:740] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:16.062403 15400 raft_consensus.cc:2749] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:16.062959 15602 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.063825 15602 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:16.064710 15471 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:16.057734 15437 consensus_queue.cc:260] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:16.067291 15471 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:16.067526 15437 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:16.068460 11127 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:16.062201 15516 consensus_queue.cc:1048] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:25:16.070897 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:16.061831 14464 raft_consensus.cc:3055] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:16.073937 11128 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 13.
I20260709 12:25:16.053234 11057 rpcz_store.cc:276] 0709 12:25:14.793431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.796285 (+  2854us) service_pool.cc:224] Handling call
0709 12:25:16.042668 (+1246383us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b540008c0d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:16.042865 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":712881024}
I20260709 12:25:16.073401 14464 raft_consensus.cc:740] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:16.057282 11052 rpcz_store.cc:276] 0709 12:25:14.638539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.638706 (+   167us) service_pool.cc:224] Handling call
0709 12:25:14.652513 (+ 13807us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:14.949123 (+296610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.045309 (+1096186us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b54003016d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:16.045651 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":680441216}
I20260709 12:25:16.075333  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:16.072626 10977 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 15.
I20260709 12:25:16.078389 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:16.077471 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:16.079025 15483 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.082597 15483 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:16.083977 10880 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39956 (request call id 179) took 23641 ms (client timeout 15000 ms). Trace:
W20260709 12:25:16.084226 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 65315.3us
I20260709 12:25:16.063162 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:16.090778 10984 raft_consensus.cc:2410] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:25:16.085608 15365 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:25:16.095451  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:16.098397 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:16.100112 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:16.101944 15534 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:16.102871 15534 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:16.107419 15553 log.cc:927] Time spent T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 1.210s	user 0.005s	sys 0.000s
I20260709 12:25:16.111174 15454 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:16.121806 15535 raft_consensus.cc:3055] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:16.122432 15535 raft_consensus.cc:740] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:16.123493 15535 consensus_queue.cc:260] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:16.124989 15535 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:16.127252 15570 consensus_queue.cc:260] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:16.128993 15570 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:16.130972 11125 raft_consensus.cc:2393] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 13: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:16.132771 11025 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:16.135334 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:16.137509 15514 raft_consensus.cc:2749] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:16.133512 15562 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:16.142444 15514 consensus_queue.cc:1059] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:16.143169 15364 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:16.143280 15514 consensus_queue.cc:1243] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer 7518bdeb78f24e67a530754ae48547eb log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:25:16.143994 15364 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:16.143842 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:16.075403 14695 consensus_queue.cc:260] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:16.146898 15364 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:16.146623 11054 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:25:16.148916 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:16.143296 15429 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:16.127821 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 729) took 2625 ms. Trace:
I20260709 12:25:16.142091 15397 consensus_queue.cc:260] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:16.158622 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:16.076683 15400 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:16.162572 11133 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 7.
I20260709 12:25:16.165710 11025 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:16.166514 15364 consensus_queue.cc:1048] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:25:16.167608 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.168052 15398 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:16.087271 10880 rpcz_store.cc:269] 0709 12:24:52.442987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.443751 (+   764us) service_pool.cc:224] Handling call
0709 12:24:55.232787 (+2789036us) spinlock_profiling.cc:243] Waited 485 ms on lock 0x7b54002e9854. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4e090 00007f8f8bdecf3a 00007f8f91ba2e9c 00007f8f91ca104e 00007f8f901622a4 00007f8f90162232 00007f8f90162161 00007f8f901620dc 00007f8f90161392 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:16.083702 (+20850915us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:08.040536 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:08.083232 (+ 42696us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:08.083286 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:25:08.083302 (+    16us) tablet.cc:662] Decoding operations
0709 12:25:08.173655 (+ 90353us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:08.196052 (+ 22397us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:08.197857 (+  1805us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:25:08.227529 (+ 29672us) tablet.cc:701] Row locks acquired
0709 12:25:08.227581 (+    52us) write_op.cc:260] PREPARE: finished
0709 12:25:08.227840 (+   259us) write_op.cc:270] Start()
0709 12:25:08.252166 (+ 24326us) write_op.cc:276] Timestamp: P: 1783599908227696 usec, L: 0
0709 12:25:08.257963 (+  5797us) op_driver.cc:348] REPLICATION: starting
0709 12:25:08.374017 (+116054us) log.cc:844] Serialized 7553 byte log entry
0709 12:25:08.963408 (+589391us) op_driver.cc:464] REPLICATION: finished
0709 12:25:11.066294 (+2102886us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b1800319c60. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cf73f3 00007f8f88cf97c1 00007f8f88cf9779 00007f8f88cf9709 00007f8f88cf96d1 00007f8f88cf89cd 0000000000388634 0000000000388479 00007f8f88cda83a
0709 12:25:11.074419 (+  8125us) write_op.cc:301] APPLY: starting
0709 12:25:11.074530 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:11.588775 (+514245us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:11.588829 (+    54us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:12.181575 (+592746us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:12.181982 (+   407us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=0,mrs_lookups=0
0709 12:25:12.182027 (+    45us) write_op.cc:312] APPLY: finished
0709 12:25:12.182512 (+   485us) log.cc:844] Serialized 172 byte log entry
0709 12:25:12.681035 (+498523us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:12.704293 (+ 23258us) write_op.cc:454] Released schema lock
0709 12:25:12.714371 (+ 10078us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:12.733971 (+ 19600us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:12.734003 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":171295,"reported_tablets":31,"spinlock_wait_cycles":1116564352,"child_traces":[["op",{"apply.queue_time_us":78555,"apply.run_cpu_time_us":177507,"apply.run_wall_time_us":1659489,"cfile_cache_hit":74,"cfile_cache_hit_bytes":77071,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6210,"cfile_init":1,"lbm_read_time_us":77428,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":5,"num_ops":19,"prepare.queue_time_us":173693,"prepare.run_cpu_time_us":28715,"prepare.run_wall_time_us":574557,"raft.queue_time_us":84197,"raft.run_cpu_time_us":10386,"raft.run_wall_time_us":77233,"replication_time_us":703336,"spinlock_wait_cycles":48123136,"thread_start_us":848599,"threads_started":5,"wal-append.queue_time_us":977691,"wal-append.run_cpu_time_us":6356,"wal-append.run_wall_time_us":2141375}]]}
I20260709 12:25:16.181149 11056 raft_consensus.cc:2393] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 10: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:16.147413 14695 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:16.184046 15268 raft_consensus.cc:2804] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:25:16.179832 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 100323us
I20260709 12:25:16.172969 10949 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:16.198779 11133 raft_consensus.cc:1240] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:16.203924 11126 raft_consensus.cc:1275] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:16.152923 11134 rpcz_store.cc:276] 0709 12:25:13.502506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.512132 (+  9626us) service_pool.cc:224] Handling call
0709 12:25:13.512506 (+   374us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:13.512903 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:13.512932 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:13.513553 (+   621us) log.cc:844] Serialized 52 byte log entry
0709 12:25:13.730655 (+217102us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:14.028969 (+298314us) log.cc:844] Serialized 14 byte log entry
0709 12:25:14.029261 (+   292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:14.029349 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:15.943029 (+1913680us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b1800370240. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cf7522 00007f8f88cf97c1 00007f8f88cf9779 00007f8f88cf9709 00007f8f88cf96d1 00007f8f88cf89cd 0000000000388634 0000000000388479 00007f8f88cda83a
0709 12:25:16.102150 (+159121us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b24001f22a8. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88b7d9c4 00007f8f88b7bacb 00007f8f88d36dc9 00007f8f88d36a55 00007f8f88d35fb0 00007f8f8b9ac488 00007f8f8b9acbe8 00007f8f8b984398 00007f8f8b97f76a 00007f8f8b97ebb6
0709 12:25:16.115878 (+ 13728us) raft_consensus.cc:1685] finished
0709 12:25:16.115901 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:16.127628 (+ 11727us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":383432,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":1069,"raft.queue_time_us":14290,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":202,"spinlock_wait_cycles":39362176,"thread_start_us":465747,"threads_started":2,"wal-append.queue_time_us":468313}
I20260709 12:25:16.201647 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:16.197237 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:16.213389 11681 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:16.213065 15398 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:16.214954 15397 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:16.215967 15398 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:16.190165 15298 consensus_queue.cc:1059] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:25:16.217478 15293 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:16.218140 15293 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:16.198029 15471 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:16.242830 11676 raft_consensus.cc:1240] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:16.244937 15365 consensus_queue.cc:1059] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:16.246309 15514 raft_consensus.cc:3055] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:16.246801 15514 raft_consensus.cc:740] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:16.219843 15268 raft_consensus.cc:697] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:16.239723 11128 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:25:16.237389 11132 raft_consensus.cc:1275] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:16.251703 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:16.255609 11127 raft_consensus.cc:1275] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:16.247746 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:16.256927 10975 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:16.247927 15514 consensus_queue.cc:260] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:16.258189 15514 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:16.259430 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:16.227268 15534 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:16.250523 14464 consensus_queue.cc:260] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:16.255695 11126 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:16.247844 11644 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:16.270460 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:16.298657 15538 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.299459 15538 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:16.303009 11025 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:16.304432 15516 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:16.304845 15516 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:16.305239 15516 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:16.305931 15268 consensus_queue.cc:237] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:16.309228 15614 log.cc:927] Time spent T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:25:16.311038 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2453) took 1020 ms. Trace:
I20260709 12:25:16.311961 15525 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:16.312261 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:16.314177 11060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52804 (request call id 670) took 1423 ms. Trace:
I20260709 12:25:16.314716 11060 rpcz_store.cc:276] 0709 12:25:14.891122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.892179 (+  1057us) service_pool.cc:224] Handling call
0709 12:25:16.313742 (+1421563us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54003020d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:16.313976 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351257344}
I20260709 12:25:16.322453 15480 raft_consensus.cc:3055] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:16.322997 15480 raft_consensus.cc:740] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:25:16.323980 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 76383us
I20260709 12:25:16.275467 10948 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:16.301816 15538 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:16.328474 10981 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:25:16.265637 15398 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:16.331048 11134 raft_consensus.cc:1240] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 12:25:16.322911 15613 log.cc:927] Time spent T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.149s	user 0.002s	sys 0.000s
I20260709 12:25:16.337132 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:16.338032 11680 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:16.330279 11023 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:16.278483 15408 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:16.311506 11131 rpcz_store.cc:276] 0709 12:25:15.290408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.923500 (+633092us) service_pool.cc:224] Handling call
0709 12:25:15.923991 (+   491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:15.924619 (+   628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:15.924653 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:15.925372 (+   719us) log.cc:844] Serialized 26 byte log entry
0709 12:25:16.010944 (+ 85572us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:16.010990 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.011071 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:16.310730 (+299659us) raft_consensus.cc:1685] finished
0709 12:25:16.310755 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:16.310965 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":151,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":141,"thread_start_us":85009,"threads_started":1,"wal-append.queue_time_us":112233}
I20260709 12:25:16.228819 15400 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:16.322737 15293 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:16.355017 14464 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:16.330245 15483 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:16.358474 10975 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:25:16.359134 14402 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:16.331235 15602 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:16.364964 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 69204.4us
I20260709 12:25:16.365881 11023 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:16.368424 14402 raft_consensus.cc:697] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:16.369678 11126 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:25:16.331571 15471 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:16.380225 15547 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:16.386374 11128 raft_consensus.cc:1240] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:16.351629 15470 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:16.360715 15607 raft_consensus.cc:2749] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:25:16.394547 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 140836us
I20260709 12:25:16.411157 11134 raft_consensus.cc:1240] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:16.412204 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2438) took 1608 ms. Trace:
I20260709 12:25:16.416011 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:16.418797 15602 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.419130 15298 raft_consensus.cc:2804] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:16.419489 11132 raft_consensus.cc:1275] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:16.419804 15298 raft_consensus.cc:697] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:16.420981 15298 consensus_queue.cc:237] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:16.422500 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:16.427093 11060 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 13.
I20260709 12:25:16.412617 11130 rpcz_store.cc:276] 0709 12:25:14.803865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.829528 (+1025663us) service_pool.cc:224] Handling call
0709 12:25:15.830117 (+   589us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:15.884504 (+ 54387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:15.884536 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:15.885096 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 12:25:16.004571 (+119475us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:16.030644 (+ 26073us) log.cc:844] Serialized 14 byte log entry
0709 12:25:16.031766 (+  1122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.031840 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:16.219031 (+187191us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b18003fe440. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cf73f3 00007f8f88cf97c1 00007f8f88cf9779 00007f8f88cf9709 00007f8f88cf96d1 00007f8f88cf89cd 0000000000388634 0000000000388479 00007f8f88cda83a
0709 12:25:16.392216 (+173185us) raft_consensus.cc:1685] finished
0709 12:25:16.403263 (+ 11047us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:16.412134 (+  8871us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44035,"prepare.queue_time_us":18445,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":63,"raft.queue_time_us":55980,"raft.run_cpu_time_us":347,"raft.run_wall_time_us":3694,"spinlock_wait_cycles":4296576,"thread_start_us":119001,"threads_started":1,"wal-append.queue_time_us":186348}
I20260709 12:25:16.438338 15602 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:16.440940 15602 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:16.450749 11058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1711) took 3041 ms. Trace:
I20260709 12:25:16.451231 11058 rpcz_store.cc:276] 0709 12:25:13.408992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.455736 (+ 46744us) service_pool.cc:224] Handling call
0709 12:25:13.456059 (+   323us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:13.456378 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:13.456397 (+    19us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:13.482747 (+ 26350us) log.cc:844] Serialized 52 byte log entry
0709 12:25:14.534170 (+1051423us) spinlock_profiling.cc:243] Waited 37.8 ms on lock 0x7b18002e0f60. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cd9e07 00007f8f91b349a9 00007f8f88cf669b 00007f8f88cf493f 00007f8f88cf6c02 00007f8f8b97e20b 00007f8f8b983d23 00007f8f8b9840d1 00007f8f8bd9fa0f
0709 12:25:14.643674 (+109504us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:14.643713 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:14.643780 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:16.106503 (+1462723us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:25:16.450306 (+343803us) raft_consensus.cc:1685] finished
0709 12:25:16.450336 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:16.450565 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":80,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":22645,"spinlock_wait_cycles":129873920,"thread_start_us":109297,"threads_started":1,"wal-append.queue_time_us":1313988}
I20260709 12:25:16.456112 15547 raft_consensus.cc:697] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:16.457320 15547 consensus_queue.cc:237] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:16.463300 15400 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:16.464165 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 65769.9us
I20260709 12:25:16.467059 15387 consensus_queue.cc:1059] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:16.467221 11645 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:16.468017 15572 consensus_queue.cc:1048] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:16.468374 15561 raft_consensus.cc:2804] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:16.468883 15561 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:16.469264 15561 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:16.471056 11645 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:16.472322 15387 raft_consensus.cc:3055] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:16.472733 15387 raft_consensus.cc:740] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:16.479406 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:16.482316 11133 raft_consensus.cc:1275] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:25:16.482743 11133 pending_rounds.cc:85] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 10
I20260709 12:25:16.482983 11133 pending_rounds.cc:107] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:25:16.483209 11133 raft_consensus.cc:2889] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:16.486305 14402 consensus_queue.cc:237] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:16.487079 15482 consensus_meta.cc:287] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.587s	user 0.012s	sys 0.001s
I20260709 12:25:16.487605 15482 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:16.490397 11056 raft_consensus.cc:1240] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:25:16.438416 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2420) took 2651 ms. Trace:
I20260709 12:25:16.491257 11129 rpcz_store.cc:276] 0709 12:25:13.786889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.898416 (+111527us) service_pool.cc:224] Handling call
0709 12:25:13.898832 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:13.910618 (+ 11786us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:13.910652 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:13.919090 (+  8438us) log.cc:844] Serialized 26 byte log entry
0709 12:25:15.753841 (+1834751us) spinlock_profiling.cc:243] Waited 5.71 ms on lock 0x7b1800375520. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cd9e07 00007f8f91b349a9 00007f8f88cf669b 00007f8f88cf493f 00007f8f88cf6c02 00007f8f8b97e20b 00007f8f8b983d23 00007f8f8b9840d1 00007f8f8bd9fa0f
0709 12:25:16.022326 (+268485us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:16.022391 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.029045 (+  6654us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:16.356385 (+327340us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b24001f2338. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88b7d9c4 00007f8f88b7bacb 00007f8f88d36dc9 00007f8f88d36a55 00007f8f88d35fb0 00007f8f8b9ac488 00007f8f8b9acbe8 00007f8f8b984398 00007f8f8b97f76a 00007f8f8b97ebb6
0709 12:25:16.430314 (+ 73929us) raft_consensus.cc:1685] finished
0709 12:25:16.430351 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:16.438250 (+  7899us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11345,"raft.queue_time_us":12509,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":77792768,"thread_start_us":221726,"threads_started":1,"wal-append.queue_time_us":2124402}
I20260709 12:25:16.465602 15602 consensus_queue.cc:1059] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:25:16.507777 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 141984us
W20260709 12:25:16.509127 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 79262.3us
W20260709 12:25:16.515458 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 44481.4us
I20260709 12:25:16.404592 15538 consensus_queue.cc:1048] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.101s
I20260709 12:25:16.472610 15471 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:16.508081 10948 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:16.524467 11126 raft_consensus.cc:1275] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:16.512061 15525 raft_consensus.cc:2749] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:16.534336 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:16.528404 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:16.473770 15387 consensus_queue.cc:260] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:16.534328 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.490002 15482 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:16.539842 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 187969us
I20260709 12:25:16.539738 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:25:16.545714 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.550294 11674 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:16.549976 15516 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:16.558090 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:16.559564 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.558485 11053 raft_consensus.cc:1240] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:16.411834 15480 consensus_queue.cc:260] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:16.564273 11058 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
W20260709 12:25:16.565527 11097 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.912s (SENT) [suppressed 32 similar messages]
I20260709 12:25:16.568672 15471 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:25:16.576458 15437 consensus_meta.cc:287] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.005s
W20260709 12:25:16.586390 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 150905us
I20260709 12:25:16.586313 11060 raft_consensus.cc:1240] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:16.595651 10948 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:16.598728 11674 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:25:16.582592 15387 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:16.604238 15408 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.604931 15408 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:16.599773 15516 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:16.606998 15477 consensus_meta.cc:287] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.740s	user 0.013s	sys 0.000s
I20260709 12:25:16.614243 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:16.618621 15516 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.619328 15516 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:16.621726 15516 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:16.624437 15538 consensus_queue.cc:1048] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:16.626302 15538 consensus_queue.cc:1048] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:16.628580 15429 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.629153 15429 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:16.630396 15470 raft_consensus.cc:2749] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:16.607157 15408 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:16.632618 15616 log.cc:927] Time spent T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:25:16.642524 10948 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:16.633554 15470 consensus_queue.cc:1048] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:16.629184 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:16.626391 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:16.639704 11676 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:25:16.645483 11680 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 17.
W20260709 12:25:16.647184 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 57698.6us
I20260709 12:25:16.651808 11675 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:25:16.611083 15471 raft_consensus.cc:697] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 13 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
W20260709 12:25:16.645303 15535 consensus_meta.cc:287] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.520s	user 0.014s	sys 0.000s
I20260709 12:25:16.656363 11133 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
W20260709 12:25:16.649689 15581 log.cc:927] Time spent T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.171s	user 0.002s	sys 0.000s
I20260709 12:25:16.668033 10948 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:16.691929 11127 raft_consensus.cc:1275] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:25:16.692422 11127 pending_rounds.cc:85] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 6
I20260709 12:25:16.692660 11127 pending_rounds.cc:107] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:25:16.691752 11645 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:16.656823 15400 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.698760 11127 raft_consensus.cc:2889] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:16.706130 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:16.669672 15583 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.710176 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:16.712634 15187 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:16.702636 15397 raft_consensus.cc:2804] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:16.715377 15397 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.715755 15397 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:16.716418 14695 consensus_meta.cc:287] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.518s	user 0.010s	sys 0.000s
I20260709 12:25:16.711004 15400 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:16.721261 15400 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:16.722373 11059 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
I20260709 12:25:16.733417 15397 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:16.737155 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:16.737811 11133 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:16.743038 15471 consensus_queue.cc:237] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:16.745848 11133 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:25:16.747283 11645 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:16.748340 15577 raft_consensus.cc:2804] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:16.748865 15577 raft_consensus.cc:697] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:16.749779 15577 consensus_queue.cc:237] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:16.753787 15397 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:16.760243 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2455) took 1374 ms. Trace:
I20260709 12:25:16.760756 11125 rpcz_store.cc:276] 0709 12:25:15.385929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.170337 (+784408us) service_pool.cc:224] Handling call
0709 12:25:16.254282 (+ 83945us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:16.297682 (+ 43400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:16.297713 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:16.331802 (+ 34089us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:16.341737 (+  9935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.341804 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:16.760031 (+418227us) spinlock_profiling.cc:243] Waited 48.4 ms on lock 0x7b540012d250. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:16.760169 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111420160}
I20260709 12:25:16.765337 15187 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:16.765619 15615 log.cc:927] Time spent T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:25:16.653571 15561 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:16.771919 11057 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:16.772840 15400 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.774091 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:16.776908 10977 raft_consensus.cc:1240] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:16.773519 15400 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:16.778581 10983 raft_consensus.cc:1240] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:16.709152 15483 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:16.766244 15187 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:16.797151 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:16.760802 15364 consensus_queue.cc:1059] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:25:16.799497 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:25:16.808447 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 223985us
W20260709 12:25:16.795477 15581 log.cc:927] Time spent T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:25:16.817510 11125 raft_consensus.cc:1240] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 7. Current term is 8. Ops: []
W20260709 12:25:16.816558 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 729365us
I20260709 12:25:16.826290 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:16.826504 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:16.828002 11680 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:16.833488 10977 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:25:16.834285 10975 raft_consensus.cc:1275] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:25:16.767123 15583 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:16.871563 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:16.881395 10984 raft_consensus.cc:1240] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 6. Current term is 7. Ops: []
W20260709 12:25:16.886528 15618 log.cc:927] Time spent T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.063s	user 0.001s	sys 0.001s
I20260709 12:25:16.892248 15387 consensus_queue.cc:1059] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:16.893796 15400 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:16.898308 11098 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:16.899645 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:16.900478 11052 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 7.
W20260709 12:25:16.899875 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 101341us
I20260709 12:25:16.905264 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:16.796099 15535 consensus_queue.cc:1048] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
W20260709 12:25:16.910852 15454 consensus_meta.cc:287] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.738s	user 0.012s	sys 0.000s
I20260709 12:25:16.911542 11051 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 10.
W20260709 12:25:16.916014 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 248052us
I20260709 12:25:16.917557 10948 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:16.917768 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 226220us
I20260709 12:25:16.927403 11133 raft_consensus.cc:1275] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:16.947005 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:16.947806 11052 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
W20260709 12:25:16.951381 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:16.952164 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.955493 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:16.956256 10981 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:16.957500 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:16.958339 11676 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
I20260709 12:25:16.940990 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:16.930663 15470 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:16.964582 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:16.967434 15388 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.960357 15535 raft_consensus.cc:2749] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:17.000744 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.963186 15429 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:16.968376 15470 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.013827 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:17.017839 15571 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.020581 15187 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:16.982481 15388 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:17.022289 15038 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:17.022763 15638 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:17.024456 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 108352us
W20260709 12:25:17.031322 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.033249 15470 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:17.037946 11133 raft_consensus.cc:1275] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:17.045231 10949 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:17.052891 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:17.043295 11098 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:17.055090 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:17.056723 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:16.983280 14695 consensus_queue.cc:1048] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:25:17.050208 15561 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:17.074987 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:17.078315 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2573) took 2926 ms. Trace:
I20260709 12:25:17.041806 15454 consensus_queue.cc:1059] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:25:17.035727 15571 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:17.083436 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:17.088277 11053 raft_consensus.cc:2393] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 16: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:17.086225 11133 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
I20260709 12:25:17.092856 11645 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:17.079630 15535 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:17.101413 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:17.101572 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:17.053494 15038 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:17.106531 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:17.063803 15638 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:17.110164 11053 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 10.
I20260709 12:25:17.080675 10980 rpcz_store.cc:276] 0709 12:25:14.089282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.090223 (+   941us) service_pool.cc:224] Handling call
0709 12:25:14.142719 (+ 52496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:14.151309 (+  8590us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:25:14.189623 (+ 38314us) log.cc:844] Serialized 14 byte log entry
0709 12:25:15.091850 (+902227us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b18004b11e0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cd9e07 00007f8f91b349a9 00007f8f88cf669b 00007f8f88cf493f 00007f8f88cf6c02 00007f8f8b97e20b 00007f8f8b983d23 00007f8f8b98423a 00007f8f8bdeea2a
0709 12:25:15.150389 (+ 58539us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:15.150896 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 12:25:15.151046 (+   150us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:15.151077 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.151150 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:16.478215 (+1327065us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b18004b11e0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cf73f3 00007f8f88cf97c1 00007f8f88cf9779 00007f8f88cf9709 00007f8f88cf96d1 00007f8f88cf89cd 0000000000388634 0000000000388479 00007f8f88cda83a
0709 12:25:16.970190 (+491975us) raft_consensus.cc:1685] finished
0709 12:25:16.970219 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.015605 (+ 45386us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34292,"prepare.queue_time_us":61750,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":12795,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":25422,"spinlock_wait_cycles":50727040,"thread_start_us":58248,"threads_started":1,"wal-append.queue_time_us":971927}
W20260709 12:25:17.125546 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 90069.8us
I20260709 12:25:17.131282 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:17.133165 15583 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:17.134641 15631 raft_consensus.cc:2749] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:17.135684 15571 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:17.133111 11053 raft_consensus.cc:1275] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:17.148919 15538 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:17.149607 15538 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:17.149742 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:17.155004 15583 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:25:17.156279 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 111145us
I20260709 12:25:17.157208 10949 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
W20260709 12:25:17.159298 15626 log.cc:927] Time spent T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.125s	user 0.000s	sys 0.002s
I20260709 12:25:17.133234 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:17.128968 15577 raft_consensus.cc:2804] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:25:17.163477 15624 log.cc:927] Time spent T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.124s	user 0.002s	sys 0.000s
I20260709 12:25:17.155115 11098 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:17.165760 15583 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:17.166167 11098 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:17.167382 15640 raft_consensus.cc:2749] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:17.168243 11098 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:17.133183 15038 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:17.174937 15583 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:17.175603 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:17.176916 15388 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:17.178256 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:17.180435 11059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 2009) took 1095 ms. Trace:
I20260709 12:25:17.181404 11057 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:17.152161 15538 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:17.182188 11056 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1736) took 1017 ms. Trace:
I20260709 12:25:17.161356 15638 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:17.185755 10948 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:17.208455 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.226559 11052 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 13.
W20260709 12:25:17.229607 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 203721us
I20260709 12:25:17.228153 11059 rpcz_store.cc:276] 0709 12:25:16.085077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.090064 (+  4987us) service_pool.cc:224] Handling call
0709 12:25:17.180183 (+1090119us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b5400348854. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:17.180353 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1288755456}
I20260709 12:25:17.233383 11056 rpcz_store.cc:276] 0709 12:25:16.165064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.188694 (+ 23630us) service_pool.cc:224] Handling call
0709 12:25:16.325136 (+136442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:16.490869 (+165733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.181117 (+690248us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54003020d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:17.181887 (+   770us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54003020d0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:17.182083 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":664444672}
I20260709 12:25:17.241715 11023 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
W20260709 12:25:17.259407 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 73739.7us
I20260709 12:25:17.265005 11023 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:17.266589 15038 consensus_queue.cc:1048] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:17.267030 14464 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:17.267426 14464 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.267750 14464 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:17.278316 15534 raft_consensus.cc:2749] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:17.256131 15484 raft_consensus.cc:2804] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:25:17.294778 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 137665us
I20260709 12:25:17.264628 15398 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:17.291424 14464 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:17.303762 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:17.294791 15516 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:17.307545 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 139364us
I20260709 12:25:17.262312 15470 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:17.309568 11125 raft_consensus.cc:1275] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:17.295892 15484 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:17.311604 14464 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:17.296823 15038 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.301163 15398 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:17.318075 15470 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:17.318504 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:17.318749 10984 raft_consensus.cc:2393] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 12: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:17.319051 15561 consensus_queue.cc:1048] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:25:17.320159 15650 log.cc:927] Time spent T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:25:17.320406 15607 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:17.320637 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:17.329907 15607 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:17.330801 11674 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 13.
I20260709 12:25:17.330602 15038 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:17.327013 14402 raft_consensus.cc:3055] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:17.332129 14402 raft_consensus.cc:740] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:17.332988 15038 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:17.333037 14402 consensus_queue.cc:260] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:17.334942 14402 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:17.337998 15607 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:17.339455 11098 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:17.340404 15583 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:17.340971 11098 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:17.341981 15583 raft_consensus.cc:2804] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:17.342410 15583 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:17.342782 15583 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:17.342916 11098 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:17.328442 15484 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:17.327499 10949 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:17.345745 15398 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:17.350507 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:17.351214 10983 raft_consensus.cc:2376] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10. Re-sending same reply.
I20260709 12:25:17.360044 10948 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:17.365787 15638 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:17.366433 11098 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:17.366849 15607 raft_consensus.cc:2804] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:17.367847 15607 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.368264 15607 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:17.372653 11675 raft_consensus.cc:1240] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12. Ops: []
W20260709 12:25:17.379938 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 71424.8us
I20260709 12:25:17.380218 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:17.366499 15638 raft_consensus.cc:697] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 17 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:17.387813 10949 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:17.382115 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:17.387619 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:17.359247 15534 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.386869 11680 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
W20260709 12:25:17.380666 11643 leader_election.cc:336] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.858s (SENT)
I20260709 12:25:17.389623 10983 raft_consensus.cc:1275] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:17.394711 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:17.395686 11676 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 15.
I20260709 12:25:17.398933 11675 raft_consensus.cc:1240] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 14. Current term is 15. Ops: [12.10-14.11]
I20260709 12:25:17.401088 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2461) took 1554 ms. Trace:
I20260709 12:25:17.401516 11127 rpcz_store.cc:276] 0709 12:25:15.846869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.276565 (+429696us) service_pool.cc:224] Handling call
0709 12:25:16.332666 (+ 56101us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:16.712503 (+379837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.400851 (+688348us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b5400034654. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:17.401028 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":825336192}
I20260709 12:25:17.406585 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:17.375168 15470 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:17.407358 10980 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:25:17.424295 11098 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:17.405200 15640 raft_consensus.cc:2764] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 12:25:17.409435 15470 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:17.416783 15471 raft_consensus.cc:2749] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:17.399401 15534 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:17.441063 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 60455.3us
W20260709 12:25:17.443372 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 55746.6us
W20260709 12:25:17.447695 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 48929.2us
I20260709 12:25:17.432989 15642 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:17.432830 15470 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:17.458060 15646 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:17.458741 15646 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:17.460840 15646 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:17.426693 15638 consensus_queue.cc:237] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:17.471684 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.453966 10949 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:17.476691 15534 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:17.477177 15398 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:17.481194 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 53321.5us
I20260709 12:25:17.450572 15535 consensus_queue.cc:1048] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:25:17.498471 11098 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:17.499598 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.497483 15408 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:17.514346 15408 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:17.514832 15408 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:17.505425 15607 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:17.506415 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 56798.7us
W20260709 12:25:17.508299 15633 log.cc:927] Time spent T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.373s	user 0.000s	sys 0.002s
I20260709 12:25:17.513685 15435 raft_consensus.cc:3055] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:17.517555 15577 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:17.533625 11098 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:17.534816 11644 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:17.519850 15435 raft_consensus.cc:740] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:17.519992 15642 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:17.545068 15297 raft_consensus.cc:3055] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:17.550069 15297 raft_consensus.cc:740] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:17.551090 15297 consensus_queue.cc:260] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:17.552198 15297 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:17.504971 15583 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:17.530179 15577 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:17.548959 10949 leader_election.cc:400] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 11. Current term is 12.
I20260709 12:25:17.556006 10949 leader_election.cc:403] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:17.547056 15572 raft_consensus.cc:3055] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:17.556933 15572 raft_consensus.cc:740] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:17.557741 10949 leader_election.cc:400] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 11. Current term is 12.
I20260709 12:25:17.558176 10949 leader_election.cc:403] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:17.561103 15480 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:17.566228 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:17.567049 11676 raft_consensus.cc:2393] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 13: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:17.567221 15607 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:17.573987 15670 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:25:17.574837 15398 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:17.576313 15534 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.576284 15671 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:17.577025 15534 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:17.577399 15642 raft_consensus.cc:697] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 12 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:17.577118 15671 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:17.545266 15535 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:17.580852 15561 raft_consensus.cc:2749] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:17.581460 15534 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:17.586813 15636 log.cc:927] Time spent T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.440s	user 0.000s	sys 0.004s
I20260709 12:25:17.588253 11058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1738) took 1011 ms. Trace:
I20260709 12:25:17.588660 11058 rpcz_store.cc:276] 0709 12:25:16.578237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.581832 (+  3595us) service_pool.cc:224] Handling call
0709 12:25:16.594415 (+ 12583us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:16.649471 (+ 55056us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:16.649510 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:16.656460 (+  6950us) log.cc:844] Serialized 26 byte log entry
0709 12:25:16.972870 (+316410us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:16.972911 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.972980 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:17.586214 (+613234us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:25:17.587893 (+  1679us) raft_consensus.cc:1685] finished
0709 12:25:17.587923 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.588181 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29694,"raft.queue_time_us":34104,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":45379,"spinlock_wait_cycles":37635968,"thread_start_us":258170,"threads_started":1,"wal-append.queue_time_us":399851}
I20260709 12:25:17.584055 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:17.591372 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:17.592000 11676 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:17.547729 15400 consensus_queue.cc:1059] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
W20260709 12:25:17.594623 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 1.16676e+06us
W20260709 12:25:17.602566 15664 log.cc:927] Time spent T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:25:17.549687 15470 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:17.582602 15535 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.606999 11675 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
I20260709 12:25:17.585240 15607 raft_consensus.cc:2749] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 11. Current term is 12.
I20260709 12:25:17.609724 15535 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:17.609726 15640 consensus_queue.cc:1059] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:17.610513 15484 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:17.612855 15484 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:17.614034 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:17.622601 10975 raft_consensus.cc:1275] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:17.623673 15388 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.624302 15388 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:17.626466 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:17.627095 10984 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:17.615355 15583 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:17.615906 15642 consensus_queue.cc:237] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:17.616518 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:25:17.629616 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 72074.9us
I20260709 12:25:17.643498 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:17.640425 10948 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:17.647007 11125 raft_consensus.cc:1240] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 12:25:17.647317 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.644274 11126 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:25:17.649318 10948 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:17.632680 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.637590 11128 raft_consensus.cc:1275] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:17.648665 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:17.652829 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:17.653720 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:17.654393 10978 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:25:17.655793 10948 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:17.650975 15388 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:17.593643 15435 consensus_queue.cc:260] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:17.663553 10948 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:17.665649 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:17.557891 15572 consensus_queue.cc:260] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:17.656888 11055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1737) took 1086 ms. Trace:
I20260709 12:25:17.658015 10949 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:17.657570 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:17.656991 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:17.651772 15631 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:17.640017 15482 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.661049 10980 raft_consensus.cc:1275] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:17.672561 10948 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:17.670996 11056 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:17.676465 11676 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 14.
W20260709 12:25:17.676221 11051 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 2006) took 1610 ms (client timeout 1963 ms). Trace:
I20260709 12:25:17.658249 15607 raft_consensus.cc:2749] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:25:17.679534 11051 rpcz_store.cc:269] 0709 12:25:16.066069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.075311 (+  9242us) service_pool.cc:224] Handling call
0709 12:25:17.676038 (+1600727us) spinlock_profiling.cc:243] Waited 829 ms on lock 0x7b54003138d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:17.676157 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1907425664}
I20260709 12:25:17.668907 11055 rpcz_store.cc:276] 0709 12:25:16.572029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.574938 (+  2909us) service_pool.cc:224] Handling call
0709 12:25:16.588620 (+ 13682us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:16.643202 (+ 54582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:16.643238 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:16.692335 (+ 49097us) log.cc:844] Serialized 52 byte log entry
0709 12:25:16.915352 (+223017us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:17.280184 (+364832us) log.cc:844] Serialized 14 byte log entry
0709 12:25:17.280556 (+   372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.280683 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:17.507564 (+226881us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:25:17.653642 (+146078us) raft_consensus.cc:1685] finished
0709 12:25:17.656667 (+  3025us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.656819 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2699,"prepare.queue_time_us":214502,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":26170,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":17106,"spinlock_wait_cycles":64431872,"thread_start_us":506852,"threads_started":2,"wal-append.queue_time_us":423705}
I20260709 12:25:17.693146 10984 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 16.
I20260709 12:25:17.673662 15484 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:17.675616 15398 raft_consensus.cc:2804] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:17.679327 15672 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.701822 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:17.705775 11127 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
W20260709 12:25:17.706815 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.707662 11024 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:17.705010 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:17.708776 11024 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:17.708976 14402 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:17.703282 15639 log.cc:927] Time spent T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.569s	user 0.003s	sys 0.000s
I20260709 12:25:17.678689 15471 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:17.704284 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:17.709512 14402 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:17.710397 15437 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:17.710182 15569 consensus_queue.cc:1059] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
W20260709 12:25:17.711011 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.725201 11023 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:17.713703 15470 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:17.728714 15534 raft_consensus.cc:3055] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:17.729218 15534 raft_consensus.cc:740] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:17.729535 11055 raft_consensus.cc:1275] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:17.729380 15408 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:17.716353 15471 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.730762 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:17.756588 11681 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:17.734730 14402 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:17.699997 15398 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.735899 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:25:17.737160 15657 log.cc:927] Time spent T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.603s	user 0.002s	sys 0.001s
I20260709 12:25:17.738742 15534 consensus_queue.cc:260] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:17.714341 15671 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:17.716090 15429 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.681758 15482 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:17.740149 15477 raft_consensus.cc:2749] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:17.741343 15435 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:17.717080 15631 raft_consensus.cc:2804] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:17.748418 15535 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:17.805323 15535 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:17.715401 15672 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:17.743683 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:17.807482 10984 raft_consensus.cc:1275] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:25:17.769930 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:17.770862 10978 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
W20260709 12:25:17.773180 15656 log.cc:927] Time spent T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.633s	user 0.000s	sys 0.004s
I20260709 12:25:17.775743 15482 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:17.742973 15577 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:17.743093 15454 consensus_queue.cc:1059] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
W20260709 12:25:17.776849 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 51743.7us
I20260709 12:25:17.777437 15388 raft_consensus.cc:2804] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:17.777004 10879 catalog_manager.cc:5697] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 7 to 9, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 9 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:17.777040 15429 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:17.783675 11057 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
W20260709 12:25:17.784157 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 89722.6us
I20260709 12:25:17.758993 15471 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:17.793778 15631 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:17.816681 15631 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:17.755479 15437 raft_consensus.cc:697] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:17.767796 15398 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:17.728732 15670 raft_consensus.cc:2749] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 11. Current term is 12.
I20260709 12:25:17.812907 15388 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.819375 15388 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:17.818352 15482 raft_consensus.cc:3055] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:17.741917 11024 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:17.835402 15562 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:17.831583 15482 raft_consensus.cc:740] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:17.838124 15672 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:17.840386 15429 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:17.843909 15572 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:17.851945 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:17.854609 15482 consensus_queue.cc:260] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:17.854905 15437 consensus_queue.cc:237] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:17.841116 15454 consensus_queue.cc:1048] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:25:17.856223 15482 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:17.858369 15429 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:17.858021 15562 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:17.858901 15429 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:17.861009 15429 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:17.861816 15562 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:17.833551 15534 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:17.867326 11025 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:17.869015 10879 catalog_manager.cc:5697] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 7 to 9, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 9 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:17.875388 11055 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
W20260709 12:25:17.878150 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 136276us
I20260709 12:25:17.888446 11098 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:17.874666 10879 catalog_manager.cc:5697] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 5 to 7, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 7 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:17.869100 15477 consensus_queue.cc:1048] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:25:17.900691 15583 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:17.901158 15583 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.901510 15583 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:17.903396 15297 raft_consensus.cc:2804] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:17.903927 15297 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.904289 15297 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:17.906188 15480 raft_consensus.cc:2804] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:17.906643 15480 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.906989 15480 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:17.909327 15484 raft_consensus.cc:2749] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:17.910203 15655 consensus_queue.cc:1048] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:17.910961 15583 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:17.912820 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:17.913269 15583 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:17.912489 10879 catalog_manager.cc:5697] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 6 to 8, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 8 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:17.915470 10879 catalog_manager.cc:5697] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:17.919463 11025 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:17.920217 11023 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:17.933012 14402 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:17.933571 14402 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:17.933950 14402 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:17.913506 11679 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:17.939002 11098 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:17.943480 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:17.945267 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:17.946703 11681 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:17.948822 11060 raft_consensus.cc:1240] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:25:17.951577 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:17.951903 11023 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:17.904184 15408 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:17.955649 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:17.956750 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 279007us
I20260709 12:25:17.959893 11133 raft_consensus.cc:2393] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 7: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:17.961098 10948 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:17.962888 10948 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:17.963649 11127 raft_consensus.cc:1275] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:25:17.956460 11134 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:17.918843 15477 consensus_queue.cc:1048] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:25:17.966444 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:17.920359 15577 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:17.966833 10948 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:17.961637 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:17.968781 11125 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:17.970125 11023 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:17.977928 11056 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:17.950634 15684 log.cc:927] Time spent T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.095s	user 0.000s	sys 0.004s
I20260709 12:25:17.980418 10948 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:17.985486 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:17.980126 10879 catalog_manager.cc:5697] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:17.949585 15535 raft_consensus.cc:2804] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:17.992264 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:17.993330 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:17.997123 11128 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:17.945717 15514 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.995087 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:17.917930 15631 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:17.999305 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:17.996327 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 338387us
I20260709 12:25:17.952702 15268 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:18.006667 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:18.007453 11054 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:18.012611 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.014710 10980 raft_consensus.cc:1240] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:18.014890 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:18.015311 10983 raft_consensus.cc:1240] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:18.015538 11676 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:18.020699 10949 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:17.978744 15484 raft_consensus.cc:2804] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:18.021793 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:18.025038 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:18.027122 11679 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:17.984151 14695 raft_consensus.cc:2804] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:17.984479 15672 raft_consensus.cc:2804] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:18.028532 10879 catalog_manager.cc:5697] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 7 to 8, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 8 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
W20260709 12:25:18.031091 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 66899.5us
W20260709 12:25:18.013872 15636 log.cc:927] Time spent T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:25:18.035543 14402 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:17.958065 15398 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:17.990727 15187 raft_consensus.cc:2749] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:18.053650 10879 catalog_manager.cc:5697] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:18.043512 11098 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:18.031149 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:18.058393 11060 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 7.
I20260709 12:25:17.995985 15470 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:18.001402 15535 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:18.053653 14464 consensus_queue.cc:1048] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:18.040995 11681 raft_consensus.cc:1240] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:18.018203 15364 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.019595 15454 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.024477 15678 consensus_queue.cc:1048] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 12:25:17.987217 15293 consensus_queue.cc:1048] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:25:18.068210 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:18.090690 11024 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:18.057588 11098 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:18.043080 14695 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.996184 15676 consensus_queue.cc:1048] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 12:25:18.046422 15484 raft_consensus.cc:697] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 14 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:18.021773 15514 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:18.099793 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 75229.3us
I20260709 12:25:18.095378 11024 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:18.109380 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.071192 15535 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:18.095786 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:18.097808 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:18.070822 15638 raft_consensus.cc:2804] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:18.042517 15672 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:18.113498 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 111198us
I20260709 12:25:18.092760 15670 raft_consensus.cc:2749] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:18.102015 15516 raft_consensus.cc:2804] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:18.076517 15470 raft_consensus.cc:697] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:18.119546 11060 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
I20260709 12:25:18.101127 14695 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:18.123116 11128 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 13.
I20260709 12:25:18.092983 15408 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:18.104692 15640 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:18.127748 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:18.136914 11057 raft_consensus.cc:2410] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 14 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:25:18.143038 11644 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:18.100011 15655 consensus_queue.cc:1048] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:25:18.087649 15364 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:18.197932 15470 consensus_queue.cc:237] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:18.185913 11060 raft_consensus.cc:1275] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:25:18.094806 15454 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:18.194576 15484 consensus_queue.cc:237] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:18.133721 15672 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:18.196930 15365 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:18.197747 10949 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:18.196482 15569 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:18.198829 10879 catalog_manager.cc:5697] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 6 to 10, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 10 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:18.188499 15651 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:18.204682 15480 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:18.316233 15480 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:18.100030 15298 consensus_queue.cc:1059] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:25:18.197875 11056 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:25:18.138335 15516 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.135281 15638 raft_consensus.cc:697] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 12 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:18.317246 15298 raft_consensus.cc:3055] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:18.317818 11059 raft_consensus.cc:1275] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:18.124121 15570 consensus_queue.cc:1059] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 12:25:18.319532 15570 raft_consensus.cc:3055] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:18.319896 15570 raft_consensus.cc:740] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:18.320696 15570 consensus_queue.cc:260] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:18.148957 15640 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:18.321877 15640 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:18.196388 15398 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:18.235083 15686 log.cc:927] Time spent T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:25:18.281409 15365 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.330958 15365 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:18.282429 15569 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.333370 15569 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:18.140405 11676 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 16.
W20260709 12:25:18.286250 15687 log.cc:927] Time spent T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 12:25:18.287240 15685 log.cc:927] Time spent T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 12:25:18.339640 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:18.340974 15297 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:18.320791 10879 catalog_manager.cc:5697] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 4 to 8, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 8 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:18.347594 11055 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
I20260709 12:25:18.291350 14402 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:18.294171 15561 raft_consensus.cc:3055] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:18.294694 15631 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:18.295957 15514 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:18.134366 15187 consensus_queue.cc:1059] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.138s
I20260709 12:25:18.297993 11645 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
W20260709 12:25:18.354386 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 56473.4us
I20260709 12:25:18.275036 15679 consensus_queue.cc:1059] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.200s
I20260709 12:25:18.304427 15471 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:18.307473 15454 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:18.308424 15607 raft_consensus.cc:2749] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:25:18.308646 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 168192us
I20260709 12:25:18.310079 15364 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:18.372784 15471 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:18.317879 15638 consensus_queue.cc:237] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:18.350697 15561 raft_consensus.cc:740] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:18.374392 15570 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:18.375288 15561 consensus_queue.cc:260] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:18.275838 15677 log.cc:927] Time spent T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:25:18.209978 15408 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:18.377182 15679 raft_consensus.cc:3055] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:18.377638 15679 raft_consensus.cc:740] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:18.379498 15408 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:18.313421 10984 raft_consensus.cc:1240] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:18.317269 15516 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:18.382516 10879 catalog_manager.cc:5697] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 6 to 9, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 9 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:18.384366 10879 catalog_manager.cc:5697] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:18.317834 15298 raft_consensus.cc:740] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:18.386736 15298 consensus_queue.cc:260] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:18.387946 15298 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:18.327044 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:18.390592 10949 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:18.391992 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:18.383394 15695 raft_consensus.cc:3055] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:18.392694 15695 raft_consensus.cc:740] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:18.392825 11676 raft_consensus.cc:2393] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 13: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:18.393633 15695 consensus_queue.cc:260] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:18.394913 15695 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:18.396447 15268 raft_consensus.cc:2749] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:18.398075 15679 consensus_queue.cc:260] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:18.398566 15516 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:18.399519 15679 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:18.400713 15516 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:18.349759 11054 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:18.274318 11060 raft_consensus.cc:1275] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:25:18.403286 11060 pending_rounds.cc:85] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting all ops after (but not including) 12
I20260709 12:25:18.403658 11060 pending_rounds.cc:107] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:25:18.403956 11060 raft_consensus.cc:2889] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:18.365253 11675 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
W20260709 12:25:18.365825 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 256988us
I20260709 12:25:18.368758 15535 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:18.392234 15187 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.137223 15388 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:18.406422 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 50290.7us
I20260709 12:25:18.391942 10949 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
W20260709 12:25:18.407577 11097 leader_election.cc:336] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.630s (SENT)
I20260709 12:25:18.411685 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:18.436163 11129 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:25:18.425102 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:18.385597 10879 catalog_manager.cc:5697] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:18.437131 11127 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:18.435582 11097 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:18.437520 10879 catalog_manager.cc:5697] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:18.435285 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:18.439903 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:18.440497 11130 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:18.441861 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:18.442649 11059 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 13.
I20260709 12:25:18.445575  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:25:18.449482 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:18.450220 11097 leader_election.cc:336] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.672s (SENT)
I20260709 12:25:18.450745 11097 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:18.439118 10879 catalog_manager.cc:5697] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 7 to 11, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 11 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:18.407413 15572 raft_consensus.cc:2804] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:18.463325 11675 raft_consensus.cc:1275] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:25:18.464537 11132 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:18.466037 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:25:18.469758 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.476292 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:18.477066 11053 raft_consensus.cc:2393] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 13: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:25:18.466492 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 398854us
I20260709 12:25:18.479487 11051 raft_consensus.cc:1240] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:18.438880 15534 raft_consensus.cc:2749] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:18.480189 11058 raft_consensus.cc:2393] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 14: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:18.485272 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:18.485952 10981 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:18.487191 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:18.487838 10977 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:18.480901 11098 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:18.381909 15640 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:18.410748 15583 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:18.480506 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 88650.1us
I20260709 12:25:18.481283 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:18.495687 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:18.492439 10948 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:18.455663 15408 raft_consensus.cc:2749] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:18.464881 15631 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:18.502218 10983 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
W20260709 12:25:18.506734 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 52943.2us
I20260709 12:25:18.508366 10879 catalog_manager.cc:5697] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:18.433236 15429 consensus_queue.cc:1048] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 12:25:18.520406 10879 catalog_manager.cc:5697] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 7 to 9, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 9 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:18.499743 15671 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:18.497503 15642 raft_consensus.cc:2749] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:18.528646 10981 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:25:18.441659 15187 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:18.503175 15691 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:18.541181 10949 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:18.531476 10879 catalog_manager.cc:5697] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:18.550822 10879 catalog_manager.cc:5697] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 3 to 7, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 7 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:18.509959 15400 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:18.566277 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 54403.5us
W20260709 12:25:18.532038 15435 consensus_meta.cc:287] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.738s	user 0.011s	sys 0.000s
I20260709 12:25:18.567545 11025 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:18.554487 15682 raft_consensus.cc:2804] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:18.558125 10879 catalog_manager.cc:5697] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 1 to 8, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 8 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:18.549785 15651 raft_consensus.cc:697] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:25:18.586831 11097 leader_election.cc:336] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.809s (SENT)
I20260709 12:25:18.513345 15583 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:18.597678 11060 raft_consensus.cc:1275] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:18.575764 15470 raft_consensus.cc:2749] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:18.586061 11644 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:18.543305 15534 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
W20260709 12:25:18.637712 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 70228.2us
I20260709 12:25:18.638593 11025 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:18.584290 15297 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:18.642464 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 115176us
I20260709 12:25:18.568218 15400 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:18.649389 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:18.676790 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:18.660233 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:18.676400 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 144119us
I20260709 12:25:18.681974 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:18.682791 11676 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:18.685082 15712 raft_consensus.cc:2804] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:18.685616 15712 raft_consensus.cc:697] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:18.686434 15712 consensus_queue.cc:237] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:18.601097 15682 raft_consensus.cc:697] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:18.689411 15682 consensus_queue.cc:237] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:18.682399 11098 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:18.565197 15691 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:18.617336 15572 raft_consensus.cc:697] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:18.699971 10949 leader_election.cc:400] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 11. Current term is 12.
I20260709 12:25:18.638314 15398 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:18.714295 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 127482us
W20260709 12:25:18.716245 11097 leader_election.cc:336] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.865s (SENT)
I20260709 12:25:18.697840 15038 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:25:18.720242 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 44111.5us
I20260709 12:25:18.718343 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:25:18.708531 15633 log.cc:927] Time spent T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:25:18.723273 11675 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:18.710773 15671 raft_consensus.cc:697] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 16 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
W20260709 12:25:18.727356 15708 log.cc:927] Time spent T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:25:18.644207 15681 consensus_queue.cc:1048] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.268s
I20260709 12:25:18.730798 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:18.736377 11676 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:18.727041 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 44728.3us
I20260709 12:25:18.643497 15365 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:18.732661 11024 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:18.735169 11130 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
W20260709 12:25:18.730010 14695 consensus_meta.cc:287] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.539s	user 0.006s	sys 0.003s
I20260709 12:25:18.705690 15704 raft_consensus.cc:2804] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:18.744218 11097 leader_election.cc:336] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.912s (SENT)
I20260709 12:25:18.675004 15484 consensus_queue.cc:1059] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:25:18.750486 10949 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:18.709919 15535 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:18.747717 11681 raft_consensus.cc:1275] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:25:18.720754 15038 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.751286 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:18.717145 15388 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:18.727527 15671 consensus_queue.cc:237] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:18.820976 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 88398.5us
I20260709 12:25:18.819167 11676 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:18.719830 15398 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:18.827330 11679 raft_consensus.cc:2393] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 14: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:18.750669 15704 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.749166 15400 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:18.835440 11025 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:18.844328 11675 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:25:18.821353 15038 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:18.818468 15640 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:18.845420 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 106401us
I20260709 12:25:18.830426 15437 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:25:18.849058 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 104879us
I20260709 12:25:18.826687 15534 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:18.825943 15470 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:18.853588 11024 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:18.826265 15703 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:18.833178 15607 raft_consensus.cc:2804] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:18.758332 14695 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:18.858619 11130 raft_consensus.cc:1275] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 12:25:18.839067 15704 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:18.884155 11130 pending_rounds.cc:85] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 10
I20260709 12:25:18.885574 11130 pending_rounds.cc:107] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 14.11
W20260709 12:25:18.877526 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 137008us
I20260709 12:25:18.885851 11130 raft_consensus.cc:2889] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:18.880735 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:18.889464 11127 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:18.872105 15717 log.cc:927] Time spent T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.197s	user 0.000s	sys 0.004s
I20260709 12:25:18.836625 15683 consensus_queue.cc:1048] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:25:18.855154 15437 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:18.844194 15535 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:25:18.878356 15480 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:25:18.882270 15569 consensus_meta.cc:287] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.537s	user 0.009s	sys 0.001s
I20260709 12:25:18.899215 11053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
W20260709 12:25:18.901546 11643 leader_election.cc:336] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.715s (SENT)
I20260709 12:25:18.736728 15651 consensus_queue.cc:237] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:18.919667 11053 raft_consensus.cc:606] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:18.919696 11643 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:18.918252 11127 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:18.878548 15561 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:18.837579 15572 consensus_queue.cc:237] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:18.896168 15364 raft_consensus.cc:2804] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:18.895401 15187 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:18.910949 15437 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:18.907400 15706 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:18.900614 15534 raft_consensus.cc:697] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
W20260709 12:25:18.894006 15638 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.002s	sys 0.011s
I20260709 12:25:18.857406 15660 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 12:25:18.954582 14464 consensus_queue.cc:1059] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:25:18.959319 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 58301.9us
I20260709 12:25:18.923439 15681 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:18.892616 15470 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:18.925662 15480 raft_consensus.cc:697] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:18.891010 15703 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:18.957798 15640 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.987435 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:18.988561 11130 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 13
W20260709 12:25:18.964785 15638 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.002s	sys 0.012s
W20260709 12:25:18.986730 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 89415.7us
I20260709 12:25:18.993163 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:18.993377 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:18.993566 14464 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.923311 15569 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:18.994086 14464 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:18.951692 15400 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:25:19.006624 11679 raft_consensus.cc:2368] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 13. Current term is 14.
W20260709 12:25:18.995467 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 93966.8us
I20260709 12:25:18.950947 15484 consensus_queue.cc:1048] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:25:18.993163 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:19.007625 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:18.981698 15297 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:19.006896 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.017647 11058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 2026) took 1323 ms. Trace:
W20260709 12:25:19.010527 11643 leader_election.cc:336] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.810s (SENT)
I20260709 12:25:18.979352 15364 raft_consensus.cc:697] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:18.982527 15398 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:19.018505 11643 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:19.018570 11058 rpcz_store.cc:276] 0709 12:25:17.694030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.743397 (+ 49367us) service_pool.cc:224] Handling call
0709 12:25:19.017461 (+1274064us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b54000b6dd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:19.017584 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1547391232}
W20260709 12:25:19.032543 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.990727 15607 raft_consensus.cc:697] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 13 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:19.011624 15517 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
W20260709 12:25:19.055657 15726 log.cc:927] Time spent T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:25:19.053785 11674 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:19.017984 11025 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:19.058043 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:19.065176 11130 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:19.066596 15569 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:19.052459 11051 raft_consensus.cc:2368] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 13. Current term is 14.
W20260709 12:25:19.073608 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:19.073807 11097 leader_election.cc:336] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 2.030s (SENT)
W20260709 12:25:19.075093 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 57182.1us
I20260709 12:25:19.079417 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:25:19.067232 15687 log.cc:927] Time spent T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:25:19.089828 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:19.006733 15435 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
W20260709 12:25:19.089828 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 79338.8us
W20260709 12:25:19.095901 11643 leader_election.cc:336] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.844s (SENT)
I20260709 12:25:19.096354 11643 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:18.962802 15706 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:19.003885 15640 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:19.084043 15516 raft_consensus.cc:2804] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:19.094856 11052 raft_consensus.cc:2393] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 13: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:19.096767 11023 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:19.075340 15429 raft_consensus.cc:2749] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:19.088443 11025 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:19.100214 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:19.084612 15711 log.cc:927] Time spent T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 12:25:19.071466 15365 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:19.098438 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.083782 15583 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:19.090605 15480 consensus_queue.cc:237] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:19.118902 10976 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:19.108713 15364 consensus_queue.cc:237] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:19.075102 15398 consensus_queue.cc:1048] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:25:19.111389 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:25:19.114213 15718 log.cc:927] Time spent T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 12:25:19.114609 15693 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.105880 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:19.050705 15297 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:19.122633 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 48857.8us
I20260709 12:25:19.110721 10984 raft_consensus.cc:1240] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 12. Current term is 13. Ops: []
W20260709 12:25:19.140391 15731 log.cc:927] Time spent T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 12:25:19.140969 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:25:19.141466 15729 log.cc:927] Time spent T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:25:19.084203 15408 consensus_queue.cc:1048] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
W20260709 12:25:19.143009 15724 log.cc:927] Time spent T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:25:19.133643 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 18 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:19.136524 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:19.144752 15514 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:19.145138 10979 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:19.145349 15514 raft_consensus.cc:697] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:25:19.139166 15707 log.cc:927] Time spent T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 12:25:19.147727 15700 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:19.148095 14464 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:19.148917 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:19.149183 15297 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:19.149663 15293 raft_consensus.cc:993] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7: : Instructing follower bc01179655564f29b83babe396377cbb to start an election
I20260709 12:25:19.150234 15293 raft_consensus.cc:1081] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Signalling peer bc01179655564f29b83babe396377cbb to start an election
I20260709 12:25:19.150527 15678 raft_consensus.cc:3055] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:19.150967 15678 raft_consensus.cc:740] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:19.151800 15678 consensus_queue.cc:260] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:19.154587 15703 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:19.155007 15678 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:19.125578 14695 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:19.155601 15482 raft_consensus.cc:3055] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:19.156052 15482 raft_consensus.cc:740] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:19.156879 15482 consensus_queue.cc:260] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:19.159735 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:25:19.160624 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.162503 11679 raft_consensus.cc:1275] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:19.166777 11680 raft_consensus.cc:1275] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:19.147059 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:19.170043 15408 consensus_queue.cc:1048] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:19.170410 15514 consensus_queue.cc:237] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:19.171660 15408 consensus_queue.cc:1048] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:25:19.174466 15728 log.cc:927] Time spent T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:25:19.149708 11672 raft_consensus.cc:2393] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 13: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
W20260709 12:25:19.176854 15672 consensus_meta.cc:287] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.837s	user 0.001s	sys 0.007s
I20260709 12:25:19.177376 15672 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:19.182626 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.183384 10983 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:19.184365 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.185488 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:19.186544 15607 consensus_queue.cc:237] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:19.187906 10979 raft_consensus.cc:2410] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:25:19.188891 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.117467 15569 raft_consensus.cc:2749] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:19.195333 10984 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:19.189998 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:25:19.166638 15719 log.cc:927] Time spent T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
W20260709 12:25:19.206158 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.082830 15517 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:19.128862 15516 raft_consensus.cc:697] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:19.212626 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.211603 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.085126 15534 consensus_queue.cc:237] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:19.134318 15725 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:19.183545 15570 consensus_meta.cc:287] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.809s	user 0.012s	sys 0.000s
I20260709 12:25:19.237398 10981 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:19.221836 10979 raft_consensus.cc:2393] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 7: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:19.222208 10984 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
W20260709 12:25:19.221199 15727 log.cc:927] Time spent T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 12:25:19.229501 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:19.162746 15691 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:19.240355 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2646) took 1264 ms. Trace:
I20260709 12:25:19.213032 15482 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:19.224951 11010 heartbeater.cc:646] Failed to heartbeat to 127.9.145.254:35687 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.9.145.254:35687 timed out after 15.000s (SENT)
I20260709 12:25:19.240963 11023 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:19.248937 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.254236 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:19.254897 10979 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:19.258062 10981 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:19.261018 14402 raft_consensus.cc:2804] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:19.261811 14402 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:19.262425 14402 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:19.248044 10978 rpcz_store.cc:276] 0709 12:25:17.976379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.976503 (+   124us) service_pool.cc:224] Handling call
0709 12:25:17.995979 (+ 19476us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:18.012051 (+ 16072us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:25:18.345892 (+333841us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b18004b1960. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cd9e07 00007f8f91b349a9 00007f8f88cf669b 00007f8f88cf493f 00007f8f88cf4455 00007f8f8f7dc3c7 00007f8f8bdee9a7 00007f8f8bdfe0bf 00007f8f8bdfe038
0709 12:25:18.523557 (+177665us) log.cc:844] Serialized 14 byte log entry
0709 12:25:19.068028 (+544471us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:19.099459 (+ 31431us) log.cc:844] Serialized 26 byte log entry
0709 12:25:19.099610 (+   151us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:19.099646 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:19.099714 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:19.190963 (+ 91249us) raft_consensus.cc:1685] finished
0709 12:25:19.240149 (+ 49186us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:19.240293 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31556,"prepare.queue_time_us":91138,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":21568,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":32426,"spinlock_wait_cycles":9399040,"thread_start_us":675743,"threads_started":3,"wal-append.queue_time_us":464297}
I20260709 12:25:19.272517 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.236977 15454 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
W20260709 12:25:19.277704 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 189329us
I20260709 12:25:19.290904 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 18 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:19.291617 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:19.286399 10982 raft_consensus.cc:2393] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 12: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:19.286509 10984 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:25:19.294134 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:19.294350 11059 raft_consensus.cc:1240] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:19.296972 11098 leader_election.cc:400] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 13. Current term is 14.
I20260709 12:25:19.297350 11098 leader_election.cc:403] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:25:19.298470 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.300081 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:19.300721 11127 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:19.300850 15470 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:19.302284 11052 raft_consensus.cc:1275] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:19.303632 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:19.306907 10979 raft_consensus.cc:2410] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:25:19.307864 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.309067 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:19.309841 10979 raft_consensus.cc:2410] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:25:19.310010 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:19.311424 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:19.312199 11054 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:25:19.313243 15698 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:19.313781 15698 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:19.314054 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:19.314896 11058 raft_consensus.cc:2393] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 12: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:19.316195 15698 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:19.275854 15678 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:19.303632 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:19.323385 11130 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:19.311530 15722 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:19.319120 11643 leader_election.cc:336] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.823s (SENT)
I20260709 12:25:19.319476 11059 raft_consensus.cc:1275] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:19.203999 15693 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:19.307047 10982 raft_consensus.cc:1240] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:19.220232 15704 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:19.343850 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 47015.3us
I20260709 12:25:19.300854 15535 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:19.412863 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 88222.3us
W20260709 12:25:19.407620 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 62967.8us
I20260709 12:25:19.417708 11098 leader_election.cc:400] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 13. Current term is 14.
I20260709 12:25:19.418769 11098 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:19.420759 14402 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:19.422848 11097 leader_election.cc:336] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.602s (SENT)
I20260709 12:25:19.423827 11097 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:19.284157 15038 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:19.241122 15725 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:19.298251 15454 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:19.407022 15400 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:19.427423 14402 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:19.429601 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:19.446434 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.434089 11130 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:19.345997 15678 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:19.494722 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.500584 15737 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:19.501428 15737 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:19.502673 15693 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:19.505326 15715 raft_consensus.cc:2749] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:19.506202 15733 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:19.506891 15733 raft_consensus.cc:697] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:19.507818 15733 consensus_queue.cc:237] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:19.509192 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:19.509917 11134 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:19.515642 15631 consensus_meta.cc:287] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.996s	user 0.007s	sys 0.004s
I20260709 12:25:19.516191 15631 raft_consensus.cc:2749] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:19.519407 11025 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:19.492332 11098 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:19.524089 11134 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:19.529214 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:19.530037 10979 raft_consensus.cc:2376] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12. Re-sending same reply.
I20260709 12:25:19.531296 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:19.425741 15535 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:19.535517 10983 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:19.533429 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:19.536893 11127 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:19.538296 11051 raft_consensus.cc:1240] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:19.537856 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.539841 10979 raft_consensus.cc:2376] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12. Re-sending same reply.
I20260709 12:25:19.535369 11025 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:19.528484 15710 log.cc:927] Time spent T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.843s	user 0.004s	sys 0.013s
I20260709 12:25:19.413715 15516 consensus_queue.cc:237] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:19.448921 15703 consensus_queue.cc:1059] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 12:25:19.428730 15437 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:19.552407 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:19.342381 15722 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:19.555122 11675 raft_consensus.cc:1275] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:25:19.504817 15737 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:19.565024 15746 log.cc:927] Time spent T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 12:25:19.548214 15435 raft_consensus.cc:2804] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:19.574968 15454 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:19.584832 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:19.595993 11133 raft_consensus.cc:2393] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 13: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:19.552845 15671 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:19.598258 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:19.601996 10979 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:19.609975 11097 leader_election.cc:336] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.749s (SENT)
I20260709 12:25:19.580466 15672 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:19.606222 15435 raft_consensus.cc:697] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:19.601756 15671 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:19.629513 11097 leader_election.cc:336] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.815s (SENT)
I20260709 12:25:19.630057 11097 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:19.626773 15695 consensus_meta.cc:287] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 1.230s	user 0.010s	sys 0.004s
I20260709 12:25:19.635558 10979 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 16.
W20260709 12:25:19.637907 15748 log.cc:927] Time spent T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:25:19.637589 15435 consensus_queue.cc:237] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:19.639797 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2500) took 1203 ms. Trace:
W20260709 12:25:19.640435 11097 leader_election.cc:336] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.828s (SENT)
I20260709 12:25:19.655889 11097 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:19.650902 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.658859 15514 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.659466 15514 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:19.632243 15671 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:19.654318 11128 rpcz_store.cc:276] 0709 12:25:18.436294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.436423 (+   129us) service_pool.cc:224] Handling call
0709 12:25:18.436799 (+   376us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:18.437166 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:18.437195 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:18.437808 (+   613us) log.cc:844] Serialized 52 byte log entry
0709 12:25:18.648710 (+210902us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:18.705172 (+ 56462us) log.cc:844] Serialized 14 byte log entry
0709 12:25:18.723812 (+ 18640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.724137 (+   325us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:19.515017 (+790880us) spinlock_profiling.cc:243] Waited 38.9 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:25:19.639368 (+124351us) raft_consensus.cc:1685] finished
0709 12:25:19.639481 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:19.639703 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":58406,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":127388,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":14131,"spinlock_wait_cycles":89535872,"thread_start_us":227882,"threads_started":2,"wal-append.queue_time_us":246973}
I20260709 12:25:19.658092 15705 raft_consensus.cc:2804] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:19.677258 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:19.634727 15517 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:19.635203 15583 raft_consensus.cc:2749] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:19.661878 15514 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:19.688313 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:25:19.674645 15743 log.cc:927] Time spent T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:25:19.641072 15704 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:19.675623 15679 consensus_meta.cc:287] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 1.265s	user 0.009s	sys 0.005s
I20260709 12:25:19.696607 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:25:19.678012 15741 log.cc:927] Time spent T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:25:19.667028 15400 raft_consensus.cc:2749] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 13. Current term is 14.
W20260709 12:25:19.717760 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.720645 10984 raft_consensus.cc:2393] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 12: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:19.694458 15730 raft_consensus.cc:2749] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:19.723835 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.690347 15705 raft_consensus.cc:697] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:25:19.726790 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 86393.5us
I20260709 12:25:19.702493 15535 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:19.729342 10979 raft_consensus.cc:2393] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 12: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
W20260709 12:25:19.734768 11097 leader_election.cc:336] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 2.164s (SENT)
I20260709 12:25:19.737530 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:25:19.754662 15720 log.cc:927] Time spent T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 1.070s	user 0.005s	sys 0.000s
I20260709 12:25:19.756410 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2654) took 1296 ms. Trace:
I20260709 12:25:19.732108 15678 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:19.757411 11097 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:19.749035 15752 log.cc:927] Time spent T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:25:19.759042 10984 raft_consensus.cc:2393] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 7: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:19.760075 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.761323 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.762408 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.763164 10984 raft_consensus.cc:2393] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 11: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:19.725004 15725 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:19.764197 15725 raft_consensus.cc:2749] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:19.765170 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.766048 10984 raft_consensus.cc:2393] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 13: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:19.767015 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.767868 10984 raft_consensus.cc:2393] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 10: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:19.768748 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.769332 10984 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:25:19.770325 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:19.773164 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.775341 10984 raft_consensus.cc:2393] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 13: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:19.756811 10975 rpcz_store.cc:276] 0709 12:25:18.459746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.459861 (+   115us) service_pool.cc:224] Handling call
0709 12:25:18.488670 (+ 28809us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:18.489023 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:18.489061 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:18.511317 (+ 22256us) log.cc:844] Serialized 26 byte log entry
0709 12:25:18.684283 (+172966us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:18.684321 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.684387 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:19.707258 (+1022871us) spinlock_profiling.cc:243] Waited 47.2 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:25:19.756078 (+ 48820us) raft_consensus.cc:1685] finished
0709 12:25:19.756102 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:19.756339 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14529,"raft.queue_time_us":111,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":9816,"spinlock_wait_cycles":108588288,"thread_start_us":118592,"threads_started":1,"wal-append.queue_time_us":144182}
I20260709 12:25:19.776221 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.777065 10984 raft_consensus.cc:2393] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 13: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:19.777765 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.778183 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:19.778752 10979 raft_consensus.cc:2393] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 13: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:19.751837 15437 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:19.781764 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:19.782744 10975 raft_consensus.cc:2410] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:25:19.783756 10984 raft_consensus.cc:1240] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:19.788125 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.788254 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.788828 10979 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:25:19.792277 15722 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:19.794358 11097 leader_election.cc:336] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.984s (SENT)
I20260709 12:25:19.794905 11097 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:19.781205 15705 consensus_queue.cc:237] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:19.789515 10984 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7"
dest_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:52828
I20260709 12:25:19.804613 10984 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:19.805148 10984 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:19.817709 15482 consensus_meta.cc:287] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.002s
I20260709 12:25:19.825244 11097 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:19.809056 15671 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:19.827296 15730 raft_consensus.cc:2749] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:19.828403 15671 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:19.829459 15753 log.cc:927] Time spent T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:25:19.808228 15722 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:19.835871 11097 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:19.841212 15535 raft_consensus.cc:2749] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:19.835843 10984 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:19.843627 11097 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:19.852236 11097 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:19.852898 10984 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:19.856633 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:19.856842 15722 raft_consensus.cc:2749] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:19.857435 10981 raft_consensus.cc:2376] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 16. Re-sending same reply.
I20260709 12:25:19.850584 15535 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:19.868597 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:19.869316 11055 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:19.843274 15671 consensus_queue.cc:1059] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:25:19.870231 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:19.870971 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.871853 10981 raft_consensus.cc:2393] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 14: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:19.872776 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.873356 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:19.873642 10981 raft_consensus.cc:2410] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:25:19.874302 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:19.875653 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.876493 10983 raft_consensus.cc:2410] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:25:19.877322 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.877815 10983 raft_consensus.cc:2376] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 16. Re-sending same reply.
I20260709 12:25:19.878427 11058 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:19.878558 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.883510 11025 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:19.927417 10980 raft_consensus.cc:2376] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 16. Re-sending same reply.
W20260709 12:25:19.927592 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 44155.1us
I20260709 12:25:19.928443 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.929252 10980 raft_consensus.cc:2393] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 7: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:19.930143 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:19.927037 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.887377 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:19.931397 10983 raft_consensus.cc:2410] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:25:19.932348 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:19.933437 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:19.888532 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:25:19.887116 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.894907 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.938899 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.940073 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:19.891454 11055 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:25:19.897413 15640 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:19.898728 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:19.941183 10981 raft_consensus.cc:2368] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 9. Current term is 10.
I20260709 12:25:19.942047 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.942613 10981 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
I20260709 12:25:19.943390 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:19.900115 15706 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:19.909539 15678 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.944509 15678 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:19.946724 15678 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:19.947363 10981 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 13.
I20260709 12:25:19.913501 14464 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.922674 15631 consensus_queue.cc:1048] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:19.948114 11132 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:19.924805 15607 consensus_queue.cc:1048] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:19.930341 15676 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:19.949700 15676 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:19.950089 15676 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:19.887770 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:19.954439 11681 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 15.
I20260709 12:25:19.954603 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:19.895056 15535 raft_consensus.cc:2749] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:19.948163 14464 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:19.956210 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:19.958209 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:19.958740 11060 raft_consensus.cc:3055] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:19.959028 11060 raft_consensus.cc:740] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:19.959916 11060 consensus_queue.cc:260] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:19.961097 11060 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:19.963613 15676 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:19.966387 14464 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:19.973739 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:19.978564 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:19.979682 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:19.980379 11125 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 12: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:19.981107 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:19.974375 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:19.982638 11128 raft_consensus.cc:2368] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 10. Current term is 11.
I20260709 12:25:19.975091 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:19.973904 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:19.984556 11127 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:19.985610 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:19.988364 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:19.995729 11127 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
I20260709 12:25:19.996486 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:19.976316 10980 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 13.
W20260709 12:25:20.003783 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 153670us
I20260709 12:25:20.013656 11097 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:20.013671 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:20.014621 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:20.015252 10980 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
I20260709 12:25:20.015242 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:20.017405 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:20.019688 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:20.020741 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:20.021775 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:20.022497 11127 raft_consensus.cc:2393] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 14: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:20.023249 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:20.023931 11127 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 12: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:20.024695 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:20.025705 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:20.001065 15676 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:20.026736 11127 raft_consensus.cc:2393] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 8: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:20.027633 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:20.028683 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:20.032894 11097 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:20.036381 11097 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:20.037588 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:20.040096 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:20.042677 14464 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.043267 14464 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:20.047135 11127 raft_consensus.cc:1275] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:20.047284 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:20.048734 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:20.048766 10976 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 16.
I20260709 12:25:20.052974 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:20.053298 14464 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:20.051121 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:20.037536 15535 raft_consensus.cc:2749] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:20.038559 15640 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:20.082026 11060 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 14.
I20260709 12:25:20.056946 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:20.057883 10976 raft_consensus.cc:1275] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:20.084280 10984 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:20.085311 10976 raft_consensus.cc:1275] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:25:20.064172 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 140041us
I20260709 12:25:20.055924 10980 raft_consensus.cc:1275] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:25:20.086496 10980 pending_rounds.cc:85] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 5
I20260709 12:25:20.086762 10980 pending_rounds.cc:107] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:25:20.086997 10980 raft_consensus.cc:2889] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:20.089712 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:20.090091 10976 raft_consensus.cc:1275] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:20.044629 15676 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.091527 10976 raft_consensus.cc:1240] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:20.052611 15534 raft_consensus.cc:2749] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:20.091414 11060 raft_consensus.cc:1240] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:20.095335 10976 raft_consensus.cc:1275] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:25:20.040899 15722 consensus_queue.cc:1059] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:25:20.101733 10984 raft_consensus.cc:1275] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:25:20.115103 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.210248 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:20.217327 11672 raft_consensus.cc:2410] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:25:20.082267 15569 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:20.241675 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.083900 15640 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:25:20.258705 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.262252 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:25:20.270061 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 233763us
I20260709 12:25:20.271237 11097 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:20.277700 11132 raft_consensus.cc:1275] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:20.279834 15583 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.280473 15583 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:20.261339 15435 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:20.282635 15435 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:20.284876 15435 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:20.209640 15676 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:20.096940 15706 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:20.285800 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1803) took 1030 ms. Trace:
I20260709 12:25:20.292598 10978 rpcz_store.cc:276] 0709 12:25:19.255821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.791472 (+535651us) service_pool.cc:224] Handling call
0709 12:25:19.812035 (+ 20563us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:19.820372 (+  8337us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:19.851713 (+ 31341us) log.cc:844] Serialized 14 byte log entry
0709 12:25:20.054727 (+203014us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:20.083245 (+ 28518us) log.cc:844] Serialized 26 byte log entry
0709 12:25:20.083407 (+   162us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:20.083439 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.083506 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:20.285551 (+202045us) raft_consensus.cc:1685] finished
0709 12:25:20.285580 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:20.285735 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2520,"prepare.queue_time_us":177127,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":10706,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":28540,"thread_start_us":229379,"threads_started":2,"wal-append.queue_time_us":395408}
I20260709 12:25:20.305408 11097 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:20.286441 15364 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.269856 15640 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:20.286180 15671 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:20.343168 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:20.316574 15707 log.cc:927] Time spent T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:25:20.363394 11681 raft_consensus.cc:1275] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:25:20.365355 15682 consensus_queue.cc:1048] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:20.369172 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1801) took 1152 ms. Trace:
I20260709 12:25:20.369092 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:20.370914 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:20.371130 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:20.371843 11127 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 13.
I20260709 12:25:20.372126 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:20.372748 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:20.372916 10979 rpcz_store.cc:276] 0709 12:25:19.217317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.790865 (+573548us) service_pool.cc:224] Handling call
0709 12:25:19.808733 (+ 17868us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:19.818579 (+  9846us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:19.902474 (+ 83895us) log.cc:844] Serialized 14 byte log entry
0709 12:25:20.368785 (+466311us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:20.368844 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:20.368897 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.368965 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:20.369094 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":175361,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":2865,"raft.queue_time_us":149,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":545173,"threads_started":2}
I20260709 12:25:20.374570 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2666) took 1158 ms. Trace:
I20260709 12:25:20.372772 11125 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:25:20.375638 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:20.380230 10982 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:20.378082 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:20.375155 10975 rpcz_store.cc:276] 0709 12:25:19.216135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.790596 (+574461us) service_pool.cc:224] Handling call
0709 12:25:19.882450 (+ 91854us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:19.882667 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:19.882693 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:19.882738 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:19.882773 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:19.882832 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:20.374367 (+491535us) spinlock_profiling.cc:243] Waited 70.7 ms on lock 0x7b54000daf50. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:20.374504 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162712832}
I20260709 12:25:20.380765 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 1810) took 1072 ms. Trace:
I20260709 12:25:20.382061 11127 raft_consensus.cc:2368] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 10. Current term is 11.
I20260709 12:25:20.383848 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:20.381886 10982 rpcz_store.cc:276] 0709 12:25:19.308624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.350468 (+ 41844us) service_pool.cc:224] Handling call
0709 12:25:20.375481 (+1025013us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b5800003698. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90daa0a0 00007f8f90da9984 00007f8f8a3246d4 00007f8f8a324662
0709 12:25:20.380687 (+  5206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4276096}
W20260709 12:25:20.390990 15755 log.cc:927] Time spent T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.638s	user 0.000s	sys 0.003s
I20260709 12:25:20.393047 11053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1770) took 1099 ms. Trace:
I20260709 12:25:20.394695 15723 raft_consensus.cc:3055] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:20.393445 11053 rpcz_store.cc:276] 0709 12:25:19.293369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.301810 (+  8441us) service_pool.cc:224] Handling call
0709 12:25:19.302135 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:19.332379 (+ 30244us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:25:19.348066 (+ 15687us) log.cc:844] Serialized 14 byte log entry
0709 12:25:19.612160 (+264094us) log.cc:844] Serialized 14 byte log entry
0709 12:25:19.612350 (+   190us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:19.612883 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 12:25:19.613022 (+   139us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:19.613069 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:19.613147 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:19.858976 (+245829us) spinlock_profiling.cc:243] Waited 5.51 ms on lock 0x7b180032c140. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cc52a6 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f90d0daa1 00007f8f90d04b37 00007f8f90d049ca 00007f8f90dfc26f
0709 12:25:19.859991 (+  1015us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b48001f0158. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f90d0daa1 00007f8f90d04b37 00007f8f90d049ca 00007f8f90dfc26f 00007f8f90dfbf37 00007f8f90e1055c 00007f8f90e10508 00007f8f90e10488 00007f8f90e10443 00007f8f90e0f6ec 00007f8f8fd39a96
0709 12:25:20.389552 (+529561us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:25:20.392816 (+  3264us) raft_consensus.cc:1685] finished
0709 12:25:20.392838 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:20.392983 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45726,"prepare.queue_time_us":97141,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":110,"raft.queue_time_us":38453,"raft.run_cpu_time_us":3482,"raft.run_wall_time_us":253033,"spinlock_wait_cycles":66732288,"thread_start_us":175703,"threads_started":1,"wal-append.queue_time_us":297895}
I20260709 12:25:20.395200 15723 raft_consensus.cc:740] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:20.396067 15723 consensus_queue.cc:260] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:20.397368 15723 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:20.310027 15725 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:20.310562 15534 raft_consensus.cc:2749] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:20.265862 15569 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:20.331868 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:25:20.406442 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 97350us
I20260709 12:25:20.406925 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:20.332829 15435 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.320506 15730 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 12:25:20.315505 15364 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:20.297816 15706 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:20.421298 15725 consensus_queue.cc:1048] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:20.423416 15733 consensus_queue.cc:1048] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:25:20.424868 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.425976 15631 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.421546 11051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 2039) took 1129 ms. Trace:
I20260709 12:25:20.426525 15631 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:20.427007 11051 rpcz_store.cc:276] 0709 12:25:19.291780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.312303 (+ 20523us) service_pool.cc:224] Handling call
0709 12:25:19.312601 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:19.538717 (+226116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.421301 (+882584us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54002dd054. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:20.421476 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":518599424}
I20260709 12:25:20.429646 15631 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:20.431398 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.436419 15038 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:20.437196 15631 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.437889 15631 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:20.440848 15631 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:20.441447 10948 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:20.442373 15737 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:20.442790 10948 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:20.443962 15737 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:20.444353 10948 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:20.445247 15737 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:20.445803 15737 raft_consensus.cc:697] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 14 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:20.452253 11133 raft_consensus.cc:1275] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:20.447360 15535 raft_consensus.cc:3055] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:20.453416 15535 raft_consensus.cc:740] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:20.453141 15737 consensus_queue.cc:237] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:20.451793 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:20.458860 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:20.460238 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:20.460995 11052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1775) took 1151 ms. Trace:
I20260709 12:25:20.461647 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:20.462486 10975 raft_consensus.cc:2393] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 14: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:20.463575 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:20.461197 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:20.461428 11052 rpcz_store.cc:276] 0709 12:25:19.309141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.315586 (+  6445us) service_pool.cc:224] Handling call
0709 12:25:19.315883 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:19.526607 (+210724us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:19.548214 (+ 21607us) log.cc:844] Serialized 14 byte log entry
0709 12:25:19.886069 (+337855us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b1800399580. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cd9e07 00007f8f91b349a9 00007f8f88cf669b 00007f8f88cf493f 00007f8f88cf6c02 00007f8f8b97e20b 00007f8f8b983d23 00007f8f8b98423a 00007f8f8bdeea2a
0709 12:25:20.068795 (+182726us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:20.068862 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:20.068919 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.460757 (+391838us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54003142d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:20.460806 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:20.460936 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21569,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":8740,"raft.queue_time_us":4791,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":93,"spinlock_wait_cycles":488992256,"thread_start_us":177460,"threads_started":1,"wal-append.queue_time_us":806034}
I20260709 12:25:20.465979 10982 raft_consensus.cc:2393] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 12: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:20.471043 15691 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:20.469312 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:20.471730 15691 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:20.473166 15678 consensus_queue.cc:1059] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:20.474090 15691 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:20.471073 15756 log.cc:927] Time spent T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.701s	user 0.002s	sys 0.000s
I20260709 12:25:20.475266 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:20.475880 10983 raft_consensus.cc:2376] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 13. Re-sending same reply.
I20260709 12:25:20.476801 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2515) took 1169 ms. Trace:
I20260709 12:25:20.477178 11131 rpcz_store.cc:276] 0709 12:25:19.307772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.313186 (+  5414us) service_pool.cc:224] Handling call
0709 12:25:19.313551 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:19.580562 (+267011us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:19.580600 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:19.581164 (+   564us) log.cc:844] Serialized 26 byte log entry
0709 12:25:19.636630 (+ 55466us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:19.636672 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:19.857183 (+220511us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b5400324e54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:19.857252 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:20.470362 (+613110us) spinlock_profiling.cc:243] Waited 4.88 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:25:20.476575 (+  6213us) raft_consensus.cc:1685] finished
0709 12:25:20.476599 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:20.476723 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20590,"raft.queue_time_us":20947,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":13185,"spinlock_wait_cycles":576711808,"thread_start_us":53030,"threads_started":1,"wal-append.queue_time_us":150900}
I20260709 12:25:20.483997 15678 raft_consensus.cc:3055] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:20.484696 15678 raft_consensus.cc:740] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
W20260709 12:25:20.489001 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 54811.4us
I20260709 12:25:20.494750 11024 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:20.494977 15038 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:20.495658 15660 raft_consensus.cc:2804] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:20.495503 15038 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:20.496261 15660 raft_consensus.cc:697] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:20.497184 15660 consensus_queue.cc:237] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:20.499605 15038 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:20.500695 11024 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:20.502230 15482 raft_consensus.cc:2749] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:20.507644 11053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:20.508343 11053 raft_consensus.cc:606] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:20.508723 11053 raft_consensus.cc:614] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:20.485725 15678 consensus_queue.cc:260] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:20.521711 15678 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:20.418450 15435 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:20.361485 15671 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:20.556138 15671 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:20.414361 15721 consensus_queue.cc:1048] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.148s
W20260709 12:25:20.562767 15768 log.cc:927] Time spent T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 12:25:20.563587 15721 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.562618 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:20.562783 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:20.565011 11126 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:20.568943 15569 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:20.569587 15569 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.571624 15535 consensus_queue.cc:260] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:20.572698 15676 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:20.573040 15535 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:20.573611 15583 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:20.574955 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:20.575649 11128 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:25:20.576627 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:20.549394 11053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6506ec2922c24d099538b52b0df81502"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:53272
W20260709 12:25:20.578457 15707 log.cc:927] Time spent T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 12:25:20.581295 11133 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:25:20.414141 15682 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.584789 11053 raft_consensus.cc:606] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:20.584605 15682 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:20.585214 11053 raft_consensus.cc:614] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:20.570066 15569 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:20.587759 15364 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:20.588063 15569 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:20.588606 15569 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.589016 15672 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:20.589648 15672 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:20.592483 15672 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:20.577823 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:20.598304 15534 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.598898 15534 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:20.601090 15534 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:20.602964 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:20.604750 15705 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:20.605389 15705 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:20.589051 15569 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:20.611610 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.619902 11644 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:20.477205 11097 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:20.620708 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:20.622066 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:20.631557 11132 raft_consensus.cc:1275] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:20.626987 11126 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:20.635903 11025 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:20.641099 15742 log.cc:927] Time spent T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 1.216s	user 0.000s	sys 0.017s
I20260709 12:25:20.589721 15706 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:20.642030 11098 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:20.643455 11098 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:20.643797 15682 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:20.564119 15721 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:20.646443 15721 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:20.553613 15435 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:20.651283 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:20.651970 11681 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:20.652913 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:20.650789 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.655642 11060 raft_consensus.cc:1240] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:20.656267 10949 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:20.657413 11133 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:20.658277 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:20.658582 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:20.659299 11133 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:20.657676 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:20.660432 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:20.662828 11134 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:20.664390 11025 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:20.653584 11132 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:20.671402 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:20.672950 11058 raft_consensus.cc:2393] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 14: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:20.646621 15723 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:20.658667 11098 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:20.690794 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:20.692297 11675 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:25:20.693316 11132 raft_consensus.cc:1275] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:20.672147 11681 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:25:20.696709 11025 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:20.697763 11098 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:20.701323 11025 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:20.677498 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 200342us
I20260709 12:25:20.706619 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:20.704330 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:20.646543 15691 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:20.712662 11132 raft_consensus.cc:1275] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:25:20.712180 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 56009.3us
I20260709 12:25:20.713785 14464 consensus_queue.cc:1048] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:20.719775 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:20.698222 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:20.724143 11681 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:20.707554 11128 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:20.721510 14464 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:20.730419 11025 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:20.676162 15570 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:20.676419 15682 raft_consensus.cc:2749] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:20.775179 10949 leader_election.cc:400] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 10. Current term is 11.
I20260709 12:25:20.775866 11128 raft_consensus.cc:1240] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 13. Current term is 14. Ops: []
W20260709 12:25:20.777629 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 58308.2us
I20260709 12:25:20.709988 15723 raft_consensus.cc:697] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:20.711345 15388 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:20.714520 15691 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.780611 15723 consensus_queue.cc:237] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:20.781374 15691 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:20.711661 15706 raft_consensus.cc:2804] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:20.768323 11058 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "702d64a1236147a784daa11e58563721"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:20.691025 15569 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:20.788736 15569 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:20.792366 11134 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:25:20.735167 14464 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:20.794502 14464 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.780869 15388 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.795094 15388 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:20.732216 15722 raft_consensus.cc:2749] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:20.793892 15705 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:20.671010 15482 consensus_queue.cc:1048] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:25:20.704761 15721 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:20.799582 15570 raft_consensus.cc:697] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:20.776288 10949 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:20.800638 15570 consensus_queue.cc:237] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:20.801024 15682 raft_consensus.cc:2749] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:20.802167 10949 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:20.726475 15435 raft_consensus.cc:2804] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:20.798357 14464 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:20.814558 10949 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:20.805462 15435 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:20.824690 15435 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:20.826141 15773 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:20.826902 15773 raft_consensus.cc:697] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
W20260709 12:25:20.828481 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.805631 15640 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:20.831727 15640 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:20.804126 15706 raft_consensus.cc:697] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:20.833575 15706 consensus_queue.cc:237] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:20.827904 15773 consensus_queue.cc:237] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:20.780542 15534 consensus_queue.cc:1048] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:25:20.846843 10949 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:20.841933 11672 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.015s	sys 0.046s
W20260709 12:25:20.848349 11672 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.015s	sys 0.046s
I20260709 12:25:20.852933 10949 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:20.854013 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:20.860080 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:20.861044 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.850217 15672 raft_consensus.cc:2749] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:20.863942 15682 raft_consensus.cc:2749] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:20.871281 15038 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:20.932477 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:20.938531 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:20.939321 10983 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:20.924321 15672 raft_consensus.cc:2749] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:20.947518 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:20.975104 14464 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:20.980928 10949 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:20.934075 15682 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:20.922221 15038 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:21.002820 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:25:21.006843 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 143624us
I20260709 12:25:21.008546 10949 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:21.011256 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.946512 15655 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:21.019423 10949 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:21.038516 14464 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:21.040433 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:21.041632 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:21.043301 10979 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:21.043407 10975 raft_consensus.cc:2393] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 11: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:21.045250 10949 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:21.046178 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:21.046974 10981 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:21.055276 10949 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:21.056671 10949 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:21.062769 10977 raft_consensus.cc:1275] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:25:21.064534 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:21.070061 10975 raft_consensus.cc:1275] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:21.070470 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:21.071223 10978 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:21.075286 10949 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:21.018339 15672 raft_consensus.cc:2749] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:21.082760 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:21.083628 10978 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 16.
I20260709 12:25:21.088248 10978 raft_consensus.cc:1275] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:21.089380 10979 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:25:21.015946 15682 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:21.112638 10981 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
W20260709 12:25:21.114485 10984 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.008s	sys 0.010s
W20260709 12:25:21.115634 11645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.009s	sys 0.005s
I20260709 12:25:21.052320 15655 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:21.112681 11125 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.005s	sys 0.009s
W20260709 12:25:21.119649 11125 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.006s	sys 0.009s
I20260709 12:25:21.093020 15672 raft_consensus.cc:2749] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:21.122453 11129 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.021s	sys 0.058s
W20260709 12:25:21.122861 11129 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.021s	sys 0.058s
W20260709 12:25:21.118295 11643 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.010s	sys 0.006s
W20260709 12:25:21.124390 11643 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.010s	sys 0.006s
W20260709 12:25:21.126878 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 739698us
I20260709 12:25:21.121382 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:21.128818 10981 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
W20260709 12:25:21.114215 10980 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.006s	sys 0.013s
W20260709 12:25:21.116072 11645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.009s	sys 0.005s
W20260709 12:25:21.114879 10984 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.008s	sys 0.010s
I20260709 12:25:21.129452 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2506) took 2211 ms. Trace:
W20260709 12:25:21.133275 10980 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.007s	sys 0.013s
W20260709 12:25:21.120143 15516 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.348s	user 0.003s	sys 0.019s
W20260709 12:25:21.161669 11643 leader_election.cc:336] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 2.188s (SENT)
I20260709 12:25:21.129407 15716 raft_consensus.cc:2749] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:21.132863 15676 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.005s	sys 0.015s
I20260709 12:25:21.151988 15722 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:25:21.162446 11130 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.009s	sys 0.010s
I20260709 12:25:21.180337 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:25:21.160491 15516 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.389s	user 0.003s	sys 0.019s
W20260709 12:25:21.164207 10976 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.018s	sys 0.004s
W20260709 12:25:21.187494 10976 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.018s	sys 0.004s
W20260709 12:25:21.183460 11644 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.008s	sys 0.037s
W20260709 12:25:21.188700 11644 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.009s	sys 0.037s
I20260709 12:25:21.161824 15672 raft_consensus.cc:2749] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:25:21.196208 10948 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.015s	sys 0.013s
I20260709 12:25:21.183575 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:21.196587 10948 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.015s	sys 0.013s
I20260709 12:25:21.130324 15794 raft_consensus.cc:2749] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:25:21.186260 11130 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.009s	sys 0.010s
W20260709 12:25:21.163969 15695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.002s	sys 0.016s
W20260709 12:25:21.181185 15676 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.006s	sys 0.015s
I20260709 12:25:21.197052 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:21.205315 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:21.205672 10976 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 7.
I20260709 12:25:21.207962 11058 raft_consensus.cc:606] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
W20260709 12:25:21.203491 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 424759us
W20260709 12:25:21.176367 15725 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.007s	sys 0.037s
W20260709 12:25:21.189080 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 556452us
I20260709 12:25:21.211772 11098 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
W20260709 12:25:21.190557 15737 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.016s	sys 0.012s
W20260709 12:25:21.220362 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 58756.4us
I20260709 12:25:21.220417 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:21.218277 11098 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
W20260709 12:25:21.205098 15695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.002s	sys 0.016s
I20260709 12:25:21.223434 11098 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:21.223762 15737 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.016s	sys 0.012s
W20260709 12:25:21.217024 15725 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.007s	sys 0.038s
I20260709 12:25:21.218317 11025 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:21.231701 15794 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:21.247351 11098 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:21.254369 11098 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:21.259037 11672 raft_consensus.cc:1275] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:21.259227 10979 raft_consensus.cc:1240] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 14 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:21.219385 15672 raft_consensus.cc:2749] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:21.262874 11051 raft_consensus.cc:1240] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:21.264945 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:21.218616 15671 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:21.268611 10983 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:21.265754 11051 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
I20260709 12:25:21.276042 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:21.255378 11098 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:21.280611 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:21.190333 15722 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:21.291280 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 224271us
I20260709 12:25:21.298295 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:21.299041 11672 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
W20260709 12:25:21.300124 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 44829.4us
I20260709 12:25:21.304004 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:21.251477 15535 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:21.320529 11059 raft_consensus.cc:1275] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:25:21.318629 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:21.324548 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:21.318558 10976 raft_consensus.cc:1275] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:21.250720 15651 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:25:21.286247 15756 log.cc:927] Time spent T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:25:21.327385 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:21.329737 11672 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
I20260709 12:25:21.288029 15721 raft_consensus.cc:2804] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:21.290493 15794 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:21.349164 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 148498us
I20260709 12:25:21.352850 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:21.328645 15535 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:21.322552 15801 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:21.368921 10948 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:21.369342 15801 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:21.369849 15801 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:21.339124 15651 raft_consensus.cc:697] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:25:21.358966 15691 consensus_meta.cc:287] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.577s	user 0.011s	sys 0.000s
I20260709 12:25:21.351550 15682 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:21.453492 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 84676.8us
I20260709 12:25:21.352198 15733 raft_consensus.cc:2749] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:21.344560 15784 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:21.339481 15721 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:21.345050 15038 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:21.341491 15777 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.480957 10948 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:21.361737 15655 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:21.419658 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:21.497521 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.364949 15535 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:21.493527 15721 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:21.398365 15678 consensus_meta.cc:287] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.850s	user 0.011s	sys 0.004s
I20260709 12:25:21.511495 15682 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:21.512087 15682 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:21.512460 15682 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:21.518721 15802 log.cc:927] Time spent T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 12:25:21.522675 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:21.523512 10978 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:25:21.524654 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:21.525329 10978 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:21.526489 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:21.526337 15784 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:21.529582 15784 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:21.356446 15794 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:21.530239 15777 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:21.532763 15777 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:21.366848 15672 consensus_queue.cc:1059] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.169s
I20260709 12:25:21.534963 15672 consensus_queue.cc:1243] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [LEADER]: Peer c979ef00e0ad4157b49ebbdc13ce7cd7 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:25:21.535473 15672 raft_consensus.cc:3055] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:21.535813 15672 raft_consensus.cc:740] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:21.536787 15672 consensus_queue.cc:260] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:21.530956 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 2092) took 1159 ms. Trace:
I20260709 12:25:21.538426 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1849) took 1078 ms. Trace:
I20260709 12:25:21.543275 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:21.561023 10980 rpcz_store.cc:276] 0709 12:25:20.460129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.460250 (+   121us) service_pool.cc:224] Handling call
0709 12:25:20.460595 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:20.460960 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:20.460988 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:20.461499 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 12:25:21.151595 (+690096us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:21.151639 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:21.151719 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:21.538171 (+386452us) raft_consensus.cc:1685] finished
0709 12:25:21.538195 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:21.538360 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21467,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"thread_start_us":689646,"threads_started":1,"wal-append.queue_time_us":1074090}
I20260709 12:25:21.537722 11130 rpcz_store.cc:276] 0709 12:25:20.371175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.385013 (+ 13838us) service_pool.cc:224] Handling call
0709 12:25:20.385381 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:20.385779 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:20.385810 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:20.388409 (+  2599us) log.cc:844] Serialized 26 byte log entry
0709 12:25:21.203165 (+814756us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:21.342228 (+139063us) log.cc:844] Serialized 14 byte log entry
0709 12:25:21.349591 (+  7363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:21.349695 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:21.530758 (+181063us) raft_consensus.cc:1685] finished
0709 12:25:21.530777 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:21.530900 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35705,"prepare.queue_time_us":158565,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":3154,"raft.queue_time_us":2115,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"thread_start_us":933570,"threads_started":2,"wal-append.queue_time_us":1140232}
I20260709 12:25:21.150835 11129 rpcz_store.cc:276] 0709 12:25:18.917840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.918155 (+   315us) service_pool.cc:224] Handling call
0709 12:25:18.918458 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:18.918665 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:20.378936 (+1460271us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b18003b1280. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f8b98c4bc 00007f8f88cda48b 00007f8f91b349a9 00007f8f88cf669b 00007f8f88cf493f 00007f8f88cf4455 00007f8f8f7dc3c7 00007f8f8bdee9a7 00007f8f8bdfe0bf
0709 12:25:20.379102 (+   166us) log.cc:844] Serialized 14 byte log entry
0709 12:25:21.129096 (+749994us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:21.129153 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:21.129196 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:21.129279 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:21.129392 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36412,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":135,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":20950,"spinlock_wait_cycles":28822784,"thread_start_us":804975,"threads_started":2}
W20260709 12:25:21.567894 15778 log.cc:927] Time spent T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.574s	user 0.005s	sys 0.009s
I20260709 12:25:21.569434 15806 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:21.569917 11055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 2049) took 1476 ms. Trace:
I20260709 12:25:21.570899 15733 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:21.571171 15807 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:25:21.571785 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 51980.3us
I20260709 12:25:21.571584 15733 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:21.574335 15733 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:21.575733 15435 consensus_meta.cc:287] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.750s	user 0.011s	sys 0.000s
I20260709 12:25:21.576174 15435 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:21.577214 15733 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:21.570048 15806 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:21.570976 15651 consensus_queue.cc:237] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:21.579731 15806 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:21.580001 15780 log.cc:927] Time spent T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.404s	user 0.008s	sys 0.010s
I20260709 12:25:21.582089 11051 raft_consensus.cc:1275] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:25:21.573860 11023 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.937s (SENT) [suppressed 37 similar messages]
I20260709 12:25:21.527225 10975 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:21.570402 11055 rpcz_store.cc:276] 0709 12:25:20.093494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.093627 (+   133us) service_pool.cc:224] Handling call
0709 12:25:20.093979 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:20.254210 (+160231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:20.254257 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:20.270342 (+ 16085us) log.cc:844] Serialized 26 byte log entry
0709 12:25:20.666716 (+396374us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:21.118183 (+451467us) log.cc:844] Serialized 14 byte log entry
0709 12:25:21.118437 (+   254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:21.118604 (+   167us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:21.566027 (+447423us) spinlock_profiling.cc:243] Waited 55.2 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:25:21.569577 (+  3550us) raft_consensus.cc:1685] finished
0709 12:25:21.569692 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:21.569848 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":163402,"prepare.queue_time_us":661728,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":5776,"raft.queue_time_us":148678,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":25166,"spinlock_wait_cycles":127044352,"thread_start_us":783026,"threads_started":2,"wal-append.queue_time_us":628257}
I20260709 12:25:21.581781 15482 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.588343 11023 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:21.563486 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:21.591161 10980 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:21.556145 10977 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
W20260709 12:25:21.494592 15755 log.cc:927] Time spent T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260709 12:25:21.611070 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 303532us
I20260709 12:25:21.615612 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:21.532646 15794 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:21.479969 15792 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:21.537999 15672 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:21.611181 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 398917us
I20260709 12:25:21.616456 10978 raft_consensus.cc:2376] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11. Re-sending same reply.
I20260709 12:25:21.631587 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:21.632436 10978 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:21.623296 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:21.633483 10975 raft_consensus.cc:2376] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12. Re-sending same reply.
I20260709 12:25:21.592315 15807 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:21.635063 11023 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:21.539812 15722 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:21.636371 15807 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:21.636687 15660 consensus_queue.cc:1048] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:21.637230 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:21.638453 15730 consensus_queue.cc:1048] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:21.640587 15477 consensus_queue.cc:1048] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:21.641255 15570 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.642918 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:21.692888 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 2091) took 1322 ms. Trace:
I20260709 12:25:21.585323 15784 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:21.620072 15792 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:21.683002 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 44753.6us
W20260709 12:25:21.624014 15388 consensus_meta.cc:287] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.824s	user 0.010s	sys 0.001s
I20260709 12:25:21.645357 15777 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:21.596032 15706 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:21.691931 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 56932.4us
I20260709 12:25:21.695760 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:21.569025 15535 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:21.756492 11130 raft_consensus.cc:2393] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 11: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:21.757355 11060 raft_consensus.cc:1275] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:21.756460 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:21.480566 15691 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:21.694383 11127 rpcz_store.cc:276] 0709 12:25:20.370919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.383844 (+ 12925us) service_pool.cc:224] Handling call
0709 12:25:20.384198 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:20.401508 (+ 17310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:20.402972 (+  1464us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:20.403480 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 12:25:20.935036 (+531556us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:21.286321 (+351285us) log.cc:844] Serialized 14 byte log entry
0709 12:25:21.579393 (+293072us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:25:21.649507 (+ 70114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:21.649592 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:21.649641 (+    49us) raft_consensus.cc:1685] finished
0709 12:25:21.692625 (+ 42984us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:21.692813 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83490,"prepare.queue_time_us":417399,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":3755,"raft.queue_time_us":282924,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":217,"spinlock_wait_cycles":6225792,"thread_start_us":976575,"threads_started":3,"wal-append.queue_time_us":696923}
I20260709 12:25:21.594380 15733 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:21.596359 15482 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:21.770174 11051 raft_consensus.cc:1240] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:25:21.770908 15482 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:21.771404 11058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:53272 (request call id 38) took 1041 ms. Trace:
I20260709 12:25:21.750061 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:21.771844 11058 rpcz_store.cc:276] 0709 12:25:20.730017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.768151 (+ 38134us) service_pool.cc:224] Handling call
0709 12:25:21.771174 (+1003023us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b54003138d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bdde853 00007f8f90dac60a 00007f8f8a3327d4 00007f8f8a332762 00007f8f8a332691 00007f8f8a33260c 00007f8f8a3318c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:21.771286 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":965053824}
I20260709 12:25:21.777618 15791 consensus_queue.cc:1048] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:21.689328 10980 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:21.755355 11023 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:21.790762 11133 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.036s	sys 0.031s
I20260709 12:25:21.791800 11023 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:21.762634 15777 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:21.690862 15820 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:21.722620 15792 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:21.784554 15800 consensus_queue.cc:1059] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:25:21.791997 11133 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.036s	sys 0.031s
W20260709 12:25:21.786588 15822 log.cc:927] Time spent T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:25:21.696880 15655 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.797896 11023 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:21.811388 11023 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:21.792418 15435 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:21.813552 15435 raft_consensus.cc:2749] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:21.811744 14464 raft_consensus.cc:2804] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:21.814430 14464 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:21.814818 14464 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:21.815594 11052 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:21.816291 11052 raft_consensus.cc:606] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:21.749235 15812 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:21.755298 15676 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:21.804051 15671 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:21.814433 15583 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:21.751731 15388 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:21.748709 15570 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:21.844805 14464 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:21.823908 15809 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:21.854754 15809 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:21.823997 15655 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:21.855145 15809 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:21.856781 15388 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:21.706418 15784 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:21.860677 15570 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:21.861277 15784 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:21.865381 15655 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:21.812336 15820 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:21.868391 15820 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:21.811857 15806 consensus_queue.cc:1048] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:25:21.868292 15691 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:21.825829 15812 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:21.870204 15733 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:21.829762 15800 raft_consensus.cc:3055] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:21.854167 15777 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:21.873109 10982 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.009s	sys 0.007s
W20260709 12:25:21.876160 10982 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.010s	sys 0.007s
I20260709 12:25:21.814137 15516 consensus_queue.cc:1048] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:25:21.876819 14464 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:21.877251 11099 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.006s	sys 0.012s
W20260709 12:25:21.878388 11099 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.006s	sys 0.012s
W20260709 12:25:21.874799 11643 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.002s	sys 0.015s
W20260709 12:25:21.879447 11643 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.002s	sys 0.015s
W20260709 12:25:21.890309 10949 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.012s	sys 0.006s
W20260709 12:25:21.894179 10984 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.007s	sys 0.018s
W20260709 12:25:21.895079 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:21.898828 10949 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.012s	sys 0.006s
I20260709 12:25:21.874079 15800 raft_consensus.cc:740] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:21.873296 15812 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:21.837075 15676 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:21.899682 10984 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.008s	sys 0.018s
I20260709 12:25:21.906626 15800 consensus_queue.cc:260] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:21.907968 15800 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:21.849668 15671 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:21.915269 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:21.917852 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 842587us
I20260709 12:25:21.920919 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:21.922740 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:21.923770 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:21.924244 11132 raft_consensus.cc:1275] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:21.919790 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:25:21.918920 11647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.007s	sys 0.020s
I20260709 12:25:21.936172 11130 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:21.936728 11647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.007s	sys 0.021s
I20260709 12:25:21.934923 11052 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:21.939352 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.918692 15829 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:21.941912 15676 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:21.942628 15583 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:21.895593 15721 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:21.949759 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2549) took 1139 ms. Trace:
I20260709 12:25:21.950192 15535 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:21.967584 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.967710 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:21.953871 11060 raft_consensus.cc:1240] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:21.955154 10949 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:21.937793 15723 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.958319 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:21.961241 11127 raft_consensus.cc:1275] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:25:21.962144 15791 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:21.964653 11128 rpcz_store.cc:276] 0709 12:25:20.810222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.810574 (+   352us) service_pool.cc:224] Handling call
0709 12:25:20.811160 (+   586us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:25:21.257178 (+446018us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:25:21.298537 (+ 41359us) log.cc:844] Serialized 14 byte log entry
0709 12:25:21.674221 (+375684us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 12:25:21.750973 (+ 76752us) log.cc:844] Serialized 104 byte log entry
0709 12:25:21.751190 (+   217us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:21.751837 (+   647us) log.cc:844] Serialized 14 byte log entry
0709 12:25:21.752334 (+   497us) log.cc:844] Serialized 14 byte log entry
0709 12:25:21.752662 (+   328us) log.cc:844] Serialized 14 byte log entry
0709 12:25:21.756567 (+  3905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:21.756649 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:21.949512 (+192863us) raft_consensus.cc:1685] finished
0709 12:25:21.949532 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:21.949690 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9401,"prepare.queue_time_us":126871,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":88,"raft.queue_time_us":88444,"raft.run_cpu_time_us":692,"raft.run_wall_time_us":85754,"spinlock_wait_cycles":8077184,"thread_start_us":729815,"threads_started":2,"wal-append.queue_time_us":565353}
W20260709 12:25:21.963825 11680 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.008s	sys 0.020s
I20260709 12:25:21.977667 10949 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:21.982851 11130 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:22.004172 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:21.970930  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:21.955585 15790 raft_consensus.cc:2749] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:22.004522 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:21.968489 11672 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:22.006543 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:22.006778 11680 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.009s	sys 0.021s
I20260709 12:25:22.010814 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:25:22.019451 11645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.004s	sys 0.046s
I20260709 12:25:22.012744 11681 raft_consensus.cc:1275] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:22.012825 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:22.013888 11676 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:22.021773 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:22.019553 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:22.022728 11679 raft_consensus.cc:1275] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 12:25:22.023113 11679 pending_rounds.cc:85] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Aborting all ops after (but not including) 11
I20260709 12:25:22.023339 11679 pending_rounds.cc:107] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 12:25:22.023571 11679 raft_consensus.cc:2889] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:22.023774 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:21.966936 15583 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:22.001773 15824 raft_consensus.cc:2749] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:21.957490 15682 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:21.970660 15820 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:22.021091 11130 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:22.015134 10949 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
W20260709 12:25:22.065374 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 50346.8us
W20260709 12:25:22.059270 15725 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.017s	sys 0.042s
I20260709 12:25:22.066061 15672 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:22.066542 15672 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:22.066938 15672 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:22.026468 11645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.004s	sys 0.046s
I20260709 12:25:21.962013 15829 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:22.021910 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:22.086902 11673 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 6.
I20260709 12:25:22.098543 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:22.099426 11126 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
W20260709 12:25:22.066082 15725 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.017s	sys 0.042s
I20260709 12:25:22.051474 10975 raft_consensus.cc:1275] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:25:22.001896 15777 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:22.057026 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:22.058704 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:22.023782 11128 raft_consensus.cc:1275] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:22.060295 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:22.061805 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:22.062687 11676 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
W20260709 12:25:22.067854 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 699783us
I20260709 12:25:22.011973  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:25:22.067965 11125 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.017s	sys 0.033s
W20260709 12:25:22.112696 11125 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.017s	sys 0.033s
I20260709 12:25:22.068890 10949 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:22.071003 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:22.114495 11129 raft_consensus.cc:2393] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 14: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:22.024021 15607 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:22.001502 15723 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:22.005489 15791 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:22.022583 11127 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:22.086299 15820 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:22.116590 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:22.120309 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:22.121284  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:22.140340 11676 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:22.121580 15824 raft_consensus.cc:2749] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:22.123045 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 54249.8us
I20260709 12:25:22.142536 10949 leader_election.cc:400] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 election: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 10. Current term is 11.
I20260709 12:25:22.142876 10949 leader_election.cc:403] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:25:21.966872 15812 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:22.107487 10975 pending_rounds.cc:85] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 8
I20260709 12:25:22.150308 10975 pending_rounds.cc:107] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:25:22.150622 10975 raft_consensus.cc:2889] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:22.140388 11057 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:25:22.148082 11130 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:22.152783 11025 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:22.163069 10949 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:22.134584 15655 consensus_queue.cc:1048] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:25:22.168718 11676 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:25:22.172322 10949 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:22.132397 15810 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:25:22.172344 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 359199us
I20260709 12:25:22.235517 11023 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:22.237607 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 84919.5us
W20260709 12:25:22.239945 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 104300us
I20260709 12:25:22.236634 10949 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:22.237291 11023 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:22.244172 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:22.236202 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:22.244819 11679 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:22.234270 15631 raft_consensus.cc:2749] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:22.245237 15822 log.cc:927] Time spent T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:25:22.265393 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:22.237527 15607 raft_consensus.cc:2749] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:22.161158 15435 consensus_queue.cc:1048] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 12:25:22.237841 15660 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:22.242865 15038 raft_consensus.cc:2804] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:22.135069 15777 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:22.274571 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:22.238682 15678 consensus_queue.cc:1048] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:25:22.235973 15842 raft_consensus.cc:2749] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 10. Current term is 11.
W20260709 12:25:22.264451 15801 consensus_meta.cc:287] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.894s	user 0.000s	sys 0.012s
I20260709 12:25:22.359351 15801 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:22.361575 15801 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:22.258634 15570 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:22.361860 15831 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:22.362300 15570 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:22.362759 15570 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:22.362833 15722 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:22.364012 15722 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:22.303905 11676 raft_consensus.cc:2410] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:25:22.311506 15723 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:22.314759 11053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41294 (request call id 1789) took 1011 ms. Trace:
W20260709 12:25:22.314790 15838 log.cc:927] Time spent T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 12:25:22.323557 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:22.334525 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:22.367519 15842 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.368067 15842 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:22.367034 11053 rpcz_store.cc:276] 0709 12:25:21.303586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.303730 (+   144us) service_pool.cc:224] Handling call
0709 12:25:22.314513 (+1010783us) spinlock_profiling.cc:243] Waited 755 ms on lock 0x7b54003e0b54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:22.314676 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1735772032}
I20260709 12:25:22.281903 15835 consensus_queue.cc:1048] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:25:22.370334 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 2090) took 1999 ms. Trace:
I20260709 12:25:22.337034 15812 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:22.338114 15829 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:22.340864 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1850) took 1880 ms. Trace:
I20260709 12:25:22.370764 15831 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:22.366321 11132 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:22.351032 11052 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
W20260709 12:25:22.246361 15773 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.357s	user 0.016s	sys 0.020s
I20260709 12:25:22.350625 11098 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:22.366251 15722 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:22.374723 15827 log.cc:927] Time spent T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.305s	user 0.000s	sys 0.001s
I20260709 12:25:22.306020 15631 raft_consensus.cc:2749] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:22.375379 10984 rpcz_store.cc:276] 0709 12:25:20.460432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.461905 (+  1473us) service_pool.cc:224] Handling call
0709 12:25:20.462199 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:21.132080 (+669881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:21.132115 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:21.132680 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 12:25:21.914253 (+781573us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:21.955148 (+ 40895us) log.cc:844] Serialized 14 byte log entry
0709 12:25:21.955411 (+   263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:21.955610 (+   199us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:22.336503 (+380893us) spinlock_profiling.cc:243] Waited 5.48 ms on lock 0x7b1800294760. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cf73f3 00007f8f88cf97c1 00007f8f88cf9779 00007f8f88cf9709 00007f8f88cf96d1 00007f8f88cf89cd 0000000000388634 0000000000388479 00007f8f88cda83a
0709 12:25:22.340494 (+  3991us) raft_consensus.cc:1685] finished
0709 12:25:22.340616 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:22.340790 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":41748,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":20228,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":218,"spinlock_wait_cycles":12614016,"thread_start_us":1391428,"threads_started":2,"wal-append.queue_time_us":1083671}
I20260709 12:25:22.370761 11125 rpcz_store.cc:276] 0709 12:25:20.370600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.379529 (+  8929us) service_pool.cc:224] Handling call
0709 12:25:20.379913 (+   384us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:20.611186 (+231273us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:21.120034 (+508848us) log.cc:844] Serialized 14 byte log entry
0709 12:25:22.113066 (+993032us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:22.122408 (+  9342us) log.cc:844] Serialized 52 byte log entry
0709 12:25:22.122603 (+   195us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:22.122840 (+   237us) log.cc:844] Serialized 14 byte log entry
0709 12:25:22.132493 (+  9653us) log.cc:844] Serialized 14 byte log entry
0709 12:25:22.344558 (+212065us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b18004153c0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88c71c0a 00007f8f923b1219 00007f8f88cf9a40 00007f8f88cf44e4 00007f8f88cf4455 00007f8f8bddc060 00007f8f8bdee716 00007f8f8bdff287 00007f8f8bdff208
0709 12:25:22.344843 (+   285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:22.369938 (+ 25095us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b5400106654. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:22.369987 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:22.370056 (+    69us) raft_consensus.cc:1685] finished
0709 12:25:22.370072 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:22.370281 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":221180,"prepare.queue_time_us":641333,"prepare.run_cpu_time_us":149,"prepare.run_wall_time_us":9182,"raft.queue_time_us":433096,"raft.run_cpu_time_us":553,"raft.run_wall_time_us":43461,"spinlock_wait_cycles":533638272,"thread_start_us":1457288,"threads_started":3,"wal-append.queue_time_us":460775}
W20260709 12:25:22.366967 15846 log.cc:927] Time spent T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:25:22.387993 15801 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.389235 15721 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:22.355825 15038 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:22.406889 11098 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:22.370842 15660 raft_consensus.cc:697] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:22.373610 15831 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:22.321964 15809 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:22.422966 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2694) took 1047 ms. Trace:
I20260709 12:25:22.431398 11132 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
W20260709 12:25:22.401301 15773 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.508s	user 0.017s	sys 0.020s
I20260709 12:25:22.402894 15829 raft_consensus.cc:2804] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:22.437314 15828 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:22.441602 10978 raft_consensus.cc:3055] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:22.434079 10981 rpcz_store.cc:276] 0709 12:25:21.453487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.453921 (+   434us) service_pool.cc:224] Handling call
0709 12:25:21.508895 (+ 54974us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:21.509143 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:22.011541 (+502398us) log.cc:844] Serialized 14 byte log entry
0709 12:25:22.422524 (+410983us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:22.422592 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:22.422663 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:22.422740 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:22.422890 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78156,"prepare.queue_time_us":144445,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":4212,"raft.queue_time_us":7176,"thread_start_us":802916,"threads_started":2}
I20260709 12:25:22.441993 10978 raft_consensus.cc:740] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:22.446053 11678 raft_consensus.cc:1275] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:22.419965 15682 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:22.442780 10978 consensus_queue.cc:260] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:22.439803 11098 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:22.459807 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:22.432427 15038 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:22.465185 11056 raft_consensus.cc:1240] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:25:22.483680 10978 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:22.485405 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2547) took 1675 ms. Trace:
I20260709 12:25:22.485831 11133 rpcz_store.cc:276] 0709 12:25:20.809585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.810366 (+   781us) service_pool.cc:224] Handling call
0709 12:25:20.810810 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:21.183241 (+372431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:21.183278 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:21.190131 (+  6853us) log.cc:844] Serialized 26 byte log entry
0709 12:25:21.808648 (+618517us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:21.808695 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:21.808778 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:22.485138 (+676360us) raft_consensus.cc:1685] finished
0709 12:25:22.485166 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:22.485333 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53668,"raft.queue_time_us":61729,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":9478,"spinlock_wait_cycles":253184,"thread_start_us":875103,"threads_started":2,"wal-append.queue_time_us":779588}
I20260709 12:25:22.441015 15829 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:25:22.508968 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 270159us
I20260709 12:25:22.511901 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:22.511281 11677 raft_consensus.cc:1275] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:25:22.511009 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 71267.5us
I20260709 12:25:22.514007 11098 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:22.514528 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:22.518606 11676 raft_consensus.cc:2410] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 12:25:22.506358 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 250603us
I20260709 12:25:22.513978 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:25:22.513959 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 277042us
I20260709 12:25:22.432250 15801 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:22.521384 11678 raft_consensus.cc:2393] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 14: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:22.505437 15721 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:22.515036 15829 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:22.518779 15792 consensus_meta.cc:287] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.694s	user 0.005s	sys 0.005s
I20260709 12:25:22.514384 15820 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:22.516007 15828 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:22.512990 11673 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:25:22.505887 15791 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:22.525143 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 274045us
I20260709 12:25:22.516016 11023 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:22.445444 15831 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 12:25:22.558385 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:22.558514 11023 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:22.530668 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:22.512881 15825 consensus_queue.cc:1059] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:25:22.565593 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:22.565940 11023 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
W20260709 12:25:22.556833 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 320259us
I20260709 12:25:22.557456 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:22.559350 11677 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:22.559397 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:22.570283 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:22.560158 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:22.564433 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:22.572430 11133 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:22.580327 11643 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:22.583192 11127 raft_consensus.cc:1275] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:25:22.570734 11129 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
I20260709 12:25:22.584851 11645 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:22.590365 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:22.591023 11134 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:25:22.595253 11643 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:22.596006 10949 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:22.596688 11645 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:22.526810 15841 raft_consensus.cc:2749] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:22.600310 11025 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:22.600598 11023 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:22.594800 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:22.607466 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:22.607466 11025 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:22.610463 14464 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:22.610857 14464 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:22.611182 14464 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:22.609148 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:22.596716 15435 raft_consensus.cc:2749] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:22.615069 11025 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:22.614650 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:22.582232 15862 raft_consensus.cc:2749] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:22.619350 11125 raft_consensus.cc:1240] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:22.589944 15850 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:22.621423 15655 raft_consensus.cc:2804] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:22.621856 15773 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.530936 15721 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:22.629536 15809 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:22.630316 15809 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:22.630833 15809 raft_consensus.cc:697] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:22.561090 15820 consensus_queue.cc:1048] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:25:22.631757 15809 consensus_queue.cc:237] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:22.589186 15828 raft_consensus.cc:697] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:22.612308 15569 raft_consensus.cc:2749] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:22.624651 15825 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:22.605383 15839 raft_consensus.cc:2764] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:25:22.613341 15516 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:22.619352 11127 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
I20260709 12:25:22.604137 15682 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:22.627467 15855 log.cc:927] Time spent T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:25:22.641806 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:22.735351 11134 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 13.
I20260709 12:25:22.527123 15660 consensus_queue.cc:237] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:22.615983 15631 raft_consensus.cc:2749] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:22.566493 15792 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:22.652438 15435 consensus_queue.cc:1048] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:22.653813 15842 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:22.657303 15857 log.cc:927] Time spent T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:25:22.658768 15721 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:22.662616 15810 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:22.780083 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:22.681452 11133 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:25:22.722486 15516 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:22.681602 14464 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:22.627421 15773 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:22.622049 15607 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:22.669188 15858 log.cc:927] Time spent T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:25:22.700521 15784 raft_consensus.cc:3055] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:22.801579 15784 raft_consensus.cc:740] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:22.802265 11680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41784 (request call id 765) took 1543 ms. Trace:
I20260709 12:25:22.632642 15820 raft_consensus.cc:2749] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:22.714675 11132 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:22.803463 14464 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:22.717780 15706 consensus_meta.cc:287] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.927s	user 0.006s	sys 0.003s
I20260709 12:25:22.608144 15705 consensus_queue.cc:1048] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:25:22.631705 15671 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:22.613205 15651 consensus_queue.cc:1048] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:25:22.625118 15777 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:22.625717 15850 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:22.804348 11680 rpcz_store.cc:276] 0709 12:25:21.258412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.258539 (+   127us) service_pool.cc:224] Handling call
0709 12:25:21.299397 (+ 40858us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:22.016448 (+717051us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:22.016484 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:22.017019 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 12:25:22.414458 (+397439us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:22.414496 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:22.414566 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:22.802009 (+387443us) raft_consensus.cc:1685] finished
0709 12:25:22.802030 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:22.802186 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34872,"raft.queue_time_us":284287,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":8800,"thread_start_us":1041195,"threads_started":2,"wal-append.queue_time_us":492707}
W20260709 12:25:22.602577 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 109893us
I20260709 12:25:22.754717 10978 raft_consensus.cc:1275] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:25:22.761965 11673 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
W20260709 12:25:22.763710 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:22.742455 15583 consensus_meta.cc:287] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.673s	user 0.006s	sys 0.001s
I20260709 12:25:22.769690 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:22.778343 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:22.778970 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:22.843802 10983 raft_consensus.cc:2410] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:25:22.781965 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:22.844548 10980 raft_consensus.cc:2393] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 15: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:22.788780 10979 raft_consensus.cc:2410] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:25:22.666837 11677 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:25:22.847054 10981 raft_consensus.cc:1275] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:25:22.762382 15672 consensus_meta.cc:287] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.693s	user 0.009s	sys 0.003s
I20260709 12:25:22.736027 15785 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:22.622424 15824 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.709376 15570 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:22.796262 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:22.756179 15868 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.755200 15791 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:22.763422 15678 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.816532 15801 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:22.792030 15810 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:22.822319 15792 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:22.840559 10978 pending_rounds.cc:85] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 6
W20260709 12:25:22.840910 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.797672 15516 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:22.848763 14464 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
W20260709 12:25:22.849728 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 192867us
I20260709 12:25:22.765213 15682 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:22.852207 10979 raft_consensus.cc:1275] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:25:22.812665 15607 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:22.854211 11132 raft_consensus.cc:1275] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:22.857650 10975 raft_consensus.cc:2393] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 7: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:22.841537 15850 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:22.802542 15784 consensus_queue.cc:260] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:22.862222 15831 consensus_queue.cc:1059] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:22.862773 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:22.827519 15706 raft_consensus.cc:2749] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:22.869680 10978 pending_rounds.cc:107] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 12.7
W20260709 12:25:22.868263 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 273071us
I20260709 12:25:22.863037 15828 consensus_queue.cc:237] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:22.900620 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 304499us
I20260709 12:25:22.984205 11643 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:22.949364 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 352726us
I20260709 12:25:22.987530 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:25:22.978863 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 336895us
I20260709 12:25:22.991514 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:22.994156 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:22.995049 11677 raft_consensus.cc:2368] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 14. Current term is 15.
I20260709 12:25:22.997287 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:22.890331 10981 raft_consensus.cc:1275] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:23.002506 10978 raft_consensus.cc:2889] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:23.003727 14464 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:23.005052 10977 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:22.985905 11645 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:23.009967 11125 raft_consensus.cc:1240] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:23.009859 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:23.011467 11058 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:25:23.016588 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:23.022524 11052 raft_consensus.cc:2368] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 14. Current term is 15.
W20260709 12:25:23.024681 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 408671us
I20260709 12:25:23.029901 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2703) took 1510 ms. Trace:
I20260709 12:25:23.030464 10978 rpcz_store.cc:276] 0709 12:25:21.519106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.758123 (+239017us) service_pool.cc:224] Handling call
0709 12:25:21.758395 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:23.003214 (+1244819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:23.029651 (+ 26437us) spinlock_profiling.cc:243] Waited 683 ms on lock 0x7b5400099f54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:23.029836 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1570851712}
I20260709 12:25:23.037424 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:23.038447 10979 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:25:22.984479 15784 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:23.028258 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:23.070732 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 86719.5us
I20260709 12:25:23.071705 11643 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:22.893146 15792 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.868912 15655 raft_consensus.cc:697] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:23.077127 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:22.872181 15794 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:22.892053 15867 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:22.851998 15583 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:22.872175 15865 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:23.040141 15839 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.864758 15672 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:23.099440 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:23.086550 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 448169us
I20260709 12:25:23.079943 15864 consensus_queue.cc:1059] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:25:23.096797 15886 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:22.979883 15038 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:23.099428 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:23.122169 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:23.122913 11681 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Advancing to term 13
W20260709 12:25:23.101092 15871 log.cc:927] Time spent T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 12:25:23.103410 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:23.103818 15815 raft_consensus.cc:2749] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:22.868526 15868 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:23.041518 15800 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:22.868811 15791 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:23.107738 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:22.871039 15678 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:23.113153 11025 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:22.868588 15824 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:22.868320 15785 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:23.127713 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:23.130481 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:23.139882 15777 consensus_queue.cc:1048] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:23.137789 11643 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:23.136312 15038 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:23.134335 15864 raft_consensus.cc:3055] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:23.142652 15607 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:23.142886 15874 log.cc:927] Time spent T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 12:25:23.145586 11127 raft_consensus.cc:1240] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:23.148291 15672 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:23.148993 15773 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:23.149348 11681 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 13.
I20260709 12:25:23.124819 15820 consensus_queue.cc:1059] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:25:23.151435 15583 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:23.104521 15867 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:23.134279 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:23.137451 15825 consensus_queue.cc:1048] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:23.155591 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:23.091127 15792 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:23.099727 15794 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:23.159965 10978 raft_consensus.cc:2393] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 8: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:23.162685 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:23.186131 10980 raft_consensus.cc:2410] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:25:23.186256 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:23.164479 11643 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
W20260709 12:25:23.165328 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 273807us
W20260709 12:25:23.160518 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 47475.1us
I20260709 12:25:23.187661 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:23.161688 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:23.161787 10983 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:23.122224 15812 consensus_queue.cc:1048] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:25:23.172523 10975 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:23.192649 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:23.193369 10980 raft_consensus.cc:2393] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 13: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:23.193539 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:23.194209 10975 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:25:23.195031 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:23.195585 10975 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:23.196408 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:23.198628 11643 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:23.196943 10975 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:23.172868 11054 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:25:23.177423 10984 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 16.
I20260709 12:25:23.189356 10978 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:23.205778 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:23.158038 10949 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:23.225232 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 67282.5us
I20260709 12:25:23.226065 10949 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:23.227383 10978 raft_consensus.cc:2410] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:25:23.228416 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:23.229329 10978 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:23.208140 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:23.241600 10980 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:23.209434 11054 raft_consensus.cc:1240] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:23.171931 15570 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:23.212334 15877 raft_consensus.cc:2749] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:23.212492 15812 consensus_queue.cc:1243] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer 7518bdeb78f24e67a530754ae48547eb log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:25:23.223469 15890 log.cc:927] Time spent T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 12:25:23.161998 15829 consensus_meta.cc:287] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.605s	user 0.011s	sys 0.000s
I20260709 12:25:23.234157 15672 raft_consensus.cc:2749] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:23.174573 15825 consensus_queue.cc:1243] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer bc01179655564f29b83babe396377cbb log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:25:23.164690 15886 raft_consensus.cc:2749] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:23.167147 15831 raft_consensus.cc:3055] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:23.231103 10949 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
W20260709 12:25:23.282311 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 51313.6us
I20260709 12:25:23.283129 10949 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:23.121171 15839 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:23.158910 15800 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:23.235419 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:23.165732 15864 raft_consensus.cc:740] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:23.236222 10979 raft_consensus.cc:1275] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:23.121907 15865 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:23.212088 15836 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:23.171108 15883 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:25:23.243232 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 55571.1us
I20260709 12:25:23.160307 10977 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 15.
W20260709 12:25:23.243090 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 138704us
I20260709 12:25:23.311980 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:23.312734 10977 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:23.245630 10983 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:25:23.314047 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:23.314749 10983 raft_consensus.cc:2376] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15. Re-sending same reply.
I20260709 12:25:23.315806 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:23.316399 10983 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:23.230125 15881 raft_consensus.cc:2749] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:23.189874 10981 raft_consensus.cc:2393] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 10: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:23.263002 11098 leader_election.cc:400] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 14. Current term is 15.
I20260709 12:25:23.319615 11098 leader_election.cc:403] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:25:23.248287 15841 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.320209 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:23.320529 15583 raft_consensus.cc:2749] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 14. Current term is 15.
I20260709 12:25:23.216521 15833 consensus_queue.cc:1048] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:25:23.304023 10980 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:23.307651 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:23.322197 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:23.322732 10975 raft_consensus.cc:2393] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 14: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:23.323304 15841 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:23.323789 10980 raft_consensus.cc:1275] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:23.322721 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:23.325623 15841 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:23.320221 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 57372.7us
I20260709 12:25:23.182286 15655 consensus_queue.cc:237] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:23.332587 11098 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:23.310935 11097 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:23.334045 11098 leader_election.cc:400] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 14. Current term is 15.
I20260709 12:25:23.235852 15706 consensus_queue.cc:1059] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 12:25:23.339635 11097 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:23.340179 10978 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:23.297173 15831 raft_consensus.cc:740] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:23.356875 10948 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:23.311515 15800 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:23.255882 15850 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:23.349298 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 150751us
I20260709 12:25:23.368598 10983 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:23.360594 10977 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
W20260709 12:25:23.374358 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.338977 15723 raft_consensus.cc:2749] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:23.341580 15841 raft_consensus.cc:2804] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:23.344223 15672 raft_consensus.cc:2804] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:23.283529 15829 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:23.384862 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 151240us
I20260709 12:25:23.343977 15773 raft_consensus.cc:2804] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:23.390803 11130 raft_consensus.cc:1240] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:23.355881 15535 raft_consensus.cc:2804] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:23.357782 15883 raft_consensus.cc:697] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:23.422888 15773 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.430570 15773 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:23.432401 15850 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:23.414002 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:23.415158 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:23.434765 11680 raft_consensus.cc:2376] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14. Re-sending same reply.
I20260709 12:25:23.416270 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:23.417008 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:23.436303 11125 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:23.355695 15722 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:25:23.415233 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:23.420878 11129 raft_consensus.cc:1240] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:23.422672 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:23.426944 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:23.427177 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:23.422187 15842 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:23.428869 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:23.392596 15841 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:23.408975 15672 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.434814 11681 raft_consensus.cc:2393] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 13: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:23.417335 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:23.356400 15721 consensus_queue.cc:1048] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:25:23.391816 15868 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:23.447062 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:23.448424 11131 raft_consensus.cc:1240] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:23.422649 15535 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:23.450845 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:23.433914 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:23.476759 11672 raft_consensus.cc:2410] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 12:25:23.460215 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 118279us
I20260709 12:25:23.437805 15682 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:23.465616 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:23.470705 11674 raft_consensus.cc:2376] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8. Re-sending same reply.
W20260709 12:25:23.470800 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 186839us
I20260709 12:25:23.472887 11125 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:23.445720 15842 raft_consensus.cc:697] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 13 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:23.480881 10977 raft_consensus.cc:1275] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:23.441079 15904 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:23.428923 15839 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:23.482358 11130 pending_rounds.cc:85] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 6
I20260709 12:25:23.493825 11130 pending_rounds.cc:107] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:25:23.494167 11130 raft_consensus.cc:2889] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:23.485985 11098 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:23.465591 15841 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:23.403312 15895 consensus_queue.cc:1048] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 12:25:23.465298 15825 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:23.471632 15672 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:23.469671 15678 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:23.585748 15867 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:23.387072 15864 consensus_queue.cc:260] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:23.496450 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:25:23.595460 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 238651us
I20260709 12:25:23.483914 15791 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:23.480531 15535 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:23.542536 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 202960us
I20260709 12:25:23.586766 15865 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:23.512552 15883 consensus_queue.cc:237] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:23.587903 15825 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:23.476445 15706 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:25:23.458951 15850 consensus_queue.cc:1048] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:25:23.596674 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:25:23.605402 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 138507us
I20260709 12:25:23.628088 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:23.629065 11023 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
W20260709 12:25:23.604839 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 167635us
I20260709 12:25:23.592329 15794 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:23.603724 15892 log.cc:927] Time spent T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
W20260709 12:25:23.602818 15906 log.cc:927] Time spent T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:25:23.629592 10977 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:25:23.631212 11023 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:23.624033 15864 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:23.636850 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:23.635087 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:23.638516 11674 raft_consensus.cc:2368] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 13. Current term is 14.
I20260709 12:25:23.641470 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:23.642364 11680 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 10.
I20260709 12:25:23.634943 11024 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
W20260709 12:25:23.626302 15891 log.cc:927] Time spent T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.336s	user 0.000s	sys 0.001s
I20260709 12:25:23.650928 11024 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:23.669842 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:23.628608 15897 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.602672 15905 consensus_queue.cc:1048] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:25:23.602846 15887 consensus_queue.cc:1048] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.140s
I20260709 12:25:23.681025 10948 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:23.681727 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 147485us
I20260709 12:25:23.512769 15904 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:23.679829 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:23.671171 11674 raft_consensus.cc:2410] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 17 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:25:23.685671 11680 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:25:23.684000 11643 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:23.635231 15865 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:23.666069 15477 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:23.692703 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:23.688915 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:23.690153 11643 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:23.667014 15911 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:23.696569 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:23.697387 11643 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
W20260709 12:25:23.698438 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 47609.4us
I20260709 12:25:23.699589 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:23.706992 11643 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:23.702183 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 2106) took 1095 ms. Trace:
I20260709 12:25:23.708000 11054 raft_consensus.cc:2393] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 13: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:23.706199 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:23.707646 10948 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:23.705806 11024 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:23.708160 11134 rpcz_store.cc:276] 0709 12:25:22.606435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:22.764636 (+158201us) service_pool.cc:224] Handling call
0709 12:25:22.791283 (+ 26647us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:22.866040 (+ 74757us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:22.866072 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:22.866654 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 12:25:23.184343 (+317689us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:23.184392 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:23.184470 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:23.701958 (+517488us) raft_consensus.cc:1685] finished
0709 12:25:23.701979 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:23.702122 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":347378,"raft.queue_time_us":76528,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":2137,"thread_start_us":283877,"threads_started":1,"wal-append.queue_time_us":338741}
I20260709 12:25:23.629392 15842 consensus_queue.cc:237] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:23.709710 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:23.694651 15829 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:23.783416 15825 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:23.785219 15815 raft_consensus.cc:3055] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:23.785704 15815 raft_consensus.cc:740] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:23.684253 15897 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:23.786633 15815 consensus_queue.cc:260] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:23.787688 15815 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:23.787933 15897 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:23.791688 15800 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:23.706475 15901 raft_consensus.cc:2749] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:23.796851 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1853) took 1016 ms. Trace:
I20260709 12:25:23.713676 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:23.704794 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:23.798017 11673 raft_consensus.cc:1240] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:23.799119 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:23.799249 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:23.701567 15916 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.800223 15916 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:23.800721 10984 raft_consensus.cc:1240] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:23.710996 15820 raft_consensus.cc:2749] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:23.802209 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 94636.3us
I20260709 12:25:23.803078 10948 leader_election.cc:400] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 13. Current term is 14.
I20260709 12:25:23.803399 10948 leader_election.cc:403] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:25:23.804281 11643 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:23.804733 15900 log.cc:927] Time spent T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 12:25:23.806138 11643 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:23.806141 11054 raft_consensus.cc:2368] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 13. Current term is 14.
W20260709 12:25:23.750053 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.802551 14464 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:23.781858 15810 consensus_meta.cc:287] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.891s	user 0.009s	sys 0.000s
I20260709 12:25:23.694132 15607 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.797278 10982 rpcz_store.cc:276] 0709 12:25:22.780660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:22.780782 (+   122us) service_pool.cc:224] Handling call
0709 12:25:22.801386 (+ 20604us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:22.804374 (+  2988us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:22.804410 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:22.804982 (+   572us) log.cc:844] Serialized 26 byte log entry
0709 12:25:23.113707 (+308725us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:23.113746 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:23.113814 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:23.796637 (+682823us) raft_consensus.cc:1685] finished
0709 12:25:23.796660 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:23.796792 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31925,"raft.queue_time_us":3750,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":7851,"thread_start_us":294178,"threads_started":1,"wal-append.queue_time_us":396610}
I20260709 12:25:23.828737 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:23.830530 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 210630us
W20260709 12:25:23.884541 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 76459.5us
W20260709 12:25:23.769191 15882 log.cc:927] Time spent T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.667s	user 0.003s	sys 0.001s
I20260709 12:25:23.797492 15651 raft_consensus.cc:3055] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:23.803475 15915 raft_consensus.cc:2804] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:23.710470 15895 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:23.803504 15792 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:23.712852 15908 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:23.828969 15901 raft_consensus.cc:2749] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:23.821806 15800 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:23.893538 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:23.820681 15820 raft_consensus.cc:2749] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:23.891126 15516 consensus_meta.cc:287] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.854s	user 0.009s	sys 0.002s
W20260709 12:25:23.893286 15900 log.cc:927] Time spent T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 12:25:23.902714 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 96674.3us
I20260709 12:25:23.883745 15477 raft_consensus.cc:697] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:25:23.917505 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.890487 15607 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:23.906632 10982 pending_rounds.cc:85] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 9
I20260709 12:25:23.925266 10982 pending_rounds.cc:107] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:25:23.927402 14464 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:23.927595 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 221829us
I20260709 12:25:23.929659 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:23.930377 11678 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 17.
I20260709 12:25:23.896039 15915 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:23.900852 15570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.005s	sys 0.007s
I20260709 12:25:23.930343 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:23.936215 11673 raft_consensus.cc:2376] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15. Re-sending same reply.
I20260709 12:25:23.896070 15651 raft_consensus.cc:740] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:23.899782 15836 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:23.773743 15773 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:23.940117 10982 raft_consensus.cc:2889] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:23.892503 15912 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 13. Current term is 14.
I20260709 12:25:23.940187 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:23.943818 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:23.891795 15790 consensus_queue.cc:1059] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:25:23.894044 15841 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:23.941249 15570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.005s	sys 0.007s
I20260709 12:25:23.941104 15915 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:23.951431 11677 raft_consensus.cc:1275] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:23.952399 15907 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:23.953090 15907 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:23.955549 15607 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:23.938328 15835 consensus_queue.cc:1059] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:25:23.960616 15672 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:23.883309 15810 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:23.963887 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:23.964097 11051 raft_consensus.cc:1240] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:23.964967 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:23.963917 15810 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:23.966236 15790 raft_consensus.cc:3055] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:23.966670 15790 raft_consensus.cc:740] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:23.967639 15790 consensus_queue.cc:260] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:23.968950 15790 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:23.972216 15841 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:23.978294 15920 raft_consensus.cc:2804] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:23.979163 15920 raft_consensus.cc:697] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:23.980211 15920 consensus_queue.cc:237] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:23.982713 15651 consensus_queue.cc:260] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:23.987077 15773 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:23.988062 10984 raft_consensus.cc:1240] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:25:23.988924 15477 consensus_queue.cc:237] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:23.996476 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:23.940843 15516 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:24.002321 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:25:24.003837 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.011513 11677 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 14.
I20260709 12:25:24.019356 10983 raft_consensus.cc:1240] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:25:24.025458 10948 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:24.027122 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 805) took 1018 ms. Trace:
I20260709 12:25:24.027613 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:24.027590 11126 rpcz_store.cc:276] 0709 12:25:23.008818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.010147 (+  1329us) service_pool.cc:224] Handling call
0709 12:25:23.010565 (+   418us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:23.167373 (+156808us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:23.167407 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:23.167982 (+   575us) log.cc:844] Serialized 52 byte log entry
0709 12:25:23.312896 (+144914us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:23.356177 (+ 43281us) log.cc:844] Serialized 14 byte log entry
0709 12:25:24.006568 (+650391us) spinlock_profiling.cc:243] Waited 8.2 ms on lock 0x7b18003cfd00. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88c71c0a 00007f8f923b1219 00007f8f88cf9a40 00007f8f88cf44e4 00007f8f88cf4455 00007f8f8bddc060 00007f8f8bdee716 00007f8f8bdff287 00007f8f8bdff208
0709 12:25:24.006785 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:24.006865 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:24.006910 (+    45us) raft_consensus.cc:1685] finished
0709 12:25:24.026846 (+ 19936us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:24.027044 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":171272,"prepare.queue_time_us":54366,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":807488,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":18854144,"thread_start_us":143887,"threads_started":1,"wal-append.queue_time_us":329676}
I20260709 12:25:23.955559 15907 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:24.003630 15877 raft_consensus.cc:3055] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:25:24.060145 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.063513 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:24.064424 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:24.067893 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:24.069638 15672 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:24.070489 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:24.071637 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:24.072263 11060 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
W20260709 12:25:24.073143 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 587187us
I20260709 12:25:24.074512 15916 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:24.001746 15820 consensus_queue.cc:1059] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:25:24.038333 15773 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:24.078215 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:24.078613 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.040449 15723 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:24.087842 10948 leader_election.cc:400] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 13. Current term is 14.
I20260709 12:25:24.077430 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:24.092950 11059 raft_consensus.cc:1240] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:24.039876 15516 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:24.058797 15877 raft_consensus.cc:740] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:24.126789 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:24.194147 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2718) took 1013 ms. Trace:
I20260709 12:25:24.194625 10978 rpcz_store.cc:276] 0709 12:25:23.181099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.342939 (+161840us) service_pool.cc:224] Handling call
0709 12:25:23.343643 (+   704us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:23.593726 (+250083us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:23.593758 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:23.607362 (+ 13604us) log.cc:844] Serialized 26 byte log entry
0709 12:25:23.946211 (+338849us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:23.946246 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:23.946316 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:24.193853 (+247537us) raft_consensus.cc:1685] finished
0709 12:25:24.193876 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:24.194043 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40146,"raft.queue_time_us":81527,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":9577,"thread_start_us":526458,"threads_started":2,"wal-append.queue_time_us":448612}
I20260709 12:25:24.039347 15535 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:24.094189 15773 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.096166 15721 raft_consensus.cc:2804] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:24.217933 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:24.215538 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:24.216598 11025 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:24.232497 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:24.227458 11025 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:24.247999 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:24.248787 11672 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:24.235697 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 43539.2us
I20260709 12:25:24.252996 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:24.254298 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:24.256565 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:24.217170 15773 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:24.263537 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:24.281534 11132 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:24.221716 15721 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.287451 11129 raft_consensus.cc:1240] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:24.200588 15705 consensus_queue.cc:1059] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 12:25:24.264534 11097 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:24.269369 10948 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:24.241822 15672 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:24.301337 15932 log.cc:927] Time spent T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:25:24.301640 15535 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:24.303650 15705 raft_consensus.cc:3055] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:24.304091 15705 raft_consensus.cc:740] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:24.304183 11132 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:25:24.304952 15705 consensus_queue.cc:260] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:24.315550 15933 log.cc:927] Time spent T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.192s	user 0.000s	sys 0.000s
I20260709 12:25:24.316884 15842 raft_consensus.cc:2749] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:24.218729 15904 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:24.299049 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:24.319845 11051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 709) took 1331 ms. Trace:
I20260709 12:25:24.320292 11051 rpcz_store.cc:276] 0709 12:25:22.988727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:22.988887 (+   160us) service_pool.cc:224] Handling call
0709 12:25:22.989173 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:23.965078 (+975905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:24.319566 (+354488us) spinlock_profiling.cc:243] Waited 975 ms on lock 0x7b54003007d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:24.319771 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2241678080}
I20260709 12:25:24.291075 15721 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:24.249783 15435 raft_consensus.cc:2749] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:24.325718 10948 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:24.326826 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 62366.1us
I20260709 12:25:24.331455 11097 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:24.263221 15850 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:25:24.318089 15934 log.cc:927] Time spent T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260709 12:25:24.305586 15915 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:24.338073 11097 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
W20260709 12:25:24.298290 15815 consensus_meta.cc:287] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.510s	user 0.012s	sys 0.000s
I20260709 12:25:24.342850 10948 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:24.368610 11097 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:24.232242 15723 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:24.336369 15535 raft_consensus.cc:2749] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:24.375701 11677 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
I20260709 12:25:24.343047 15843 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:24.378561 11097 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:24.379635 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.297782 15672 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:24.344190 15912 raft_consensus.cc:2749] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:24.369971 15864 consensus_meta.cc:287] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.702s	user 0.007s	sys 0.003s
I20260709 12:25:24.383327 11134 raft_consensus.cc:1275] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:24.366819 15705 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:24.369418 15722 raft_consensus.cc:2749] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:24.272670 15877 consensus_queue.cc:260] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:24.379181 15607 raft_consensus.cc:2804] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:24.380319 15909 raft_consensus.cc:2804] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:24.393782 11097 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:24.374928 15850 raft_consensus.cc:697] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:24.384159 15841 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:24.384595 15631 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:24.386212 15794 consensus_queue.cc:1059] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
W20260709 12:25:24.433380 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 311515us
I20260709 12:25:24.435124 11097 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:24.435811 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.435225 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:24.439675 11134 raft_consensus.cc:1240] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:24.425622 15841 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:24.443226 15841 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:24.443481 15942 log.cc:927] Time spent T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:25:24.444787 15672 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:24.395787 15607 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:24.445556 15607 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:24.442852 15800 consensus_queue.cc:1059] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:24.446867 15800 raft_consensus.cc:3055] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:24.447157 15915 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:24.447260 15800 raft_consensus.cc:740] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:24.448256 15800 consensus_queue.cc:260] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:24.449697 15800 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:24.457945 11058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41294 (request call id 1813) took 1375 ms. Trace:
I20260709 12:25:24.367664 15831 consensus_queue.cc:260] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:24.459815 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:24.462448 11133 raft_consensus.cc:2393] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 14: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:24.459512 11058 rpcz_store.cc:276] 0709 12:25:23.082918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.083179 (+   261us) service_pool.cc:224] Handling call
0709 12:25:23.083509 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:23.349529 (+266020us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:23.349568 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:23.349619 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:23.349665 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:24.457690 (+1108025us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b54002792d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:24.457737 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:24.457878 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":611170176}
I20260709 12:25:24.405153 15909 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:24.432979 15733 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.479271 11645 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:24.433233 15848 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:24.480100 15938 log.cc:927] Time spent T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:25:24.481928 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2584) took 1068 ms. Trace:
W20260709 12:25:24.477180 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:24.482913 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.439167 15829 raft_consensus.cc:2804] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:24.483412 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:24.475879 15909 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:24.483409 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.500213 11134 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:24.476128 15936 log.cc:927] Time spent T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
W20260709 12:25:24.480007 15939 log.cc:927] Time spent T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 12:25:24.504905 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 69878.3us
I20260709 12:25:24.436952 15631 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:24.506659 11097 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:24.508216 11097 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:24.498761 11127 rpcz_store.cc:276] 0709 12:25:23.413068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.414366 (+  1298us) service_pool.cc:224] Handling call
0709 12:25:23.414686 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:24.040759 (+626073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:24.040795 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:24.060317 (+ 19522us) log.cc:844] Serialized 26 byte log entry
0709 12:25:24.344570 (+284253us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:24.344615 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:24.344689 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:24.481590 (+136901us) raft_consensus.cc:1685] finished
0709 12:25:24.481617 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:24.481853 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":803924,"raft.queue_time_us":648946,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":249906,"threads_started":1,"wal-append.queue_time_us":385191}
I20260709 12:25:24.509652 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:24.510360 11097 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:24.510556 11127 raft_consensus.cc:2393] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 16: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:24.513545 11672 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:25:24.496304 15790 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:24.501124 15831 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:24.473519 15836 consensus_queue.cc:1059] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:25:24.480095 15864 consensus_queue.cc:1059] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:25:24.501848 15829 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:24.530372 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.512290 15815 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.512446 15828 raft_consensus.cc:2749] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:24.493345 15733 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:24.517277 15516 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:24.548540 11134 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
W20260709 12:25:24.554230 15943 log.cc:927] Time spent T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 12:25:24.562309 15937 log.cc:927] Time spent T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 12:25:24.554214 15828 consensus_queue.cc:1048] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:25:24.587009 15733 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:24.588728 15733 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:24.589315 15733 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:24.528504 15790 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:24.590651 11052 raft_consensus.cc:1240] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:24.542394 15815 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:24.548911 15836 raft_consensus.cc:3055] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:24.535562 15829 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:24.554868 15952 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:24.496960 15848 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:24.572114 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.584112 15631 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:24.584712 15950 log.cc:927] Time spent T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.126s	user 0.001s	sys 0.001s
I20260709 12:25:24.585258 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 673) took 1086 ms. Trace:
I20260709 12:25:24.600905 11052 raft_consensus.cc:1240] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:24.554345 15953 raft_consensus.cc:2804] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:24.592536 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 670) took 1094 ms. Trace:
I20260709 12:25:24.601257 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:24.542934 15956 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:24.580505 15723 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:24.512202 15850 consensus_queue.cc:237] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:24.612526 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:24.584461 15737 raft_consensus.cc:3055] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:24.592707 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:24.602207 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:25:24.608896 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 971576us
I20260709 12:25:24.601681 10979 rpcz_store.cc:276] 0709 12:25:23.498125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.800057 (+301932us) service_pool.cc:224] Handling call
0709 12:25:23.800388 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:23.800736 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:23.800780 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:23.801242 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 12:25:23.921781 (+120539us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:23.946338 (+ 24557us) log.cc:844] Serialized 14 byte log entry
0709 12:25:23.946585 (+   247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:23.946667 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:24.592310 (+645643us) raft_consensus.cc:1685] finished
0709 12:25:24.592333 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:24.592469 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3572,"prepare.queue_time_us":24320,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":2770,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":48666,"thread_start_us":120143,"threads_started":1,"wal-append.queue_time_us":296951}
I20260709 12:25:24.595703 15836 raft_consensus.cc:740] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:24.639303 11673 raft_consensus.cc:2393] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 13: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:24.600351 10982 rpcz_store.cc:276] 0709 12:25:23.498861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.897163 (+398302us) service_pool.cc:224] Handling call
0709 12:25:23.906366 (+  9203us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:23.994815 (+ 88449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:23.994847 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:23.995419 (+   572us) log.cc:844] Serialized 52 byte log entry
0709 12:25:24.369678 (+374259us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:24.381552 (+ 11874us) log.cc:844] Serialized 14 byte log entry
0709 12:25:24.387153 (+  5601us) log.cc:844] Serialized 14 byte log entry
0709 12:25:24.387706 (+   553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:24.387781 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:24.585030 (+197249us) raft_consensus.cc:1685] finished
0709 12:25:24.585054 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:24.585197 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50090,"prepare.queue_time_us":11720,"raft.queue_time_us":51745,"raft.run_cpu_time_us":386,"raft.run_wall_time_us":12271,"spinlock_wait_cycles":14585216,"thread_start_us":373879,"threads_started":1,"wal-append.queue_time_us":528585}
I20260709 12:25:24.631866 11134 raft_consensus.cc:1240] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 12:25:24.642459 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:24.643790 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:24.580325 15516 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:24.648543 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:24.649031 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:24.640637 11023 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:24.653861 15733 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:24.659375 15848 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:24.661087 15607 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:24.662089 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:24.663558 15909 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:24.664364 15940 log.cc:927] Time spent T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 12:25:24.664592 15773 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:24.668293 15951 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:24.669996 15815 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:24.670822 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:24.595391 15721 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:24.693886 11023 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:24.599309 15841 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:24.603397 15953 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:24.616947 15737 raft_consensus.cc:740] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:24.698921 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:24.699728 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 188068us
I20260709 12:25:24.698949 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:24.703498 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 84059.3us
I20260709 12:25:24.704527 11645 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:24.704455 15773 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:24.710877 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:24.711186 11645 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:24.646181 15435 consensus_queue.cc:1048] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:25:24.693478 15570 raft_consensus.cc:2804] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:24.712227 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:24.713730 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:24.611753 15956 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:24.719164 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:24.719272 11024 leader_election.cc:336] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Timed out: RequestConsensusVote RPC to 127.9.145.196:42197 timed out after 1.896s (SENT)
I20260709 12:25:24.722714 11024 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:24.724881 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:24.726333 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:24.727077 11126 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 13.
I20260709 12:25:24.709844 15953 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:24.714501 15038 raft_consensus.cc:2749] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:24.759881 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:24.733320 15944 log.cc:927] Time spent T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
I20260709 12:25:24.762780 15972 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:24.728405 15809 consensus_queue.cc:1048] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:25:24.765264 15909 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:24.772498 11645 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:24.778890 15721 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:24.779136 15864 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:24.780224 15864 raft_consensus.cc:697] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:24.781441 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:24.733806 15914 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:24.791109 15956 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:24.796233 11024 leader_election.cc:336] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Timed out: RequestConsensusVote RPC to 127.9.145.196:42197 timed out after 1.952s (SENT)
I20260709 12:25:24.808182 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1878) took 1186 ms. Trace:
W20260709 12:25:24.846861 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.865722 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:24.931983 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 135773us
W20260709 12:25:24.932807 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:24.935117 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:24.935622 11024 leader_election.cc:336] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Timed out: RequestConsensusVote RPC to 127.9.145.196:42197 timed out after 2.107s (SENT)
I20260709 12:25:24.808722 10981 rpcz_store.cc:276] 0709 12:25:23.621348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.980838 (+359490us) service_pool.cc:224] Handling call
0709 12:25:23.981219 (+   381us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:23.981649 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:23.981979 (+   330us) log.cc:844] Serialized 14 byte log entry
0709 12:25:24.221945 (+239966us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:24.247904 (+ 25959us) log.cc:844] Serialized 52 byte log entry
0709 12:25:24.248171 (+   267us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:24.248233 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:24.248345 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:24.807885 (+559540us) raft_consensus.cc:1685] finished
0709 12:25:24.807912 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:24.808106 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":926,"prepare.queue_time_us":11353,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":1949,"raft.queue_time_us":4640,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":27320,"thread_start_us":215856,"threads_started":1,"wal-append.queue_time_us":437506}
W20260709 12:25:24.939052 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 225173us
I20260709 12:25:24.792946 15956 raft_consensus.cc:2804] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:24.783399 15843 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:24.933614 15773 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:24.963774 11058 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:25:24.965701 15516 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:24.938235 15607 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:24.994031 15773 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:24.995762 11679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 928) took 2546 ms. Trace:
I20260709 12:25:25.026409 11679 rpcz_store.cc:276] 0709 12:25:22.449465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:22.460847 (+ 11382us) service_pool.cc:224] Handling call
0709 12:25:22.461191 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:22.461565 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:25:22.981089 (+519524us) log.cc:844] Serialized 14 byte log entry
0709 12:25:23.295012 (+313923us) log.cc:844] Serialized 14 byte log entry
0709 12:25:24.995173 (+1700161us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b1800358240. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f8b98c4bc 00007f8f88cda48b 00007f8f91b349a9 00007f8f88cf669b 00007f8f88cf493f 00007f8f88cf4455 00007f8f8bddc060 00007f8f8bdee716 00007f8f8bdff287
0709 12:25:24.995298 (+   125us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:24.995355 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:24.995417 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:24.995503 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:24.995649 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7222,"prepare.queue_time_us":169809,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":70,"raft.queue_time_us":93663,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":14325,"spinlock_wait_cycles":31592448,"thread_start_us":706497,"threads_started":3,"wal-append.queue_time_us":350156}
I20260709 12:25:24.934010 15631 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:24.994571 11128 raft_consensus.cc:2410] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:25:24.728073 15836 consensus_queue.cc:260] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:24.766047 15737 consensus_queue.cc:260] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:24.977835 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:24.978842 15964 log.cc:927] Time spent T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 12:25:25.017998 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:24.947989 15956 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.974710 15777 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:24.934604 15570 raft_consensus.cc:697] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:24.781868 15864 consensus_queue.cc:237] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:25.034385 11132 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 8.
I20260709 12:25:25.053270 11132 raft_consensus.cc:1240] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:25.040261 15836 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:25.042471 15956 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:25.017287 15908 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:25.062879 11126 raft_consensus.cc:1240] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:25.044727 15841 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:25.056049 11132 raft_consensus.cc:1240] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:25:25.057241 15364 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:25.080799 15364 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:25.083117 15364 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:25.051771 15777 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:25.089007 15777 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:25.036798 15631 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:25.074951 15737 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:25.067314 15972 raft_consensus.cc:2749] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:25:25.100735 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.105880 11679 raft_consensus.cc:1275] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:25:25.089743 15570 consensus_queue.cc:237] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:25.076392 15908 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:25.099027 15607 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:25.111776 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 173168us
W20260709 12:25:25.113096 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 340794us
W20260709 12:25:25.115480 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:25.116113 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.098970 15952 raft_consensus.cc:2749] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:25.099763 15829 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:25.120164 11134 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:25.114650 15972 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:25.116544 15825 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.117156 15833 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.132689 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2713) took 1952 ms. Trace:
I20260709 12:25:25.114916 15607 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:25.133179 10980 rpcz_store.cc:276] 0709 12:25:23.179787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.325524 (+145737us) service_pool.cc:224] Handling call
0709 12:25:23.688445 (+362921us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:23.707457 (+ 19012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:23.707489 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:23.713256 (+  5767us) log.cc:844] Serialized 52 byte log entry
0709 12:25:24.127029 (+413773us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:24.200079 (+ 73050us) log.cc:844] Serialized 14 byte log entry
0709 12:25:24.200301 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:24.200377 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:24.650838 (+450461us) raft_consensus.cc:1685] finished
0709 12:25:24.650860 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:25.132449 (+481589us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b540028aad0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:25.132610 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68980,"prepare.queue_time_us":76268,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":24478,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":14567,"spinlock_wait_cycles":833849088,"thread_start_us":226434,"threads_started":1,"wal-append.queue_time_us":393293}
W20260709 12:25:25.151432 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.153755 15829 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:25.157323 11024 leader_election.cc:336] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Timed out: RequestConsensusVote RPC to 127.9.145.196:42197 timed out after 2.241s (SENT)
I20260709 12:25:25.157158 15953 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:25.158437 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.159509 15953 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:25.164788 15773 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:25.179765 15889 log.cc:927] Time spent T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 1.593s	user 0.005s	sys 0.007s
I20260709 12:25:25.180708 15790 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:25.181748 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 802) took 2624 ms. Trace:
I20260709 12:25:25.182202 11131 rpcz_store.cc:276] 0709 12:25:22.557660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:22.560637 (+  2977us) service_pool.cc:224] Handling call
0709 12:25:22.591188 (+ 30551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:23.470303 (+879115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.181473 (+1711170us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b5400030a54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:25.181681 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1971018496}
I20260709 12:25:25.183620 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1854) took 2402 ms. Trace:
I20260709 12:25:25.184147 10976 rpcz_store.cc:276] 0709 12:25:22.780984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:22.781141 (+   157us) service_pool.cc:224] Handling call
0709 12:25:22.781476 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:22.793604 (+ 12128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:22.793633 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:22.798907 (+  5274us) log.cc:844] Serialized 26 byte log entry
0709 12:25:23.263333 (+464426us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:23.263380 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:23.263457 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:25.178971 (+1915514us) spinlock_profiling.cc:243] Waited 4.91 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:25:25.183322 (+  4351us) raft_consensus.cc:1685] finished
0709 12:25:25.183344 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:25.183554 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18846,"raft.queue_time_us":12257,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":6007,"spinlock_wait_cycles":11292544,"thread_start_us":461943,"threads_started":1,"wal-append.queue_time_us":784834}
W20260709 12:25:25.188992 15917 log.cc:927] Time spent T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 1.423s	user 0.010s	sys 0.000s
I20260709 12:25:25.135862 15972 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:25.193949 15972 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:25.196624 11134 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:25:25.136531 15825 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:25.199317 15651 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:25.200626 15825 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:25.138732 15833 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:25.204358 15631 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:25.205812 15833 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:25.206779 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 89760.7us
W20260709 12:25:25.215992 15951 consensus_meta.cc:287] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.510s	user 0.000s	sys 0.011s
I20260709 12:25:25.220244 15951 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:25.222539 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:25.225314 15893 log.cc:927] Time spent T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 1.760s	user 0.003s	sys 0.000s
I20260709 12:25:25.228178 15975 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.228847 15975 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:25.214030 15607 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:25.234637 15477 raft_consensus.cc:993] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7: : Instructing follower bc01179655564f29b83babe396377cbb to start an election
I20260709 12:25:25.234772 11024 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:25.235381 15477 raft_consensus.cc:1081] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Signalling peer bc01179655564f29b83babe396377cbb to start an election
I20260709 12:25:25.236285 15477 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:25.236650 15477 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:25.237002 15477 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:25.239753 15904 consensus_queue.cc:1048] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:25.242255 15824 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:25.242522 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:25.242697 11679 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:25.244065 15956 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:25.247294 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.247478 11678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 949) took 1316 ms. Trace:
I20260709 12:25:25.247946 15737 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:25.249125 11128 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 2579) took 1837 ms (client timeout 1756 ms). Trace:
W20260709 12:25:25.249538 11128 rpcz_store.cc:269] 0709 12:25:23.411591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.415000 (+  3409us) service_pool.cc:224] Handling call
0709 12:25:25.246048 (+1831048us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b5400210a54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:25.249050 (+  3002us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3564878208}
I20260709 12:25:25.250078 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:25.250284 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:25.253463 10980 raft_consensus.cc:2410] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 12:25:25.250684 10977 raft_consensus.cc:1240] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:25.254382 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:25.251442 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:25.255465 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:25:25.255057 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 48681.1us
I20260709 12:25:25.256260 10980 raft_consensus.cc:2393] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 13: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:25.256083 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:25.256848 10979 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 15.
I20260709 12:25:25.258400 10979 raft_consensus.cc:1240] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:25.255785 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:25.259426 10977 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
I20260709 12:25:25.247851 11678 rpcz_store.cc:276] 0709 12:25:23.931447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.931549 (+   102us) service_pool.cc:224] Handling call
0709 12:25:23.931846 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:23.943125 (+ 11279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:23.943159 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:23.997806 (+ 54647us) log.cc:844] Serialized 26 byte log entry
0709 12:25:24.232515 (+234709us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:24.232563 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.247057 (+1014494us) spinlock_profiling.cc:243] Waited 7.55 ms on lock 0x7b540049ff54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:25.247108 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:25.247164 (+    56us) raft_consensus.cc:1685] finished
0709 12:25:25.247179 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:25.247414 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3248,"raft.queue_time_us":6166,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":40722,"spinlock_wait_cycles":17364224,"thread_start_us":228896,"threads_started":1,"wal-append.queue_time_us":391263}
I20260709 12:25:25.259878 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:25.260133 11643 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:25.260506 11053 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:25:25.261811 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:25.262434 11060 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:25.262813 11643 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:25.263536 11055 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:25.251368 11024 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:25.264593 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:25.265494 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:25.265457 11024 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:25.266510 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:25.267257 11056 raft_consensus.cc:2393] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 14: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:25.267518 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:25.265802 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:25.268362 11679 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:25.270673 10976 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
I20260709 12:25:25.275978 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:25.267413 10948 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:25.277038 15785 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:25.277211 15631 raft_consensus.cc:2804] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:25.277757 15631 raft_consensus.cc:697] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 11 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:25.278795 15631 consensus_queue.cc:237] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:25.282655 15790 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:25.284777 15773 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:25.285378 15773 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:25.286465 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:25.287277 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:25.287546 10984 raft_consensus.cc:1275] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:25.288905 15773 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:25.289456 15607 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:25.290424 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:25.248673 15737 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:25.290943 10980 raft_consensus.cc:1275] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:25:25.339123 10981 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 8.
I20260709 12:25:25.294409 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:25.294757 10977 raft_consensus.cc:1240] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:25.339274 10978 raft_consensus.cc:1275] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:25:25.342299 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:25.346740 10980 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:25.347697 10980 raft_consensus.cc:1240] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:25.348698 10980 raft_consensus.cc:1240] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:25:25.349462 11060 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
W20260709 12:25:25.342299 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 68858.3us
I20260709 12:25:25.354998 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:25.269636 15862 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:25.292562 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:25.362908 10983 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:25.272188 15956 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:25.289736 15790 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.275275 15904 raft_consensus.cc:2749] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:25.275117 15835 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:25.275355 15824 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:25.338548 15705 consensus_queue.cc:1048] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:25:25.367901 15516 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.370317 10975 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:25:25.373451 11679 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 15.
I20260709 12:25:25.364682 10983 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3"
dest_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:52828
I20260709 12:25:25.445395 15975 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:25.410449 15956 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.447328 15956 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:25.449779 15956 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:25.399403 15773 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:25.454677 15946 raft_consensus.cc:2749] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:25.455300 15958 raft_consensus.cc:3055] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:25.452198 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2599) took 1199 ms. Trace:
I20260709 12:25:25.455862 15958 raft_consensus.cc:740] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:25.455965 15773 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:25.457508 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 787882us
I20260709 12:25:25.456905 15958 consensus_queue.cc:260] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:25.459225 15958 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:25.459522 15773 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:25.460892 15773 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:25.461464 15773 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:25.462831 15792 consensus_queue.cc:1059] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:25.465157 15792 raft_consensus.cc:3055] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:25.465528 15792 raft_consensus.cc:740] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:25.465752 15733 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.466343 15733 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:25.466706 15792 consensus_queue.cc:260] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:25.468556 15733 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:25.469157 15733 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:25.470789 11128 raft_consensus.cc:1240] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:25.351227 15607 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:25.471968 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:25.474092 11132 raft_consensus.cc:1240] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:25.479689 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:25.480154 11678 raft_consensus.cc:1240] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 14. Current term is 15. Ops: [11.10-14.12]
I20260709 12:25:25.480430 11672 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 16.
I20260709 12:25:25.482057 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2590) took 2000 ms. Trace:
I20260709 12:25:25.482568 11130 rpcz_store.cc:276] 0709 12:25:23.481409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.481811 (+   402us) service_pool.cc:224] Handling call
0709 12:25:23.482141 (+   330us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:24.365032 (+882891us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:24.365140 (+   108us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:24.365759 (+   619us) log.cc:844] Serialized 52 byte log entry
0709 12:25:24.542508 (+176749us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:24.699826 (+157318us) log.cc:844] Serialized 14 byte log entry
0709 12:25:25.481697 (+781871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.481781 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:25.481827 (+    46us) raft_consensus.cc:1685] finished
0709 12:25:25.481839 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:25.481974 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1428038,"prepare.queue_time_us":165018,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":610203,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":77744,"thread_start_us":537706,"threads_started":3,"wal-append.queue_time_us":281290}
I20260709 12:25:25.487571 11024 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:25.456279 11125 rpcz_store.cc:276] 0709 12:25:24.252315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.258734 (+  6419us) service_pool.cc:224] Handling call
0709 12:25:24.259003 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:24.259217 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:24.504144 (+244927us) log.cc:844] Serialized 14 byte log entry
0709 12:25:25.451618 (+947474us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b1800363700. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88c71c0a 00007f8f923b1219 00007f8f88cf9a40 00007f8f88cf44e4 00007f8f88cf4455 00007f8f8bddc060 00007f8f8bdee716 00007f8f8bdff287 00007f8f8bdff208
0709 12:25:25.451822 (+   204us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:25.451876 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:25.451924 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.452001 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:25.452132 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44027,"prepare.queue_time_us":344837,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":826546,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":9794816,"thread_start_us":370466,"threads_started":2,"wal-append.queue_time_us":210096}
I20260709 12:25:25.469637 15733 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:25.501313 15733 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:25.498903 10949 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:25.510932 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:25.513460 11128 raft_consensus.cc:1275] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:25:25.512820 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 174140us
I20260709 12:25:25.515268 11023 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:25.380647 15835 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.468461 15792 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:25.516806 10977 raft_consensus.cc:1275] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:25:25.521133 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:25.521325 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 811872us
I20260709 12:25:25.521709 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 814) took 1098 ms. Trace:
I20260709 12:25:25.549335 11127 rpcz_store.cc:276] 0709 12:25:24.423427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.563482 (+140055us) service_pool.cc:224] Handling call
0709 12:25:24.563882 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:24.564115 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:25:24.711740 (+147625us) log.cc:844] Serialized 14 byte log entry
0709 12:25:25.521398 (+809658us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:25.521447 (+    49us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:25.521489 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.521550 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:25.521656 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":823175,"prepare.queue_time_us":157561,"prepare.run_cpu_time_us":11576,"prepare.run_wall_time_us":26521,"thread_start_us":129932,"threads_started":1}
I20260709 12:25:25.521974 11131 raft_consensus.cc:1275] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 12:25:25.550854 11131 pending_rounds.cc:85] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 6
I20260709 12:25:25.551116 11131 pending_rounds.cc:107] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:25:25.551371 11131 raft_consensus.cc:2889] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:25.522231 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:25.434842 15842 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.479693 10983 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:25.538595 10948 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:25.545856 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:25.553100 10983 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:25.557826 15631 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:25.378078 15790 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:25.561578 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:25.514520 15848 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:25.562419 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:25.437253 15824 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:25.547559 15835 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:25.545048 15583 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:25.571237 11679 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:25.556381 15966 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:25.558738 15435 raft_consensus.cc:2749] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:25.679036 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:25.570025 11672 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:25:25.614032 11055 raft_consensus.cc:1240] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:25:25.613631 11058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41294 (request call id 1819) took 1021 ms. Trace:
I20260709 12:25:25.762626 11058 rpcz_store.cc:276] 0709 12:25:24.592262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.592396 (+   134us) service_pool.cc:224] Handling call
0709 12:25:25.613408 (+1021012us) spinlock_profiling.cc:243] Waited 54.5 ms on lock 0x7b54002774d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:25.613549 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125425920}
I20260709 12:25:25.518735 15516 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:25.746229 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.680608 11677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41784 (request call id 790) took 1530 ms. Trace:
I20260709 12:25:25.682705 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:25.765946 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 278480us
W20260709 12:25:25.625037 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.685451 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:25.733713 11134 raft_consensus.cc:1275] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:25.770521 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:25.579985 15959 log.cc:927] Time spent T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.881s	user 0.003s	sys 0.001s
I20260709 12:25:25.773219 11058 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:25.605727 10983 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:25.769418 11131 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 16.
I20260709 12:25:25.768167 11677 rpcz_store.cc:276] 0709 12:25:24.081681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.263424 (+181743us) service_pool.cc:224] Handling call
0709 12:25:25.612308 (+1348884us) spinlock_profiling.cc:243] Waited 56.9 ms on lock 0x7b5400591fd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:25.612462 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130798464}
I20260709 12:25:25.558472 15631 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:25.778781 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:25.781037 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 282187us
I20260709 12:25:25.576773 15651 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:25.585646 15908 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:25.598307 15877 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:25.799799 11098 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:25.802275 15953 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:25.680037 15901 consensus_queue.cc:1059] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.123s
I20260709 12:25:25.802841 15953 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:25.803704 15901 raft_consensus.cc:3055] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:25.804086 15901 raft_consensus.cc:740] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:25.804919 15901 consensus_queue.cc:260] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:25.805805 15829 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:25.788805 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:25.806365 15829 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:25.807773 15901 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:25.808542 15829 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:25.810436 15965 consensus_queue.cc:1059] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:25.810760 15721 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:25.811703 15721 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:25.812186 15721 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:25.812477 15965 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:25.813051 15965 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:25.814728 15967 raft_consensus.cc:3055] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:25.815227 15967 raft_consensus.cc:740] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:25.816294 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:25.819540 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:25.820333 11133 raft_consensus.cc:2393] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 13: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:25.822067 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:25.823498 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:25.824173 11128 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:25:25.825189 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:25.826153 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:25.827445 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:25.827984 11125 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:25.828227 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:25.805477 15953 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:25.806296 15801 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.809679 15829 consensus_queue.cc:1059] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:25.782092 15785 raft_consensus.cc:2749] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:25.789590 10949 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:25.686671 15836 raft_consensus.cc:2749] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:25:25.828687 15998 log.cc:927] Time spent T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:25:25.558681 15842 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:25.835675 11680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 947) took 1905 ms. Trace:
I20260709 12:25:25.829406 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:25.836755 11126 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 15.
I20260709 12:25:25.594489 15824 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:25.574690 15991 consensus_queue.cc:1048] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.222s
I20260709 12:25:25.574292 15992 consensus_queue.cc:1048] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.211s
I20260709 12:25:25.787158 16005 consensus_queue.cc:1059] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:25:25.787096 15651 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:25.797510 15987 log.cc:927] Time spent T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.360s	user 0.001s	sys 0.000s
I20260709 12:25:25.688055 15583 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:25.583423 15990 raft_consensus.cc:2804] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:25.838146 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:25.836087 11680 rpcz_store.cc:276] 0709 12:25:23.930769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.931924 (+  1155us) service_pool.cc:224] Handling call
0709 12:25:23.932238 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:23.932650 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:25:23.951561 (+ 18911us) log.cc:844] Serialized 14 byte log entry
0709 12:25:24.068607 (+117046us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b18000d6060. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cf73f3 00007f8f88cf97c1 00007f8f88cf9779 00007f8f88cf9709 00007f8f88cf96d1 00007f8f88cf89cd 0000000000388634 0000000000388479 00007f8f88cda83a
0709 12:25:25.449908 (+1381301us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b18000d6060. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cd9e07 00007f8f91b349a9 00007f8f88cf669b 00007f8f88cf493f 00007f8f88cf6c02 00007f8f8b97e20b 00007f8f8b983d23 00007f8f8b98423a 00007f8f8bdeea2a
0709 12:25:25.683751 (+233843us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:25.684290 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 12:25:25.684524 (+   234us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:25.684571 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.684654 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:25.835471 (+150817us) raft_consensus.cc:1685] finished
0709 12:25:25.835491 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:25.835617 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45320,"prepare.queue_time_us":19272,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":4130,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":15657,"spinlock_wait_cycles":48652416,"thread_start_us":223345,"threads_started":1,"wal-append.queue_time_us":1637254}
I20260709 12:25:25.674772 15848 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:25.842797 11645 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:25.843575 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:25.899973 11678 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:25.897789 11125 raft_consensus.cc:2468] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 14.
I20260709 12:25:25.845307 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:25.846971 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:25.902577 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:25.903203 11129 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
I20260709 12:25:25.904192 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:25.833313 15477 consensus_meta.cc:287] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.596s	user 0.008s	sys 0.000s
I20260709 12:25:25.844648 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:25.883348 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:25.887264 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:25.907089 11054 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:25.840302 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:25:25.850455 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 60952.2us
I20260709 12:25:25.909956 10949 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:25.911568 10949 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:25.905244 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:25.605430 15835 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:25.885993 15861 raft_consensus.cc:2749] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:25.913059 15733 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:25.913373 15721 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:25.834452 15737 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:25.914569 15842 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:25.915367 15607 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:25.939186 11676 raft_consensus.cc:1275] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:25:25.939509 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:25.940706 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:25.915534 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:25.941671 11134 raft_consensus.cc:2393] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 13: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:25.915480 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:25.916582 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 73897.1us
I20260709 12:25:25.943027 10949 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:25.943295 11645 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:25.832496 15829 raft_consensus.cc:3055] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:25.834313 15773 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:25.892361 15990 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:25.922204 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:25.970865 11677 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:25.924299 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:25.908021 11675 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 16.
I20260709 12:25:25.828263 15516 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:25.924613 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:25.924461 15968 raft_consensus.cc:2749] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:25.902630 15901 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:25.921587 15912 raft_consensus.cc:2749] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:25.931527 15583 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:25.888886 15877 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:25.936619 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:25.937408 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:25.937574 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:25.763209 15966 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:25.945932 11054 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:25.947576 11645 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:25.846009 15965 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:25.951380 11644 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:26.039502 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 88244.1us
I20260709 12:25:25.816140 15967 consensus_queue.cc:260] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:25.972036 11125 raft_consensus.cc:2410] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:25:25.831864 15801 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:26.027783 11056 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 13.
I20260709 12:25:26.026450 11131 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:25.931804 15848 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:26.030216 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 82712.2us
I20260709 12:25:25.959699 15737 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.073607 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:26.080027 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:25.921944 15477 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:25.997529 15792 raft_consensus.cc:2749] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:25.892619 15651 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:25.946411 15829 raft_consensus.cc:740] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:25.950198 15861 raft_consensus.cc:2749] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:25.973625 15990 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:26.172283 11674 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.011s	sys 0.076s
I20260709 12:25:25.962330 15992 consensus_queue.cc:1048] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.116s
I20260709 12:25:26.067497 15908 raft_consensus.cc:2804] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:26.174361 11128 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
I20260709 12:25:25.972858 10949 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:26.072041 15958 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:26.183100 11674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.011s	sys 0.077s
I20260709 12:25:26.183748 11056 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:26.194904 11053 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:26.036783 15877 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:26.178640 15967 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:26.031314 15901 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:26.201563 15792 raft_consensus.cc:2804] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:26.138444 15737 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:26.205379 15996 log.cc:927] Time spent T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
W20260709 12:25:26.210569 10979 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.007s	sys 0.005s
W20260709 12:25:26.216848 10979 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.007s	sys 0.005s
I20260709 12:25:26.210275 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:26.211159 11023 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.006s	sys 0.007s
W20260709 12:25:26.222021 11023 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.006s	sys 0.007s
W20260709 12:25:26.222458 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 665159us
I20260709 12:25:26.223289 11023 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
W20260709 12:25:26.195086 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 222310us
I20260709 12:25:26.237128 10949 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:26.491861 10983 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:26.492300 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 255138us
I20260709 12:25:26.500118 10949 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:26.244186 11023 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:26.502372 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:52828 (request call id 2755) took 1134 ms. Trace:
W20260709 12:25:26.503196 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 259006us
I20260709 12:25:26.241745 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:24.389671  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:26.506258 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:26.289671 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:26.264434 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:26.510926 11055 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:26.511022 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:25:26.512394 11057 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 2085) took 1254 ms (client timeout 1600 ms). Trace:
W20260709 12:25:26.512887 11057 rpcz_store.cc:269] 0709 12:25:25.257964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.258137 (+   173us) service_pool.cc:224] Handling call
0709 12:25:26.510693 (+1252556us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b58001a5e98. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfeee 000000000036eb39 00007f8f90d331e0 00007f8f90dfc0c4 00007f8f90dfc131 00007f8f90daa0a0 00007f8f90da9984 00007f8f8a3246d4 00007f8f8a324662
0709 12:25:26.512279 (+  1586us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36940800}
I20260709 12:25:26.314008 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:26.242508 11059 raft_consensus.cc:1240] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12. Ops: []
W20260709 12:25:26.486464 10948 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.932s	user 0.008s	sys 0.008s
W20260709 12:25:26.518292 10948 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.009s	sys 0.008s
W20260709 12:25:26.326072 11097 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.021s	sys 0.027s
W20260709 12:25:26.520469 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 981918us
W20260709 12:25:26.521025 11097 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.022s	sys 0.027s
I20260709 12:25:26.503046 10983 rpcz_store.cc:276] 0709 12:25:25.364358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.364539 (+   181us) service_pool.cc:224] Handling call
0709 12:25:26.488869 (+1124330us) spinlock_profiling.cc:243] Waited 89.6 ms on lock 0x7b4c001126c0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8a0b0a20 00007f8f8a0c1a29 00007f8f8a0c213f 00007f8f8a0862ab 00007f8f8a0b3f3c 00007f8f8a0b43fe 00007f8f8a34188b 00007f8f8bd40495 00007f8f8bd9130f 00007f8f8bddba55 00007f8f90dabcd0
0709 12:25:26.498841 (+  9972us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":206086912}
I20260709 12:25:26.536194 11645 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:26.365689 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:25:26.539556 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.249347 15435 consensus_queue.cc:1048] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:25:26.541141 15482 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:26.541816 15482 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:26.542516 15482 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:26.360253 15477 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 18 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:26.547274 15477 consensus_queue.cc:1059] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:26.239936 15570 raft_consensus.cc:2804] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:26.551000 15570 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:26.551743 15570 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:26.553508 15631 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:26.421308 15651 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:26.554522 15583 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:26.380051 15737 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:26.269145 15773 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:26.608379 11056 raft_consensus.cc:2393] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 17: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:26.240110 15785 consensus_queue.cc:1059] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:25:26.451696 15790 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:26.625011 15583 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:26.625888 16011 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:26.628346 15583 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:26.632433 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:26.611304 15861 raft_consensus.cc:2804] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:26.634446 15861 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:26.634976 15861 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:26.214138 15792 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.642647 15792 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:26.645932 15651 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:26.646929 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 111230us
I20260709 12:25:26.381314 15801 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:26.381772 15815 raft_consensus.cc:2749] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:26.212000 15829 consensus_queue.cc:260] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:26.288729 15835 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:26.374835 15877 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:26.322768 15887 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.727339 15887 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:26.375742 15901 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:26.383688 15908 raft_consensus.cc:697] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:26.731907 15908 consensus_queue.cc:237] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:26.265203 15912 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:26.734959 15912 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:26.735937 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:26.393030 15914 raft_consensus.cc:3055] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:26.738482 15914 raft_consensus.cc:740] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:26.453883 15958 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:26.740120 15914 consensus_queue.cc:260] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:26.737751 15912 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:26.339239 16007 log.cc:927] Time spent T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 12:25:26.428395 16008 log.cc:927] Time spent T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
W20260709 12:25:26.419087 16017 log.cc:927] Time spent T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:25:26.415759 16024 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.788192 16024 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:26.411532 16029 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:26.601015 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.791035 16029 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:26.457934 15990 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:26.794498 15990 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:26.795250 15990 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.795845 15990 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:26.551595 15836 raft_consensus.cc:2749] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:26.798918 16029 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:26.608922 15773 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:26.801527 15773 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:26.541728 15038 consensus_queue.cc:1059] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 12:25:26.802819 15038 raft_consensus.cc:3055] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:26.803169 15038 raft_consensus.cc:740] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:26.647130 11127 raft_consensus.cc:1240] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:26.804122 15482 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:26.650404 15583 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:26.680375 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 153223us
W20260709 12:25:26.686929 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 164054us
I20260709 12:25:26.624310 15631 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 12:25:26.694612 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:26.707439 15812 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.045s	sys 0.079s
I20260709 12:25:26.712014 15737 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.721182 15864 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:26.347620 15966 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:26.705668 11645 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:26.699587 16011 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.711583 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:26.753952 15914 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:26.805810 15583 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:26.813406 16011 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:26.761946 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 143326us
I20260709 12:25:26.709318 15967 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.806646 15651 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.815249 15967 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:26.815559 11644 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:26.816561 16011 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:26.710204 16013 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:25:26.816886 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 49187.9us
I20260709 12:25:26.744387 15887 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:26.770709 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:26.809157 11023 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:26.776559 15912 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:26.815418 15651 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:26.819430 15570 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:26.819317 11023 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:26.823235 15812 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.045s	sys 0.081s
W20260709 12:25:26.823380 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 165282us
W20260709 12:25:26.824030 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.817454 16013 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:26.825374 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2744) took 1533 ms. Trace:
I20260709 12:25:26.822016 15651 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:26.826538 16013 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:26.807718 15364 consensus_queue.cc:1059] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
W20260709 12:25:26.760576 11132 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.842s	user 0.013s	sys 0.015s
I20260709 12:25:26.819772 15912 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:26.829159 15655 consensus_queue.cc:1048] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:26.830641 15477 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:26.821553 15836 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:26.820789 15887 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:26.831881 15887 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:26.824070 16029 raft_consensus.cc:2804] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:26.831612 15836 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.849469 15836 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:26.850594 15435 consensus_queue.cc:1048] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:25:26.832741 11132 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.014s	sys 0.015s
I20260709 12:25:26.854351 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2613) took 1388 ms. Trace:
I20260709 12:25:26.825835 15737 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:26.854944 15435 consensus_queue.cc:1048] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:26.857219 15737 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:26.854790 11132 rpcz_store.cc:276] 0709 12:25:25.465494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.477163 (+ 11669us) service_pool.cc:224] Handling call
0709 12:25:25.477499 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:25.477736 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:25:25.848304 (+370568us) log.cc:844] Serialized 14 byte log entry
0709 12:25:26.853672 (+1005368us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:26.853790 (+   118us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:26.853917 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:26.854034 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:26.854272 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":702628,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":1570,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":140,"thread_start_us":1375062,"threads_started":2,"wal-append.queue_time_us":932233}
I20260709 12:25:26.831409 15477 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:26.835388 15887 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:26.804270 15038 consensus_queue.cc:260] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:26.817816 15967 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:26.814579 15583 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:26.831550 15912 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:26.836748 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:26.863873 16029 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:26.864398 16029 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:26.837203 10948 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:26.866510 10948 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:26.866981 15482 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:26.868268 10948 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:26.870664 16035 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:26.873144 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2733) took 1589 ms. Trace:
I20260709 12:25:26.838239 16010 consensus_queue.cc:1059] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:26.839574 15364 raft_consensus.cc:3055] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:26.874571 15364 raft_consensus.cc:740] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:26.873586 10976 rpcz_store.cc:276] 0709 12:25:25.283170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.309534 (+ 26364us) service_pool.cc:224] Handling call
0709 12:25:25.310531 (+   997us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:25.351318 (+ 40787us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:25.674092 (+322774us) log.cc:844] Serialized 14 byte log entry
0709 12:25:25.775622 (+101530us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:25.779872 (+  4250us) log.cc:844] Serialized 26 byte log entry
0709 12:25:25.780021 (+   149us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:25.780260 (+   239us) log.cc:844] Serialized 14 byte log entry
0709 12:25:25.780418 (+   158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.780609 (+   191us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:26.427751 (+647142us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:25:26.872653 (+444902us) raft_consensus.cc:1685] finished
0709 12:25:26.872698 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:26.872959 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":163750,"prepare.queue_time_us":221502,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":66,"raft.queue_time_us":160366,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":12665,"spinlock_wait_cycles":4863744,"thread_start_us":299398,"threads_started":2,"wal-append.queue_time_us":456726}
I20260709 12:25:26.875836 15364 consensus_queue.cc:260] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:26.876921 16032 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:26.797967 15990 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:26.847129 15904 consensus_queue.cc:1048] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:26.877753 16038 consensus_queue.cc:1048] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:26.833659 16036 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:26.826601 15864 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:26.841554 15991 consensus_queue.cc:1059] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:26.839479 15607 raft_consensus.cc:3055] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:26.879747 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:26.893425 15990 raft_consensus.cc:2749] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:26.805666 15829 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:26.878072 15364 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:26.894735 16010 raft_consensus.cc:3055] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:26.895153 16010 raft_consensus.cc:740] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:26.896795 15991 raft_consensus.cc:3055] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:26.897224 15991 raft_consensus.cc:740] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:26.877801 16032 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:26.896087 16036 raft_consensus.cc:697] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:25:26.836385 11098 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.145.194:44483 timed out after 1.590s (SENT) [suppressed 21 similar messages]
I20260709 12:25:26.898792 15607 raft_consensus.cc:740] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:26.881124 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:26.899156 16036 consensus_queue.cc:237] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:26.900167 10983 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:26.899932 15607 consensus_queue.cc:260] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:26.901551 15607 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:26.879817 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:26.825858 10979 rpcz_store.cc:276] 0709 12:25:25.291894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.293330 (+  1436us) service_pool.cc:224] Handling call
0709 12:25:25.293721 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:25.350964 (+ 57243us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:25.821698 (+470734us) spinlock_profiling.cc:243] Waited 7.19 ms on lock 0x7b4800002dd8. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f90d0daa1 00007f8f90d04b37 00007f8f90d049ca 00007f8f90dfc26f 00007f8f90dfbf37 00007f8f90e1055c 00007f8f90e10508 00007f8f90e10488 00007f8f90e10443 00007f8f90e0f6ec 00007f8f8fd39a96
0709 12:25:26.226204 (+404506us) log.cc:844] Serialized 14 byte log entry
0709 12:25:26.484176 (+257972us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:26.485672 (+  1496us) log.cc:844] Serialized 26 byte log entry
0709 12:25:26.485945 (+   273us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:26.486039 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:26.486239 (+   200us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:26.824778 (+338539us) raft_consensus.cc:1685] finished
0709 12:25:26.824898 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:26.825090 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":137786,"prepare.queue_time_us":221473,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":175828,"raft.run_cpu_time_us":11605,"raft.run_wall_time_us":499915,"spinlock_wait_cycles":16541056,"thread_start_us":998649,"threads_started":2,"wal-append.queue_time_us":468771}
I20260709 12:25:26.904728 15477 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:26.892437 15912 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:26.906481 16024 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:26.909170 15815 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.909861 15815 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:26.918927 16021 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.892985 15038 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:26.919708 16021 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:26.922663 16021 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:26.902297 16032 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:26.896152 16010 consensus_queue.cc:260] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:26.927925 16010 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:26.926717 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:26.930446 10980 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:26.898471 15991 consensus_queue.cc:260] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:26.931605 15991 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:26.926271 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.919608 10948 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:26.938969 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:26.941340 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:26.937779 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:26.943945 10981 raft_consensus.cc:1275] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:26.941622 15785 raft_consensus.cc:2804] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:26.945068 15785 raft_consensus.cc:697] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:26.945927 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:26.946712 10978 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:25:26.948273 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:26.949182 10977 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 16.
I20260709 12:25:26.821880 15570 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:26.950611 15836 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:26.957834 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 103282us
I20260709 12:25:26.962762 15792 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:26.970126 15785 consensus_queue.cc:237] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:26.970863 15583 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.971648 15583 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:26.972194 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:26.972878 11132 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:26.980149 15887 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:26.981431 11132 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 16.
I20260709 12:25:26.982987 15815 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:26.984828 10882 catalog_manager.cc:5697] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 6 to 10, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 10 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:26.986474 16029 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:26.987427 15864 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:26.990224 15583 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:26.992393 15836 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:26.992781 11673 raft_consensus.cc:1240] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:25:26.992347 15912 raft_consensus.cc:2749] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:26.929905 15861 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:27.039988 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 235496us
I20260709 12:25:27.088122 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:27.089457 10980 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
W20260709 12:25:27.095108 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 108471us
I20260709 12:25:27.099408 16035 raft_consensus.cc:2749] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:27.103288 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:27.104236 11132 raft_consensus.cc:2393] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 9: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:27.106348 11133 raft_consensus.cc:1275] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:27.107589 10983 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 16.
I20260709 12:25:27.108065 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:27.111368 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:27.112063 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:27.100417 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:27.120546 10976 raft_consensus.cc:1240] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 13. Current term is 14. Ops: []
W20260709 12:25:27.127715 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.130820 10977 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:27.132030 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:27.107036 15864 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:27.133670 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:27.090565 15836 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:27.136343 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 300103us
I20260709 12:25:27.107779 15792 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:27.166893 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.131731 15887 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:27.173916 10982 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:27.177584 10983 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:27.133688 15815 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:27.174679 10981 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:25:27.180627 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:27.180835 11673 raft_consensus.cc:1240] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:27.176537 10980 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:27.187517 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:27.191475 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:27.195379 10975 raft_consensus.cc:2393] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 12: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:27.196203 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:27.191552 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:27.199151 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:27.172379 15864 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:27.201983 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:27.203539 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:27.205888 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:27.185599 16024 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.204726 11131 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
I20260709 12:25:27.209403 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:27.183668 15836 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:27.202498 16010 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:27.215525 10975 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:25:27.217227 11132 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 8.
I20260709 12:25:27.217635 11127 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:25:27.220659 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:27.224406 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:27.225793 10983 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:27.226820 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:27.197445 15815 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:27.227758 10976 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:27.224198 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 51619.6us
I20260709 12:25:27.225041 10981 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:27.221367 11128 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 13.
I20260709 12:25:27.223671 16032 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.234313 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:27.222441 15651 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.238008 11645 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:27.235675 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:27.239058 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:27.239998 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:27.240860 16010 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:27.241313 15967 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:27.242172 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:27.241935 15967 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:27.242853 11677 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:27.243156 16010 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:27.243806 16032 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:27.245916 10975 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 8.
I20260709 12:25:27.248346 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:27.232085 15861 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:27.249802 10975 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:27.252377 15815 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:27.256561 10984 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:25:27.258261 11131 raft_consensus.cc:2410] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:25:27.254724 11674 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:27.260439 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:27.232187 16029 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:27.279346 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.280413 11125 raft_consensus.cc:2393] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 14: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:27.281294 10980 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:27.282621 10977 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:27.283638 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:27.284157 10977 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:27.259076 16036 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.285120 11133 raft_consensus.cc:2393] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 12: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:25:27.285634 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 53607.5us
I20260709 12:25:27.245970 16032 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:27.288537 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 50655.7us
I20260709 12:25:27.232005 16024 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:27.291224 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:27.291432 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:27.294904 10980 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:27.294904 10981 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:27.295971 10975 raft_consensus.cc:2410] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:25:27.296886 10983 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 15.
I20260709 12:25:27.250396 15651 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:27.300511 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:25:27.305192 16041 log.cc:927] Time spent T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:25:27.307755 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:27.308270 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:27.308571 11672 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 13.
I20260709 12:25:27.308979 11681 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
I20260709 12:25:27.310011 11677 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 17.
I20260709 12:25:27.314116 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:27.315287 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:27.315795 10980 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:27.318545 10983 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:27.319314 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:27.316500 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:27.320456 10977 raft_consensus.cc:2393] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 14: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:27.320485 11059 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:25:27.300455 15967 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:27.339068 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:27.339054 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:27.333256 15958 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:27.340271 11672 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 17.
I20260709 12:25:27.340467 15958 raft_consensus.cc:697] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:27.341728 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:27.342919 10977 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:27.344949 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:27.345683 11057 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:27.346019 10983 raft_consensus.cc:1240] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:27.346401 11056 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 17.
I20260709 12:25:27.346836 10980 raft_consensus.cc:1275] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:25:27.348480 15651 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:27.314237 15914 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:27.301050 15887 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:27.324594 11645 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:27.354175 10976 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
W20260709 12:25:27.357694 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 47624.9us
I20260709 12:25:27.354972 11679 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 16.
I20260709 12:25:27.314694 16029 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:27.314284 16032 consensus_queue.cc:1048] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:25:27.311517 16036 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:27.364614 15836 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:27.365370 15908 raft_consensus.cc:2804] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:27.370965 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.364794 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:27.371562 11645 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:27.358964 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:27.369732 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:27.377947 11645 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:27.379377 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:27.360778 15887 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:27.380371 15914 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:27.381327 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:27.371394 15861 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:27.382393 11672 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 13.
I20260709 12:25:27.385174 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:27.385941 10975 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:27.390715 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:27.392899 11643 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:27.394565 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:27.395413 11125 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:25:27.395857 11097 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:27.397346 11097 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:27.380441 16036 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:27.398878 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:27.399564 11056 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:25:27.399849 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:27.400672 11133 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:27.401002 11098 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:27.399284 15583 raft_consensus.cc:2804] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:27.403036 15583 raft_consensus.cc:697] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:27.404098 15583 consensus_queue.cc:237] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:27.388952 16043 log.cc:927] Time spent T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:25:27.402206 16021 raft_consensus.cc:2804] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:27.406597 16021 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.406289 15861 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:27.406984 16021 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:27.407421 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:27.408265 11055 raft_consensus.cc:2393] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 18: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:27.410673 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:27.411336 11059 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 14.
W20260709 12:25:27.411677 16044 log.cc:927] Time spent T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:25:27.411846 15887 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:27.399601 16032 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:27.398756 15829 raft_consensus.cc:2749] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:27.402405 15967 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:27.413072 11023 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:27.414631 11024 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:27.413833 15967 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:27.415482 15967 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:27.417927 11023 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:27.388487 15836 raft_consensus.cc:2804] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:27.419016 15836 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.390697 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:27.420094 11679 raft_consensus.cc:2393] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 11: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:27.373816 15792 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.419291 11023 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:27.424104 15836 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:27.426316 11057 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 14.
I20260709 12:25:27.415297 15887 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:27.427546 15887 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.427902 15887 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:27.430342 16046 log.cc:927] Time spent T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:25:27.374372 15908 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.442440 16010 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:27.442997 16010 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.443374 16010 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:27.341698 15958 consensus_queue.cc:237] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:27.449816 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 48910.7us
W20260709 12:25:27.423830 10948 connection.cc:256] RPC call timeout handler was delayed by -1.1694619449999664s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
W20260709 12:25:27.451354 10948 connection.cc:256] RPC call timeout handler was delayed by -1.0029619450001519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
I20260709 12:25:27.452630 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:27.438656 16024 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
I20260709 12:25:27.350689 15655 consensus_queue.cc:1059] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:25:27.436664 16021 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:27.383409 16029 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:27.437973 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:27.455217 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:27.454560 10978 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:27.449318 15908 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:27.468299 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:27.442319 15364 raft_consensus.cc:2749] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:25:27.434815 16036 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:27.471062 10982 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:27.510980 10983 raft_consensus.cc:1240] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:27.511359 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:27.452761 11645 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:27.499655 11131 raft_consensus.cc:1240] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:27.495368 10949 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:27.503474 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 88999.1us
I20260709 12:25:27.505757 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:27.509385 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:25:27.512640 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 59958.8us
I20260709 12:25:27.446528 15904 consensus_queue.cc:1048] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:25:27.512758 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:27.517549 11128 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:27.500510 10948 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:27.471762 15651 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:27.518015 16039 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.533970 16039 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:27.533831 10882 catalog_manager.cc:5697] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 8 to 10, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 10 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:27.535670 10882 catalog_manager.cc:5697] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 6 to 7, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 7 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:27.538635 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:27.538259 10882 catalog_manager.cc:5697] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 6 to 7, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 7 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.539260 10984 raft_consensus.cc:2376] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12. Re-sending same reply.
I20260709 12:25:27.540405 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:27.540192 10882 catalog_manager.cc:5697] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 5 to 9, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 9 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:27.541910 10882 catalog_manager.cc:5697] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:27.520174 10978 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:25:27.545378 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:27.521870 11127 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 14.
I20260709 12:25:27.522053 15829 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:27.547727 15829 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:27.522255 11098 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:27.552577 11098 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:27.556155 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 83498.7us
I20260709 12:25:27.442701 15792 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:27.524930 11024 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:27.523404 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 51839.6us
I20260709 12:25:27.560166 11675 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:27.522401 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:27.566839 11057 raft_consensus.cc:2393] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 9: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:27.512032 10982 raft_consensus.cc:2376] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13. Re-sending same reply.
I20260709 12:25:27.541800 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:27.532727 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:27.526284 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:25:27.530668 10879 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41098 (request call id 285) took 24308 ms (client timeout 15000 ms). Trace:
I20260709 12:25:27.553794 15966 raft_consensus.cc:2749] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:27.569406 10975 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:25:27.563897 11645 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:27.544312 10882 catalog_manager.cc:5697] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:27.571224 11133 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
W20260709 12:25:27.575567 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 50724.1us
I20260709 12:25:27.524220 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:27.521705 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:27.510618 16036 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.582710 11644 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:27.590792 11644 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:27.527272 15607 raft_consensus.cc:2804] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:27.591964 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:27.592576 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:27.559517 16024 raft_consensus.cc:2804] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:27.577404 11134 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:27.577194 16032 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:27.530428 15864 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:27.600850 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:27.561560 15829 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:27.605090 10882 catalog_manager.cc:5697] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:27.568930 16035 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:27.608180 11129 raft_consensus.cc:2376] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15. Re-sending same reply.
I20260709 12:25:27.533907 15836 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:27.594710 16036 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:27.524590 15651 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:27.621841 10975 raft_consensus.cc:1275] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:25:27.587771 15655 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:27.623546 11097 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:27.639731 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:27.602861 15607 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:27.642056 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:27.640583 11134 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:27.604627 16024 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.608613 16032 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.603689 16039 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:27.650285 11057 raft_consensus.cc:2393] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 17: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:27.654260 10979 raft_consensus.cc:1240] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:27.593629 15904 consensus_queue.cc:1059] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:25:27.654894 11672 raft_consensus.cc:1240] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:27.630625 15864 raft_consensus.cc:2804] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:27.659307 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.688582 16039 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:27.644690 15829 raft_consensus.cc:2804] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:27.655814 16032 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:27.648391 15607 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:27.690562 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 138100us
W20260709 12:25:27.690954 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 298281us
I20260709 12:25:27.631112 15861 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:27.693392 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:27.701954 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 111247us
I20260709 12:25:27.702630 10949 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:27.707158 11643 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:27.653769 16024 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:27.705014 11097 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:27.690591 15864 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:27.712596 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:27.715561 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:27.693106 16039 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:27.656647 15655 raft_consensus.cc:697] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:27.725142 11057 raft_consensus.cc:3055] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:27.725620 11057 raft_consensus.cc:740] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:27.719677 11058 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 13.
I20260709 12:25:27.727421 11056 raft_consensus.cc:2393] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 12: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:27.705822 15861 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.697098 15904 consensus_queue.cc:1243] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:25:27.706993 15829 raft_consensus.cc:697] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 12 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:27.690478 15785 consensus_queue.cc:1059] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:25:27.735778 11127 raft_consensus.cc:1240] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:27.718973 16050 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:27.721639 16039 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:27.722723 15864 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:27.744678 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:27.745921 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:27.742936 11057 consensus_queue.cc:260] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:27.740911 16050 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.743150 16029 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:27.740347 15861 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:27.777503 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:27.570132 10879 rpcz_store.cc:269] 0709 12:25:03.222411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.235827 (+ 13416us) service_pool.cc:224] Handling call
0709 12:25:27.530388 (+24294561us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:19.314380 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:19.315100 (+   720us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:19.315154 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:25:19.315172 (+    18us) tablet.cc:662] Decoding operations
0709 12:25:19.542693 (+227521us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:19.560657 (+ 17964us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:19.568385 (+  7728us) tablet.cc:685] Acquiring locks for 20 operations
0709 12:25:19.767075 (+198690us) tablet.cc:701] Row locks acquired
0709 12:25:19.767127 (+    52us) write_op.cc:260] PREPARE: finished
0709 12:25:19.767309 (+   182us) write_op.cc:270] Start()
0709 12:25:19.767476 (+   167us) write_op.cc:276] Timestamp: P: 1783599919767237 usec, L: 0
0709 12:25:19.767516 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 12:25:19.794125 (+ 26609us) log.cc:844] Serialized 7953 byte log entry
0709 12:25:20.449139 (+655014us) spinlock_profiling.cc:243] Waited 5.93 ms on lock 0x7b54002e9854. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bddfe28 00007f8f8f81a581 00007f8f8f819d58 00007f8f8f81e9f1 00007f8f8f81e9a9 00007f8f8f81e939 00007f8f8f81e901 00007f8f8f81db2d 0000000000388634 0000000000388479
0709 12:25:20.654263 (+205124us) op_driver.cc:464] REPLICATION: finished
0709 12:25:21.571698 (+917435us) write_op.cc:301] APPLY: starting
0709 12:25:21.571805 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:22.364794 (+792989us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:22.364837 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:23.785176 (+1420339us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:23.785580 (+   404us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=0,mrs_lookups=0
0709 12:25:23.785653 (+    73us) write_op.cc:312] APPLY: finished
0709 12:25:23.830000 (+ 44347us) log.cc:844] Serialized 180 byte log entry
0709 12:25:24.270525 (+440525us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:24.290849 (+ 20324us) write_op.cc:454] Released schema lock
0709 12:25:24.338900 (+ 48051us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:24.392296 (+ 53396us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:24.394746 (+  2450us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":428734,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":850953,"apply.run_cpu_time_us":152959,"apply.run_wall_time_us":2804488,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87447,"num_ops":20,"prepare.queue_time_us":334826,"prepare.run_cpu_time_us":26197,"prepare.run_wall_time_us":1162569,"raft.queue_time_us":736676,"raft.run_cpu_time_us":44940,"raft.run_wall_time_us":536739,"replication_time_us":874973,"spinlock_wait_cycles":13629824,"thread_start_us":1350437,"threads_started":5,"wal-append.queue_time_us":586032,"wal-append.run_cpu_time_us":59068,"wal-append.run_wall_time_us":2576972}]]}
I20260709 12:25:27.781991 10977 raft_consensus.cc:1240] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:27.785091 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:27.787251 11056 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:27.769739 16050 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:27.780200 15792 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:27.811482 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:27.762820 16060 consensus_queue.cc:1048] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:25:27.825405 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:27.802539 15836 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:27.802475 16029 raft_consensus.cc:2804] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:27.832010 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:27.831902 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 124701us
I20260709 12:25:27.779765 16057 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:25:27.841604 11644 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:27.844801 11644 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:27.850991 15038 consensus_queue.cc:1048] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:25:27.852665 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 151760us
I20260709 12:25:27.855527 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:27.832583 15651 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:27.858294 11128 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 17.
I20260709 12:25:27.859597 11097 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:27.850315 15815 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:27.873450 15861 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:27.875097 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:27.875622 16047 log.cc:927] Time spent T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:25:27.877353 11130 raft_consensus.cc:1275] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:27.878585 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:27.879186 11130 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 15
W20260709 12:25:27.882604 16052 log.cc:927] Time spent T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:25:27.883375 10977 raft_consensus.cc:1240] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:27.884588 16021 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:27.842994 16029 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:27.886724 11675 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 15.
I20260709 12:25:27.918851 11051 raft_consensus.cc:1240] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:25:27.919190 16066 raft_consensus.cc:3055] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:27.887838 15887 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:27.941773 11059 raft_consensus.cc:2393] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 15: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
W20260709 12:25:27.943702 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 90275.6us
I20260709 12:25:27.818503 15655 consensus_queue.cc:237] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:27.947288 11097 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:27.950852 11130 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 15.
I20260709 12:25:27.952252 11645 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:27.952663 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:27.953487 11130 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:27.954699 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:27.956072 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:27.957047 11130 raft_consensus.cc:2393] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 10: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:27.958141 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:27.958910 11130 raft_consensus.cc:2393] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 11: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:27.960583 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:27.828078 15829 consensus_queue.cc:237] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:27.919708 16066 raft_consensus.cc:740] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
W20260709 12:25:27.942531 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 93021.4us
I20260709 12:25:27.964120 11056 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
I20260709 12:25:27.853286 16058 raft_consensus.cc:2749] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:27.967825 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:27.870432 15836 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:27.973740 11130 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:27.915903 16029 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:27.974421 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1888) took 1046 ms. Trace:
I20260709 12:25:27.924436 15914 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:27.860375 15435 consensus_queue.cc:1059] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
W20260709 12:25:28.004772 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 297679us
W20260709 12:25:28.019770 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 461869us
I20260709 12:25:28.023941 11128 raft_consensus.cc:1240] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:25:27.963470 16035 raft_consensus.cc:697] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 15 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:28.042820 10948 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:27.971971 16021 raft_consensus.cc:2804] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:28.023494 16057 raft_consensus.cc:2804] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:25:28.056469 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 81980.1us
W20260709 12:25:28.055603 15967 consensus_meta.cc:287] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.640s	user 0.013s	sys 0.000s
I20260709 12:25:28.001423 10981 rpcz_store.cc:276] 0709 12:25:26.923309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.299270 (+375961us) service_pool.cc:224] Handling call
0709 12:25:27.313915 (+ 14645us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:27.324931 (+ 11016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:27.324955 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:27.339555 (+ 14600us) log.cc:844] Serialized 26 byte log entry
0709 12:25:27.619963 (+280408us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:27.967409 (+347446us) log.cc:844] Serialized 14 byte log entry
0709 12:25:27.969165 (+  1756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:27.969254 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:27.969291 (+    37us) raft_consensus.cc:1685] finished
0709 12:25:27.969303 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:27.969430 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24658,"prepare.queue_time_us":103064,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":56,"raft.queue_time_us":8067,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":32395,"thread_start_us":551360,"threads_started":2,"wal-append.queue_time_us":369252}
I20260709 12:25:27.968372 16060 consensus_queue.cc:1048] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 12:25:28.063831 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:28.067373 11097 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:25:28.073500 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 361205us
I20260709 12:25:28.058859 15967 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:28.104480 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 413693us
I20260709 12:25:28.104775 11097 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:25:28.105568 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 62821.8us
I20260709 12:25:28.058228 16057 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:28.140915 10948 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:28.141731 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:28.140951 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:28.142913 10980 raft_consensus.cc:2393] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 10: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:28.143141 10981 raft_consensus.cc:2393] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 12: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:28.000169 16062 consensus_queue.cc:1059] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.314s
I20260709 12:25:28.147814 16061 raft_consensus.cc:2804] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:28.148351 16061 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:28.148816 16061 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:28.150195 16054 log.cc:927] Time spent T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
W20260709 12:25:28.150916 16055 log.cc:927] Time spent T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:25:28.152086 10949 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:28.147518 16078 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.147639 16084 consensus_queue.cc:1059] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:28.159998 16021 raft_consensus.cc:697] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:25:28.165845 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 59458.1us
I20260709 12:25:28.166842 10948 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:28.134526 16057 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:28.174625 10981 raft_consensus.cc:1240] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12. Ops: []
W20260709 12:25:28.184988 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 43572.5us
I20260709 12:25:28.186616 16058 raft_consensus.cc:2749] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:28.186892 11025 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:28.189049 11025 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:28.190040 16074 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:28.190623 16074 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:28.191021 16074 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:28.193928 16035 consensus_queue.cc:237] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:28.196724 15364 raft_consensus.cc:2749] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:28.147575 16056 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:28.199081 11025 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
W20260709 12:25:28.211182 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 44441.5us
I20260709 12:25:28.213055 16072 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:28.213958 11055 raft_consensus.cc:3055] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:28.213793 16072 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:28.215868 10977 raft_consensus.cc:1275] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:28.216866 16072 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:28.217163 10977 raft_consensus.cc:1240] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:28.170919 16078 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:28.224128 15904 raft_consensus.cc:3055] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:28.224582 15904 raft_consensus.cc:740] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:28.214380 11055 raft_consensus.cc:740] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:28.221829 16078 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:28.174523 15792 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.223989 10948 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:25:28.205336 15908 consensus_meta.cc:287] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.693s	user 0.011s	sys 0.000s
I20260709 12:25:28.199601 16038 raft_consensus.cc:2749] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:25:28.235321 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 89730.8us
I20260709 12:25:28.209775 11025 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:28.241875 11098 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:28.265434 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 55754.5us
W20260709 12:25:28.267452 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.224774 16058 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:28.201645 16056 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:28.270015 11025 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:28.244400 15815 raft_consensus.cc:2749] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:28.319054 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:28.319859 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 107478us
I20260709 12:25:28.226481 16084 raft_consensus.cc:2804] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:28.199150 15364 consensus_queue.cc:1059] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 12:25:28.334167 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 64219.9us
I20260709 12:25:28.343317 10948 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:28.344161 11025 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:28.349972 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 286457us
I20260709 12:25:28.135466 16066 consensus_queue.cc:260] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:28.225507 15904 consensus_queue.cc:260] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:28.349560 15912 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:28.356220 15912 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:28.329691 15914 raft_consensus.cc:2749] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:28.356617 16082 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:28.357208 16082 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:28.332465 15958 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:28.357584 16082 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:28.358038 15829 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:28.362951 16073 log.cc:927] Time spent T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:25:28.364490 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:28.365178 16078 raft_consensus.cc:3055] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:28.365644 16078 raft_consensus.cc:740] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:25:28.366181 16064 log.cc:927] Time spent T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.343s	user 0.000s	sys 0.001s
I20260709 12:25:28.257614 15836 raft_consensus.cc:697] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:28.366818 16021 consensus_queue.cc:237] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:28.367856 15836 consensus_queue.cc:237] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:28.369280 11675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41784 (request call id 800) took 1059 ms. Trace:
I20260709 12:25:28.369683 11675 rpcz_store.cc:276] 0709 12:25:27.309465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.313795 (+  4330us) service_pool.cc:224] Handling call
0709 12:25:28.369096 (+1055301us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54004e2fd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:28.369210 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":425648000}
I20260709 12:25:28.371381 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2762) took 1142 ms. Trace:
I20260709 12:25:28.371781 10976 rpcz_store.cc:276] 0709 12:25:27.228655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.362517 (+133862us) service_pool.cc:224] Handling call
0709 12:25:27.362807 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:27.454987 (+ 92180us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:25:27.633768 (+178781us) log.cc:844] Serialized 14 byte log entry
0709 12:25:27.832221 (+198453us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:27.832274 (+    53us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:27.832324 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.371124 (+538800us) spinlock_profiling.cc:243] Waited 84 ms on lock 0x7b540028aad4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:28.371177 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:28.371322 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":267328,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":107344,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":6191,"spinlock_wait_cycles":194396800,"thread_start_us":292070,"threads_started":3,"wal-append.queue_time_us":103254}
I20260709 12:25:28.365648 11674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41762 (request call id 977) took 1155 ms. Trace:
I20260709 12:25:28.375072 11674 rpcz_store.cc:276] 0709 12:25:27.210394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.228831 (+ 18437us) service_pool.cc:224] Handling call
0709 12:25:28.365434 (+1136603us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b54005794d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:28.365554 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32168832}
I20260709 12:25:28.376626 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1884) took 1454 ms. Trace:
I20260709 12:25:28.377041 10979 rpcz_store.cc:276] 0709 12:25:26.921987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.950992 (+ 29005us) service_pool.cc:224] Handling call
0709 12:25:26.951367 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:27.654700 (+703333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.376369 (+721669us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b540022a454. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:28.376561 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1608771968}
I20260709 12:25:28.356698 15912 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:28.378430 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2764) took 1138 ms. Trace:
I20260709 12:25:28.378840 10982 rpcz_store.cc:276] 0709 12:25:27.240324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.576452 (+336128us) service_pool.cc:224] Handling call
0709 12:25:27.598295 (+ 21843us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:27.733985 (+135690us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:27.734016 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:27.745073 (+ 11057us) log.cc:844] Serialized 52 byte log entry
0709 12:25:28.045625 (+300552us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:28.045684 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.045760 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:28.378176 (+332416us) raft_consensus.cc:1685] finished
0709 12:25:28.378197 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:28.378364 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13043,"raft.queue_time_us":207206,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":8165,"thread_start_us":382187,"threads_started":2,"wal-append.queue_time_us":445149}
I20260709 12:25:28.380381 16038 raft_consensus.cc:2749] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:28.381147 15435 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:28.381575 15435 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:28.381985 15435 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:28.381817 15958 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:28.384902 15958 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:28.365226 11131 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:28.390486 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2767) took 1149 ms. Trace:
W20260709 12:25:28.391016 16063 log.cc:927] Time spent T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.383s	user 0.000s	sys 0.001s
I20260709 12:25:28.392313 16075 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:28.392882 16075 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:28.393337 16075 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:28.394479 16032 consensus_meta.cc:287] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.681s	user 0.001s	sys 0.010s
I20260709 12:25:28.394985 16032 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:28.398269 10949 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:28.399063 16036 consensus_meta.cc:287] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.707s	user 0.007s	sys 0.003s
W20260709 12:25:28.399389 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 49153.5us
I20260709 12:25:28.400427 10949 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:28.401643 16071 raft_consensus.cc:2749] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:28.402455 16071 raft_consensus.cc:2749] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:28.374672 16067 raft_consensus.cc:2804] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:28.403903 16067 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:28.404148 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.404289 16067 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:28.406718 15912 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:28.409133 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 167350us
W20260709 12:25:28.331084 15607 consensus_meta.cc:287] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.613s	user 0.010s	sys 0.001s
I20260709 12:25:28.412006 11131 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
I20260709 12:25:28.390974 10978 rpcz_store.cc:276] 0709 12:25:27.241231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.632835 (+391604us) service_pool.cc:224] Handling call
0709 12:25:27.651345 (+ 18510us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:27.692717 (+ 41372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:27.692748 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:27.700753 (+  8005us) log.cc:844] Serialized 26 byte log entry
0709 12:25:28.019421 (+318668us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:28.019470 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.019551 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:28.390199 (+370648us) raft_consensus.cc:1685] finished
0709 12:25:28.390229 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:28.390416 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1920,"raft.queue_time_us":141209,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":13842,"thread_start_us":295756,"threads_started":1,"wal-append.queue_time_us":426909}
I20260709 12:25:28.321455 16058 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:28.434793 11675 raft_consensus.cc:1240] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:28.405260 15829 raft_consensus.cc:2749] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:28.392617 15967 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:28.402573 16010 consensus_meta.cc:287] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.959s	user 0.011s	sys 0.002s
I20260709 12:25:28.330539 15887 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:28.435949 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:28.436815 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:28.332392 16056 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:28.438594 11133 raft_consensus.cc:1275] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:28.390384 11055 consensus_queue.cc:260] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:28.452020 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:28.422797 16032 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:28.241258 15792 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:28.437671 16058 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:28.345405 16084 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:28.443323 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:28.443600 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:28.444299 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:28.445004 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:28.439859 15815 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:28.399529 16036 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:28.468066 15912 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:28.469523 16036 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:28.470432 11058 raft_consensus.cc:2368] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 13. Current term is 14.
I20260709 12:25:28.366674 16078 consensus_queue.cc:260] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:28.472012 16029 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:28.475411 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:28.476649 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:25:28.477427 15864 consensus_meta.cc:287] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.727s	user 0.008s	sys 0.003s
I20260709 12:25:28.467700 10979 raft_consensus.cc:2393] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 9: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:28.467664 15815 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:28.479274 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:28.445405 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:28.479971 11681 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 15.
I20260709 12:25:28.445940 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2624) took 1011 ms. Trace:
I20260709 12:25:28.480446 11125 rpcz_store.cc:276] 0709 12:25:27.434720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.449475 (+ 14755us) service_pool.cc:224] Handling call
0709 12:25:28.241247 (+791772us) spinlock_profiling.cc:243] Waited 986 us on lock 0x7b5800117398. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90dbdfc0 00007f8f90da8929 00007f8f90da83d2 00007f8f8a31fbd4
0709 12:25:28.333622 (+ 92375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:28.438049 (+104427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:28.438082 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:28.445609 (+  7527us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:28.445671 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.445742 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:28.445874 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2267392}
I20260709 12:25:28.481309 15815 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:28.480218 10982 raft_consensus.cc:2393] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 11: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:28.317857 15908 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:28.485222 16029 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:28.485994 16059 log.cc:927] Time spent T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.380s	user 0.000s	sys 0.001s
W20260709 12:25:28.441937 11134 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.010s	sys 0.005s
W20260709 12:25:28.491189 11134 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.010s	sys 0.006s
W20260709 12:25:28.431988 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 327281us
I20260709 12:25:28.458415 11672 raft_consensus.cc:2393] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 15: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:28.461220 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:25:28.441638 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.463842 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:28.464542 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:28.465185 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:28.467707 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:28.496363 11643 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:28.501420 11643 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:28.508607 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:28.508795 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:28.471935 16039 consensus_meta.cc:287] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.721s	user 0.009s	sys 0.000s
I20260709 12:25:28.510092 11674 raft_consensus.cc:2393] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 9: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:28.510056 10976 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 14.
I20260709 12:25:28.504074 11097 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:25:28.511458 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 52328.8us
I20260709 12:25:28.510849 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:28.513563 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:28.433004 15607 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:28.516224 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:28.518527 11133 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:28.456959 16010 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:28.522071 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:28.461503 16066 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:28.520879 10983 raft_consensus.cc:2393] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 15: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
W20260709 12:25:28.505710 16024 consensus_meta.cc:287] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.776s	user 0.008s	sys 0.003s
I20260709 12:25:28.522056 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:28.477873 15864 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:28.487560 15908 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:28.543431 15651 consensus_queue.cc:1059] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:28.491237 16084 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:28.527012 11131 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:28.522341 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:28.544843 10982 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:25:28.545370 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:28.545809 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:28.546761 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:28.546926 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:28.547590 11125 raft_consensus.cc:2393] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 9: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:28.500206 15904 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:28.548622 11125 raft_consensus.cc:1240] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:28.506767 16036 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.510492 16029 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:28.526505 16062 consensus_queue.cc:1059] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:25:28.535838 15607 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:28.536224 11024 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:28.539609 16010 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:28.541960 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:28.561364 10978 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 14.
I20260709 12:25:28.526804 16057 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:28.505059 15887 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.546501 15966 raft_consensus.cc:3055] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:28.546494 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:28.566392 10983 raft_consensus.cc:2393] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 9: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:28.552021 10981 raft_consensus.cc:1240] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:28.544353 11098 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:28.526353 16024 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:28.550441 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2768) took 1309 ms. Trace:
I20260709 12:25:28.485566 16074 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:28.569417 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 65643.6us
I20260709 12:25:28.520162 16039 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:28.577997 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:28.615199 10983 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:28.505549 16058 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:28.616452 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 111087us
W20260709 12:25:28.567008 16050 consensus_meta.cc:287] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.748s	user 0.012s	sys 0.000s
I20260709 12:25:28.604449 11133 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 15.
I20260709 12:25:28.606422 11126 raft_consensus.cc:1275] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:25:28.607298 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:28.625877 10978 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:25:28.574950 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:28.626653 11681 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:28.615623 10982 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:25:28.602810 11675 raft_consensus.cc:1240] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:28.550428 16036 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:28.570511 10975 rpcz_store.cc:276] 0709 12:25:27.241507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.649697 (+408190us) service_pool.cc:224] Handling call
0709 12:25:27.694198 (+ 44501us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:27.703580 (+  9382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:27.703610 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:27.723748 (+ 20138us) log.cc:844] Serialized 26 byte log entry
0709 12:25:28.155007 (+431259us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:28.155050 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.155124 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:28.550204 (+395080us) raft_consensus.cc:1685] finished
0709 12:25:28.550230 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:28.550383 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4042,"raft.queue_time_us":131641,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":8260,"thread_start_us":411920,"threads_started":1,"wal-append.queue_time_us":779343}
I20260709 12:25:28.634871 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:28.635527 10979 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:28.636555 10948 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:28.618956 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:28.565882 15966 raft_consensus.cc:740] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:28.639698 10983 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:28.560633 16061 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:28.651736 11131 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
W20260709 12:25:28.655222 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 110929us
I20260709 12:25:28.572034 15887 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:28.637748 15655 raft_consensus.cc:2804] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:28.666848 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:28.665082 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:25:28.660566 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 118004us
I20260709 12:25:28.617532 16082 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:28.667979 11126 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:28.682602 11098 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:28.702940 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 66468.6us
I20260709 12:25:28.651002 16094 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:28.663089 10983 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:25:28.633332 16050 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:28.660888 15607 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:28.711683 11131 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:28.705104 10978 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:28.667600 15655 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:28.723064 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:25:28.725879 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 189738us
W20260709 12:25:28.727980 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 45481.2us
I20260709 12:25:28.713608 16021 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:28.663594 16099 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:28.718705 16032 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:28.788759 11024 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:28.718408 16094 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:28.702335 16096 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.122s
I20260709 12:25:28.792676 11098 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:28.724746 15651 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.732336 15655 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:28.712098 16067 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:28.820190 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.797135 16094 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:28.799630 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 159759us
W20260709 12:25:28.870038 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 77439.4us
W20260709 12:25:28.872946 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.899019 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2784) took 1502 ms. Trace:
W20260709 12:25:28.876418 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 68720.6us
I20260709 12:25:28.795790 16099 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
W20260709 12:25:28.897682 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.903918 10984 raft_consensus.cc:2410] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:25:28.899827 10981 rpcz_store.cc:276] 0709 12:25:27.397071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.189492 (+792421us) service_pool.cc:224] Handling call
0709 12:25:28.189765 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:28.567718 (+377953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.898744 (+331026us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b5400333e54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:28.898952 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":832662784}
I20260709 12:25:28.839061 15583 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:28.906926 11129 raft_consensus.cc:1240] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:28.793111 16062 raft_consensus.cc:2749] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:28.908336 11097 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:28.839403 16035 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:28.878334 10948 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:28.921418 10948 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:28.905987 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 189580us
I20260709 12:25:28.905516 16099 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:28.793314 15966 consensus_queue.cc:260] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:28.898082 15651 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:28.796458 16021 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:28.941887 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:28.945739 11679 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:28.926627 16066 raft_consensus.cc:2804] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:28.933516 16039 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:28.959743 16039 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:28.960309 16039 raft_consensus.cc:697] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:28.961179 16039 consensus_queue.cc:237] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:28.962687 16082 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:28.964010 16121 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:28.966898 16075 consensus_meta.cc:287] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.573s	user 0.005s	sys 0.006s
I20260709 12:25:28.967638 11681 raft_consensus.cc:2410] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:25:28.967437 16075 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:28.969121 11055 raft_consensus.cc:3060] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:28.942193 16058 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:28.946358 16036 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:28.970299 16098 log.cc:927] Time spent T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.210s	user 0.000s	sys 0.000s
I20260709 12:25:28.973740 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2639) took 1091 ms. Trace:
W20260709 12:25:28.946913 16101 log.cc:927] Time spent T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:25:28.980383 11126 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:28.947680 16113 raft_consensus.cc:2764] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:25:28.948179 16050 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:28.950796 16103 log.cc:927] Time spent T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
W20260709 12:25:28.952164 16102 log.cc:927] Time spent T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.239s	user 0.000s	sys 0.000s
I20260709 12:25:28.953118 15887 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:28.974136 11130 rpcz_store.cc:276] 0709 12:25:27.882671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.005268 (+122597us) service_pool.cc:224] Handling call
0709 12:25:28.005846 (+   578us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:28.025614 (+ 19768us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:28.025643 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:28.060731 (+ 35088us) log.cc:844] Serialized 26 byte log entry
0709 12:25:28.433128 (+372397us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:28.433169 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.433236 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:28.973498 (+540262us) raft_consensus.cc:1685] finished
0709 12:25:28.973531 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:28.973675 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":300,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":9840,"thread_start_us":278665,"threads_started":1,"wal-append.queue_time_us":553752}
I20260709 12:25:28.946815 16108 consensus_queue.cc:1048] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.156s
W20260709 12:25:28.959014 16106 log.cc:927] Time spent T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:25:29.005759 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:28.977376 10979 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:25:29.026314 11126 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:29.003839 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.929617 16057 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:29.014618 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:29.017988 11645 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
W20260709 12:25:28.959853 16100 log.cc:927] Time spent T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 12:25:29.022862 11130 raft_consensus.cc:1240] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:29.017215 16076 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.969898 16075 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:28.928543 16035 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:29.021663 16061 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:29.030030 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 130332us
I20260709 12:25:29.037326 11130 raft_consensus.cc:1240] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 12. Current term is 13. Ops: []
W20260709 12:25:29.038607 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 134182us
I20260709 12:25:29.034786 11645 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:29.027531 15912 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:28.946928 16092 consensus_queue.cc:1059] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.315s
I20260709 12:25:29.044759 11097 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:29.017202 16084 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:29.049275 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.049815 11097 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:29.050572 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 150210us
I20260709 12:25:29.050766 11126 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
W20260709 12:25:29.052368 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 262946us
I20260709 12:25:29.052489 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:29.054611 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:29.055990 11058 raft_consensus.cc:2393] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 15: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
W20260709 12:25:29.062270 16056 consensus_meta.cc:287] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.556s	user 0.011s	sys 0.000s
I20260709 12:25:29.062865 16056 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:29.064857 16067 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:29.065104 16056 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:29.041780 16029 consensus_queue.cc:1059] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
W20260709 12:25:29.043871 15435 consensus_meta.cc:287] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.661s	user 0.004s	sys 0.008s
W20260709 12:25:29.066705 15904 consensus_meta.cc:287] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.518s	user 0.005s	sys 0.004s
I20260709 12:25:29.035692 16050 raft_consensus.cc:2804] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:29.067766 11127 raft_consensus.cc:1240] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:29.066423 15435 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:29.080760 11055 raft_consensus.cc:1275] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:29.079070 11098 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:29.035215 16066 raft_consensus.cc:697] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:29.085625 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:29.084833 11055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 733) took 1672 ms. Trace:
I20260709 12:25:29.088400 11054 raft_consensus.cc:1240] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:29.094949 11097 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:29.090385 11055 rpcz_store.cc:276] 0709 12:25:27.409113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.409238 (+   125us) service_pool.cc:224] Handling call
0709 12:25:27.409553 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:28.213847 (+804294us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b5400152fa0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bd5bdc0 00007f8f8bde61c0 00007f8f8bde7231 00007f8f8bde3d8f 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c
0709 12:25:28.968854 (+755007us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b580062f0d0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bd400aa 00007f8f8bdc2447 00007f8f8bddafe7 00007f8f8bddc7de 00007f8f8bde6b49 00007f8f8bde7416 00007f8f8bde3d8f 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4
0709 12:25:29.081304 (+112450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:29.081534 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1421384448}
I20260709 12:25:29.147635 11126 raft_consensus.cc:1275] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:25:29.149847 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 70888us
I20260709 12:25:29.150950 15651 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:29.152426 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:29.153074 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:29.153949 11681 raft_consensus.cc:2410] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:25:29.154320 11059 raft_consensus.cc:1240] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:29.154894 16057 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:29.155668 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:29.156317 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:29.158874 11058 raft_consensus.cc:2393] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 15: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:29.062306 16122 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:29.164357 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:25:29.166451 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.161496 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:29.168051 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:29.168603 11679 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 14.
I20260709 12:25:29.038944 16076 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:29.087796 15570 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
W20260709 12:25:29.174201 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 79352us
I20260709 12:25:29.163506 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:29.082379 16125 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:29.175060 11097 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:29.180577 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 146964us
I20260709 12:25:29.157518 16056 raft_consensus.cc:2749] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:29.180831 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:29.181507 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2793) took 1210 ms. Trace:
I20260709 12:25:29.189458 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:29.190937 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:25:29.179205 16090 log.cc:927] Time spent T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:25:29.195431 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:29.187741 10977 rpcz_store.cc:276] 0709 12:25:27.971262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.218088 (+246826us) service_pool.cc:224] Handling call
0709 12:25:28.218443 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:28.240885 (+ 22442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:28.240919 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:28.346690 (+105771us) log.cc:844] Serialized 26 byte log entry
0709 12:25:28.576892 (+230202us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:28.634329 (+ 57437us) log.cc:844] Serialized 14 byte log entry
0709 12:25:28.646664 (+ 12335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.646739 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:29.181308 (+534569us) raft_consensus.cc:1685] finished
0709 12:25:29.181330 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:29.181451 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16008,"prepare.queue_time_us":57202,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":41032,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":23289,"spinlock_wait_cycles":15756160,"thread_start_us":127786,"threads_started":1,"wal-append.queue_time_us":278802}
I20260709 12:25:29.196727 11677 raft_consensus.cc:1275] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:25:29.173837 16113 raft_consensus.cc:2804] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:29.181772 11645 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:29.177102 16029 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:29.196245 16062 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.206647 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:29.179822 16125 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:29.207569 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:29.209254 11053 raft_consensus.cc:2393] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 15: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:29.189092 16135 raft_consensus.cc:3055] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:29.218572 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:29.219403 11130 raft_consensus.cc:2368] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 13. Current term is 14.
I20260709 12:25:29.215569 11097 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:29.224249 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:29.224797 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:29.217684 16124 log.cc:927] Time spent T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:25:29.207547 16082 raft_consensus.cc:2804] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:29.228310 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:29.227157 11025 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:29.233695 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:29.230479 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:29.214600 16125 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:29.176409 16122 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:29.239271 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:29.217670 16135 raft_consensus.cc:740] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:25:29.231231 16111 log.cc:927] Time spent T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 12:25:29.220921 16113 raft_consensus.cc:697] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 12 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:29.244263 11126 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:29.253880 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:29.225036 16050 raft_consensus.cc:697] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:29.251577 11098 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:29.255290 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:29.229640 16029 raft_consensus.cc:697] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:29.236089 15908 raft_consensus.cc:2804] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:29.234457 16039 raft_consensus.cc:2804] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:29.232129 16082 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:29.259629 11126 raft_consensus.cc:2393] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 15: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
W20260709 12:25:29.246248 15607 consensus_meta.cc:287] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.000s
I20260709 12:25:29.262089 11098 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:29.217121 16062 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:29.267195 11672 raft_consensus.cc:1240] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:25:29.268267 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:29.269172 11126 raft_consensus.cc:2393] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 9: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
W20260709 12:25:29.270758 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 89060.4us
I20260709 12:25:29.265693 11644 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:29.272329 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:29.273535 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:29.277197 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:29.224284 16066 consensus_queue.cc:237] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:29.281749 11644 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:29.283525 16138 raft_consensus.cc:2749] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:29.284257 16138 raft_consensus.cc:2749] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:29.265528 16082 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:29.287199 11130 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 15.
I20260709 12:25:29.288728 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:29.276057 15607 raft_consensus.cc:2749] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:29.297152 11677 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
W20260709 12:25:29.281226 16118 log.cc:927] Time spent T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 12:25:29.288710 11023 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:29.277987 16035 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:29.277570 15908 raft_consensus.cc:697] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:29.303025 11023 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:29.317787 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:29.296630 16084 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:29.318487 11126 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:29.310847 15705 raft_consensus.cc:2749] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:29.321331 16130 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:29.323297 16129 raft_consensus.cc:2804] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:29.285632 15836 consensus_queue.cc:1048] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:25:29.323972 16057 consensus_queue.cc:1059] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:29.324716 16057 consensus_queue.cc:1243] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer bc01179655564f29b83babe396377cbb log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:25:29.325086 16134 consensus_queue.cc:1048] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.096s
W20260709 12:25:29.328835 16131 log.cc:927] Time spent T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:25:29.329195 15792 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:29.329668 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2641) took 1446 ms. Trace:
I20260709 12:25:29.330084 11128 rpcz_store.cc:276] 0709 12:25:27.883398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.111195 (+227797us) service_pool.cc:224] Handling call
0709 12:25:28.143851 (+ 32656us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:28.168582 (+ 24731us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:28.168611 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:28.169132 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 12:25:28.575408 (+406276us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:28.631341 (+ 55933us) log.cc:844] Serialized 14 byte log entry
0709 12:25:28.639253 (+  7912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.639323 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:28.967223 (+327900us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b180038f920. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cf7522 00007f8f88cf97c1 00007f8f88cf9779 00007f8f88cf9709 00007f8f88cf96d1 00007f8f88cf89cd 0000000000388634 0000000000388479 00007f8f88cda83a
0709 12:25:29.326438 (+359215us) raft_consensus.cc:1685] finished
0709 12:25:29.329446 (+  3008us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:29.329602 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":58687,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":1488,"raft.queue_time_us":23363,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":43206,"spinlock_wait_cycles":7432448,"thread_start_us":405860,"threads_started":1,"wal-append.queue_time_us":489865}
I20260709 12:25:29.332260 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:29.332701 16062 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:29.333722 11128 raft_consensus.cc:1240] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:29.333298 16029 consensus_queue.cc:237] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:29.321007 16116 log.cc:927] Time spent T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.307s	user 0.001s	sys 0.000s
I20260709 12:25:29.336366 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:29.348508 15908 consensus_queue.cc:237] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:29.336885 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2789) took 1366 ms. Trace:
I20260709 12:25:29.336889 16076 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:29.367681 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 841) took 1168 ms. Trace:
I20260709 12:25:29.368135 11125 rpcz_store.cc:276] 0709 12:25:28.199598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.549395 (+349797us) service_pool.cc:224] Handling call
0709 12:25:28.549751 (+   356us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:28.632067 (+ 82316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:28.632102 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:28.656808 (+ 24706us) log.cc:844] Serialized 52 byte log entry
0709 12:25:28.790216 (+133408us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:28.790400 (+   184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.790507 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:29.367412 (+576905us) raft_consensus.cc:1685] finished
0709 12:25:29.367433 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:29.367618 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19340,"raft.queue_time_us":89430,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":6197,"thread_start_us":68059,"threads_started":1,"wal-append.queue_time_us":102982}
I20260709 12:25:29.315169 15651 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.370532 15651 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:29.335192 16132 log.cc:927] Time spent T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:25:29.346352 16050 consensus_queue.cc:237] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:29.373642 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 93410.9us
I20260709 12:25:29.334829 16113 consensus_queue.cc:237] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:29.347461 16119 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:29.352754 16133 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:29.314870 16135 consensus_queue.cc:260] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:29.350136 16110 consensus_queue.cc:1059] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:25:29.300210 16039 raft_consensus.cc:697] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:29.282258 15655 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:29.302052 15435 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:29.323829 16129 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.363293 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:29.362113 10980 rpcz_store.cc:276] 0709 12:25:27.970186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.194945 (+224759us) service_pool.cc:224] Handling call
0709 12:25:28.195330 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:28.225168 (+ 29838us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:28.225203 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:28.225792 (+   589us) log.cc:844] Serialized 26 byte log entry
0709 12:25:28.804164 (+578372us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b18004b1c00. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cd9e07 00007f8f91b349a9 00007f8f88cf669b 00007f8f88cf493f 00007f8f88cf6c02 00007f8f8b97e20b 00007f8f8b983d23 00007f8f8b9840d1 00007f8f8bd9fa0f
0709 12:25:28.903092 (+ 98928us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:28.903133 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.903203 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:29.336587 (+433384us) raft_consensus.cc:1685] finished
0709 12:25:29.336608 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:29.336820 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92712,"raft.queue_time_us":38400,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":10560,"spinlock_wait_cycles":67119872,"thread_start_us":98734,"threads_started":1,"wal-append.queue_time_us":795693}
I20260709 12:25:29.365146 15583 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:29.371845 11132 raft_consensus.cc:1240] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:25:29.375185 16094 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:29.336282 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2631) took 1681 ms. Trace:
I20260709 12:25:29.358279 16122 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:29.377400 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:29.373245 16142 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.390574 11098 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:29.393642 16129 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:29.512800 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 51606.4us
I20260709 12:25:29.398367 11053 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:29.413659 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:29.528601 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:25:29.471469 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.394577 11126 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:29.446079 11643 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:29.533131 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:29.412194 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:25:29.494719 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.413292 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:29.401088 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:29.404997 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:29.417312 11128 raft_consensus.cc:2393] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 13: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:29.401309 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:29.523830 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2644) took 1639 ms. Trace:
I20260709 12:25:29.526705 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2643) took 1642 ms. Trace:
I20260709 12:25:29.573696 11125 raft_consensus.cc:1240] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:29.571416 11023 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:29.574337 11059 raft_consensus.cc:2368] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 14. Current term is 15.
I20260709 12:25:29.575912 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:29.576998 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:25:29.520474 16105 log.cc:927] Time spent T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.721s	user 0.003s	sys 0.000s
I20260709 12:25:29.578672 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:29.412592 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:29.579373 11098 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:29.582216 11058 raft_consensus.cc:2393] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 17: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:29.583616 11676 raft_consensus.cc:2368] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12.
I20260709 12:25:29.399040 15655 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:29.584014 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:29.520813 15967 raft_consensus.cc:3055] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:29.395048 11134 rpcz_store.cc:276] 0709 12:25:27.654821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.690785 (+ 35964us) service_pool.cc:224] Handling call
0709 12:25:27.713051 (+ 22266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:28.492402 (+779351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:28.492437 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:28.524355 (+ 31918us) log.cc:844] Serialized 26 byte log entry
0709 12:25:28.816992 (+292637us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:28.817032 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.817231 (+   199us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:29.336066 (+518835us) raft_consensus.cc:1685] finished
0709 12:25:29.336095 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:29.336227 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20645,"raft.queue_time_us":106602,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":6308,"thread_start_us":885479,"threads_started":2,"wal-append.queue_time_us":357734}
I20260709 12:25:29.418043 16135 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:29.585418 11023 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:29.588151 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:29.415210 15966 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:29.592080 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:29.406303 15651 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:29.424428 15829 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:29.586628 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 140671us
I20260709 12:25:29.413097 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:29.584702 11127 rpcz_store.cc:276] 0709 12:25:27.884154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.167844 (+283690us) service_pool.cc:224] Handling call
0709 12:25:28.168222 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:29.082779 (+914557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:29.526436 (+443657us) spinlock_profiling.cc:243] Waited 899 ms on lock 0x7b5400373554. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:29.526638 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2068276480}
I20260709 12:25:29.589170 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:29.530920 16119 raft_consensus.cc:2749] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:29.594872 11678 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:29.595129 11056 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:29.396533 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 113876us
I20260709 12:25:29.512320 16126 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.598868 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:29.599033 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:29.402843 16094 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:29.592525 11098 leader_election.cc:400] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 14. Current term is 15.
I20260709 12:25:29.600121 11098 leader_election.cc:403] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:25:29.583069 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:29.601048 11059 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:29.593462 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:29.397122 15883 consensus_queue.cc:1048] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.198s
I20260709 12:25:29.600409 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:29.601614 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:29.601277 11643 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:29.596791 11644 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:29.587931 16038 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:29.590677 15908 raft_consensus.cc:2804] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:29.615620 11644 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:29.395205 15583 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:29.573182 11129 rpcz_store.cc:276] 0709 12:25:27.884440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.329698 (+445258us) service_pool.cc:224] Handling call
0709 12:25:28.353212 (+ 23514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:28.909797 (+556585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:29.523547 (+613750us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b5400067554. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:29.523758 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1262434560}
I20260709 12:25:29.589802 16113 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:29.608070 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:29.608209 10976 raft_consensus.cc:1240] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:29.421998 16082 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:29.610770 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.424003 16129 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:29.617620 16050 raft_consensus.cc:2804] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:29.588224 15967 raft_consensus.cc:740] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:29.615520 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:29.627668 11134 raft_consensus.cc:1240] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:29.594491 16121 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:25:29.619480 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.396056 16123 consensus_queue.cc:1059] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.223s
I20260709 12:25:29.395576 16143 consensus_queue.cc:1059] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.226s
I20260709 12:25:29.424775 16140 consensus_queue.cc:1048] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.300s
I20260709 12:25:29.424669 16142 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:29.695399 11060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:29.618199 16032 raft_consensus.cc:2749] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:29.432729 16125 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:29.622795 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:29.395753 16099 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:29.623951 10979 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
W20260709 12:25:29.623230 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 176307us
I20260709 12:25:29.606891 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:29.613655 11056 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 14.
I20260709 12:25:29.627137 11126 raft_consensus.cc:1240] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:25:29.617807 10983 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
W20260709 12:25:29.696074 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 111845us
I20260709 12:25:29.721833 11128 raft_consensus.cc:2393] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 15: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:29.722383 10975 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
W20260709 12:25:29.696612 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.726145 11678 raft_consensus.cc:1275] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:25:29.727140 11053 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
I20260709 12:25:29.626032 16038 raft_consensus.cc:697] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:29.614682 16057 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 14. Current term is 15.
I20260709 12:25:29.618943 15908 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:29.698292 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 45907.2us
I20260709 12:25:29.602852 15904 consensus_queue.cc:1059] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:25:29.620820 16133 raft_consensus.cc:2749] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:29.700078 16122 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.428002 16039 consensus_queue.cc:237] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:29.606594 16126 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:29.714885 16149 log.cc:927] Time spent T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:25:29.701639 16050 raft_consensus.cc:697] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:29.699167 16066 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:29.741670 11130 raft_consensus.cc:2393] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 11: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:29.743640 11126 raft_consensus.cc:1275] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:25:29.744197 11128 raft_consensus.cc:1240] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:29.758284 11023 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:29.737207 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:29.739586 11129 raft_consensus.cc:1240] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:29.773509 16082 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:29.776137 16099 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:29.752146 10949 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:29.781414 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:29.782428 10980 raft_consensus.cc:2393] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 13: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:29.783703 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:29.784415 10981 raft_consensus.cc:2376] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10. Re-sending same reply.
I20260709 12:25:29.729568 16140 consensus_queue.cc:1243] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer c979ef00e0ad4157b49ebbdc13ce7cd7 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:25:29.741014 16113 raft_consensus.cc:3055] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:29.738075 15908 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:29.745328 15792 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.801661 11056 raft_consensus.cc:1240] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:29.739252 16010 raft_consensus.cc:3055] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:29.795864 16129 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:29.804877 15583 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:29.723140 16121 raft_consensus.cc:697] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:25:29.805898 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 53876.5us
I20260709 12:25:29.801343 15785 raft_consensus.cc:2749] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:29.807507 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 49313.9us
I20260709 12:25:29.831316 11023 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:29.746794 16122 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:29.745397 15912 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:29.808985 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:29.813146 15812 raft_consensus.cc:2804] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:29.848928 15812 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.814178 16050 consensus_queue.cc:237] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:29.849429 15812 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:29.849844 15991 raft_consensus.cc:3055] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:29.850255 15991 raft_consensus.cc:740] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:29.784963 16066 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:29.851140 15991 consensus_queue.cc:260] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:29.852381 15991 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:29.853279 16066 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:29.848850 11126 raft_consensus.cc:1240] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:29.802769 16113 raft_consensus.cc:740] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
W20260709 12:25:29.818805 16151 log.cc:927] Time spent T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:25:29.821893 11677 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:29.822116 16010 raft_consensus.cc:740] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:29.863880 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:29.864056 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:29.864260 16010 consensus_queue.cc:260] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:29.865540 16010 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:29.830078 10949 leader_election.cc:400] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 13. Current term is 14.
I20260709 12:25:29.832921 16121 consensus_queue.cc:237] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:29.866148 16135 consensus_queue.cc:1059] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:29.867249 16135 raft_consensus.cc:3055] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:29.867641 16135 raft_consensus.cc:740] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:29.833904 16123 raft_consensus.cc:2804] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:29.869484 16123 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.869892 16123 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:29.834394 16137 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.836234 11054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 2114) took 1387 ms. Trace:
I20260709 12:25:29.837711 11025 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:29.831336 16038 consensus_queue.cc:237] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:29.838634 16024 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:29.847802 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:29.849347 11023 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:29.882289 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:29.826419 15792 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:29.827142 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:29.864825 11126 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 17.
I20260709 12:25:29.868561 16135 consensus_queue.cc:260] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:29.866258 10949 leader_election.cc:403] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:29.808243 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:29.899221 10981 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:29.754447 15967 consensus_queue.cc:260] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:29.873183 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:29.900324 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:29.874042 11054 rpcz_store.cc:276] 0709 12:25:28.449079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.449366 (+   287us) service_pool.cc:224] Handling call
0709 12:25:28.499174 (+ 49808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:29.143786 (+644612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:29.835987 (+692201us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b5400348354. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:29.836171 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1354644096}
I20260709 12:25:29.886373 11052 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:25:29.878425 16084 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:29.861498 15912 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:29.901592 11060 raft_consensus.cc:606] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:29.903591 11060 raft_consensus.cc:614] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:29.907620 11025 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
W20260709 12:25:29.918390 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 88444.8us
I20260709 12:25:29.919390 10949 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:29.873924 16137 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:29.925679 10949 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:29.922837 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:29.922398 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:29.929028 10980 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:29.880728 16139 consensus_queue.cc:1059] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:25:29.921345 16142 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:29.933524 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.920884 16119 raft_consensus.cc:2804] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:29.951354 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:29.952251 11681 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 18.
I20260709 12:25:29.884145 15705 consensus_queue.cc:1059] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:25:29.934856 11056 raft_consensus.cc:1275] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:29.935834 16137 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:29.934005 15785 raft_consensus.cc:2749] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:29.938838 11054 raft_consensus.cc:1240] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:25:29.938033 15812 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:29.939467 15912 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:29.931514 16135 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:29.942178 16113 consensus_queue.cc:260] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:29.943070 16122 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:29.944911 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:29.946408 10949 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:29.947228 11059 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 18.
I20260709 12:25:29.929875 16066 raft_consensus.cc:2749] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 13. Current term is 14.
I20260709 12:25:29.961459 11056 raft_consensus.cc:1275] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:25:29.984127 11056 pending_rounds.cc:85] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting all ops after (but not including) 11
I20260709 12:25:29.929723 15887 raft_consensus.cc:2804] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:29.930373 16069 raft_consensus.cc:2749] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:29.971918 11059 raft_consensus.cc:1240] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:29.988341 11054 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:29.988710 11057 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:29.989759 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:29.990545 10978 raft_consensus.cc:2393] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 15: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
W20260709 12:25:29.993158 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.994901 10980 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 15.
I20260709 12:25:29.996191 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:29.998320 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:29.999115 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:29.999845 10978 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:30.000852 11059 raft_consensus.cc:1240] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:30.002141 11059 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:30.002058 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:30.002902 10977 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:25:29.984525 11056 pending_rounds.cc:107] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:25:30.003360 11056 raft_consensus.cc:2889] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:29.999780 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:30.009920 11056 raft_consensus.cc:1240] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 14. Current term is 15. Ops: []
W20260709 12:25:30.006675 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 86944.8us
I20260709 12:25:30.011374 10980 raft_consensus.cc:2410] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:25:29.986393 15967 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:30.012207 11059 raft_consensus.cc:1275] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:30.013197 10980 raft_consensus.cc:1240] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:25:30.014562 11054 raft_consensus.cc:1240] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:30.017378 10977 raft_consensus.cc:1240] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:30.019414 10980 raft_consensus.cc:1275] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:30.020619 11057 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 15.
I20260709 12:25:30.021826 10978 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:29.997028 16122 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:30.005112 15887 raft_consensus.cc:697] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:30.013959 16113 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:30.027024 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 80679.2us
I20260709 12:25:30.027890 10949 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:30.028069 11057 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 2101) took 2326 ms (client timeout 1707 ms). Trace:
W20260709 12:25:30.029397 11057 rpcz_store.cc:269] 0709 12:25:27.695170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.695336 (+   166us) service_pool.cc:224] Handling call
0709 12:25:28.532789 (+837453us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b1800010200. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8be1f646 00007f8f8bd5958e 00007f8f8bddaf9e 00007f8f8bddc7de 00007f8f8bde827c 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c
0709 12:25:29.959029 (+1426240us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b58008825d0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bd400aa 00007f8f8bdc2447 00007f8f8bddafe7 00007f8f8bddc7de 00007f8f8bde827c 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c
0709 12:25:30.021683 (+ 62654us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2078616704}
I20260709 12:25:30.020975 16069 raft_consensus.cc:2749] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:30.031461 10977 raft_consensus.cc:1275] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:25:30.022598 15651 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.031739 10980 raft_consensus.cc:1240] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:30.035578 10982 raft_consensus.cc:1240] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:30.041136 10981 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:25:30.027182 16122 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:30.032552 15785 raft_consensus.cc:2749] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:30.035001 15912 consensus_queue.cc:1059] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
W20260709 12:25:30.044675 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.046276 10948 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:30.047264 11645 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:30.047832 15651 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:30.049014 16024 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:30.049564 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:30.050360 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:30.050630 16156 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.049078 11681 raft_consensus.cc:1240] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:30.054953 15991 consensus_queue.cc:1059] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:30.058881 10980 raft_consensus.cc:1275] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:30.058640 15887 consensus_queue.cc:237] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:30.060599 15908 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:30.078706 16122 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:30.080513 15812 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:30.081471 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:30.082873 15912 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:30.082635 16024 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:30.083425 15912 raft_consensus.cc:697] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 15 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:30.084237 16156 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:30.072360 10948 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:30.073937 11678 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:30.084512 16069 consensus_queue.cc:1059] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:30.085752 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:30.067081 10949 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:30.075174 16029 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:30.104492 10981 raft_consensus.cc:3060] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:30.075075 15792 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:30.085016 16024 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:30.081511 15908 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
I20260709 12:25:30.119437 16123 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:30.123754 16123 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:30.084400 15912 consensus_queue.cc:237] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:30.125257 15705 raft_consensus.cc:3055] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:30.125789 15705 raft_consensus.cc:740] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:30.070644 16168 consensus_queue.cc:1059] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:25:30.128450 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:25:30.129031 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 110110us
I20260709 12:25:30.130494 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:30.126819 15705 consensus_queue.cc:260] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:30.134321 10980 raft_consensus.cc:2393] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 11: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:30.134795 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:30.135756 10982 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:30.110410 16029 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.139837 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:30.151407 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:30.151751 10981 raft_consensus.cc:1275] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:30.152477 10977 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:30.156472 11097 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:30.131641 16171 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:30.148092 16029 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:30.168474 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:30.172756 16119 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.173296 16119 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:30.174309 15908 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.177701 10977 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
W20260709 12:25:30.180044 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 107762us
I20260709 12:25:30.179039 10982 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 18.
I20260709 12:25:30.180766 10980 raft_consensus.cc:1240] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:30.181316 10948 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:30.162302 16171 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:30.181806 11097 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:30.174955 15908 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:30.175766 15967 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:30.179790 15792 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:30.184005 10977 raft_consensus.cc:1240] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:30.184710 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:30.188150 10981 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:30.185542 10982 raft_consensus.cc:1240] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 13. Current term is 14. Ops: []
W20260709 12:25:30.185885 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.183554 15785 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.191919 10948 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:30.176162 16024 consensus_queue.cc:1048] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:25:30.194466 10948 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:30.195166 15908 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:30.197010 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:30.197809 11125 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:25:30.199226 16179 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.199823 16179 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:30.202394 11060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:30.203050 11060 raft_consensus.cc:606] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:30.206640 16156 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:30.189759 15792 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:30.202399 16113 raft_consensus.cc:2804] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:30.208467 16113 raft_consensus.cc:697] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:30.209530 15792 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:30.209378 16113 consensus_queue.cc:237] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:30.201987 16179 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:30.207130 15785 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:30.184933 16171 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:30.211944 11053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52804 (request call id 740) took 1005 ms. Trace:
I20260709 12:25:30.217571 11678 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:30.225385 16074 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:30.226189 10980 raft_consensus.cc:1275] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:25:30.225565 15785 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:30.227175 16067 raft_consensus.cc:3055] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:30.227596 16067 raft_consensus.cc:740] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:30.228466 16067 consensus_queue.cc:260] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:30.229715 16067 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:30.210089 15792 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.230553 15792 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:30.232188 16078 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:30.232685 15792 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:30.225680 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 43958.4us
I20260709 12:25:30.236884 11097 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:30.238083 11097 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:30.220867 11053 rpcz_store.cc:276] 0709 12:25:29.206906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.220692 (+ 13786us) service_pool.cc:224] Handling call
0709 12:25:30.211783 (+991091us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54003011d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:30.211886 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":376070016}
I20260709 12:25:30.239180 11097 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:30.242262 11097 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:30.249974 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:30.250816 10982 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:30.250651 11097 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:30.255342 11097 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:30.255849 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:25:30.199827 16167 log.cc:927] Time spent T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:25:30.256418 16092 raft_consensus.cc:2749] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:30.227202 15785 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:30.262624 15785 raft_consensus.cc:697] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 14 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:30.211571 16179 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:30.248328 16142 raft_consensus.cc:2749] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:30.226123 16074 raft_consensus.cc:2749] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:30.253998 15829 raft_consensus.cc:2749] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:30.265779 10977 raft_consensus.cc:1240] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:30.263612 15785 consensus_queue.cc:237] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:30.265089 11053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:30.267393 11097 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:30.271677 11053 raft_consensus.cc:606] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:30.272063 11053 raft_consensus.cc:614] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:30.272908 10982 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:25:30.253358 15966 raft_consensus.cc:2749] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:30.273769 16092 raft_consensus.cc:2804] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:30.275151 16099 consensus_queue.cc:1048] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:30.275424 15583 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:30.211436 15864 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:30.277097 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:30.255008 16143 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:25:30.278367 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 252693us
I20260709 12:25:30.278066 11643 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:30.278590 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:25:30.291625 16174 log.cc:927] Time spent T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:25:30.295056 11053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:30.295717 11053 raft_consensus.cc:606] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:30.296078 11053 raft_consensus.cc:614] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:30.291989 10977 raft_consensus.cc:1275] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:30.270680 16142 raft_consensus.cc:2749] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:30.297936 10981 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:30.285797 16038 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.295130 15966 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:30.287070 16092 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:30.273939 16039 consensus_queue.cc:1059] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:25:30.307508 15966 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:30.308928 15992 raft_consensus.cc:3055] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:30.309413 15992 raft_consensus.cc:740] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:30.309887 15966 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:30.311317 16123 consensus_queue.cc:1059] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:25:30.285974 16094 consensus_queue.cc:1048] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:25:30.310642 16092 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:30.288295 15912 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:30.313931 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 119541us
I20260709 12:25:30.315442 10948 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:30.299333 16087 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:30.301517 16143 raft_consensus.cc:697] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 15 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:30.290158 15829 consensus_queue.cc:1059] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:25:30.321714 16126 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:30.322384 16123 raft_consensus.cc:3055] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:30.324775 10948 leader_election.cc:400] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 13. Current term is 14.
I20260709 12:25:30.327800 10948 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:30.328905 10948 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:30.331542 10984 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 693) took 1912 ms (client timeout 1913 ms). Trace:
I20260709 12:25:30.331835 11053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
W20260709 12:25:30.340967 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.322551 16170 raft_consensus.cc:3055] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:30.344223 11053 raft_consensus.cc:606] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:30.344157 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:25:30.332059 10984 rpcz_store.cc:269] 0709 12:25:28.414581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.426061 (+ 11480us) service_pool.cc:224] Handling call
0709 12:25:30.327148 (+1901087us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b540022b854. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:30.327295 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1004277632}
I20260709 12:25:30.346042 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:30.302896 16119 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:30.350513 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:30.351203 11134 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 18.
I20260709 12:25:30.352180 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:25:30.353401 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.353852 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:30.354770 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:30.355057 11673 raft_consensus.cc:1240] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:30.318338 16185 raft_consensus.cc:2749] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:30.307381 16175 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:25:30.358273 11675 raft_consensus.cc:1275] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:30.313304 16038 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:30.362596 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:30.364748 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:30.332345 16074 raft_consensus.cc:2749] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:30.358883 16010 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.330659 16087 raft_consensus.cc:697] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:30.330724 16123 raft_consensus.cc:740] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:30.342327 16029 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:30.347592 16170 raft_consensus.cc:740] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:30.425493 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:30.426204 15992 consensus_queue.cc:260] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:30.413971 15655 raft_consensus.cc:3055] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:30.427757 15655 raft_consensus.cc:740] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:30.426259 16170 consensus_queue.cc:260] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:30.428622 15655 consensus_queue.cc:260] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:30.403873 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.429983 16172 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.430569 16172 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:30.431232 16038 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:30.327068 15864 consensus_queue.cc:1048] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:25:30.429947 16170 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:30.376334 16143 consensus_queue.cc:237] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:30.421598 16066 consensus_queue.cc:1059] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:25:30.419422 16169 consensus_queue.cc:1059] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:25:30.346032 16179 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:30.414695 11128 raft_consensus.cc:1240] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:30.435369 16123 consensus_queue.cc:260] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:30.436839 16123 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:30.414427 11129 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:30.418011 11134 raft_consensus.cc:1240] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:30.417625 11126 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 13: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:30.417407 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:30.418449 11679 raft_consensus.cc:1240] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 14. Current term is 15. Ops: []
W20260709 12:25:30.422600 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.414005 16126 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.423179 16010 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:30.440788 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.441431 11672 raft_consensus.cc:2393] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 12: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:30.415479 15812 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.417529 15967 raft_consensus.cc:2749] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:30.320011 15912 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:30.416937 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.432883 15883 raft_consensus.cc:3055] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:30.446636 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:30.447499 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:30.448324 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:30.446887 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:30.448634 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:30.449167 11052 raft_consensus.cc:2393] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 14: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:30.448989 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:30.449721 11059 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 10.
I20260709 12:25:30.449817 11057 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 14.
I20260709 12:25:30.452121 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:30.450155 11025 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:30.432679 16172 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:30.452772 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:30.441552 15992 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:30.462178 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:30.431713 16029 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:30.459705 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:30.457332 16179 raft_consensus.cc:697] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 14 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:30.464484 16010 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:30.464346 16179 consensus_queue.cc:237] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:30.465411 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:30.466241  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:30.468255  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:30.469450  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:30.472267 16142 raft_consensus.cc:3055] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:30.472782 16142 raft_consensus.cc:740] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:30.473240 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:30.474541 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:30.475718 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:30.476871 16087 consensus_queue.cc:237] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:30.479661 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2654) took 1848 ms. Trace:
I20260709 12:25:30.480147 11132 rpcz_store.cc:276] 0709 12:25:28.631638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.012809 (+381171us) service_pool.cc:224] Handling call
0709 12:25:29.371551 (+358742us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:29.394001 (+ 22450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.479437 (+1085436us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b540012d250. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:30.479592 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":798991616}
I20260709 12:25:30.454275 15883 raft_consensus.cc:740] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:30.445724 16126 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:30.484129 15883 consensus_queue.cc:260] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:30.484920 11677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41762 (request call id 992) took 1075 ms. Trace:
I20260709 12:25:30.464278 11051 raft_consensus.cc:1275] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:25:30.486581 16185 raft_consensus.cc:3055] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:30.486975 16185 raft_consensus.cc:740] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:30.487071 16125 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:30.456430 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:30.488217 11128 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:30.487839 16185 consensus_queue.cc:260] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:30.489418 16185 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:30.460374 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:30.490564 11125 raft_consensus.cc:2393] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 14: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:30.490859 11132 raft_consensus.cc:1275] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:30.458612 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:30.473742 16142 consensus_queue.cc:260] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:30.454454 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:30.462972 15887 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:30.492509 11672 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:30.493160 11053 raft_consensus.cc:2393] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 15: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:30.494774 16171 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:30.485324 11677 rpcz_store.cc:276] 0709 12:25:29.409029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.411823 (+  2794us) service_pool.cc:224] Handling call
0709 12:25:30.484756 (+1072933us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b5400500fd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:30.484860 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":579836544}
W20260709 12:25:30.485553 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:30.497821 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.492033 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:30.501052 11126 raft_consensus.cc:2393] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 13: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:30.501533 16021 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:30.506870 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 2160) took 1284 ms. Trace:
I20260709 12:25:30.508503 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:30.509317 10976 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:30.508582 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:30.511353 11128 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 18.
I20260709 12:25:30.516275 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:30.518034 10982 raft_consensus.cc:1275] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:25:30.518522 10982 pending_rounds.cc:85] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 9
I20260709 12:25:30.518733 10982 pending_rounds.cc:107] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:25:30.518950 10982 raft_consensus.cc:2889] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:30.521962 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:30.507316 11127 rpcz_store.cc:276] 0709 12:25:29.222286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.596151 (+373865us) service_pool.cc:224] Handling call
0709 12:25:29.626864 (+ 30713us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:30.075271 (+448407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:30.075299 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:30.075338 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:30.075366 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.506621 (+431255us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b5400066654. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:30.506668 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:30.506804 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1749,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"spinlock_wait_cycles":1026421248}
I20260709 12:25:30.454569 15812 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:30.529018 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 67187.1us
I20260709 12:25:30.529806 11060 raft_consensus.cc:2368] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 11. Current term is 12.
I20260709 12:25:30.530603 11644 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:30.536679 10976 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
I20260709 12:25:30.537567 11672 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 14.
W20260709 12:25:30.521826 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.556547 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:30.556689 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:30.485453 15883 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:30.550164 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:30.561305 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:30.561545 11053 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 14.
I20260709 12:25:30.560461 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:30.554620 16082 raft_consensus.cc:3055] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:30.564289 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:30.555553 16126 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:30.556403 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:25:30.548184 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.557928 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:30.568248 10983 raft_consensus.cc:2393] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 13: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
W20260709 12:25:30.558540 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 47314us
W20260709 12:25:30.559263 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 46472us
I20260709 12:25:30.569890 11126 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 13: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:30.559801 16021 raft_consensus.cc:2804] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:30.492589 15887 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.560906 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:30.560539 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:30.563609 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:30.569067 11645 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:30.575997 11051 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 9.
I20260709 12:25:30.577391 10984 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:25:30.564263 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:30.577773 10984 pending_rounds.cc:85] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 11
I20260709 12:25:30.565479 11054 raft_consensus.cc:2393] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 14: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:30.572657 11098 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:30.578394 10984 pending_rounds.cc:107] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:25:30.578820 10984 raft_consensus.cc:2889] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:30.578198 11128 raft_consensus.cc:2393] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 11: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:30.583290 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:30.584082 10981 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:30.585484 10981 raft_consensus.cc:1275] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:30.586606 16138 raft_consensus.cc:2749] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:30.587877 15864 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:30.588472 15864 raft_consensus.cc:697] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:30.589372 15864 consensus_queue.cc:237] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:30.590314 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 60551.3us
I20260709 12:25:30.593259 15912 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:30.594082 11023 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:30.594966 16171 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:30.596835 16021 raft_consensus.cc:697] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:30.597864 16021 consensus_queue.cc:237] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:30.598866 16119 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:30.602571 11023 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:30.583491 10983 raft_consensus.cc:1275] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:25:30.604444 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 51186.9us
I20260709 12:25:30.605176 11024 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:30.577119 15887 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:30.608843 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:30.611614 10979 raft_consensus.cc:1275] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:25:30.612440 11024 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:30.565842 16082 raft_consensus.cc:740] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:30.556856 16029 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 12:25:30.613389 10975 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 13.
I20260709 12:25:30.654011 11024 leader_election.cc:400] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12.
I20260709 12:25:30.549503 16172 consensus_queue.cc:1059] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.056s
W20260709 12:25:30.651841 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 49354.9us
I20260709 12:25:30.661091 11098 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:30.666045 11024 leader_election.cc:403] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:25:30.604990 16092 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:30.674258 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 321301us
I20260709 12:25:30.676669 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:30.677330 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:30.679108 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:30.681669 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:30.683940 10948 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:30.601953 16110 consensus_queue.cc:1059] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:25:30.692437 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:30.693786 11129 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
W20260709 12:25:30.612197 16190 log.cc:927] Time spent T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:25:30.564950 16134 consensus_queue.cc:1048] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:25:30.611088 16038 raft_consensus.cc:2804] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:30.661154 16056 consensus_queue.cc:1048] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:25:30.650988 15812 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:30.654275 16109 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:30.653095 16188 raft_consensus.cc:2804] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:30.663237 16171 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.651949 16175 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:30.660915 16133 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:30.703853 10948 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:30.701630 11672 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:30.701722 15904 consensus_queue.cc:1059] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:25:30.719447 11058 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
I20260709 12:25:30.659020 16114 consensus_queue.cc:1059] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:25:30.659705 16099 consensus_queue.cc:1059] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:25:30.708215 16185 raft_consensus.cc:2749] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:30.725929 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:30.727468 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:30.729077 11129 raft_consensus.cc:1240] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 15 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:30.729954 11134 raft_consensus.cc:1240] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:30.730505 16171 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:30.731271 11125 raft_consensus.cc:1240] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 12:25:30.697924 16113 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:30.706573 16175 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.703467 16139 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12.
I20260709 12:25:30.735237 16133 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:30.808149 16133 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:30.659384 16039 consensus_queue.cc:1048] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:25:30.740897 11127 raft_consensus.cc:1240] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:30.810333 11127 raft_consensus.cc:1275] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:25:30.811560 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:30.741640 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:30.611202 16094 consensus_queue.cc:1059] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 12:25:30.717334 15887 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:30.703141 11023 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:30.815099 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 112032us
I20260709 12:25:30.769804 11055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 739) took 1589 ms. Trace:
W20260709 12:25:30.770908 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 495334us
I20260709 12:25:30.816632 11097 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:30.817127 11023 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:30.773699 11025 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:30.624399 16126 consensus_queue.cc:1059] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 12:25:30.776468 11098 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:30.780697 16188 raft_consensus.cc:697] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:30.751847 16038 raft_consensus.cc:697] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:30.775177 16138 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.802198 15966 raft_consensus.cc:3055] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:30.784086 15785 raft_consensus.cc:2749] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:30.816279 11055 rpcz_store.cc:276] 0709 12:25:29.180750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.197934 (+ 17184us) service_pool.cc:224] Handling call
0709 12:25:29.214182 (+ 16248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:29.261803 (+ 47621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:29.261833 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:29.261876 (+    43us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:29.261909 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.768761 (+1506852us) spinlock_profiling.cc:243] Waited 47.4 ms on lock 0x7b54001879d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:30.769551 (+   790us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:30.769727 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109006080}
W20260709 12:25:30.831634 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:30.780965 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 77199.9us
W20260709 12:25:30.832782 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 178909us
W20260709 12:25:30.834256 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 61455.7us
I20260709 12:25:30.834753 11024 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:30.836817 10948 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:30.822726 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:30.826339 11672 raft_consensus.cc:1240] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:25:30.838364 11128 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:25:30.796367 16175 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:30.823496 15570 raft_consensus.cc:2804] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:30.824718 16039 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:30.826843 16133 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 12:25:30.847886 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:30.848613 10978 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:30.849047 11024 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:30.849893 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:30.850731 10981 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 9.
I20260709 12:25:30.829663 15966 raft_consensus.cc:740] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:30.835502 16139 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:30.856295 11644 leader_election.cc:400] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 11. Current term is 12.
I20260709 12:25:30.840607 16078 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:30.837145 16099 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:30.857523 11097 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:30.861150 10949 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:30.870867 11644 leader_election.cc:403] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:25:30.828850 16143 consensus_queue.cc:1059] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:25:30.859117 11643 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:30.878414 11643 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:30.879878 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:30.874330 11644 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:30.830715 16138 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:30.875470 11025 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:30.885200 10978 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:30.882050 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:30.837774 16109 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:25:30.881764 11644 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:30.857343 16129 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:30.840087 15435 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:25:30.890561 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:30.894191 10981 raft_consensus.cc:2393] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 17: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:30.870577 16139 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.845103 16172 raft_consensus.cc:2749] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:30.885788 16029 raft_consensus.cc:2804] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:30.852620 16170 consensus_queue.cc:1048] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:25:30.846998 16179 consensus_queue.cc:1059] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:25:30.871749 15864 consensus_queue.cc:1048] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:25:30.894347 15966 consensus_queue.cc:260] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:30.924396 15966 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:30.924938 15887 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 19 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:30.872594 16039 raft_consensus.cc:697] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:30.895983 16185 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:30.862900 15570 raft_consensus.cc:697] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:30.882788 16134 raft_consensus.cc:2804] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:30.886766 16087 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:30.886057 16099 raft_consensus.cc:697] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:30.891333 16050 consensus_queue.cc:1048] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:25:30.868713 16126 consensus_queue.cc:1059] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:25:30.906090 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:30.891314 16130 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:25:30.886250 16056 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:30.852614 16038 consensus_queue.cc:237] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:30.871884 16197 consensus_queue.cc:1059] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:25:30.914412 11023 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:30.914763 10981 raft_consensus.cc:1275] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:25:30.915290 16140 consensus_queue.cc:1048] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:30.901654 16029 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:30.902572 16168 raft_consensus.cc:2749] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:30.893957 16129 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:30.916844 15705 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:30.966974 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 80339us
W20260709 12:25:30.920868 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 84131.2us
I20260709 12:25:30.922689 15651 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:30.923030 16133 raft_consensus.cc:2804] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:30.876587 16021 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:30.926362 16039 consensus_queue.cc:237] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:30.878592 16125 consensus_queue.cc:1048] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:25:30.932096 10949 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:30.937299 16209 consensus_queue.cc:1059] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:25:30.938119 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 64307.1us
I20260709 12:25:30.978919 11097 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:30.900362 16139 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:30.938182 16123 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.939844 16099 consensus_queue.cc:237] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:30.942304 16134 raft_consensus.cc:697] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:30.950971 11132 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:30.922748 16138 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:30.960777 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 50368.5us
W20260709 12:25:30.962997 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 48700.6us
I20260709 12:25:30.881508 16188 consensus_queue.cc:237] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:30.965579 11058 raft_consensus.cc:1275] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:30.887379 15785 raft_consensus.cc:2764] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
W20260709 12:25:30.965683 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 83992.3us
I20260709 12:25:30.977126 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:30.971119 10948 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:30.959784 16029 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:30.994081 11054 raft_consensus.cc:1275] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:25:30.994270 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:31.008539 11052 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:30.967419 16121 raft_consensus.cc:2804] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:30.999382 11023 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:30.968961 16129 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:31.058503 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 53465.4us
I20260709 12:25:30.965867 16171 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:30.980012 16133 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.006776 11644 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:30.989143 16213 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:31.000185 16170 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:31.026566 11132 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 19.
I20260709 12:25:31.094623 10984 raft_consensus.cc:1240] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 15. Current term is 16. Ops: []
W20260709 12:25:31.059438 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 127393us
I20260709 12:25:30.994937 15570 consensus_queue.cc:237] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:31.097333 10983 raft_consensus.cc:1240] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:30.979499 16185 consensus_queue.cc:1048] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:25:31.101101 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:31.095981 10980 raft_consensus.cc:3055] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:31.132817 10980 raft_consensus.cc:740] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:30.985069 16179 consensus_queue.cc:1048] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 12:25:31.058163 16121 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.073974 15651 raft_consensus.cc:2804] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:31.090859 16133 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:31.073638 16078 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:31.222111 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:30.994652 16123 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:31.195724 11672 raft_consensus.cc:1240] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
W20260709 12:25:31.253666 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.094816 16126 raft_consensus.cc:2804] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:31.263329 11098 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:31.202788 11053 pending_rounds.cc:85] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting all ops after (but not including) 10
I20260709 12:25:31.264710 11053 pending_rounds.cc:107] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:25:31.204106 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:31.204350 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 197658us
I20260709 12:25:31.205628 16067 raft_consensus.cc:3055] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:31.214002 16134 consensus_queue.cc:237] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:31.273192 11130 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 2676) took 1854 ms (client timeout 2220 ms). Trace:
I20260709 12:25:31.250962 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:31.251763 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:31.265044 11053 raft_consensus.cc:2889] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:31.091765 16168 consensus_queue.cc:1048] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.126s
I20260709 12:25:31.258368 10980 consensus_queue.cc:260] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:31.098322 16113 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:31.287633 11060 raft_consensus.cc:1240] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:31.314985 11055 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 13.
I20260709 12:25:31.244931 11097 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:31.317994 11677 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:31.190773 16121 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:31.323741 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.317727 11674 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:25:31.336345 10980 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:31.337482 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 366427us
W20260709 12:25:31.319087 11130 rpcz_store.cc:269] 0709 12:25:29.399335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.401015 (+  1680us) service_pool.cc:224] Handling call
0709 12:25:31.253405 (+1852390us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b5400030a54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:31.253554 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":387495680}
I20260709 12:25:31.155742 16171 raft_consensus.cc:2804] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:31.338328 10948 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:31.367444 16197 raft_consensus.cc:2749] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:31.407838 16214 raft_consensus.cc:2749] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:31.409834 11060 raft_consensus.cc:1240] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:25:31.404449 16139 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:31.261615 16208 consensus_queue.cc:1048] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.150s
I20260709 12:25:31.156790 16213 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:31.367715 16211 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:31.409492 11057 raft_consensus.cc:1240] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:31.273554 15651 raft_consensus.cc:697] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:31.320762 15883 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.273233 16067 raft_consensus.cc:740] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:31.323879 15815 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:31.340139 16171 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:31.392372 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 130533us
I20260709 12:25:31.478814 11677 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 19.
I20260709 12:25:31.361171 11130 raft_consensus.cc:1275] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:31.348635 15705 consensus_queue.cc:1059] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 12:25:31.417888 10980 raft_consensus.cc:1275] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:31.222311 15966 raft_consensus.cc:3055] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:25:31.425685 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 87076.3us
I20260709 12:25:31.371447 16113 consensus_queue.cc:1048] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:25:31.420969 15992 raft_consensus.cc:3055] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:31.484483 11051 raft_consensus.cc:1240] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:25:31.480191 11024 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:31.491899 10948 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:31.492177 11130 raft_consensus.cc:1240] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:31.493269 10948 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:31.470842 16099 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:31.450646 16221 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:31.496913 11130 raft_consensus.cc:1275] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
W20260709 12:25:31.501322 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 256477us
I20260709 12:25:31.501262 10948 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:31.500623 16069 raft_consensus.cc:2749] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:31.503355 16069 consensus_queue.cc:1048] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:31.504747 16029 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:31.485162 16171 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:31.497342 16179 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:31.509114 10948 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:31.510572 11097 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:31.494204 16039 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.494941 15966 raft_consensus.cc:740] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:31.476837 15883 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:31.494576 15992 raft_consensus.cc:740] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:31.500996 16221 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.485208 16125 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.519235 10948 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
W20260709 12:25:31.515372 16207 log.cc:927] Time spent T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.313s	user 0.001s	sys 0.000s
I20260709 12:25:31.511799 15705 consensus_queue.cc:1243] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 12:25:31.521953 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 426424us
I20260709 12:25:31.508324 16099 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:31.513566 16069 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:31.515081 16078 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:31.528515 10949 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:31.526443 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.533707 16029 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:31.536568 16219 consensus_queue.cc:1048] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:25:31.533591 11060 raft_consensus.cc:1275] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:25:31.518128 16222 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.533589 11057 raft_consensus.cc:1275] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:25:31.518765 16123 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:31.474479 16211 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:31.515337 15815 consensus_queue.cc:1048] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:25:31.521836 16221 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:31.550256 11059 raft_consensus.cc:3055] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:31.569901 11059 raft_consensus.cc:740] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:31.519381 16039 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:31.531914 16126 raft_consensus.cc:697] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
W20260709 12:25:31.572939 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 44516.2us
I20260709 12:25:31.538694 15991 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.538802 16078 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.526304 16224 raft_consensus.cc:2749] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:31.570824 11059 consensus_queue.cc:260] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:31.542743 15705 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.531807 16137 raft_consensus.cc:3055] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:31.580217 16126 consensus_queue.cc:237] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:31.582966 11059 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:31.577474 10949 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:31.567813 16222 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:31.545964 16113 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:31.584867 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.531889 16067 consensus_queue.cc:260] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:31.519548 15651 consensus_queue.cc:237] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:31.525264 16125 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:31.540544 16197 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:25:31.603420 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.614954 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60928 (request call id 712) took 1108 ms. Trace:
I20260709 12:25:31.630409 10975 rpcz_store.cc:276] 0709 12:25:30.506487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.512997 (+  6510us) service_pool.cc:224] Handling call
0709 12:25:31.614793 (+1101796us) spinlock_profiling.cc:243] Waited 45.8 ms on lock 0x7b54001a1154. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:31.614894 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105344384}
W20260709 12:25:31.604507 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 85320.4us
I20260709 12:25:31.586385 16078 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:31.602824 16238 raft_consensus.cc:2804] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:31.635273 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:31.591670 15705 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:31.637485 11059 raft_consensus.cc:1275] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 12:25:31.637957 11059 pending_rounds.cc:85] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting all ops after (but not including) 11
I20260709 12:25:31.605361 16231 consensus_queue.cc:1048] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 12:25:31.590270 16137 raft_consensus.cc:740] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:25:31.619292 16129 consensus_meta.cc:287] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.520s	user 0.009s	sys 0.001s
I20260709 12:25:31.620755 16139 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:31.621589 16222 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:31.622133 16224 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:31.583029 16235 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:31.605836 16113 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:31.651808 15705 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:31.641718 15864 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:31.654701 15864 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:31.655264 11681 raft_consensus.cc:1275] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:31.576010 15992 consensus_queue.cc:260] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:31.655546 16113 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:31.625725 16170 consensus_meta.cc:287] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.520s	user 0.009s	sys 0.000s
I20260709 12:25:31.613543 11131 raft_consensus.cc:1275] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:31.656126 15992 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:31.657544 11131 raft_consensus.cc:1275] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:25:31.634344 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 56985.9us
I20260709 12:25:31.658707 16137 consensus_queue.cc:260] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:31.659456 10949 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:31.627784 15883 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:31.638470 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.629403 15655 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:31.609184 16087 consensus_meta.cc:287] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.670s	user 0.008s	sys 0.001s
I20260709 12:25:31.582638 15966 consensus_queue.cc:260] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:31.586725 15991 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:31.676713 16170 raft_consensus.cc:2749] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:31.680797 15991 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:31.681135 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.598829 16218 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 12:25:31.616182 16211 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:31.650743 16239 raft_consensus.cc:2749] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:31.618422 16067 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:31.654131 16213 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:31.658847 11131 raft_consensus.cc:1275] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:25:31.638281 11059 pending_rounds.cc:107] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 12:25:31.791465 11059 raft_consensus.cc:2889] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:31.635840 16238 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.669898 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:31.644390 11680 raft_consensus.cc:1275] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:31.682868 11056 raft_consensus.cc:1275] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:31.650507 16234 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:31.687740 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:31.689020 16170 raft_consensus.cc:2749] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:31.651822 16010 raft_consensus.cc:993] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7: : Instructing follower bc01179655564f29b83babe396377cbb to start an election
I20260709 12:25:31.714871 10948 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:31.659403 16069 raft_consensus.cc:2749] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:31.679054 16087 raft_consensus.cc:2749] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:31.795786 11057 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:31.792822 11672 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:31.794863 16238 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:31.689175 16039 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:31.801542 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:31.798838 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:31.639926 16197 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:31.649130 16129 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:31.695271 16235 raft_consensus.cc:2749] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:31.809123 11056 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 15.
I20260709 12:25:31.642733 16133 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:31.819442 15815 consensus_queue.cc:1048] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:25:31.822748 16171 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:31.820009 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:31.824921 16171 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:31.820775 16069 raft_consensus.cc:2749] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:31.831491 16121 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:31.832016 16233 log.cc:927] Time spent T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:25:31.835098 16179 raft_consensus.cc:2749] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:31.838341 16220 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 12:25:31.840521 16082 consensus_queue.cc:260] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:31.841322 11057 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 15.
I20260709 12:25:31.806432 15651 raft_consensus.cc:1081] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 LEADER]: Signalling peer bc01179655564f29b83babe396377cbb to start an election
I20260709 12:25:31.833827 16121 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:31.804952 16218 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.856637 16218 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:31.859046 16218 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:31.809353 16213 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 12:25:31.852689 16197 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:31.811309 16239 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.863411 11644 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:31.661168 16224 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:31.864028 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 204644us
W20260709 12:25:31.859905 16180 log.cc:927] Time spent T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 1.505s	user 0.006s	sys 0.000s
I20260709 12:25:31.869464 10949 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:31.874024 16142 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:31.882717 16133 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:31.883570 16094 raft_consensus.cc:3055] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:31.884018 16094 raft_consensus.cc:740] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:31.884902 16094 consensus_queue.cc:260] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:31.889417 16175 consensus_meta.cc:287] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 1.041s	user 0.000s	sys 0.011s
I20260709 12:25:31.895676 10949 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:31.885898 16094 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:31.924569 11643 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:31.927897 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:31.931970 10976 raft_consensus.cc:1240] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:25:31.934152 10976 raft_consensus.cc:1240] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:31.935907 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:31.936537 10976 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:25:31.938019 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:31.938776 11134 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 9.
I20260709 12:25:31.940440 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:31.941944 10980 raft_consensus.cc:1240] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:31.871538 16218 raft_consensus.cc:2804] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:31.945648 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:31.948133 10980 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:31.802567 16234 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:31.951251 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.952288 10981 raft_consensus.cc:1240] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 12:25:31.951071 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:31.937783 15785 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:31.938853 16235 raft_consensus.cc:2749] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:31.889979 16175 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:31.977175 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:31.977836 16175 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:31.978513 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:31.979013 16129 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:31.979167 10979 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:31.929208 16197 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:31.979887 16197 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:31.980299 16092 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:31.950449 16133 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:31.980883 16241 raft_consensus.cc:2749] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:31.961851 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:31.982882 10980 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 9.
I20260709 12:25:31.943931 16179 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:31.959934 10984 raft_consensus.cc:1275] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:25:31.967056 16039 consensus_queue.cc:1059] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:31.988071 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:31.973793 16224 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:31.928092 16221 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:31.975486 16021 consensus_meta.cc:287] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.992s	user 0.007s	sys 0.004s
I20260709 12:25:31.920607 16239 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:31.992973 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:31.980371 10979 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:31.961733 15785 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:31.995090 11133 raft_consensus.cc:1275] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:25:31.997175 15785 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:31.999065 16238 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:32.000631 11025 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 2.220s (SENT) [suppressed 16 similar messages]
I20260709 12:25:31.958187 16218 raft_consensus.cc:697] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:31.985154 11024 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:32.003995 11024 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:31.986795 11097 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:32.007491 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:32.008601 10975 raft_consensus.cc:1240] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:25:32.011394 11097 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:32.013037 11133 raft_consensus.cc:1275] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:25:32.015072 11097 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:32.018934 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:31.949846 16082 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:31.988124 10980 raft_consensus.cc:1240] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:31.972455 16056 raft_consensus.cc:3055] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:31.972254 16234 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:31.990268 10981 raft_consensus.cc:1240] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:32.023016 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:32.023140 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:32.023818 11125 raft_consensus.cc:2393] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 13: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:32.024430 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:32.024668 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:31.992471 16211 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.025298 11125 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:32.025060 10981 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:25:32.026428 16092 raft_consensus.cc:2804] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:32.026885 16092 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.027340 16092 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:32.013234 16039 raft_consensus.cc:2804] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:32.030807 16039 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:32.030362 11674 raft_consensus.cc:1240] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:32.031503 16211 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:32.032055 16197 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:32.034343 16211 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:32.019393 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 719) took 1503 ms. Trace:
I20260709 12:25:32.035053 11128 raft_consensus.cc:1275] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:32.037017 15864 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:32.031211 16039 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:32.039063 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:32.040241 16218 consensus_queue.cc:237] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:32.042289 16242 log.cc:927] Time spent T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.221s	user 0.000s	sys 0.002s
I20260709 12:25:32.045285 16138 raft_consensus.cc:3055] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:32.045745 16138 raft_consensus.cc:740] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:31.989503 16219 consensus_queue.cc:1059] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:25:32.046916 16219 raft_consensus.cc:3055] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:32.046593 16138 consensus_queue.cc:260] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:32.047919 16138 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:31.989961 16179 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:32.050118 16179 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:32.003204 16021 raft_consensus.cc:2749] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 11. Current term is 12.
W20260709 12:25:32.051046 16074 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 12:25:32.053202 16221 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:32.062326 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:32.063604 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:32.030340 16209 raft_consensus.cc:2804] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:32.064539 16209 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.017133 16224 consensus_queue.cc:1059] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:25:32.064955 16209 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:32.065325 16224 raft_consensus.cc:3055] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:32.065726 16224 raft_consensus.cc:740] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:32.066645 16143 consensus_queue.cc:1059] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:32.067526 16113 raft_consensus.cc:3055] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:32.034972 10977 rpcz_store.cc:276] 0709 12:25:30.515548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.515711 (+   163us) service_pool.cc:224] Handling call
0709 12:25:30.516068 (+   357us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:30.516453 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:30.516481 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:30.538673 (+ 22192us) log.cc:844] Serialized 52 byte log entry
0709 12:25:30.700376 (+161703us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:30.781664 (+ 81288us) log.cc:844] Serialized 14 byte log entry
0709 12:25:30.787619 (+  5955us) log.cc:844] Serialized 14 byte log entry
0709 12:25:30.787899 (+   280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.787968 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:31.998799 (+1210831us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b18002d6c40. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cf73f3 00007f8f88cf97c1 00007f8f88cf9779 00007f8f88cf9709 00007f8f88cf96d1 00007f8f88cf89cd 0000000000388634 0000000000388479 00007f8f88cda83a
0709 12:25:32.019143 (+ 20344us) raft_consensus.cc:1685] finished
0709 12:25:32.019172 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:32.019332 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1910,"prepare.queue_time_us":83416,"raft.queue_time_us":1413,"raft.run_cpu_time_us":404,"raft.run_wall_time_us":46119,"spinlock_wait_cycles":62001280,"thread_start_us":93402,"threads_started":1,"wal-append.queue_time_us":217336}
W20260709 12:25:32.068490 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.066537 16224 consensus_queue.cc:260] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:32.069288 10977 raft_consensus.cc:1240] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:25:32.069736 15829 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.067950 16113 raft_consensus.cc:740] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:32.026862 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:32.072129 16239 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:32.013118 15655 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:32.073848 10982 raft_consensus.cc:1240] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:25:32.020463 11133 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:32.098558 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:32.099270 11051 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:32.075553 10980 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:25:32.098927 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:32.076824 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:32.040277 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:32.101054 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:32.101415 11129 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:32.104542 11125 raft_consensus.cc:2393] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 9: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:32.019073 11097 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:25:32.105523 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 86519.6us
I20260709 12:25:32.106729 11133 raft_consensus.cc:2393] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 13: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:32.047319 16219 raft_consensus.cc:740] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:32.084048 11678 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
W20260709 12:25:31.987290 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 272521us
I20260709 12:25:32.092490 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:32.012822 16129 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:32.115160 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:32.083294 11677 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:32.075116 16056 raft_consensus.cc:740] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
W20260709 12:25:32.095849 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 95258.9us
I20260709 12:25:32.122978 11672 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:25:32.136272 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:32.174408 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:32.115453 16197 raft_consensus.cc:2804] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:32.115063 15655 raft_consensus.cc:697] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:32.094998 15829 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:32.123026 16129 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.130549 16074 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.184060 10980 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
W20260709 12:25:32.176852 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.196485 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:32.205229 11681 raft_consensus.cc:2368] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 9. Current term is 10.
I20260709 12:25:32.207647 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:32.208418 10981 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:25:32.220232 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:32.221153 10980 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 16.
I20260709 12:25:32.176273 11129 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:25:32.123155 16067 consensus_queue.cc:1048] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 12:25:32.123016 16221 consensus_queue.cc:1048] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 12:25:32.242134 10979 raft_consensus.cc:1275] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:32.122946 16234 consensus_queue.cc:1059] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 12:25:32.244756 11125 raft_consensus.cc:1275] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:32.249128 11097 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:32.209098 16129 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:32.196934 16197 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:32.198022 15651 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.195215 16143 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:32.231393 16126 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.005s	sys 0.010s
I20260709 12:25:32.246812 16239 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.239892 16074 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:32.261762 16126 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.005s	sys 0.010s
I20260709 12:25:32.258029 16197 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:32.278146 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.261644 15864 raft_consensus.cc:3055] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:25:32.283811 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.285485 11132 raft_consensus.cc:1240] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:32.286274 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:32.287094 11059 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 13.
I20260709 12:25:32.291785 16179 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.272372 16143 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:32.314146 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 65094.3us
I20260709 12:25:32.239039 16113 consensus_queue.cc:260] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:32.240356 16056 consensus_queue.cc:260] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:32.240075 16219 consensus_queue.cc:260] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:32.332705 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 54630.2us
I20260709 12:25:32.284641 15864 raft_consensus.cc:740] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:25:32.337347 16253 log.cc:927] Time spent T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 12:25:32.337675 16248 log.cc:927] Time spent T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 12:25:32.339813 16074 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:32.323817 16078 consensus_meta.cc:287] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.671s	user 0.008s	sys 0.006s
I20260709 12:25:32.342561 16078 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:32.344934 16078 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:32.353134 15829 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:32.353806 15829 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.354324 15829 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:32.355695 16094 consensus_queue.cc:1048] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:32.356472 15829 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:32.314884 16126 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:32.358387 16126 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:32.358794 16126 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:32.274597 16092 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:32.362254 11134 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:32.362862 16219 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:32.364177 15864 consensus_queue.cc:260] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:32.365240 10984 raft_consensus.cc:1275] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:25:32.268672 15651 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:32.276899 16239 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:32.375166 10977 raft_consensus.cc:1240] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:25:32.365437 15864 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:32.334771 15570 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.362448 16113 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:32.294322 15655 consensus_queue.cc:237] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:32.314389 16179 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:32.409328 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.392820 11133 raft_consensus.cc:2410] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:25:32.400790 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:32.411300 11672 raft_consensus.cc:2410] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:25:32.369590 16133 raft_consensus.cc:2749] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:32.370827 16094 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:32.405110 16245 log.cc:927] Time spent T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.575s	user 0.000s	sys 0.002s
I20260709 12:25:32.433139 11051 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:25:32.419358 15435 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.419512 16264 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.394764 16143 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:32.410162 16092 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:32.432727 16265 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.444458 11675 raft_consensus.cc:1240] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:32.390749 16209 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:32.451630 15651 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:32.444716 15435 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:32.454311 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.387954 15570 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:32.457989 16265 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:32.460575 16265 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:32.462935 16039 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:32.463691 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 865) took 1460 ms. Trace:
I20260709 12:25:32.446273 16264 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:32.426527 16094 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:32.467670 16094 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:32.468920 16179 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:32.470000 16039 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:32.470728 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:32.471401 11672 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 17.
I20260709 12:25:32.472198 16238 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:32.460286 16197 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:32.474336 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2698) took 1576 ms. Trace:
I20260709 12:25:32.474727 11132 rpcz_store.cc:276] 0709 12:25:30.897887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.130617 (+232730us) service_pool.cc:224] Handling call
0709 12:25:31.130936 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:32.286000 (+1155064us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:32.474081 (+188081us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400373a54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:32.474277 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2654655872}
I20260709 12:25:32.469879 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:32.458186 15570 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:32.454190 15887 consensus_queue.cc:1059] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:25:32.477210 16129 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:32.463138 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:32.482456 11643 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:32.483893 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:32.464152 11130 rpcz_store.cc:276] 0709 12:25:31.002977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.507859 (+504882us) service_pool.cc:224] Handling call
0709 12:25:31.508933 (+  1074us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:31.518378 (+  9445us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:25:31.601544 (+ 83166us) log.cc:844] Serialized 14 byte log entry
0709 12:25:31.796244 (+194700us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:31.808464 (+ 12220us) log.cc:844] Serialized 26 byte log entry
0709 12:25:31.808615 (+   151us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:31.808664 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:31.809869 (+  1205us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:32.404460 (+594591us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:25:32.463344 (+ 58884us) raft_consensus.cc:1685] finished
0709 12:25:32.463450 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:32.463625 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":939,"prepare.queue_time_us":126908,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":13749,"raft.queue_time_us":6495,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":10549,"spinlock_wait_cycles":36245248,"thread_start_us":223549,"threads_started":2,"wal-append.queue_time_us":194437}
I20260709 12:25:32.490285 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:32.491079 11132 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 17.
I20260709 12:25:32.478338 15887 raft_consensus.cc:3055] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:32.494239 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:32.494530 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:32.493736 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:32.495157 10980 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:32.492108 16133 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:32.496404 16133 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:32.496786 16133 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:32.497716 16129 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:32.498518 16024 consensus_queue.cc:1048] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:25:32.503149 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.484050 16209 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:32.511499 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 61928.7us
I20260709 12:25:32.513456 11025 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:32.516681 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:32.517411 10981 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:32.518337 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:32.518967 10981 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:32.520419 11097 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:25:32.520956 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.521674 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:32.493877 15887 raft_consensus.cc:740] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:32.522970 11097 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:25:32.538450 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.539299 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:32.541163 10980 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:25:32.513147 16056 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:32.546960 11025 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:32.546142 10981 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:32.547391 11097 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:32.548341 16138 raft_consensus.cc:2804] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:32.528100 15570 raft_consensus.cc:2749] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:32.537425 16129 consensus_queue.cc:1048] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:25:32.528347 16067 raft_consensus.cc:2804] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:32.541550 16114 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:32.519083 16265 consensus_queue.cc:1059] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:25:32.540215 16209 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.566501 11025 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:32.566614 16138 raft_consensus.cc:697] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:32.557586 16238 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.576864 11025 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:32.567348 16269 consensus_queue.cc:1048] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:25:32.588017 11025 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:32.570457 16114 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.589188 16114 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:32.590165 16265 raft_consensus.cc:2804] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:32.577167 16209 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:32.590655 15651 consensus_queue.cc:1059] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:32.568200 16038 raft_consensus.cc:2804] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:32.591758 16038 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.592116 16038 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:32.592316 11053 raft_consensus.cc:1240] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:25:32.593092 16138 consensus_queue.cc:237] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:32.564256 16067 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.596371 15815 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.596963 15815 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:32.577477 16039 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.598768 16039 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:32.600263 15815 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:32.591287 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:32.601994 15570 raft_consensus.cc:2804] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:32.602517 15570 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.590783 16265 raft_consensus.cc:697] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:32.603794 16238 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:32.604045 16265 consensus_queue.cc:237] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:32.601032 16039 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:32.601591 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:32.607686 11053 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:32.606738 16238 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:32.602624 11052 raft_consensus.cc:2368] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 15. Current term is 16.
I20260709 12:25:32.611455 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:32.611970 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:32.612829 11127 raft_consensus.cc:2410] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:25:32.602910 15570 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:32.575553 15887 consensus_queue.cc:260] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:32.615988 15887 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:32.616989 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:32.621079 11053 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:25:32.592444 16209 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:32.624101 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:32.624822 10977 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 15.
I20260709 12:25:32.625890 10977 raft_consensus.cc:3055] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:32.626802 11097 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:32.626940 10977 raft_consensus.cc:740] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:32.627825 16209 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:32.628265 16209 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.628590 16209 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:32.630975 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:32.631675 11672 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 13.
W20260709 12:25:32.635419 16244 log.cc:927] Time spent T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.806s	user 0.003s	sys 0.007s
I20260709 12:25:32.631978 10977 consensus_queue.cc:260] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:32.574066 15435 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:32.638978 10977 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:32.643908 16125 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:32.645977 11673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41784 (request call id 822) took 1013 ms. Trace:
I20260709 12:25:32.646622 16126 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:32.647775 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:32.648991 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.590344 15364 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:32.623133 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:32.650837 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:32.655707 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:32.656454 11131 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 16.
I20260709 12:25:32.660781 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:32.661926 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:32.649650 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:32.669785 11025 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:32.582312 10981 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:32.684691 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:32.685134 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:32.684681 11097 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:32.685813 11053 raft_consensus.cc:2368] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 9. Current term is 10.
I20260709 12:25:32.685839 10981 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:25:32.703753 11125 raft_consensus.cc:2368] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12.
I20260709 12:25:32.704779 10948 leader_election.cc:400] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 15. Current term is 16.
I20260709 12:25:32.707422 11097 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:32.709630 10977 raft_consensus.cc:1275] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:32.710433 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:32.620445 16067 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:32.629886 16239 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:32.718705 11025 leader_election.cc:400] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12.
I20260709 12:25:32.665787 16113 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.720208 16113 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:32.721596 16172 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:32.722159 16172 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.722527 16172 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:32.683482 16094 consensus_queue.cc:1059] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:25:32.665925 15364 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.724215 15364 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:32.666425 16125 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.724805 16125 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:32.726263 15864 consensus_queue.cc:1048] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:32.727162 16125 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:32.733314 11644 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:32.703644 16238 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:32.714244 16179 consensus_queue.cc:1059] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:25:32.734505 16238 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:32.734908 11644 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:32.736946 16238 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:32.737156 15570 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:32.738091 16211 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:32.739125 16211 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.739509 16211 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:32.739979 15836 raft_consensus.cc:2804] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:32.740551 15836 raft_consensus.cc:697] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:32.712224 16143 raft_consensus.cc:2804] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:32.743618 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:32.744418 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:32.745155 10977 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:32.746076 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:32.746076 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:32.746843 11053 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:32.746884 11097 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:32.646420 11673 rpcz_store.cc:276] 0709 12:25:31.632702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.633066 (+   364us) service_pool.cc:224] Handling call
0709 12:25:31.633425 (+   359us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:25:31.650385 (+ 16960us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:31.650421 (+    36us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:25:31.651182 (+   761us) log.cc:844] Serialized 78 byte log entry
0709 12:25:31.802380 (+151198us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:31.816937 (+ 14557us) log.cc:844] Serialized 14 byte log entry
0709 12:25:32.255256 (+438319us) log.cc:844] Serialized 14 byte log entry
0709 12:25:32.258187 (+  2931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:32.258266 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:32.634799 (+376533us) spinlock_profiling.cc:243] Waited 32 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:25:32.645737 (+ 10938us) raft_consensus.cc:1685] finished
0709 12:25:32.645761 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:32.645910 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63622,"prepare.queue_time_us":43206,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":75,"raft.queue_time_us":45828,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":13190,"spinlock_wait_cycles":73646336,"thread_start_us":561761,"threads_started":2,"wal-append.queue_time_us":178078}
I20260709 12:25:32.746856 10977 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:32.751390 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:32.752193 11672 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:32.718278 10948 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:32.760332 11127 raft_consensus.cc:2393] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 15: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:32.770403 11053 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 13.
I20260709 12:25:32.766415 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:32.778131 11672 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 16.
I20260709 12:25:32.722528 16113 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:32.787613 11051 raft_consensus.cc:1240] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 12:25:32.779603 11024 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:32.790478 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:32.791443 11053 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 15.
I20260709 12:25:32.792392 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:32.703588 16129 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 12:25:32.741566 15836 consensus_queue.cc:237] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:32.795092 11132 raft_consensus.cc:1240] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:32.795924 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:32.798285 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 51497.1us
I20260709 12:25:32.803489 11054 raft_consensus.cc:1240] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:32.784335 16143 raft_consensus.cc:697] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:32.782752 15651 consensus_queue.cc:1243] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer 7518bdeb78f24e67a530754ae48547eb log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:25:32.811167 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:32.818840 11053 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 15.
I20260709 12:25:32.822686 11053 raft_consensus.cc:1240] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:32.814451 16113 raft_consensus.cc:2804] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:32.835860 16113 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.836316 16113 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:32.829125 16266 raft_consensus.cc:2804] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:32.847306 16133 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:32.852777 15364 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:32.826192 16126 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:32.872265 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 92668.5us
I20260709 12:25:32.874765 16143 consensus_queue.cc:237] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:32.899042 11644 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:32.877611 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.902434 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:32.903115 11129 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:32.879135 15364 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:32.883168 15651 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.884979 15570 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:32.846990 16038 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:32.857829 16283 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:32.913383 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:32.890012 16209 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:32.892427 16211 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:32.849948 16133 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:32.905201 11680 raft_consensus.cc:1275] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:25:32.904970 16134 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:32.909241 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:32.914067 11127 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:32.936691 11134 raft_consensus.cc:1240] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:25:32.936406 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:32.904973 11676 raft_consensus.cc:1240] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:32.954771 11679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 1007) took 1739 ms. Trace:
I20260709 12:25:32.985047 11057 raft_consensus.cc:1240] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:25:32.955317 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:32.985381 11129 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:25:32.899641 16172 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:32.990608 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:25:32.965790 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.985343 11679 rpcz_store.cc:276] 0709 12:25:31.198220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.198370 (+   150us) service_pool.cc:224] Handling call
0709 12:25:31.198675 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:31.477396 (+278721us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:31.477427 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:31.477469 (+    42us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:31.477501 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:32.920316 (+1442815us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b54005668d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:32.937486 (+ 17170us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:32.937606 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":640510720}
I20260709 12:25:32.991715 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:32.989197 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:32.993206 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:32.994568 11025 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:32.943190 15655 raft_consensus.cc:3055] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:33.011040 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:32.992352 11680 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:25:32.957702 16283 raft_consensus.cc:697] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:33.016803 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:33.018061 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 110373us
I20260709 12:25:33.024783 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:32.914736 15651 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:33.028898 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:33.029886 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.997040 16039 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:33.010699 15364 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:33.049392 15364 raft_consensus.cc:697] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:33.049237 16039 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:33.049682 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:33.050529 15364 consensus_queue.cc:237] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:33.038877 16038 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:33.031936 16094 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.050910 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:33.054920 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:33.024065 16114 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:33.017431 16138 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.038776 16067 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:33.042088 16113 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:33.046530 16209 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:33.047442 16099 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:33.044902 11676 raft_consensus.cc:1275] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:33.011906 15655 raft_consensus.cc:740] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:32.997108 16126 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:33.040532 16172 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:33.055562 11127 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:33.055527 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:33.057180 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:33.061335 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:33.069233 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:25:33.074931 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.078315 11130 raft_consensus.cc:2393] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 14: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:33.080039 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:33.080741 11053 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:33.053194 16211 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:33.051512 16039 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:33.065138 15705 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:25:33.083636 16215 log.cc:927] Time spent T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 1.859s	user 0.005s	sys 0.000s
I20260709 12:25:33.052083 16094 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:33.104221 11057 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 15.
I20260709 12:25:33.064980 16138 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:33.078274 16122 consensus_queue.cc:1059] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:25:33.110332 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:33.068333 16269 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 12:25:33.117424 16094 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:33.125455 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:33.126245 11676 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:33.097996 15705 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:33.128587 11058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 750) took 1935 ms. Trace:
I20260709 12:25:33.114977 15655 consensus_queue.cc:260] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:33.095781 16283 consensus_queue.cc:237] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:33.131914 15655 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:33.135859 16138 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:33.137619 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2834) took 2223 ms. Trace:
I20260709 12:25:33.138069 10978 rpcz_store.cc:276] 0709 12:25:30.913971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.941397 (+ 27426us) service_pool.cc:224] Handling call
0709 12:25:30.941809 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:30.944357 (+  2548us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:30.944653 (+   296us) log.cc:844] Serialized 14 byte log entry
0709 12:25:31.074233 (+129580us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:31.096343 (+ 22110us) log.cc:844] Serialized 26 byte log entry
0709 12:25:31.096505 (+   162us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:31.096540 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:31.096615 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:32.927045 (+1830430us) spinlock_profiling.cc:243] Waited 7.2 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:25:33.137271 (+210226us) raft_consensus.cc:1685] finished
0709 12:25:33.137386 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:33.137533 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23645,"prepare.queue_time_us":723,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":87339,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":13438,"spinlock_wait_cycles":16554240,"thread_start_us":60921,"threads_started":1,"wal-append.queue_time_us":257101}
I20260709 12:25:33.141222 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:33.141909 11676 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 19.
W20260709 12:25:33.145803 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.150969 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:33.083420 16126 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:33.165194 11053 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 14.
I20260709 12:25:33.160045 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:33.129014 11058 rpcz_store.cc:276] 0709 12:25:31.192834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.193024 (+   190us) service_pool.cc:224] Handling call
0709 12:25:31.193371 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:31.221560 (+ 28189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:31.221598 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:32.934257 (+1712659us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b2c00000de8. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8a6dda11 00007f8f8a6ed372 00007f8f8be1fa01 00007f8f8bde443a 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2
0709 12:25:32.934669 (+   412us) log.cc:844] Serialized 26 byte log entry
0709 12:25:33.064972 (+130303us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:33.065010 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:33.065095 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:33.128211 (+ 63116us) raft_consensus.cc:1685] finished
0709 12:25:33.128255 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:33.128514 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20771,"raft.queue_time_us":64447,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":26592,"spinlock_wait_cycles":24074496,"thread_start_us":129911,"threads_started":1,"wal-append.queue_time_us":162173}
I20260709 12:25:33.214882 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:33.217785 11644 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:33.219375 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:33.220250 11053 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:33.221266 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:33.222688 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:33.223372 11057 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
W20260709 12:25:33.165169 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.230366 11057 raft_consensus.cc:1240] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:25:33.233192 11057 raft_consensus.cc:1275] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:33.233215 11058 raft_consensus.cc:1275] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:25:33.239542 16224 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:33.242969 16114 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:33.244309 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 2189) took 1152 ms. Trace:
I20260709 12:25:33.232530 11054 raft_consensus.cc:1240] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:33.121954 15651 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:33.247820 11057 raft_consensus.cc:1275] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:33.244771 11133 rpcz_store.cc:276] 0709 12:25:32.091446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.114926 (+ 23480us) service_pool.cc:224] Handling call
0709 12:25:33.244100 (+1129174us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b540023aad4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:33.244246 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":626384128}
I20260709 12:25:33.211448 15887 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.250372 11675 raft_consensus.cc:1275] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:33.158329 16076 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
W20260709 12:25:33.259126 11678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41762 (request call id 1003) took 2123 ms (client timeout 1761 ms). Trace:
I20260709 12:25:33.260111 16067 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:33.278445 11678 rpcz_store.cc:269] 0709 12:25:31.126165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.126334 (+   169us) service_pool.cc:224] Handling call
0709 12:25:33.249697 (+2123363us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b540049ff54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:33.249830 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1910159104}
I20260709 12:25:33.161911 16082 raft_consensus.cc:3055] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:33.227600 15836 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:33.290438 11674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41774 (request call id 764) took 1765 ms. Trace:
I20260709 12:25:33.290880 11674 rpcz_store.cc:276] 0709 12:25:31.524755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.524903 (+   148us) service_pool.cc:224] Handling call
0709 12:25:31.534397 (+  9494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:32.035426 (+501029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:33.290159 (+1254733us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b54005fffd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:33.290377 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1140069632}
I20260709 12:25:33.282764 15887 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:33.286188 16082 raft_consensus.cc:740] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:33.283658 16076 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:33.290215 15836 raft_consensus.cc:697] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:33.302359 16262 raft_consensus.cc:3055] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:33.313269 16262 raft_consensus.cc:740] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:33.314483 16262 consensus_queue.cc:260] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:33.316069 16262 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:33.305354 15836 consensus_queue.cc:237] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:33.308104 16076 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:33.331660 16126 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:33.332382 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:33.333184 11674 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 15.
I20260709 12:25:33.321134 11053 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:33.337821 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 866) took 1963 ms. Trace:
I20260709 12:25:33.341141 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:33.338291 11126 rpcz_store.cc:276] 0709 12:25:31.374836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.610912 (+236076us) service_pool.cc:224] Handling call
0709 12:25:31.611250 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:32.938788 (+1327538us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:25:33.016220 (+ 77432us) log.cc:844] Serialized 14 byte log entry
0709 12:25:33.284496 (+268276us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:33.284576 (+    80us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:33.284631 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:33.337600 (+ 52969us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400032d54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:33.337648 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:33.337768 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":95199,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":1277,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":4644,"spinlock_wait_cycles":3050922368,"thread_start_us":298436,"threads_started":2,"wal-append.queue_time_us":281965}
I20260709 12:25:33.325425 16264 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:33.344597 11055 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52804 (request call id 749) took 2156 ms (client timeout 1707 ms). Trace:
W20260709 12:25:33.345062 11055 rpcz_store.cc:269] 0709 12:25:31.188597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.188741 (+   144us) service_pool.cc:224] Handling call
0709 12:25:33.344416 (+2155675us) spinlock_profiling.cc:243] Waited 49.4 ms on lock 0x7b54001892d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:33.344526 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113547520}
I20260709 12:25:33.354626 15887 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:33.356916 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.357069 11053 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:33.367724 15705 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:33.369166 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 2182) took 2506 ms. Trace:
I20260709 12:25:33.369656 11128 rpcz_store.cc:276] 0709 12:25:30.862662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.897752 (+ 35090us) service_pool.cc:224] Handling call
0709 12:25:30.913070 (+ 15318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:32.035508 (+1122438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:33.368788 (+1333280us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400374954. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:33.369052 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2579454208}
I20260709 12:25:33.372179 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:33.373036 11674 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:25:33.374455 11024 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:33.375450 16109 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:33.375918 16109 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:33.372663 16113 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:33.376307 16109 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:33.379055 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.383487 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:33.384102 11134 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:33.385902 11128 raft_consensus.cc:1240] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:33.387213 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:33.387805 11128 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:33.389807 15966 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:33.397662 11677 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41762 (request call id 1013) took 1411 ms (client timeout 1629 ms). Trace:
W20260709 12:25:33.399947 11677 rpcz_store.cc:269] 0709 12:25:31.986360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.986835 (+   475us) service_pool.cc:224] Handling call
0709 12:25:33.397456 (+1410621us) spinlock_profiling.cc:243] Waited 41.4 ms on lock 0x7b5400500fd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:33.397589 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95183104}
I20260709 12:25:33.397565 11128 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 17.
I20260709 12:25:33.401172 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:33.401636 11024 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:33.401890 11132 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:25:33.395782 11025 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:33.404662 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:33.405395 11132 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 15.
I20260709 12:25:33.347514 16082 consensus_queue.cc:260] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:33.409225 11126 raft_consensus.cc:1240] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:33.409775 16197 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:33.409803 16266 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:33.406263 16123 raft_consensus.cc:2804] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:33.404414 16139 raft_consensus.cc:2764] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 12:25:33.406690 16220 consensus_queue.cc:1059] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:25:33.414752 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:33.416966 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:33.460352 11127 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 14.
I20260709 12:25:33.461287 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:33.461869 11127 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 13.
I20260709 12:25:33.462735 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:33.463271 11128 raft_consensus.cc:1275] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:33.421363 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:33.422528 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:33.421224 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:33.464548 11131 raft_consensus.cc:2393] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 14: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:33.432022 11098 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:33.466460 11098 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:33.438011 11134 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:33.439908 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:33.442190 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:33.442382 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:33.443426 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:33.468874 11058 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:33.417747 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:33.469817 11129 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:33.451766 11025 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:33.473285 15812 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:33.450537 16038 consensus_queue.cc:1059] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:25:33.451081 16119 consensus_queue.cc:1048] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:25:33.459812 16266 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:33.475283 16038 consensus_queue.cc:1243] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer 7518bdeb78f24e67a530754ae48547eb log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:25:33.479887 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:33.494155 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:33.494793 11133 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 15.
I20260709 12:25:33.467523 11060 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:33.480356 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:33.496649 11057 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:33.481663 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.482908 11098 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:33.473855 15812 raft_consensus.cc:697] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:33.500982 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:33.502293 11098 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:33.504213 11098 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
W20260709 12:25:33.506177 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.501700 11060 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 15.
I20260709 12:25:33.440404 16113 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:33.517335 11129 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:25:33.519474 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:33.521451 15967 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:33.525427 11131 raft_consensus.cc:1275] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:25:33.527341 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 54542.9us
I20260709 12:25:33.529166 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:33.529825 11126 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:33.521939 15967 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.530933 15967 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:33.479173 16197 raft_consensus.cc:2749] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:33.478673 15364 consensus_queue.cc:1059] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:25:33.539708 15364 raft_consensus.cc:3055] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:33.540115 15364 raft_consensus.cc:740] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:33.540957 15364 consensus_queue.cc:260] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:33.500008 15966 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:33.499666 16123 raft_consensus.cc:697] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:33.545241 16123 consensus_queue.cc:237] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:33.556195 11098 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:33.557638 11098 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:33.546588 15967 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:33.510447 16224 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.562260 15812 consensus_queue.cc:237] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:33.562996 16224 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:33.564025 15967 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 20 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:33.477308 16138 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:33.566634 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.565043 16224 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:33.577512 15364 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:33.517227 16264 raft_consensus.cc:2749] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:33.441951 16172 consensus_queue.cc:1059] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 12:25:33.588485 16172 raft_consensus.cc:3055] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:33.588943 16172 raft_consensus.cc:740] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:33.591068 11675 raft_consensus.cc:1240] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:33.592180 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:33.549996 16126 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:33.549652 16208 consensus_queue.cc:1048] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:25:33.593528 16038 consensus_queue.cc:1059] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:25:33.594601 11057 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:25:33.595870 11098 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:33.518927 16082 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:33.601609 11098 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:33.566849 16142 raft_consensus.cc:2749] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:33.593551 16126 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.613507 11058 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
W20260709 12:25:33.617862 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 158535us
I20260709 12:25:33.605731 11126 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 14.
I20260709 12:25:33.552194 16113 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:33.600906 16224 raft_consensus.cc:2749] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:33.568120 16139 consensus_queue.cc:1048] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:25:33.627127 11098 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:33.630719 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.596068 16138 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:33.630088 11025 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:33.635483 11131 raft_consensus.cc:1240] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 12. Current term is 14. Ops: []
I20260709 12:25:33.623064 16126 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:33.589800 16172 consensus_queue.cc:260] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:33.635527 11133 raft_consensus.cc:1240] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:25:33.628163 16076 consensus_queue.cc:1048] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:25:33.643290 11126 pending_rounds.cc:85] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 7
I20260709 12:25:33.631079 11645 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:33.669240 16172 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:33.673355 11126 pending_rounds.cc:107] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:25:33.674757 11126 raft_consensus.cc:2889] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:33.674935 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 44941.4us
I20260709 12:25:33.624707 16208 raft_consensus.cc:2804] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:33.670367 16142 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:33.671205 16113 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:33.696833 15812 raft_consensus.cc:2804] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:33.628186 16211 consensus_queue.cc:1048] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 12:25:33.628235 16134 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 12:25:33.703001 16283 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.736575 16283 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:33.739109 16283 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:33.700920 15904 consensus_queue.cc:1059] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:25:33.741410 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:33.698863 16110 consensus_queue.cc:1048] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 12:25:33.745541 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.751711 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 742) took 1213 ms. Trace:
I20260709 12:25:33.752168 10982 rpcz_store.cc:276] 0709 12:25:32.538056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.651802 (+113746us) service_pool.cc:224] Handling call
0709 12:25:32.652080 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:32.652288 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:32.704301 (+ 52013us) log.cc:844] Serialized 14 byte log entry
0709 12:25:33.751133 (+1046832us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b1800135760. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88c71c0a 00007f8f923b1219 00007f8f88cf9a40 00007f8f88cf44e4 00007f8f88cf4455 00007f8f8bddc060 00007f8f8bdee716 00007f8f8bdff287 00007f8f8bdff208
0709 12:25:33.751323 (+   190us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:33.751380 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:33.751433 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:33.751504 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:33.751647 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42670,"prepare.queue_time_us":52060,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":4663,"spinlock_wait_cycles":23768960}
I20260709 12:25:33.750900 16021 raft_consensus.cc:2804] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:33.764622 16021 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:33.765058 16021 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:33.767980 15992 raft_consensus.cc:3055] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:33.768467 15992 raft_consensus.cc:740] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:33.769377 15992 consensus_queue.cc:260] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:33.773753 16179 raft_consensus.cc:3055] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:25:33.775975 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.796795 16137 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:33.777630 16239 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.740800 15812 raft_consensus.cc:697] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:33.778505 16179 raft_consensus.cc:740] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:33.799418 15992 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:33.799149 15812 consensus_queue.cc:237] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:33.801175 11060 raft_consensus.cc:1275] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
W20260709 12:25:33.803567 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:33.804502 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 1.08622e+06us
I20260709 12:25:33.805572 10948 leader_election.cc:400] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 9. Current term is 10.
I20260709 12:25:33.805879 10948 leader_election.cc:403] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:33.806792 16239 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:33.817454 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.832423 15991 raft_consensus.cc:3055] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:33.832916 15991 raft_consensus.cc:740] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:33.844698 11129 raft_consensus.cc:1275] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:25:33.845149 11129 pending_rounds.cc:85] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 6
I20260709 12:25:33.845363 11129 pending_rounds.cc:107] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:25:33.845621 11129 raft_consensus.cc:2889] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:33.833802 15991 consensus_queue.cc:260] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:33.845377 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 2714) took 1190 ms. Trace:
I20260709 12:25:33.852294 11130 rpcz_store.cc:276] 0709 12:25:32.655008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.660534 (+  5526us) service_pool.cc:224] Handling call
0709 12:25:33.845147 (+1184613us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b54000311d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:33.845307 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":958257024}
I20260709 12:25:33.899819 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:33.900664 11053 raft_consensus.cc:2393] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 16: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
W20260709 12:25:33.902052 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.908917 11053 raft_consensus.cc:1275] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:25:33.813287 16126 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:33.799261 16179 consensus_queue.cc:260] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:33.905786 16134 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:33.919648 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.923982 16239 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:33.927979 16126 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:33.916718 15991 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:33.932525 16134 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:33.934998 16134 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:33.938688 16211 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:33.939167 16021 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:33.852072 16109 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:33.937270 16134 consensus_queue.cc:1048] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:33.931259 16266 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:33.968552 16266 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:33.969035 16109 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:33.970089 16021 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:33.939307 16211 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:33.975001 16211 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:33.990489 11052 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 13.
I20260709 12:25:33.991694 15570 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.992707 15570 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:34.004359 16138 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:34.008144 16221 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.041927 16221 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:34.044241 16221 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:34.044765 16221 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.045428 15570 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:34.045213 16221 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:34.008661 16169 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:34.009413 15912 raft_consensus.cc:2804] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:34.045701 11676 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:25:34.046692 16169 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:34.047857 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:34.048799 16169 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:34.049367 16169 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 9. Current term is 10.
I20260709 12:25:34.012202 10949 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:34.052289 10949 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:34.014600 16239 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.054435 16239 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:34.055688 11676 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:25:34.056728 16239 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:34.015744 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:34.057212 15570 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:25:34.057726 10983 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:34.059350 16238 consensus_queue.cc:1048] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:34.061156 11024 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:34.062071 15570 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:34.062624 15570 raft_consensus.cc:697] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:34.063486 15570 consensus_queue.cc:237] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:34.065196 11052 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41302 (request call id 2142) took 1469 ms (client timeout 1602 ms). Trace:
I20260709 12:25:34.017395 10976 raft_consensus.cc:1240] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:34.019198 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:34.021318 16074 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:34.022069 16069 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:34.022477 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 169471us
I20260709 12:25:34.085695 10983 raft_consensus.cc:2410] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:25:34.023954 11054 raft_consensus.cc:3055] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:34.090677 11054 raft_consensus.cc:740] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:25:34.026547 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 393830us
I20260709 12:25:34.035533 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 746) took 1290 ms. Trace:
I20260709 12:25:34.070341 10979 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
W20260709 12:25:34.065634 11052 rpcz_store.cc:269] 0709 12:25:32.595698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.611156 (+ 15458us) service_pool.cc:224] Handling call
0709 12:25:34.065010 (+1453854us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400188dd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:34.065131 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3169862016}
I20260709 12:25:33.937469  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:34.092988 10977 rpcz_store.cc:276] 0709 12:25:32.745148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.754960 (+  9812us) service_pool.cc:224] Handling call
0709 12:25:32.755381 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:33.804473 (+1049092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:33.804506 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:33.808791 (+  4285us) log.cc:844] Serialized 26 byte log entry
0709 12:25:33.917270 (+108479us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:33.917305 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:33.917371 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:34.035217 (+117846us) raft_consensus.cc:1685] finished
0709 12:25:34.035250 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:34.035458 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1048676,"raft.queue_time_us":1253378,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"thread_start_us":101726,"threads_started":1,"wal-append.queue_time_us":155130}
I20260709 12:25:34.093670 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:34.073046 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:34.063385 16179 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:34.094238 16074 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:34.100263 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:34.101006 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:34.101052 11053 raft_consensus.cc:2393] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 15: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:34.091670 11054 consensus_queue.cc:260] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:34.105211 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 739) took 1604 ms. Trace:
I20260709 12:25:34.095429 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:34.095765 10982 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:34.094070 15912 raft_consensus.cc:697] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 11 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:34.098325 16069 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:34.102943 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 471960us
I20260709 12:25:34.123831 11645 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:34.112679 10977 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:34.108410 10980 rpcz_store.cc:276] 0709 12:25:32.501286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.585922 (+ 84636us) service_pool.cc:224] Handling call
0709 12:25:32.608849 (+ 22927us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:32.609197 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:32.609226 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:32.609739 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 12:25:32.763465 (+153726us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:32.907354 (+143889us) log.cc:844] Serialized 14 byte log entry
0709 12:25:34.104861 (+1197507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:34.104948 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:34.104993 (+    45us) raft_consensus.cc:1685] finished
0709 12:25:34.105006 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:34.105145 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1127826,"prepare.queue_time_us":67439,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":1104026,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":154,"thread_start_us":335104,"threads_started":3,"wal-append.queue_time_us":244759,"wal-append.run_cpu_time_us":2401,"wal-append.run_wall_time_us":1079722}
I20260709 12:25:34.118069 11054 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:34.130142 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:34.130879 10977 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:34.100709 16074 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:34.131465 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:34.106035 15967 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.134496 11645 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:34.126435 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 737) took 2032 ms. Trace:
I20260709 12:25:34.142679 11645 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:34.143162 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 743) took 1578 ms. Trace:
I20260709 12:25:34.145169 11125 raft_consensus.cc:1275] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:25:34.145838 11130 raft_consensus.cc:1240] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:34.146142 11134 raft_consensus.cc:1240] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:34.147028 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 741) took 1630 ms. Trace:
I20260709 12:25:34.147965 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:34.148425 11097 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:34.144381 10981 rpcz_store.cc:276] 0709 12:25:32.564517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.708501 (+143984us) service_pool.cc:224] Handling call
0709 12:25:32.708838 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:32.709078 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:25:32.789944 (+ 80866us) log.cc:844] Serialized 14 byte log entry
0709 12:25:34.142377 (+1352433us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:34.142687 (+   310us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:34.142832 (+   145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:34.142984 (+   152us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:34.143105 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1217676,"prepare.queue_time_us":96978,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":1220114,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":68,"thread_start_us":133968,"threads_started":1}
I20260709 12:25:34.148614 10980 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:34.148300 10982 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 17.
I20260709 12:25:34.150497 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:34.151125 10982 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:34.151623 11645 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:34.151954 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:34.147418 10975 rpcz_store.cc:276] 0709 12:25:32.516354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.632777 (+116423us) service_pool.cc:224] Handling call
0709 12:25:32.633088 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:32.633284 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:25:32.772759 (+139475us) log.cc:844] Serialized 14 byte log entry
0709 12:25:34.142442 (+1369683us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:34.146772 (+  4330us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:34.146821 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:34.146884 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:34.146976 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1234543,"prepare.queue_time_us":9348,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":1237136,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":11018,"thread_start_us":273317,"threads_started":2}
I20260709 12:25:34.153525 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:34.155877 10982 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:25:34.142611 10984 rpcz_store.cc:276] 0709 12:25:32.094065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.366049 (+271984us) service_pool.cc:224] Handling call
0709 12:25:32.369035 (+  2986us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:32.369245 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:25:32.545001 (+175756us) log.cc:844] Serialized 14 byte log entry
0709 12:25:34.006406 (+1461405us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b18004954c0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88c71c0a 00007f8f923b1219 00007f8f88cf9a40 00007f8f88cf44e4 00007f8f88cf4455 00007f8f8bddc060 00007f8f8bdee716 00007f8f8bdff287 00007f8f8bdff208
0709 12:25:34.126056 (+119650us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:34.126134 (+    78us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:34.126181 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:34.126251 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:34.126373 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1039022,"prepare.queue_time_us":273152,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":1244355,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"spinlock_wait_cycles":5850496,"thread_start_us":514969,"threads_started":3,"wal-append.queue_time_us":254641,"wal-append.run_cpu_time_us":1137,"wal-append.run_wall_time_us":1003962}
I20260709 12:25:34.127279 16169 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:34.155937 10981 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 15.
I20260709 12:25:34.157747 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:34.158530 10982 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:34.131255 16208 raft_consensus.cc:697] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 15 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:34.109143 16219 consensus_queue.cc:1048] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:25:34.118772 16332 consensus_queue.cc:1048] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:25:34.140748 16331 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:34.232594 11134 raft_consensus.cc:1275] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:25:34.232681 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:34.158816 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:34.214598 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:25:34.209975 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.204022 11129 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 20 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 19. Current term is 20. Ops: []
W20260709 12:25:34.174780 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.251817 10980 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
I20260709 12:25:34.254244 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:34.225381 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:34.259728 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:34.260140 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:34.260751 10983 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:34.189771 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:34.261361 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 455890us
W20260709 12:25:34.219867 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 71556.8us
I20260709 12:25:34.152170 16087 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:34.152345 16239 raft_consensus.cc:2804] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:34.253836 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:25:34.159363 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 66239.7us
I20260709 12:25:34.133560 15966 raft_consensus.cc:2749] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:34.158074 16336 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:34.325568 11675 raft_consensus.cc:1240] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:34.325940 16336 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.326406 16336 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:34.322417 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:34.328243 10978 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:34.330587 16337 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:34.331307 16337 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:34.159384 16123 consensus_queue.cc:1048] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.173s
I20260709 12:25:34.210014 16021 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:34.246248 16126 raft_consensus.cc:2804] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:34.272565 10982 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:25:34.341876 11097 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:34.344017 16129 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:34.345583 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:34.152593 15864 raft_consensus.cc:2749] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:34.156473 16113 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:34.345970 16129 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:34.277024 10983 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:34.147873 16082 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.208076 16214 consensus_queue.cc:1048] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.106s
I20260709 12:25:34.310539 16010 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:25:34.314803 15904 consensus_queue.cc:1059] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:34.316390 16208 consensus_queue.cc:237] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:34.317464 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:34.318117 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:34.319314 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:34.255250 16331 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.322499 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:25:34.323030 16313 log.cc:927] Time spent T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.680s	user 0.004s	sys 0.005s
I20260709 12:25:34.323668 16221 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:34.324625 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 45206.8us
I20260709 12:25:34.245108 16069 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:34.203740 16169 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:34.363356 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:34.279597 16324 consensus_queue.cc:1048] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:25:34.364101 10976 raft_consensus.cc:2376] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14. Re-sending same reply.
I20260709 12:25:34.347530 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:34.371656 10983 raft_consensus.cc:2393] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 15: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:34.312589 10981 raft_consensus.cc:2393] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 12: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:34.348071 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:34.348943 11097 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:34.238713 16334 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.086s
I20260709 12:25:34.371691 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:34.373035 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:34.313165 11098 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:34.356304 16126 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.283975 11125 raft_consensus.cc:2393] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 14: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:34.355530 10975 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 13.
W20260709 12:25:34.375433 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 62348.1us
I20260709 12:25:34.359368 11054 raft_consensus.cc:1275] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:34.345583 16219 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:34.376920 16219 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.377336 16219 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:34.262458 10948 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:34.381738 10982 raft_consensus.cc:2393] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 13: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:25:34.365366 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:34.382680 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.279666 16087 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.225924 15912 consensus_queue.cc:237] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:34.369292 10978 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 15.
I20260709 12:25:34.395803 10979 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 16.
I20260709 12:25:34.369678 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:34.396937 10980 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:34.344404 16021 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:34.341152 11643 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:34.398617 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 57560.1us
I20260709 12:25:34.375205 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:34.381829 11126 raft_consensus.cc:1275] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:34.172613 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:34.151155 15967 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:34.407796 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.381764 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:34.376909 11098 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:34.346738 16113 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:34.386698 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 124317us
I20260709 12:25:34.413283 10948 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:34.387331 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:34.361347 16331 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:34.390568 16069 raft_consensus.cc:2804] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:34.391479 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:34.350705 15570 consensus_queue.cc:1059] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:25:34.410312 11098 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:34.414440 10984 raft_consensus.cc:2410] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:25:34.374864 16221 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:34.394469 16119 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:25:34.360528 16082 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:34.419852 10982 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:25:34.372092 16137 consensus_queue.cc:1059] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 12:25:34.386420 16094 raft_consensus.cc:2804] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:34.445680 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:34.446707 10984 raft_consensus.cc:2393] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 14: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:34.415833 16138 raft_consensus.cc:2749] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:34.402207 16087 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:34.425964 10948 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:34.429716 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:25:34.431187 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 241561us
I20260709 12:25:34.403388 16021 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:34.372071 16240 consensus_queue.cc:1048] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:25:34.380970 16142 raft_consensus.cc:2749] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:34.383323 16126 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:34.481036 11126 raft_consensus.cc:1275] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:25:34.481559 11126 pending_rounds.cc:85] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 10
I20260709 12:25:34.481788 11126 pending_rounds.cc:107] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:25:34.482016 11126 raft_consensus.cc:2889] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:34.490262 16338 consensus_queue.cc:1059] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:34.491932 16113 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:34.493072 16129 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:34.501158 16337 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:34.458160 16094 raft_consensus.cc:697] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:34.475246 16335 raft_consensus.cc:2749] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:34.451036 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:34.427425 16266 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:34.452164 16188 consensus_queue.cc:1048] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:25:34.430949 16179 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:34.468147 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:34.471333 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 872) took 1065 ms. Trace:
I20260709 12:25:34.471879 11130 raft_consensus.cc:1240] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:34.516417 11132 rpcz_store.cc:276] 0709 12:25:33.406265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.406393 (+   128us) service_pool.cc:224] Handling call
0709 12:25:33.406729 (+   336us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:33.407118 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:33.407147 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:33.411136 (+  3989us) log.cc:844] Serialized 52 byte log entry
0709 12:25:33.617626 (+206490us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:33.678484 (+ 60858us) log.cc:844] Serialized 14 byte log entry
0709 12:25:34.133828 (+455344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:34.133906 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:34.209236 (+ 75330us) spinlock_profiling.cc:243] Waited 27.6 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:25:34.454966 (+245730us) raft_consensus.cc:1685] finished
0709 12:25:34.471093 (+ 16127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:34.471269 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":524181,"prepare.queue_time_us":60323,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":2092,"raft.queue_time_us":460825,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":11381,"spinlock_wait_cycles":63469440,"thread_start_us":206102,"threads_started":1,"wal-append.queue_time_us":230951}
I20260709 12:25:34.424853 11098 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:34.435899 16221 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:34.431948 16069 raft_consensus.cc:697] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 13 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:34.463984 15864 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:34.464363 10975 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:34.514782 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:34.524119 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:34.524834 11023 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:34.528455 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:34.531598 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:34.513015 16266 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.535498 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:34.470342 10982 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 17.
W20260709 12:25:34.536916 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 109092us
I20260709 12:25:34.538645 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:34.536371 11125 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 13.
I20260709 12:25:34.536895 10984 raft_consensus.cc:2393] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 15: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:34.515897 16179 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:34.545365 11097 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:34.562842 11097 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:34.563805 16214 raft_consensus.cc:2804] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:34.564213 16214 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.564529 16214 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:34.546727 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:34.547667 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:34.548599 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:34.568384 10981 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:34.549403 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:34.549978 10976 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:34.538303 16240 raft_consensus.cc:2749] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:34.537382 16266 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:34.537949 16138 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:34.598991 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:34.540283 15864 raft_consensus.cc:697] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:34.552600 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:34.663477 10984 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:25:34.663808 15864 consensus_queue.cc:237] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:34.551729 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 152206us
I20260709 12:25:34.646842 16082 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:34.574811 16094 consensus_queue.cc:237] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:34.666483 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:34.594424 15364 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.668125 10982 raft_consensus.cc:1275] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:34.668125 15364 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:34.668455 16266 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:34.671409 16266 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:34.619458 16336 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:34.661010 16168 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.671291 15364 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:34.675123 16168 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:34.677577 16168 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:34.662325 16069 consensus_queue.cc:237] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:34.678781 16336 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 18 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:34.679155 16221 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:34.679788 16221 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.682418 11643 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:34.682729 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:34.561626 11023 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:34.684432 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:34.541299 11098 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:34.680238 16221 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:34.685185 10975 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:34.691793 10976 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:25:34.681409 16336 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:34.696589 10981 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
W20260709 12:25:34.696727 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.700313 11681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 1029) took 1030 ms. Trace:
I20260709 12:25:34.701419 15967 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:34.700768 11681 rpcz_store.cc:276] 0709 12:25:33.670175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.670362 (+   187us) service_pool.cc:224] Handling call
0709 12:25:33.695933 (+ 25571us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:34.135378 (+439445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:34.135406 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:34.135953 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 12:25:34.410365 (+274412us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:34.410401 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:34.410468 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:34.700060 (+289592us) raft_consensus.cc:1685] finished
0709 12:25:34.700083 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:34.700245 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":67185,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":88,"thread_start_us":713061,"threads_started":2,"wal-append.queue_time_us":520011}
I20260709 12:25:34.594794 16113 raft_consensus.cc:2804] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:34.704170 16021 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:34.704919 16238 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.705415 16238 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:34.555282 16179 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:34.712670 10978 raft_consensus.cc:1275] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:25:34.708431 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 167205us
I20260709 12:25:34.710861 11643 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:34.712836 10980 raft_consensus.cc:1240] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12. Ops: []
W20260709 12:25:34.737386 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 256533us
I20260709 12:25:34.744180 11643 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:34.670040 10982 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19"
dest_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:52828
I20260709 12:25:34.721180 10981 raft_consensus.cc:1275] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:34.745317 10982 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:34.740305 10978 raft_consensus.cc:1275] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:34.746729 10948 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
W20260709 12:25:34.684448 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 123015us
I20260709 12:25:34.745764 10982 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:34.749375 11023 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:34.718472 15967 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:34.724023 10984 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:25:34.721706 16113 raft_consensus.cc:697] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 15 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:34.712061 16021 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:34.761629 10984 raft_consensus.cc:1275] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:34.739177 16347 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:34.762998 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:34.747432 16168 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.759091 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:34.765997 11053 raft_consensus.cc:2393] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 15: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:34.767838 10978 raft_consensus.cc:1275] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:25:34.768213 11023 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:34.774533 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:34.775130 11053 raft_consensus.cc:1240] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:34.750174 10981 raft_consensus.cc:1240] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:34.777356 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:34.778698 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:34.779450 11058 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 14.
I20260709 12:25:34.780411 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:34.781580 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:34.782270 11058 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:25:34.784971 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:34.785725 11058 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:34.789382 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:34.787518 11023 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:34.714327 16336 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:34.856200 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:34.856712 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:34.860988 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.762024 16326 raft_consensus.cc:2804] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:34.714161 16219 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:34.869416 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:34.870609 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:34.765595 16076 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:34.768953 16240 raft_consensus.cc:2749] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:34.874786 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:34.769636 15364 raft_consensus.cc:2749] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:34.754705 16082 consensus_queue.cc:1048] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:25:34.874037 11053 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 13.
I20260709 12:25:34.707152 16331 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:34.762393 16214 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:34.879060 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 130131us
I20260709 12:25:34.794080 15967 raft_consensus.cc:697] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:34.867549 16338 raft_consensus.cc:2764] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:25:34.908407 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:34.909598 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:34.879159 16076 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:34.914070 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:34.914951 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:25:34.921478 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.908908 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:34.872485 16326 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.954612 16326 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:34.955022 16265 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.955581 16265 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:34.884722 15705 raft_consensus.cc:2749] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:34.945580 10948 connection.cc:256] RPC call timeout handler was delayed by -1.0209738350004045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18000000000000002s for a response
I20260709 12:25:34.770813 15912 consensus_queue.cc:1059] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.130s
I20260709 12:25:34.948597 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:34.771826 16168 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:34.959216 16265 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:34.960421 11058 raft_consensus.cc:1275] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:34.867004 16092 consensus_queue.cc:1048] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:25:34.854813 16021 consensus_queue.cc:1048] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 12:25:34.950963 11673 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 13.
I20260709 12:25:34.952562 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:34.910941 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:34.961268 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:34.894503 16353 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.966679 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:34.966984 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 179554us
I20260709 12:25:34.794999 16087 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:34.970252 11674 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:34.950028 15904 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.977820 11023 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:34.997605 11023 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:34.962293 16076 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:34.894112 16113 consensus_queue.cc:237] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:35.004843 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:35.006718 11059 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:34.964109 16356 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:35.011473 11679 raft_consensus.cc:2393] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 15: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:35.014784 11023 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:34.891886 10982 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:34.990535 16355 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:35.016870 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 306854us
I20260709 12:25:35.021559 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:35.009500 15705 raft_consensus.cc:2804] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:35.032507 11059 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:25:35.005702 15904 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:35.038605 16344 log.cc:927] Time spent T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 12:25:35.013089 16265 raft_consensus.cc:2749] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:35.014292 16221 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:35.045498 16214 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:35.017520 16188 raft_consensus.cc:2749] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:35.017122 16356 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:35.021746 15364 consensus_queue.cc:1048] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:25:35.038468 15904 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:35.060657 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:35.061164 16219 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:35.062194 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:35.062875 11129 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:25:35.063751 16336 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:35.064845 16239 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:35.065171 11674 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 18.
I20260709 12:25:35.065341 16239 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:35.065640 16168 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:35.063750 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:35.069175 11129 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:25:35.035179 15967 consensus_queue.cc:237] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:35.071074 16349 log.cc:927] Time spent T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:25:35.066751 16221 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.072044 16221 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:35.032931 15705 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.995647 16353 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:35.057572 10982 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 18 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:35.073150 16336 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:35.099064 16221 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:35.100174 16221 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.101765 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:52828 (request call id 2852) took 1014 ms. Trace:
I20260709 12:25:35.102371 10982 rpcz_store.cc:276] 0709 12:25:34.074700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.669893 (+595193us) service_pool.cc:224] Handling call
0709 12:25:35.089122 (+419229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:35.112022 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:35.112800 11060 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:25:35.110003 11025 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:35.117936 11051 raft_consensus.cc:1275] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:35.090154 15705 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:35.097122 16336 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:35.124725 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:35.124989 16366 consensus_queue.cc:1048] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:35.128010 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:35.144515 11131 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:25:35.145582 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:35.128834 16363 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:35.100903 16221 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:35.111491 16357 log.cc:927] Time spent T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:25:35.026507 16355 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:35.118454 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:35.156563 11055 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 15.
W20260709 12:25:35.154285 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 208604us
I20260709 12:25:35.141182 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:35.149998 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:35.117853 15364 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.121119 16168 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.159564 11129 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:25:35.158776 11675 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:35.166011 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 207263us
I20260709 12:25:35.146921 16240 raft_consensus.cc:2804] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:35.167047 10948 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:35.161434 16348 log.cc:927] Time spent T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:25:35.187377 10948 leader_election.cc:400] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 9. Current term is 10.
I20260709 12:25:35.192996 10948 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:35.194116 15912 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:25:35.196854 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 54209.4us
I20260709 12:25:35.197604 11645 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:35.198783 16377 raft_consensus.cc:2749] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:35.196380 10948 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:35.148988 16346 consensus_queue.cc:1059] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:25:35.198869 11645 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:35.160326 16211 consensus_queue.cc:1048] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:25:35.206851 16353 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:35.165750 15364 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:35.209687 15364 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:35.186398 16356 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:35.182443 16240 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:35.210651 16240 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:35.187683 16333 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:25:35.205878 11675 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
W20260709 12:25:35.218942 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 201387us
I20260709 12:25:35.218988 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:35.190503 16069 raft_consensus.cc:2749] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:35.168165 16168 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:35.224234 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:35.224680 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:35.224706 11051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:35.226027 11051 raft_consensus.cc:606] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:35.225970 11052 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:35.226476 11051 raft_consensus.cc:614] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:35.225903 11056 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 18.
I20260709 12:25:35.228412 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:35.229940 11054 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 13.
I20260709 12:25:35.230893 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:35.231499 11051 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:35.221777 16366 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:35.233142 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:35.233783 11056 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 15.
I20260709 12:25:35.234561 16168 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:35.220749 16371 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:35.236411 16169 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:35.236804 16355 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:35.220752 16137 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:25:35.234587 16367 log.cc:927] Time spent T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:25:35.250654 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:35.252336 11052 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 18.
I20260709 12:25:35.248368 11051 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 16.
I20260709 12:25:35.256264 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:35.259555 10948 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:35.261401 11054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6506ec2922c24d099538b52b0df81502"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:35.229386 16188 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:35.261976 10948 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:35.262215 11054 raft_consensus.cc:606] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:35.264870 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:35.265625 11675 raft_consensus.cc:3055] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:35.266079 11675 raft_consensus.cc:740] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:35.274259 16374 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:35.258342 15364 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.278384 15364 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:35.263355 16169 raft_consensus.cc:2749] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:35.279776 16179 consensus_meta.cc:287] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.542s	user 0.005s	sys 0.005s
I20260709 12:25:35.280211 16179 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:35.282450 16188 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:35.283381 10975 raft_consensus.cc:1240] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:35.284487 16336 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:35.285063 16188 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:35.288080 16336 consensus_queue.cc:1059] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:35.290020 10948 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:35.285974 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1980) took 1210 ms. Trace:
I20260709 12:25:35.293357 10948 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:35.263585 16331 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:35.296254 10948 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:35.236424 16371 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:35.292932 10975 rpcz_store.cc:276] 0709 12:25:34.075573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.689260 (+613687us) service_pool.cc:224] Handling call
0709 12:25:34.720408 (+ 31148us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:35.283842 (+563434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.285721 (+  1879us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b5400229554. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:35.285906 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1294208384}
I20260709 12:25:35.297009 16371 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:35.297789 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:35.298511 10975 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:35.270437 11675 consensus_queue.cc:260] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:35.300397 11675 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:35.260967 16221 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:35.306402 16076 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:35.309125 16076 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:35.309646 16347 consensus_meta.cc:287] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.000s
I20260709 12:25:35.310297 16239 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:35.311345 11054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "702d64a1236147a784daa11e58563721"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:35.314450 11054 raft_consensus.cc:606] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:35.314913 11054 raft_consensus.cc:614] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:35.309947 16326 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:35.315889 11672 raft_consensus.cc:2393] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 14: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:35.316442 16122 raft_consensus.cc:3055] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:35.316843 16122 raft_consensus.cc:740] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:35.317106 16326 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:35.317734 16122 consensus_queue.cc:260] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:35.318885 16122 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:35.320590 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:35.320312 16371 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:35.321913 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:35.324836 11672 raft_consensus.cc:1240] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:35.328042 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2845) took 1314 ms. Trace:
I20260709 12:25:35.322829 16371 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:35.328485 10983 rpcz_store.cc:276] 0709 12:25:34.013504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.595878 (+582374us) service_pool.cc:224] Handling call
0709 12:25:34.596266 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:34.776366 (+180100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:34.776396 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:34.889534 (+113138us) log.cc:844] Serialized 26 byte log entry
0709 12:25:35.011115 (+121581us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:35.011151 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.011218 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:35.327799 (+316581us) raft_consensus.cc:1685] finished
0709 12:25:35.327822 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:35.327960 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":157676,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":5285,"thread_start_us":243941,"threads_started":2,"wal-append.queue_time_us":122086}
I20260709 12:25:35.330948 16110 consensus_queue.cc:1059] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:35.332204 16110 raft_consensus.cc:3055] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:35.333675 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:35.334350 10983 raft_consensus.cc:3060] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:35.334781 10948 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:35.312817 16239 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:35.335811 11672 raft_consensus.cc:1240] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:35.332600 16110 raft_consensus.cc:740] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:35.337570 10948 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:35.332316 16169 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:35.341023 11680 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:25:35.332698 16333 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:35.340873 10975 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 16.
I20260709 12:25:35.356324 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:35.340101 16347 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:35.340935 16355 raft_consensus.cc:2804] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:35.347525 16169 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:35.347721 16123 consensus_queue.cc:1059] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:25:35.353117 16379 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:25:35.353854 16126 consensus_meta.cc:287] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.847s	user 0.006s	sys 0.006s
I20260709 12:25:35.337291 16221 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:35.349648 16179 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:35.345198 10948 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:35.351573 11675 raft_consensus.cc:2410] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:25:35.349381 16371 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:35.366999 11054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:35.370290 11054 raft_consensus.cc:606] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:35.370689 11054 raft_consensus.cc:614] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:35.370632 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:35.370954 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:35.371982 11053 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 16.
I20260709 12:25:35.378314 11056 raft_consensus.cc:1240] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 12:25:35.359468 16355 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:35.361505 16169 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:35.358819 10983 raft_consensus.cc:2468] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 14.
I20260709 12:25:35.380264 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:35.383203 11051 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 15.
I20260709 12:25:35.384438 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:35.355311 16110 consensus_queue.cc:260] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:35.363984 16221 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:35.370048 16371 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:35.380959 10948 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:35.379045 11052 raft_consensus.cc:1275] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:35.374148 16179 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:35.395545 10948 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:35.383670 16355 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:35.365830 16126 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:35.390657 10975 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 16.
I20260709 12:25:35.392988 16221 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:35.395782 16371 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:35.397985 16336 consensus_queue.cc:1059] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:25:35.363757 16240 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:35.397361 16333 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:35.407390 10975 raft_consensus.cc:1240] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:25:35.407713 11134 raft_consensus.cc:1240] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:25:35.408294 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2876) took 1078 ms. Trace:
I20260709 12:25:35.398021 16123 consensus_queue.cc:1059] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:25:35.418326 10975 rpcz_store.cc:276] 0709 12:25:34.329764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.401056 (+1071292us) service_pool.cc:224] Handling call
0709 12:25:35.407115 (+  6059us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:35.407962 (+   847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.408213 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:35.419901 11129 raft_consensus.cc:1240] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 15 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:35.420192 10975 raft_consensus.cc:1275] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:25:35.421042 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2877) took 1091 ms. Trace:
I20260709 12:25:35.408547 16336 consensus_queue.cc:1243] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [LEADER]: Peer c979ef00e0ad4157b49ebbdc13ce7cd7 log is divergent from this leader: its last log entry 13.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:25:35.410316 16240 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:35.415546 16126 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:35.399055 16110 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:35.425033 16347 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:35.425652 16347 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:35.427321 15705 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:35.428349 16347 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:35.429533 15705 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:35.400633 16179 raft_consensus.cc:697] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 18 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:35.431087 10975 rpcz_store.cc:276] 0709 12:25:34.330041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.419473 (+1089432us) service_pool.cc:224] Handling call
0709 12:25:35.419824 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:35.420738 (+   914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.420977 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:35.431886 10977 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 2863) took 1269 ms (client timeout 1655 ms). Trace:
W20260709 12:25:35.432299 10977 rpcz_store.cc:269] 0709 12:25:34.162398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.172253 (+  9855us) service_pool.cc:224] Handling call
0709 12:25:35.431671 (+1259418us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b540009b354. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:35.431822 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1799669120}
I20260709 12:25:35.432654 10975 raft_consensus.cc:1275] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:25:35.433475 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2879) took 1102 ms. Trace:
I20260709 12:25:35.433825 10975 rpcz_store.cc:276] 0709 12:25:34.330611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.431978 (+1101367us) service_pool.cc:224] Handling call
0709 12:25:35.432333 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:35.433220 (+   887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.433422 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:35.434010 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 754) took 1091 ms. Trace:
I20260709 12:25:35.434872 10977 rpcz_store.cc:276] 0709 12:25:34.343081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.433233 (+1090152us) service_pool.cc:224] Handling call
0709 12:25:35.433522 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:35.433694 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:35.433730 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:35.433772 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:35.433801 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.433848 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:35.433951 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:35.436005 11643 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:25:35.421556 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:35.436344 10977 raft_consensus.cc:1240] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:35.438135 11643 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:35.438988 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 1998) took 1095 ms. Trace:
I20260709 12:25:35.439356 10977 rpcz_store.cc:276] 0709 12:25:34.343675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.435857 (+1092182us) service_pool.cc:224] Handling call
0709 12:25:35.436168 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:35.438728 (+  2560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.438930 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:35.401610 16338 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:35.425637 15904 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:35.445502 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:35.431010 16238 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:35.406836 16333 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:35.401252 16239 consensus_queue.cc:1048] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:25:35.452745 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2875) took 1123 ms. Trace:
I20260709 12:25:35.443348 16347 raft_consensus.cc:2804] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:35.443977 16338 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:35.458348 16338 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:35.459234 16374 raft_consensus.cc:2749] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:35.453274 10983 rpcz_store.cc:276] 0709 12:25:34.329500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.385825 (+1056325us) service_pool.cc:224] Handling call
0709 12:25:35.387449 (+  1624us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:35.387693 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:35.440400 (+ 52707us) log.cc:844] Serialized 14 byte log entry
0709 12:25:35.452350 (+ 11950us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:35.452405 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:35.452456 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.452522 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:35.452663 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20172,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":101,"thread_start_us":63813,"threads_started":2}
I20260709 12:25:35.444392 16366 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:35.464850 10983 raft_consensus.cc:3055] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:35.464854 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:35.451402 16333 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:35.465418 10983 raft_consensus.cc:740] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:35.466483 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:35.430917 16179 consensus_queue.cc:237] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:35.466773 10983 consensus_queue.cc:260] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:35.478159 10983 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:35.478164 11675 raft_consensus.cc:1217] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Deduplicated request from leader. Original: 14.12->[15.13-15.13]   Dedup: 15.13->[]
I20260709 12:25:35.449784 15904 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:35.479024 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 755) took 1135 ms. Trace:
I20260709 12:25:35.479087 11675 raft_consensus.cc:1240] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:25:35.487365 10983 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:25:35.487991 10983 pending_rounds.cc:85] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 12
I20260709 12:25:35.488255 10983 pending_rounds.cc:107] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:25:35.488515 10983 raft_consensus.cc:2889] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:35.489254 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2882) took 1131 ms. Trace:
I20260709 12:25:35.489589 10983 rpcz_store.cc:276] 0709 12:25:34.357799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.463975 (+1106176us) service_pool.cc:224] Handling call
0709 12:25:35.464321 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:35.488993 (+ 24672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.489197 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:35.465173 16347 raft_consensus.cc:697] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:35.491047 10983 raft_consensus.cc:1275] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:25:35.490917 16347 consensus_queue.cc:237] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:35.491688 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2885) took 1116 ms. Trace:
I20260709 12:25:35.492058 10983 rpcz_store.cc:276] 0709 12:25:34.375396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.490425 (+1115029us) service_pool.cc:224] Handling call
0709 12:25:35.490739 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:35.491440 (+   701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.491635 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:35.497350 16169 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:35.498276 15364 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:35.503984 16335 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 12:25:35.465790 16366 raft_consensus.cc:697] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:35.480625 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:35.536836 11644 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:35.539198 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:35.542984 16332 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:35.543676 16332 raft_consensus.cc:697] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:35.544693 16332 consensus_queue.cc:237] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:35.533034 16387 log.cc:927] Time spent T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:25:35.550145 11680 raft_consensus.cc:1240] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 14. Current term is 15. Ops: []
W20260709 12:25:35.558560 16339 log.cc:927] Time spent T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 1.122s	user 0.000s	sys 0.019s
I20260709 12:25:35.574776 15904 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:35.576260 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 887) took 1107 ms. Trace:
I20260709 12:25:35.580309 16371 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:35.548386 16338 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:35.564363 16355 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:35.584362 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:35.585400 16351 raft_consensus.cc:3055] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:35.585892 16351 raft_consensus.cc:740] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:35.587062 16142 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:35.587378 16338 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:35.587695 16094 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:35.588224 16094 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:35.582805 16366 consensus_queue.cc:237] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:35.590440 16142 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:35.592496 16338 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.592602 16142 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:35.592979 16338 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:35.582849 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 891) took 1113 ms. Trace:
I20260709 12:25:35.592666 10981 raft_consensus.cc:1240] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:35.586750 16351 consensus_queue.cc:260] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:35.616119 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2761) took 1018 ms. Trace:
I20260709 12:25:35.576696 11133 rpcz_store.cc:276] 0709 12:25:34.468597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.468714 (+   117us) service_pool.cc:224] Handling call
0709 12:25:34.469044 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:34.469416 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:34.469444 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:34.474516 (+  5072us) log.cc:844] Serialized 26 byte log entry
0709 12:25:34.748658 (+274142us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:34.771456 (+ 22798us) log.cc:844] Serialized 14 byte log entry
0709 12:25:35.575622 (+804166us) spinlock_profiling.cc:243] Waited 6.45 ms on lock 0x7b180034c2a0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88c71c0a 00007f8f923b1219 00007f8f88cf9a40 00007f8f88cf44e4 00007f8f88cf4455 00007f8f8bddc060 00007f8f8bdee716 00007f8f8bdff287 00007f8f8bdff208
0709 12:25:35.575855 (+   233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.575932 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:35.575976 (+    44us) raft_consensus.cc:1685] finished
0709 12:25:35.576066 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:35.576196 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91484,"prepare.queue_time_us":20113,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":2816,"raft.queue_time_us":1446,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"spinlock_wait_cycles":14843648,"thread_start_us":263467,"threads_started":1,"wal-append.queue_time_us":533669}
I20260709 12:25:35.585539 16355 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:35.611827 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:35.617184 11052 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:35.617498 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:35.616582 11126 rpcz_store.cc:276] 0709 12:25:34.597922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.331713 (+733791us) service_pool.cc:224] Handling call
0709 12:25:35.332041 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:35.332248 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:35.332555 (+   307us) log.cc:844] Serialized 14 byte log entry
0709 12:25:35.615773 (+283218us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:35.615829 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:35.615875 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.615939 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:35.616057 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":216953,"prepare.queue_time_us":3788,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"thread_start_us":65890,"threads_started":1,"wal-append.queue_time_us":131637}
I20260709 12:25:35.618484 11133 raft_consensus.cc:2393] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 10: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:35.611451 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:35.619971 11055 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:35.567238 16221 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:35.622388 10983 raft_consensus.cc:1240] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 18. Current term is 19. Ops: []
W20260709 12:25:35.584543 16365 log.cc:927] Time spent T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.378s	user 0.000s	sys 0.001s
I20260709 12:25:35.618929 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:35.613022 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:35.635336 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:35.635552 10981 raft_consensus.cc:2393] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 16: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:35.632934 11052 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 16.
I20260709 12:25:35.636189 11133 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 14: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:35.611364 11125 rpcz_store.cc:276] 0709 12:25:34.469632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.542546 (+ 72914us) service_pool.cc:224] Handling call
0709 12:25:34.542879 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:34.543093 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:25:34.858474 (+315381us) log.cc:844] Serialized 14 byte log entry
0709 12:25:35.582472 (+723998us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:35.582530 (+    58us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:25:35.582583 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.582648 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:35.582785 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":636009,"prepare.queue_time_us":19432,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":636124,"raft.run_cpu_time_us":63,"raft.run_wall_time_us":62,"thread_start_us":402714,"threads_started":2,"wal-append.queue_time_us":262880}
I20260709 12:25:35.642395 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:35.643858 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:35.644544 11054 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:35.646016 11055 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 16.
I20260709 12:25:35.593127 16092 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.592897 16082 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.648699 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:35.658720 11126 raft_consensus.cc:2393] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 14: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:35.641112 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:35.659524 10981 raft_consensus.cc:2393] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 16: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:35.649935 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:35.648152 10948 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:35.650267 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:35.624845 16113 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.663481 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:35.664196 11133 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 14.
I20260709 12:25:35.664623 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:35.655072 11097 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:35.665068 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:35.624708 16126 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:35.663497 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:35.667111 16371 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:35.667650 16239 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:35.662130 16082 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:35.634054 15966 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:35.659688 16094 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:35.665520 16394 log.cc:927] Time spent T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:25:35.672030 16138 raft_consensus.cc:2749] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:35.662957 10948 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:35.661453 16385 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.688329 11054 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 14.
I20260709 12:25:35.660485 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:35.681092 15991 raft_consensus.cc:3055] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:25:35.624712 16324 consensus_queue.cc:1059] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:25:35.682844 16113 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:35.683954 16400 consensus_queue.cc:1048] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:35.684293 11097 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:35.661150 16351 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:35.675980 11125 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 15.
I20260709 12:25:35.723022 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:35.723634 11125 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:35.727870 16403 raft_consensus.cc:2804] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:35.728523 16401 consensus_queue.cc:1048] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:35.728717 16400 consensus_queue.cc:1048] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:35.728543 16403 raft_consensus.cc:697] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:35.730294 16400 consensus_queue.cc:1059] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:35.731406 16400 raft_consensus.cc:3055] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:35.731236 16403 consensus_queue.cc:237] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:35.730309 16356 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:35.732712 16356 raft_consensus.cc:697] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 16 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:35.733646 16356 consensus_queue.cc:237] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:35.734229 16401 consensus_queue.cc:1059] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:35.735149 16401 raft_consensus.cc:3055] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:35.694715 10981 raft_consensus.cc:2393] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 14: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:35.659837 16092 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:35.701422 11133 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:35.701325 11057 raft_consensus.cc:1240] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:25:35.702836 10948 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:35.701380 16385 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:35.704766 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:35.709796 10977 raft_consensus.cc:1240] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 18 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 16. Current term is 18. Ops: []
I20260709 12:25:35.693179 15966 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:35.694983 16094 consensus_queue.cc:1048] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
W20260709 12:25:35.713433 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:35.719048 16221 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 19 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:35.736466 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:35.757382 10981 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:35.695734 15991 raft_consensus.cc:740] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:35.735540 16401 raft_consensus.cc:740] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
W20260709 12:25:35.751147 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 48404.1us
I20260709 12:25:35.731810 16400 raft_consensus.cc:740] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:35.786029 10981 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:25:35.755825 11126 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
I20260709 12:25:35.697657 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:35.760254 16385 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:35.688418 16126 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:35.794389 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:35.763782 10949 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:35.769075 11098 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:35.796921 16401 consensus_queue.cc:260] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:35.797542 16092 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:35.798206 16211 raft_consensus.cc:3055] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:35.798580 16211 raft_consensus.cc:740] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:35.799696 16126 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:35.799415 16211 consensus_queue.cc:260] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:35.772974 11023 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:35.777837 11054 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 14.
I20260709 12:25:35.787648 11055 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:35.787111 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:35.806691 10981 raft_consensus.cc:2393] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 10: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:35.807760 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:35.808427 10981 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 16.
I20260709 12:25:35.809351 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:35.787038 11052 raft_consensus.cc:1240] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:35.811620 10948 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:35.714825 16239 raft_consensus.cc:697] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 16 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:35.813024 16239 consensus_queue.cc:237] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:35.760099 15966 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:35.792435 11133 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 18.
I20260709 12:25:35.754925 16074 raft_consensus.cc:2804] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:25:35.817539 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 48531.8us
I20260709 12:25:35.838418 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:35.809921 10981 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:35.840166 11098 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:35.842775 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:25:35.843127 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 79439.2us
I20260709 12:25:35.843885 10949 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:35.844377 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:35.845052 10949 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:35.846287 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:35.848338 10949 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:35.851179 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:35.756681 16266 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:35.856170 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:35.856140 11098 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:35.863565 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:35.857447 11055 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 19.
I20260709 12:25:35.837910 16211 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:35.859861 11097 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:35.868095 11097 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:35.839444 16401 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:35.816839 16169 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:35.847040 16092 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:35.848965 16221 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:35.849212 16074 raft_consensus.cc:697] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 14 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:35.852947 16371 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:35.794003 16355 consensus_queue.cc:1059] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 12:25:35.855268 16335 raft_consensus.cc:2749] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:35.870385 16262 raft_consensus.cc:3055] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:35.800246 16333 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:35.878649 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:35.883080 16094 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:35.874419 16266 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:35.861745 15966 raft_consensus.cc:2804] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:35.861936 16353 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:35.889219 10981 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:25:35.852833 16179 raft_consensus.cc:2749] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:35.869753 16219 raft_consensus.cc:2749] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:25:35.873255 16126 raft_consensus.cc:2804] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:35.837723 15991 consensus_queue.cc:260] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:35.888029 16142 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:35.874698 16092 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:35.866657 16334 consensus_queue.cc:1059] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:25:35.914664 16334 raft_consensus.cc:3055] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:35.915050 16334 raft_consensus.cc:740] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:35.915825 16334 consensus_queue.cc:260] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:35.916826 16334 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:35.888381 16169 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.918423 16169 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:35.921478 16169 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:35.922228 16142 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:35.893091 16262 raft_consensus.cc:740] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:35.874985 16409 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.890791 16338 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:35.890461 16221 raft_consensus.cc:697] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 14 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:35.891438 16224 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:35.913180 16113 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:35.908990 11125 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 16.
I20260709 12:25:35.899950 16094 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:35.906769 15966 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:35.906497 16353 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:36.011603 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:35.930028 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:35.872448 16400 consensus_queue.cc:260] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:36.008721 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:35.910252 16406 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.008626 11645 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:36.010608 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:35.923437 16092 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:36.012452 10981 raft_consensus.cc:2393] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 18: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:36.015578 11132 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:36.017437 16082 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:36.014297 15966 raft_consensus.cc:3060] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:36.011174 16094 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:36.101442 10949 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:36.014142 16353 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:35.926488 16126 raft_consensus.cc:697] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:36.029937 16074 consensus_queue.cc:237] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:36.091370 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.091629 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:36.094723 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:36.095902 11127 raft_consensus.cc:1240] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:25:36.112030 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 886) took 1643 ms. Trace:
W20260709 12:25:36.090143 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.101289 10948 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:36.102027 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:36.113703 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:36.090926 16069 raft_consensus.cc:3055] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:36.099025 16113 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:36.112422 11025 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:36.108471 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 99946.7us
W20260709 12:25:36.103231 16405 log.cc:927] Time spent T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.091s	user 0.007s	sys 0.000s
I20260709 12:25:36.112372 11127 rpcz_store.cc:276] 0709 12:25:34.468320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.469759 (+  1439us) service_pool.cc:224] Handling call
0709 12:25:36.025297 (+1555538us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b5800117398. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfeee 000000000036eb39 00007f8f90d331e0 00007f8f90dfc0c4 00007f8f90dfc131 00007f8f90dbdfc0 00007f8f90da8929 00007f8f90da83d2 00007f8f8a31fbd4
0709 12:25:36.095625 (+ 70328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:36.111765 (+ 16140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.111973 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3566464}
W20260709 12:25:36.122278 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.163682 11680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:36.164464 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:25:36.143005 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.165056 11127 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:35.932550 16409 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:36.114871 16337 raft_consensus.cc:2804] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:36.154150 11681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:36.100407 16266 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:36.161999 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 60845.7us
I20260709 12:25:36.161945 11132 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 10.
I20260709 12:25:36.110003 16208 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:36.115041 16322 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:36.166637 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:36.115185 16400 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:36.181315 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:36.222301 11132 raft_consensus.cc:2393] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 13: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:36.164592 11680 raft_consensus.cc:2393] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 18: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:36.100133 16406 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:36.167166 16262 consensus_queue.cc:260] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:36.182555 10949 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:25:36.183111 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.184903 16371 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:36.226431 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 43996.8us
I20260709 12:25:36.185961 16333 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:36.186479 16134 consensus_queue.cc:1059] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:36.186957 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2765) took 1587 ms. Trace:
I20260709 12:25:36.232683 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:36.170305 16179 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.179435 16113 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:36.160167 16069 raft_consensus.cc:740] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:36.229658 16336 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:36.237701 16126 consensus_queue.cc:237] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:36.241971 16336 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:36.244215 16142 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:36.195086 16092 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:36.179083 16335 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:36.199406 11681 raft_consensus.cc:1275] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 12:25:36.284884 11681 pending_rounds.cc:85] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Aborting all ops after (but not including) 12
I20260709 12:25:36.285200 11681 pending_rounds.cc:107] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 12:25:36.285461 11681 raft_consensus.cc:2889] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:36.179316 16337 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:36.202082 16366 raft_consensus.cc:3055] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:36.187047 16221 consensus_queue.cc:237] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:36.203729 11127 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 16.
I20260709 12:25:36.293402 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:36.211988 16087 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:36.219924 16208 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:36.153374 16169 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:36.224735 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:36.303392 11674 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 18.
I20260709 12:25:36.163654 16082 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:36.090952 16224 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:36.233740 10981 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 15.
I20260709 12:25:36.233042 11130 rpcz_store.cc:276] 0709 12:25:34.599034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.456873 (+857839us) service_pool.cc:224] Handling call
0709 12:25:35.457230 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:35.629390 (+172160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:35.629428 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:35.629972 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 12:25:35.847505 (+217533us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:35.847554 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.847641 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:36.186720 (+339079us) raft_consensus.cc:1685] finished
0709 12:25:36.186746 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:36.186895 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":171705,"raft.queue_time_us":181458,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":142,"thread_start_us":184755,"threads_started":1,"wal-append.queue_time_us":243084}
I20260709 12:25:36.307723 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:36.308621 11130 raft_consensus.cc:2393] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 14: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:36.180284 16374 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.162272 16403 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:36.236012 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:36.232448 16322 raft_consensus.cc:697] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:36.238540 16179 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:36.240054 16406 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:36.240737 16113 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:36.241830 16069 consensus_queue.cc:260] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:36.185956 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 758) took 1023 ms. Trace:
I20260709 12:25:36.331444 10984 rpcz_store.cc:276] 0709 12:25:35.162472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.547706 (+385234us) service_pool.cc:224] Handling call
0709 12:25:35.566624 (+ 18918us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:35.567008 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:35.567042 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:35.567573 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 12:25:35.882721 (+315148us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:35.882761 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.882831 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:36.185725 (+302894us) raft_consensus.cc:1685] finished
0709 12:25:36.185744 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:36.185890 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":110,"thread_start_us":234718,"threads_started":1,"wal-append.queue_time_us":392932}
I20260709 12:25:36.244343 16336 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:36.195431 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 756) took 1033 ms. Trace:
I20260709 12:25:36.232944 16351 raft_consensus.cc:2804] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:36.251812 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:35.481890 10975 rpcz_store.cc:276] 0709 12:25:34.343357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.434638 (+1091281us) service_pool.cc:224] Handling call
0709 12:25:35.434926 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:35.435128 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:25:35.443819 (+  8691us) log.cc:844] Serialized 14 byte log entry
0709 12:25:35.478681 (+ 34862us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:35.478732 (+    51us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:35.478780 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.478841 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:35.478967 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8420,"prepare.queue_time_us":10129,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":7528,"raft.run_wall_time_us":2678,"thread_start_us":27185,"threads_started":1}
W20260709 12:25:36.281809 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.241325 16262 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:36.300597 11128 raft_consensus.cc:2368] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 14. Current term is 15.
I20260709 12:25:36.290431 16337 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:36.348577 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 225218us
I20260709 12:25:36.313012 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:36.351171 11127 raft_consensus.cc:2376] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bc01179655564f29b83babe396377cbb in term 16. Re-sending same reply.
I20260709 12:25:36.289516 16366 raft_consensus.cc:740] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:36.338946 10983 rpcz_store.cc:276] 0709 12:25:35.161738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.492788 (+331050us) service_pool.cc:224] Handling call
0709 12:25:35.493075 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:35.625819 (+132744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.195167 (+569348us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54001ab3d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:36.195368 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296958208}
I20260709 12:25:36.357851 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:36.358565 10983 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 17.
W20260709 12:25:36.358314 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 245956us
I20260709 12:25:36.359654 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:36.360467 10983 raft_consensus.cc:2393] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 16: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:36.362313 11097 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:36.341303 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:36.345594 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:36.364558 10981 raft_consensus.cc:2368] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 16. Current term is 17.
I20260709 12:25:36.347074 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:36.365468 10984 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:25:36.366626 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:25:36.348904 10976 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 2851) took 2274 ms (client timeout 2370 ms). Trace:
W20260709 12:25:36.367424 10976 rpcz_store.cc:269] 0709 12:25:34.074416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.381534 (+307118us) service_pool.cc:224] Handling call
0709 12:25:36.348632 (+1967098us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54001accd4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:36.348826 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323489152}
I20260709 12:25:36.368727 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:36.369408 10976 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:25:36.350538 10980 raft_consensus.cc:1275] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:36.287449 16335 raft_consensus.cc:697] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 19 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:36.373957 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:36.363839 10975 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:36.376107 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:36.356668 16351 raft_consensus.cc:697] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 10 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:36.359762 11025 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:36.381181 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:36.307479 16169 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:36.387434 11097 leader_election.cc:400] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Vote denied by peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777) with higher term. Message: Invalid argument: T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 16. Current term is 17.
I20260709 12:25:36.387877 11097 leader_election.cc:403] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:36.381916 11127 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:36.347285 16355 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.343850 16371 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:25:36.381100 16413 log.cc:927] Time spent T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
I20260709 12:25:36.396521 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:36.380250 16113 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:36.384533 16409 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:36.317203 16374 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:36.383279 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:36.402522 10975 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:25:36.403420 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:36.346817 16333 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:36.390882 16410 log.cc:927] Time spent T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
I20260709 12:25:36.320927 16403 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:36.403564 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:36.311750 16082 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:36.404719 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:36.393477 16411 log.cc:927] Time spent T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 12:25:36.416405 16378 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:36.423662 10981 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:36.378691 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:25:36.393113 16414 log.cc:927] Time spent T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:25:36.390353 16406 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:25:36.407891 16094 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:36.408699 16374 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:36.408989 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2764) took 1810 ms. Trace:
I20260709 12:25:36.418419 16335 consensus_queue.cc:237] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:36.414567 16333 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:36.412240 11127 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 16.
I20260709 12:25:36.402715 16113 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:36.401075 16371 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:36.426754 10983 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:36.416930 15992 consensus_queue.cc:1048] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:25:36.432229 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:36.473487 11059 raft_consensus.cc:2393] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 16: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:36.434829 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:36.433854 11055 raft_consensus.cc:1240] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:36.437603 16337 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:36.421149 16403 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:36.478396 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:36.478890 16169 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:36.447072 16351 consensus_queue.cc:237] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:36.479650 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:36.472258 16179 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:36.483982 11055 raft_consensus.cc:1275] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:25:36.485102 15966 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:36.412164 16322 consensus_queue.cc:237] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:36.492144 16337 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:36.493085 16419 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:36.493614 16419 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:36.494060 16419 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:36.494874 15966 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:36.495604 16371 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:36.495806 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:36.496234 10984 raft_consensus.cc:2468] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 15.
I20260709 12:25:36.493829 16406 raft_consensus.cc:2749] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777) with higher term. Message: Invalid argument: T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 16. Current term is 17.
I20260709 12:25:36.498181 16092 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:36.500310 16094 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:36.501263 16208 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:36.469795 16113 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:36.502115 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:36.425006 16378 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:36.503660 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:36.504333 16378 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:36.504930 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:36.505755 10979 raft_consensus.cc:2393] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 14: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:36.423933 16238 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.506575 11130 raft_consensus.cc:2393] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 13: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:36.506388 16238 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:36.396065 16355 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:36.441712 11129 rpcz_store.cc:276] 0709 12:25:34.598805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.420784 (+821979us) service_pool.cc:224] Handling call
0709 12:25:35.421109 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:35.802229 (+381120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:35.802282 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:35.843995 (+ 41713us) log.cc:844] Serialized 26 byte log entry
0709 12:25:35.886388 (+ 42393us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:35.886437 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.886509 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:36.200160 (+313651us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b4800061a58. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f90d0daa1 00007f8f90d04b37 00007f8f90d049ca 00007f8f90dfc26f 00007f8f90dfbf37 00007f8f90e1055c 00007f8f90e10508 00007f8f90e10488 00007f8f90e10443 00007f8f90e0f6ec 00007f8f8fd39a96
0709 12:25:36.408659 (+208499us) raft_consensus.cc:1685] finished
0709 12:25:36.408684 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:36.408921 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":195657,"raft.queue_time_us":215520,"raft.run_cpu_time_us":2003,"raft.run_wall_time_us":553916,"spinlock_wait_cycles":6366464,"thread_start_us":226940,"threads_started":2,"wal-append.queue_time_us":83333}
I20260709 12:25:36.471306 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:36.476267 11126 raft_consensus.cc:2393] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 17: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:36.511020 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:36.511703 11129 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 17.
I20260709 12:25:36.512724 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:36.513566 11059 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:25:36.415019 16366 consensus_queue.cc:260] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:36.514580 16421 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:36.515506 16208 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:36.516352 10983 raft_consensus.cc:2468] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:36.502207 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:36.516062 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:36.518301 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:36.514817 16366 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:36.419490 16082 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:36.516045 16208 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:36.439740 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:36.519608 11127 raft_consensus.cc:2393] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 16: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:36.519955 10979 raft_consensus.cc:2393] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 17: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:36.521087 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:36.521332 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:36.493722 16333 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:36.535372 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:36.542075 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 762) took 1343 ms. Trace:
I20260709 12:25:36.542537 10979 rpcz_store.cc:276] 0709 12:25:35.198389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.541210 (+1342821us) service_pool.cc:224] Handling call
0709 12:25:36.541537 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:36.541732 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:36.541757 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:36.541801 (+    44us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:36.541846 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.541901 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:36.542018 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:36.545329 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:36.546289 11127 raft_consensus.cc:2393] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 14: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:36.547778 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:36.548372 11127 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 17.
I20260709 12:25:36.549225 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:36.549872 11127 raft_consensus.cc:2393] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 15: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:36.551972 16419 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:36.556279 16419 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:36.523967 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 170585us
I20260709 12:25:36.605777 16353 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:36.613663 11023 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:36.518654 11129 raft_consensus.cc:2393] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 20: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
W20260709 12:25:36.473585 16239 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.015s	sys 0.018s
W20260709 12:25:36.614516 16239 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.015s	sys 0.018s
I20260709 12:25:36.615006 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:36.615715 16262 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:25:36.517772 16355 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:36.532410 10983 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 10.
I20260709 12:25:36.561631 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2868) took 2307 ms. Trace:
I20260709 12:25:36.620054 16330 raft_consensus.cc:3055] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:25:36.588197 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.633179 10983 raft_consensus.cc:1275] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:25:36.634343 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.596794 16113 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:36.599033 16238 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:36.541955 16418 raft_consensus.cc:2764] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:25:36.601714 16208 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:36.600821 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:36.602931 10948 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
W20260709 12:25:36.600246 16401 consensus_meta.cc:287] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.724s	user 0.012s	sys 0.003s
I20260709 12:25:36.528880 11125 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 14.
I20260709 12:25:36.531925 11133 raft_consensus.cc:2410] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:25:36.673089 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 2196) took 1087 ms. Trace:
I20260709 12:25:36.617108 11023 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:36.619711 16427 consensus_queue.cc:1048] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:36.615669 11129 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 10.
I20260709 12:25:36.622066 10980 rpcz_store.cc:276] 0709 12:25:34.254167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.742275 (+488108us) service_pool.cc:224] Handling call
0709 12:25:36.350054 (+1607779us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:36.371566 (+ 21512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.561386 (+189820us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b54001accd0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:36.561557 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3663254272}
I20260709 12:25:36.623160 10978 raft_consensus.cc:1275] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:25:36.626456 11675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41784 (request call id 842) took 1258 ms. Trace:
W20260709 12:25:36.523418 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 163714us
I20260709 12:25:36.675567 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:36.675551 11675 rpcz_store.cc:276] 0709 12:25:35.368101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.395481 (+ 27380us) service_pool.cc:224] Handling call
0709 12:25:35.478047 (+ 82566us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:35.480625 (+  2578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.626237 (+1145612us) spinlock_profiling.cc:243] Waited 82.2 ms on lock 0x7b54004e2fd0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:36.626385 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":189046656}
W20260709 12:25:36.660630 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.673435 11133 rpcz_store.cc:276] 0709 12:25:35.585709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.521070 (+935361us) service_pool.cc:224] Handling call
0709 12:25:36.673002 (+151932us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:36.670053 11127 raft_consensus.cc:2393] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 10: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
W20260709 12:25:36.670856 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 68018.3us
I20260709 12:25:36.678726 10948 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:36.631135 16355 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:36.674333 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 57314.3us
I20260709 12:25:36.687786 11023 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:36.683404 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 2206) took 1059 ms. Trace:
I20260709 12:25:36.688553 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2767) took 2025 ms. Trace:
I20260709 12:25:36.688871 11127 rpcz_store.cc:276] 0709 12:25:35.624181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.562538 (+938357us) service_pool.cc:224] Handling call
0709 12:25:36.683341 (+120803us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:36.690410 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2766) took 2028 ms. Trace:
I20260709 12:25:36.690861 11129 rpcz_store.cc:276] 0709 12:25:34.662421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.689496 (+2027075us) service_pool.cc:224] Handling call
0709 12:25:36.689820 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:36.690019 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:36.690046 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:36.690092 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:36.690158 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.690214 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:36.690350 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:36.635664 16419 raft_consensus.cc:2804] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:36.688951 11133 rpcz_store.cc:276] 0709 12:25:34.662765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.687761 (+2024996us) service_pool.cc:224] Handling call
0709 12:25:36.688082 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:36.688253 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:36.688277 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:36.688317 (+    40us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:36.688346 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.688394 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:36.688495 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:36.629956 16330 raft_consensus.cc:740] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:36.673650 16337 raft_consensus.cc:2764] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:25:36.704113 11132 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 16.
I20260709 12:25:36.711171 11133 raft_consensus.cc:1240] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 12:25:36.712443 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 2198) took 1118 ms. Trace:
I20260709 12:25:36.712785 11133 rpcz_store.cc:276] 0709 12:25:35.593610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.710432 (+1116822us) service_pool.cc:224] Handling call
0709 12:25:36.710871 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:36.712126 (+  1255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.712379 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:36.714299 11129 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 20 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:25:36.715181 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2772) took 1604 ms. Trace:
I20260709 12:25:36.715508 11129 rpcz_store.cc:276] 0709 12:25:35.111207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.700414 (+1589207us) service_pool.cc:224] Handling call
0709 12:25:36.701055 (+   641us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:36.714906 (+ 13851us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.715127 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:36.719514 11133 raft_consensus.cc:1240] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:25:36.720618 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 2202) took 1125 ms. Trace:
I20260709 12:25:36.720952 11133 rpcz_store.cc:276] 0709 12:25:35.594760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.713657 (+1118897us) service_pool.cc:224] Handling call
0709 12:25:36.719129 (+  5472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:36.720269 (+  1140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.720555 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:36.671872 16353 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:36.724777 11133 raft_consensus.cc:1275] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:25:36.725512 11133 pending_rounds.cc:85] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 7
I20260709 12:25:36.725867 11133 pending_rounds.cc:107] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:25:36.687443 16239 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:36.726166 11133 raft_consensus.cc:2889] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:36.686666 16418 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:36.732609 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 2211) took 1073 ms. Trace:
I20260709 12:25:36.695586 16419 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:36.738339 16419 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:36.736646 11133 rpcz_store.cc:276] 0709 12:25:35.659377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.721754 (+1062377us) service_pool.cc:224] Handling call
0709 12:25:36.722093 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:36.732342 (+ 10249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.732548 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:36.729696 16238 consensus_queue.cc:1048] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 12:25:36.747370 16419 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:36.750262 16419 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:36.753927 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:36.754509 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2758) took 2388 ms. Trace:
I20260709 12:25:36.753927 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:36.754966 11134 rpcz_store.cc:276] 0709 12:25:34.365902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.367518 (+  1616us) service_pool.cc:224] Handling call
0709 12:25:34.367905 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:35.408275 (+1040370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.754211 (+1345936us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400068954. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:36.754440 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2390756608}
I20260709 12:25:36.758157 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2880) took 2406 ms. Trace:
W20260709 12:25:36.759020 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.763082 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:36.761341 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:36.765475 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 895) took 1079 ms. Trace:
I20260709 12:25:36.762306 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:36.761734 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:36.768334 11678 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
I20260709 12:25:36.765928 11128 rpcz_store.cc:276] 0709 12:25:35.686032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.764609 (+1078577us) service_pool.cc:224] Handling call
0709 12:25:36.764947 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:36.765158 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:36.765183 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:36.765226 (+    43us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:36.765267 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.765318 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:36.765414 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:36.772321 11128 raft_consensus.cc:1275] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:25:36.772711 11128 pending_rounds.cc:85] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 7
I20260709 12:25:36.772943 11128 pending_rounds.cc:107] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:25:36.773180 11128 raft_consensus.cc:2889] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:36.699196 16355 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:36.758615 10977 rpcz_store.cc:276] 0709 12:25:34.351889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.440160 (+1088271us) service_pool.cc:224] Handling call
0709 12:25:35.448604 (+  8444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:35.752483 (+303879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.757866 (+1005383us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b540028aad4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:36.758070 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":600208768}
I20260709 12:25:36.775822 16330 consensus_queue.cc:260] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:36.777081 16330 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:36.779662 11645 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:36.781317 16360 raft_consensus.cc:2749] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:36.784214 16224 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:36.785244 11679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41774 (request call id 780) took 1871 ms (client timeout 2119 ms). Trace:
I20260709 12:25:36.758605 11134 raft_consensus.cc:1275] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:36.786485 11672 raft_consensus.cc:1240] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:25:36.786520 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 894) took 1100 ms. Trace:
I20260709 12:25:36.787956 11134 rpcz_store.cc:276] 0709 12:25:35.685787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.757813 (+1072026us) service_pool.cc:224] Handling call
0709 12:25:36.758221 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:36.786196 (+ 27975us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.786433 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:36.789186 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:36.791730 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 766) took 1458 ms. Trace:
I20260709 12:25:36.792198 10978 rpcz_store.cc:276] 0709 12:25:35.333778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.613666 (+1279888us) service_pool.cc:224] Handling call
0709 12:25:36.622836 (+  9170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:36.675260 (+ 52424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.791495 (+116235us) spinlock_profiling.cc:243] Waited 8.84 ms on lock 0x7b54001ac2d0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:36.791659 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20339072}
I20260709 12:25:36.793936 10978 raft_consensus.cc:1275] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:36.796391 10978 raft_consensus.cc:1275] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 12:25:36.797395 10978 pending_rounds.cc:85] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 5
I20260709 12:25:36.763141 10980 raft_consensus.cc:1240] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 14 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 12:25:36.801298 15864 consensus_queue.cc:1048] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:36.801764 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 2011) took 1055 ms. Trace:
I20260709 12:25:36.802256 10980 rpcz_store.cc:276] 0709 12:25:35.746276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.723394 (+977118us) service_pool.cc:224] Handling call
0709 12:25:36.762836 (+ 39442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:36.801433 (+ 38597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.801670 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:36.803762 10980 raft_consensus.cc:1275] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:36.800359 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 2223) took 1039 ms. Trace:
I20260709 12:25:36.767333 16113 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:36.805313 11128 rpcz_store.cc:276] 0709 12:25:35.761219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.771492 (+1010273us) service_pool.cc:224] Handling call
0709 12:25:36.771902 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:36.800057 (+ 28155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.800286 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:36.808267 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2770) took 2112 ms. Trace:
I20260709 12:25:36.808741 11127 rpcz_store.cc:276] 0709 12:25:34.695673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.689744 (+1994071us) service_pool.cc:224] Handling call
0709 12:25:36.798017 (+108273us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b5800117398. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90dbdfc0 00007f8f90da8929 00007f8f90da83d2 00007f8f8a31fbd4
0709 12:25:36.807718 (+  9701us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:36.807917 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:36.807946 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:36.807989 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:36.808023 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.808089 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:36.808204 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12776192}
I20260709 12:25:36.811736 11134 raft_consensus.cc:1240] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:36.812716 16355 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:36.811811 11127 raft_consensus.cc:1240] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:36.800881 10978 pending_rounds.cc:107] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 12:25:36.819051 10978 raft_consensus.cc:2889] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:36.818322 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:36.785689 11679 rpcz_store.cc:269] 0709 12:25:34.913610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.913775 (+   165us) service_pool.cc:224] Handling call
0709 12:25:36.785002 (+1871227us) spinlock_profiling.cc:243] Waited 56.2 ms on lock 0x7b54004bee54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:36.785177 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129307520}
I20260709 12:25:36.823247 11134 raft_consensus.cc:1240] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 9. Current term is 10. Ops: []
W20260709 12:25:36.827721 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 320286us
I20260709 12:25:36.830165 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:36.831115 11679 raft_consensus.cc:2393] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 12: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:36.832230 11134 raft_consensus.cc:1240] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:25:36.834702 11134 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:25:36.832888 16427 raft_consensus.cc:2804] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:36.833209 11024 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:36.840070 11060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:36.840787 11060 raft_consensus.cc:606] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:36.841143 11060 raft_consensus.cc:614] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:25:36.846071 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 162584us
I20260709 12:25:36.825290 16239 raft_consensus.cc:697] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 18 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:36.831888 16409 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.862592 16409 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:36.859740 16347 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:25:36.864563 16347 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:36.859616 16134 consensus_queue.cc:1048] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:25:36.868166 16262 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:36.859388 16087 consensus_queue.cc:1059] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 12:25:36.870687 16409 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:36.834540 16224 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:36.835459 16427 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:36.874019 16262 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:36.879032 16427 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:36.881148 16330 raft_consensus.cc:3055] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:36.886552 16262 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:25:36.957263 16412 log.cc:927] Time spent T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.858s	user 0.003s	sys 0.000s
I20260709 12:25:36.959450 16239 consensus_queue.cc:237] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:36.950052 16330 raft_consensus.cc:740] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:36.879676 16224 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:37.008282 16427 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:37.010952 16427 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:37.010671 16418 raft_consensus.cc:2749] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:25:37.013720 16415 log.cc:927] Time spent T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.726s	user 0.000s	sys 0.006s
I20260709 12:25:37.083974  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:37.089287 10877 catalog_manager.cc:5697] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 7 to 8, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 8 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:37.093936 10877 catalog_manager.cc:5697] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:37.095362  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:37.097632 10877 catalog_manager.cc:5697] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 10 to 12, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 12 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
W20260709 12:25:37.092348 10882 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41120 (request call id 266) took 40991 ms (client timeout 15000 ms). Trace:
W20260709 12:25:37.105357 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.107167 10949 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:37.116425 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 2009) took 1370 ms. Trace:
I20260709 12:25:37.119289 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52820 (request call id 2013) took 1264 ms. Trace:
I20260709 12:25:37.119814 10984 rpcz_store.cc:276] 0709 12:25:35.854843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.366301 (+511458us) service_pool.cc:224] Handling call
0709 12:25:37.118780 (+752479us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54000da054. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:37.119040 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296514304}
I20260709 12:25:37.123667 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:37.125159 10976 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 10.
W20260709 12:25:36.835744 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 148020us
I20260709 12:25:36.872143 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 2218) took 1112 ms. Trace:
I20260709 12:25:37.117089 10983 rpcz_store.cc:276] 0709 12:25:35.745740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.634066 (+888326us) service_pool.cc:224] Handling call
0709 12:25:36.635383 (+  1317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:36.661105 (+ 25722us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:36.661134 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:36.661601 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 12:25:37.115484 (+453883us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:37.115614 (+   130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:37.115802 (+   188us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:37.115886 (+    84us) raft_consensus.cc:1685] finished
0709 12:25:37.115917 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:37.116146 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25318,"raft.queue_time_us":26764,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":3395,"thread_start_us":420188,"threads_started":1,"wal-append.queue_time_us":210137}
I20260709 12:25:37.121888 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:37.141422 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2759) took 2544 ms. Trace:
I20260709 12:25:37.127578 11023 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:37.142222 11131 rpcz_store.cc:276] 0709 12:25:34.597342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.151471 (+554129us) service_pool.cc:224] Handling call
0709 12:25:35.151860 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:35.698899 (+547039us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:35.698935 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:35.708177 (+  9242us) log.cc:844] Serialized 26 byte log entry
0709 12:25:35.891283 (+183106us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:35.891321 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.891522 (+   201us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:35.908671 (+ 17149us) spinlock_profiling.cc:243] Waited 9.68 ms on lock 0x7b4800061a58. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f90d0daa1 00007f8f90d04b37 00007f8f90d049ca 00007f8f90dfc26f 00007f8f90dfbf37 00007f8f90e1055c 00007f8f90e10508 00007f8f90e10488 00007f8f90e10443 00007f8f90e0f6ec 00007f8f8fd39a96
0709 12:25:36.956565 (+1047894us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:25:37.140775 (+184210us) raft_consensus.cc:1685] finished
0709 12:25:37.140826 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:37.141168 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":445876,"raft.queue_time_us":484675,"raft.run_cpu_time_us":3105,"raft.run_wall_time_us":266057,"spinlock_wait_cycles":31865856,"thread_start_us":260741,"threads_started":2,"wal-append.queue_time_us":201244}
I20260709 12:25:37.146257 10984 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:37.146528 11023 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:37.126075 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 763) took 1856 ms. Trace:
I20260709 12:25:37.150421 10979 rpcz_store.cc:276] 0709 12:25:35.269509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.573603 (+1304094us) service_pool.cc:224] Handling call
0709 12:25:37.122492 (+548889us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:37.123045 (+   553us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:37.123082 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:37.123131 (+    49us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:37.123169 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:37.123245 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:37.125648 (+  2403us) spinlock_profiling.cc:243] Waited 523 ms on lock 0x7b54000da050. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:37.125834 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1201853696}
I20260709 12:25:37.151842 11023 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:37.152618 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:37.162423 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:37.137208 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 2219) took 1377 ms. Trace:
I20260709 12:25:37.139871 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36582 (request call id 2778) took 1031 ms. Trace:
I20260709 12:25:37.134853 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 2213) took 1469 ms. Trace:
W20260709 12:25:37.155125 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 306974us
I20260709 12:25:37.155980 16238 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.140623 11129 raft_consensus.cc:1240] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:37.127539 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:37.135830 11133 raft_consensus.cc:1240] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:37.153882 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:37.129678 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:37.163851 16265 raft_consensus.cc:2749] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:37.163770 16447 raft_consensus.cc:2804] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:37.164499 15570 raft_consensus.cc:2804] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:37.016156 16224 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:37.021042 16262 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:37.167044 11132 rpcz_store.cc:276] 0709 12:25:35.760064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.235403 (+475339us) service_pool.cc:224] Handling call
0709 12:25:37.136686 (+901283us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b5400106b54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:37.136966 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":852092160}
I20260709 12:25:37.188078 16211 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.190824 16211 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:37.191825 16262 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 19 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:37.013720 16330 consensus_queue.cc:260] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:37.194361 16211 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:37.195585 10979 raft_consensus.cc:2393] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 12: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:37.186398 16238 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:37.109232 10882 rpcz_store.cc:269] 0709 12:24:56.101396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.101623 (+   227us) service_pool.cc:224] Handling call
0709 12:25:37.092030 (+40990407us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:28.651149 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:28.929313 (+278164us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:28.939183 (+  9870us) write_op.cc:435] Acquired schema lock
0709 12:25:28.939204 (+    21us) tablet.cc:662] Decoding operations
0709 12:25:29.222111 (+282907us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:29.236533 (+ 14422us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:29.238992 (+  2459us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:25:29.348361 (+109369us) tablet.cc:701] Row locks acquired
0709 12:25:29.348417 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:25:29.348605 (+   188us) write_op.cc:270] Start()
0709 12:25:29.370793 (+ 22188us) write_op.cc:276] Timestamp: P: 1783599929348528 usec, L: 0
0709 12:25:29.370839 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 12:25:29.374383 (+  3544us) log.cc:844] Serialized 3253 byte log entry
0709 12:25:30.032166 (+657783us) op_driver.cc:464] REPLICATION: finished
0709 12:25:30.169418 (+137252us) write_op.cc:301] APPLY: starting
0709 12:25:30.183877 (+ 14459us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:30.366061 (+182184us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:30.422293 (+ 56232us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:30.479544 (+ 57251us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:30.479868 (+   324us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=0,mrs_lookups=0
0709 12:25:30.479928 (+    60us) write_op.cc:312] APPLY: finished
0709 12:25:30.480254 (+   326us) log.cc:844] Serialized 81 byte log entry
0709 12:25:30.481156 (+   902us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:30.481285 (+   129us) write_op.cc:454] Released schema lock
0709 12:25:30.481349 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:30.481843 (+   494us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:30.481879 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":771986,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":110387,"apply.run_cpu_time_us":17054,"apply.run_wall_time_us":322563,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37455,"num_ops":8,"prepare.queue_time_us":647193,"prepare.run_cpu_time_us":69192,"prepare.run_wall_time_us":995838,"raft.queue_time_us":229381,"raft.run_cpu_time_us":17550,"raft.run_wall_time_us":120868,"replication_time_us":652001,"thread_start_us":622040,"threads_started":4,"wal-append.queue_time_us":256032,"wal-append.run_cpu_time_us":22549,"wal-append.run_wall_time_us":1789010}]]}
W20260709 12:25:37.129699 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 282394us
I20260709 12:25:37.167521 11130 rpcz_store.cc:276] 0709 12:25:36.108136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.391483 (+283347us) service_pool.cc:224] Handling call
0709 12:25:37.137903 (+746420us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400066654. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:37.139621 (+  1718us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":235263872}
I20260709 12:25:37.172030 16447 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.185303 16333 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:37.153805 11023 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:37.186146 16140 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:37.167851 11126 rpcz_store.cc:276] 0709 12:25:35.665274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.251468 (+586194us) service_pool.cc:224] Handling call
0709 12:25:37.134126 (+882658us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b5400032d54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:37.134469 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":311655168}
I20260709 12:25:37.197547 10979 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:25:37.206576 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 892) took 1521 ms. Trace:
I20260709 12:25:37.207105 10981 raft_consensus.cc:2393] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 13: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:37.214706 16447 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:37.226052 16140 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:37.202677 16351 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:37.198313 10983 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 15.
I20260709 12:25:37.232468 11129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 2204) took 1621 ms. Trace:
I20260709 12:25:37.200481 16238 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:37.213567 11133 rpcz_store.cc:276] 0709 12:25:35.685237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.744902 (+1059665us) service_pool.cc:224] Handling call
0709 12:25:37.135116 (+390214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:37.205173 (+ 70057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:37.206262 (+  1089us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b5400032d50. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:37.206475 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":895702912}
I20260709 12:25:37.234755 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2913) took 1037 ms. Trace:
I20260709 12:25:37.248265 10979 rpcz_store.cc:276] 0709 12:25:36.178376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:37.196481 (+1018105us) service_pool.cc:224] Handling call
0709 12:25:37.197055 (+   574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:37.214031 (+ 16976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:37.215316 (+  1285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:37.235396 16333 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:37.236961 16353 consensus_queue.cc:1059] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:37.237938 11678 raft_consensus.cc:1275] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 12:25:37.109423 10877 catalog_manager.cc:5697] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:37.197757 15570 raft_consensus.cc:697] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:25:37.242674 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.241504 16322 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:37.204780 11643 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:37.196713 16069 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:37.131232 11125 rpcz_store.cc:276] 0709 12:25:35.759750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.009663 (+249913us) service_pool.cc:224] Handling call
0709 12:25:36.871987 (+862324us) spinlock_profiling.cc:243] Waited 508 ms on lock 0x7b5400033ed4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:36.872081 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1169042304}
W20260709 12:25:37.230285 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.237805 10981 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:25:37.262311 11057 raft_consensus.cc:1275] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:25:37.263806 16427 raft_consensus.cc:2804] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:37.264364 16427 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:37.264753 16427 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:37.267395 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 63069.5us
W20260709 12:25:37.270799 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.271795 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 768) took 1043 ms. Trace:
I20260709 12:25:37.269905 16446 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:37.272311 10981 rpcz_store.cc:276] 0709 12:25:36.227877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:37.236749 (+1008872us) service_pool.cc:224] Handling call
0709 12:25:37.237267 (+   518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:37.258736 (+ 21469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:37.271697 (+ 12961us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:37.272684 16446 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:37.274487 16446 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:37.274562 11025 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:37.269096 10984 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 18.
I20260709 12:25:37.246640 11129 rpcz_store.cc:276] 0709 12:25:35.611390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.716332 (+1104942us) service_pool.cc:224] Handling call
0709 12:25:37.135905 (+419573us) spinlock_profiling.cc:243] Waited 5.93 ms on lock 0x7b5800117398. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cbfa22 00007f8f91bd88d9 00007f8f90d32ee0 00007f8f90dfc0ab 00007f8f90dfc131 00007f8f90dbdfc0 00007f8f90da8929 00007f8f90da83d2 00007f8f8a31fbd4
0709 12:25:37.139998 (+  4093us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:37.172391 (+ 32393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:37.232218 (+ 59827us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b5400066650. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:37.232401 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21607680}
I20260709 12:25:37.282977 15991 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:37.294238 16322 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:37.275805 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:25:37.286852 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 173674us
I20260709 12:25:37.304708 10984 raft_consensus.cc:1275] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:25:37.307127 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 52803.9us
I20260709 12:25:37.308228 11025 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:37.309377 16440 raft_consensus.cc:2749] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:37.314450 16335 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.315181 16335 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:37.317704 16335 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:37.318960 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 165359us
I20260709 12:25:37.318470 16355 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.320832 10984 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:25:37.313524 16364 consensus_queue.cc:1048] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 12:25:37.372398 16355 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:37.360097 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 769) took 1113 ms. Trace:
I20260709 12:25:37.305891 16333 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:37.295325 16238 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.383697 10949 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:37.431290 16333 raft_consensus.cc:2749] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:37.431669 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 48146.9us
I20260709 12:25:37.432255  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:25:37.384495 10982 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.008s	sys 0.015s
W20260709 12:25:37.434377 10982 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.009s	sys 0.015s
I20260709 12:25:37.430418 16238 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:37.324461 15570 consensus_queue.cc:237] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:37.398629 10983 raft_consensus.cc:1275] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:25:37.400661 10975 raft_consensus.cc:2410] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:25:37.400624 16338 raft_consensus.cc:3055] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:37.402161 16342 consensus_queue.cc:1059] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.115s
I20260709 12:25:37.404650 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:37.420182 16140 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:37.411428 16427 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:37.426599 10979 raft_consensus.cc:1275] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:25:37.410279 10877 catalog_manager.cc:5697] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
W20260709 12:25:37.427187 11026 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.017s	sys 0.016s
I20260709 12:25:37.428345 16332 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.417178 10981 rpcz_store.cc:276] 0709 12:25:36.228181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:37.273233 (+1045052us) service_pool.cc:224] Handling call
0709 12:25:37.273751 (+   518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:37.298696 (+ 24945us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:37.298732 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:37.341443 (+ 42711us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:37.341496 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:37.341565 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:37.341709 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17722,"raft.queue_time_us":36202,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":134}
I20260709 12:25:37.433835 10949 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:37.481935 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 101172us
I20260709 12:25:37.494999 10984 raft_consensus.cc:1275] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:37.498624 10975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52828 (request call id 2896) took 1324 ms. Trace:
I20260709 12:25:37.410614 16265 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:25:37.505967 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 97744.9us
I20260709 12:25:37.437624 16238 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:37.508126 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 770) took 1246 ms. Trace:
I20260709 12:25:37.509727 10979 rpcz_store.cc:276] 0709 12:25:36.256532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:37.286633 (+1030101us) service_pool.cc:224] Handling call
0709 12:25:37.409442 (+122809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:37.500461 (+ 91019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:37.503069 (+  2608us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:37.508148 11026 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.018s	sys 0.016s
I20260709 12:25:37.450934 16338 raft_consensus.cc:740] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:37.503278 10975 rpcz_store.cc:276] 0709 12:25:36.174001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.403343 (+229342us) service_pool.cc:224] Handling call
0709 12:25:37.498285 (+1094942us) spinlock_profiling.cc:243] Waited 976 ms on lock 0x7b540035fa54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:37.498529 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2245296384}
I20260709 12:25:37.504616 16265 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:37.527359 10948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.520169 16238 raft_consensus.cc:2749] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:37.523283 16265 raft_consensus.cc:3060] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:37.546954 10978 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.023s	sys 0.022s
W20260709 12:25:37.547465 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 113730us
I20260709 12:25:37.548327 15992 consensus_queue.cc:1048] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
W20260709 12:25:37.549525 16417 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.018s	sys 0.036s
I20260709 12:25:37.548547 10949 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:37.545274 11645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.012s	sys 0.012s
I20260709 12:25:37.522838 16447 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:37.559631 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.556857 11052 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 20.
W20260709 12:25:37.561877 11645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.012s	sys 0.012s
W20260709 12:25:37.550027 16417 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.018s	sys 0.036s
I20260709 12:25:37.590468 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:37.591382 11127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 903) took 1327 ms. Trace:
I20260709 12:25:37.591909 11127 rpcz_store.cc:276] 0709 12:25:36.219269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.814247 (+594978us) service_pool.cc:224] Handling call
0709 12:25:36.814734 (+   487us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:36.815570 (+   836us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:36.815603 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:36.817453 (+  1850us) log.cc:844] Serialized 52 byte log entry
0709 12:25:37.140165 (+322712us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:37.140291 (+   126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:37.140454 (+   163us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:37.539290 (+398836us) raft_consensus.cc:1685] finished
0709 12:25:37.539315 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:37.546187 (+  6872us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":255,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":99,"thread_start_us":321833,"threads_started":1,"wal-append.queue_time_us":562370}
I20260709 12:25:37.594223 16426 consensus_queue.cc:1048] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:37.594638 10877 catalog_manager.cc:5697] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:37.596230 16355 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:37.598795 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:37.599797 11672 raft_consensus.cc:2410] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:25:37.607558 16447 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:37.610605 11052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52804 (request call id 801) took 1176 ms. Trace:
I20260709 12:25:37.611120 11052 rpcz_store.cc:276] 0709 12:25:36.434371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.434539 (+   168us) service_pool.cc:224] Handling call
0709 12:25:37.610288 (+1175749us) spinlock_profiling.cc:243] Waited 927 ms on lock 0x7b54003714d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:37.610462 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2131300096}
W20260709 12:25:37.617074 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 68658.7us
I20260709 12:25:37.618315 10949 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:37.620240 11128 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.009s	sys 0.004s
W20260709 12:25:37.620738 11128 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.009s	sys 0.005s
I20260709 12:25:37.621809 16338 consensus_queue.cc:260] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:37.623512 16338 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:37.626245 11098 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.006s	sys 0.008s
W20260709 12:25:37.626659 11098 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.006s	sys 0.008s
W20260709 12:25:37.627077 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 795308us
I20260709 12:25:37.628023 16224 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.628675 16224 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:37.630146 11060 raft_consensus.cc:1240] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:37.634543 16330 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:37.638866 16419 consensus_queue.cc:1059] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.109s
I20260709 12:25:37.640317 16419 raft_consensus.cc:3055] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:37.640622 16239 raft_consensus.cc:2749] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:37.593004 16418 consensus_queue.cc:1048] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.131s
I20260709 12:25:37.651678 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:37.656729 11051 raft_consensus.cc:1240] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:37.554593 16332 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:37.658600 16447 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.661008 16447 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:37.634438 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 2010) took 1888 ms. Trace:
W20260709 12:25:37.583909 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 728374us
I20260709 12:25:37.626503 16427 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:37.690263 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.656646 16322 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:37.697863 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:37.698870 11056 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:37.700287 16332 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:37.701309 11644 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:37.704659 16347 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:37.705085 16347 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:37.705449 16347 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:37.707271 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:37.669080 10982 rpcz_store.cc:276] 0709 12:25:35.745970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.662848 (+916878us) service_pool.cc:224] Handling call
0709 12:25:36.693296 (+ 30448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:36.693738 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:36.693770 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:36.694328 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 12:25:37.435003 (+740675us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:37.435087 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:37.435191 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:37.634161 (+198970us) raft_consensus.cc:1685] finished
0709 12:25:37.634184 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:37.634366 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1400,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":24263,"thread_start_us":697066,"threads_started":1,"wal-append.queue_time_us":907116}
I20260709 12:25:37.709568 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:37.710707 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:37.711565 11053 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
I20260709 12:25:37.711884 16447 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:37.712349 11057 raft_consensus.cc:1240] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 12:25:37.714974 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:25:37.720077 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.672845 16364 consensus_queue.cc:1048] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 12:25:37.714215 16435 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.580897 15864 consensus_queue.cc:1048] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.224s
I20260709 12:25:37.640799 16419 raft_consensus.cc:740] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:25:37.775669 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 231201us
I20260709 12:25:37.760637 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:37.753391 16351 consensus_meta.cc:287] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.008s
I20260709 12:25:37.780292 10977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 2012) took 1891 ms. Trace:
I20260709 12:25:37.784564 11052 raft_consensus.cc:1240] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 12:25:37.789816 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 250320us
I20260709 12:25:37.815222 10978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2903) took 1613 ms. Trace:
I20260709 12:25:37.784240 16351 raft_consensus.cc:2749] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:37.828434 16224 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:37.829087 16224 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:37.829744 16459 log.cc:927] Time spent T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:25:37.830718 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:37.832099 16461 log.cc:927] Time spent T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:25:37.832432 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:37.833221 11055 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 16.
I20260709 12:25:37.835258 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:37.836582 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:37.837467 11054 raft_consensus.cc:2410] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:25:37.839196 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:37.839984 11053 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 14.
I20260709 12:25:37.841022 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:37.825006 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:37.827620 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:37.817947 16435 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:37.828203 11058 raft_consensus.cc:1240] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:37.842203 11679 raft_consensus.cc:1275] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:25:37.783388 10977 rpcz_store.cc:276] 0709 12:25:35.854565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.774779 (+920214us) service_pool.cc:224] Handling call
0709 12:25:37.127738 (+352959us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:37.128929 (+  1191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:37.129004 (+    75us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:37.129891 (+   887us) log.cc:844] Serialized 26 byte log entry
0709 12:25:37.522318 (+392427us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:37.522358 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:37.525315 (+  2957us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:37.701605 (+176290us) raft_consensus.cc:1685] finished
0709 12:25:37.701625 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:37.746117 (+ 44492us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b5400099f50. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde38ad 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:37.746318 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":55702,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":294,"spinlock_wait_cycles":810439424,"thread_start_us":383908,"threads_started":1,"wal-append.queue_time_us":533876}
I20260709 12:25:37.596318 10877 catalog_manager.cc:5697] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:37.819384 10978 rpcz_store.cc:276] 0709 12:25:36.175767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.820381 (+644614us) service_pool.cc:224] Handling call
0709 12:25:36.820748 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:36.820977 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:36.821003 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:36.821521 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 12:25:37.547670 (+726149us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:37.766507 (+218837us) log.cc:844] Serialized 14 byte log entry
0709 12:25:37.766788 (+   281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:37.779804 (+ 13016us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:37.779852 (+    48us) raft_consensus.cc:1685] finished
0709 12:25:37.779864 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:37.789354 (+  9490us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":96231,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":10786,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":5717,"thread_start_us":943959,"threads_started":2,"wal-append.queue_time_us":817264}
I20260709 12:25:37.843410 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:37.844597 11060 raft_consensus.cc:2393] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 11: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:37.846212 11051 raft_consensus.cc:1275] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:37.780820 16238 raft_consensus.cc:2749] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:37.846467 11053 raft_consensus.cc:1275] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:25:37.845963 11058 raft_consensus.cc:1275] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:37.849047 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 897) took 1631 ms. Trace:
I20260709 12:25:37.849169 11023 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:37.863986 10877 catalog_manager.cc:5697] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:37.866189 16435 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:37.866478 16419 consensus_queue.cc:260] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:37.867216 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.870605 16134 consensus_queue.cc:1059] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:37.870886 16449 consensus_queue.cc:1059] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.083s
W20260709 12:25:37.849992 16464 log.cc:927] Time spent T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 12:25:37.842861 16463 log.cc:927] Time spent T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:25:37.852484 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:37.854156 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:37.855326 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:37.855949 11132 raft_consensus.cc:1240] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:37.856377 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:37.857817 16172 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.859484 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:37.829814 16224 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:37.843116 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:37.878924 11052 raft_consensus.cc:1275] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:25:37.846495 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:37.882009 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:37.895905 11128 rpcz_store.cc:276] 0709 12:25:36.217552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.808101 (+590549us) service_pool.cc:224] Handling call
0709 12:25:36.808479 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:36.810788 (+  2309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:36.810824 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:36.817950 (+  7126us) log.cc:844] Serialized 26 byte log entry
0709 12:25:37.621271 (+803321us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:37.621332 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:37.621439 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:37.848731 (+227292us) raft_consensus.cc:1685] finished
0709 12:25:37.848760 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:37.848968 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":631,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":109,"thread_start_us":802727,"threads_started":1,"wal-append.queue_time_us":1028665}
W20260709 12:25:37.850315 16452 log.cc:927] Time spent T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:25:37.884155 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:37.885456 10948 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:37.892257 16265 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:37.783006 16332 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.898160 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:37.883152 11054 raft_consensus.cc:2410] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:25:37.915189 11060 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 14.
I20260709 12:25:37.926386 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:37.927137 11059 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:37.939853 11055 raft_consensus.cc:2368] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 13. Current term is 14.
I20260709 12:25:37.944962 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:37.946043 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:37.953986 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:37.923295 16426 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.898066 16347 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:37.956961 11129 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:37.957166 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:37.957759 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 72430.1us
I20260709 12:25:37.960036 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:37.960402 11057 raft_consensus.cc:2368] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 16. Current term is 17.
I20260709 12:25:37.938822 16419 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:37.946182 16446 consensus_meta.cc:287] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.648s	user 0.009s	sys 0.003s
I20260709 12:25:37.965799 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:37.956764 16435 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.983385 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:37.983510 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:37.987260 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:37.985965 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 171568us
I20260709 12:25:37.989868 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:37.988438 11053 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:37.975099 15570 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.999553 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:38.000129 11053 raft_consensus.cc:1275] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 12:25:38.001889 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:37.995520 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:37.994957 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:38.004560 11097 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 2.066s (SENT) [suppressed 16 similar messages]
I20260709 12:25:37.897995 10877 catalog_manager.cc:5697] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 11 to 14, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 14 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:38.005318 10948 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:38.004369 16211 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:38.014961 11053 raft_consensus.cc:1275] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:25:38.016839 11132 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 16.
I20260709 12:25:37.974299 16446 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:37.984068 16435 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:38.033679 11051 raft_consensus.cc:1240] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:25:38.007025 16338 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:37.972479 16172 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:37.993418 16426 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:38.054211 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:37.992220 16332 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:38.059864 11023 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:38.058983 11131 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 18.
I20260709 12:25:38.005573 15570 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:38.046551 11098 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:38.040324 16475 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.045533 16338 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:38.071254 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.080999 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:38.084194 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:38.047353 16444 consensus_queue.cc:1059] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:25:38.066082 16333 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:38.093518 11051 raft_consensus.cc:1275] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:38.095674 11052 raft_consensus.cc:1275] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:38.065250 16468 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:38.100831 11060 raft_consensus.cc:1275] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:38.080189 16338 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:38.106130 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 50793.1us
I20260709 12:25:38.103399 10976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2911) took 1925 ms. Trace:
I20260709 12:25:38.092259 16427 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:38.087399 16265 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:38.114974 11133 raft_consensus.cc:2393] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 15: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:38.101876 16468 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:38.108310 10976 rpcz_store.cc:276] 0709 12:25:36.177780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:37.187652 (+1009872us) service_pool.cc:224] Handling call
0709 12:25:37.188270 (+   618us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:37.188805 (+   535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:37.188837 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:37.279517 (+ 90680us) spinlock_profiling.cc:243] Waited 42 ms on lock 0x7b2c00030d28. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8a6dda11 00007f8f8a6ed372 00007f8f8be1fa01 00007f8f8bde443a 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2
0709 12:25:37.320348 (+ 40831us) log.cc:844] Serialized 26 byte log entry
0709 12:25:37.512155 (+191807us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:37.566138 (+ 53983us) log.cc:844] Serialized 14 byte log entry
0709 12:25:37.575706 (+  9568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:37.575849 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:38.099854 (+524005us) raft_consensus.cc:1685] finished
0709 12:25:38.103153 (+  3299us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:38.103327 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1186,"prepare.queue_time_us":131218,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":16396,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":5354,"spinlock_wait_cycles":96708480,"thread_start_us":230761,"threads_started":2,"wal-append.queue_time_us":340714}
I20260709 12:25:38.122957 11134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 910) took 1309 ms. Trace:
W20260709 12:25:38.124006 16471 log.cc:927] Time spent T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:25:38.125752 10980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2902) took 1905 ms. Trace:
I20260709 12:25:38.128937 11132 raft_consensus.cc:1275] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:38.129290 11673 raft_consensus.cc:1240] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:38.130153 16467 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.086s
W20260709 12:25:38.145382 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 105136us
I20260709 12:25:38.132422 15570 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:38.102576 16224 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:38.146075 11129 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 16.
I20260709 12:25:38.146905 16224 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.147576 16224 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:38.149901 16224 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:38.150578 16224 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:38.151109 16224 raft_consensus.cc:697] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:38.152275 16224 consensus_queue.cc:237] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:38.133674 16342 consensus_queue.cc:1048] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
W20260709 12:25:38.144227 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 142297us
I20260709 12:25:38.154759 10948 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:38.132004 16477 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.157649 16477 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:38.174947 11131 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:25:38.136032 16347 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:38.142319 16330 raft_consensus.cc:3055] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:38.143157 16468 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:38.193979 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 58985us
I20260709 12:25:38.100991 16475 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:38.142880 10980 rpcz_store.cc:276] 0709 12:25:36.175529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.805376 (+629847us) service_pool.cc:224] Handling call
0709 12:25:36.805659 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:36.823830 (+ 18171us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:37.532722 (+708892us) log.cc:844] Serialized 14 byte log entry
0709 12:25:37.815147 (+282425us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:37.951754 (+136607us) log.cc:844] Serialized 26 byte log entry
0709 12:25:37.951967 (+   213us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:37.952003 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:37.971629 (+ 19626us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:38.052577 (+ 80948us) raft_consensus.cc:1685] finished
0709 12:25:38.052599 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:38.081147 (+ 28548us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5265,"prepare.queue_time_us":819669,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":24367,"raft.run_cpu_time_us":365,"raft.run_wall_time_us":53218,"thread_start_us":610475,"threads_started":2,"wal-append.queue_time_us":283025}
W20260709 12:25:38.202541 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 198681us
I20260709 12:25:38.168896 16477 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:38.137207 11134 rpcz_store.cc:276] 0709 12:25:36.805056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.844592 (+ 39536us) service_pool.cc:224] Handling call
0709 12:25:36.847396 (+  2804us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:36.847682 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:36.847706 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:36.873876 (+ 26170us) log.cc:844] Serialized 26 byte log entry
0709 12:25:37.579956 (+706080us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:38.009610 (+429654us) log.cc:844] Serialized 14 byte log entry
0709 12:25:38.084999 (+ 75389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:38.092234 (+  7235us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:38.092284 (+    50us) raft_consensus.cc:1685] finished
0709 12:25:38.092295 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:38.113973 (+ 21678us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8874,"prepare.queue_time_us":384476,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":7445,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":2721,"thread_start_us":666570,"threads_started":3,"wal-append.queue_time_us":508825}
I20260709 12:25:38.207330 10976 raft_consensus.cc:1240] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 12. Current term is 13. Ops: []
W20260709 12:25:38.218219 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 164038us
I20260709 12:25:38.221774 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:38.198561 16330 raft_consensus.cc:740] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:25:38.227484 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 94243.7us
I20260709 12:25:38.199808 16335 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:38.228679 11025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.228365 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:38.229774 10948 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:38.231057 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:38.231818 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:38.236552 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:38.199877 16364 consensus_queue.cc:1059] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:25:38.225447 16351 raft_consensus.cc:2804] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:38.207084 16333 consensus_queue.cc:1048] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:25:38.253298 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:38.256353 16330 consensus_queue.cc:260] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:38.263262 16332 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:38.265596 10976 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
I20260709 12:25:38.224694 16134 consensus_queue.cc:1048] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:25:38.240173 16489 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.279408 16435 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:38.274650 10978 raft_consensus.cc:2393] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 14: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:38.280591 10980 raft_consensus.cc:1240] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:38.237344 10982 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 16.
I20260709 12:25:38.282120 11127 raft_consensus.cc:2468] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 17.
I20260709 12:25:38.238902 16426 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:38.207639 16355 consensus_queue.cc:1048] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:25:38.265312 16351 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.231376 16446 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:38.275842 16474 log.cc:927] Time spent T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
W20260709 12:25:38.275441 16481 log.cc:927] Time spent T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.056s	user 0.001s	sys 0.001s
I20260709 12:25:38.277539 16172 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:38.308653 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 80770.2us
I20260709 12:25:38.310365 11098 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
W20260709 12:25:38.311348 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.312067 16495 consensus_queue.cc:1048] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:38.286541 16333 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:38.261994 16338 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:38.279543 16489 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:38.324405 16338 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:38.313835 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:38.325320 10980 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:38.328312 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:38.329350 10984 raft_consensus.cc:2410] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:25:38.329982 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:38.330530 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:38.330821 10975 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:25:38.331496 16494 consensus_queue.cc:1048] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:25:38.333001 11643 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:38.334440 16499 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:38.324404 16489 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:38.343349 11643 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:38.344743 11643 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:38.345242 16446 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:38.345662 16483 raft_consensus.cc:2804] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:38.346091 16483 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.346534 16483 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:38.350756 16330 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:38.350826 16134 consensus_queue.cc:1059] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:38.352033 16489 raft_consensus.cc:3055] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:38.352401 16489 raft_consensus.cc:740] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:38.353300 16489 consensus_queue.cc:260] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:38.237691 16335 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:38.295414 16351 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:38.360975 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:38.322232 16482 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.365013 11059 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 15.
W20260709 12:25:38.368758 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 90105.3us
I20260709 12:25:38.386423 11055 raft_consensus.cc:1240] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:38.233518 16239 consensus_queue.cc:1048] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
W20260709 12:25:38.383797 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 154172us
W20260709 12:25:38.370404 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 60182.9us
I20260709 12:25:38.386606 10976 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 14.
I20260709 12:25:38.389979 10980 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 16.
I20260709 12:25:38.132632 10877 catalog_manager.cc:5697] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index 2 to 7, term changed from 6 to 13, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to <none>, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER bc01179655564f29b83babe396377cbb (127.9.145.193), VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194), VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195), VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 13 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:38.389014 10948 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:38.345679 16446 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:38.401808 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:38.404201 11131 raft_consensus.cc:2393] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 20: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:38.403800 16497 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:38.408365 11127 raft_consensus.cc:1275] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:25:38.412842 10877 catalog_manager.cc:5697] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 9 to 11, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 11 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:38.415023 10877 catalog_manager.cc:5697] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 11 to 13, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 13 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:38.416864 10877 catalog_manager.cc:5697] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 9 to 12, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 12 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:38.397601 16475 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:38.404249 16446 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:38.418686 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:38.423425 16499 raft_consensus.cc:2749] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:38.397032 16335 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:38.398598 16338 raft_consensus.cc:2804] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:38.433424 16338 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.433876 16338 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:38.441541 16338 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:38.444365 16338 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:38.396925 16482 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:38.449591 16482 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:38.449954 16342 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.450649 16342 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:38.451414 16351 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:38.453598 16351 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:38.454272 11098 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:38.454521 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:38.455209 10978 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 15.
I20260709 12:25:38.455672 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:38.455960 16483 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:38.460052 16446 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:38.461381 16468 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:38.462010 16417 raft_consensus.cc:3055] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:38.472724 11643 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:38.474577 10976 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 13.
I20260709 12:25:38.473989 11643 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:38.465984 16502 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:38.467170 10978 raft_consensus.cc:1240] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 13. Current term is 14. Ops: [10.6-13.7]
I20260709 12:25:38.467391 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:38.468302 10877 catalog_manager.cc:5697] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
W20260709 12:25:38.469954 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 71283.8us
I20260709 12:25:38.468215 10981 raft_consensus.cc:1240] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:25:38.462344 16446 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:38.480995 11025 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:38.483899 11025 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:38.483163 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:38.485114 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 78057.3us
I20260709 12:25:38.478518 16475 consensus_queue.cc:1059] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:25:38.488505 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:38.488722 11645 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:38.489176 16475 consensus_queue.cc:1243] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer bc01179655564f29b83babe396377cbb log is divergent from this leader: its last log entry 14.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:25:38.488361 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:38.490032 11645 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:38.490320 16499 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:38.490757 16499 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.490971 10975 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:38.491111 16499 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:38.492882 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:38.488822 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:38.489800 16475 raft_consensus.cc:3055] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:38.494149 10979 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:25:38.494297 16475 raft_consensus.cc:740] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:38.495287 16475 consensus_queue.cc:260] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:38.496629 16475 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:38.486160 16482 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:38.498361 16482 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.498720 16482 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:38.499495 16238 raft_consensus.cc:3055] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:38.499898 16238 raft_consensus.cc:740] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:38.500401 16172 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:38.500757 16238 consensus_queue.cc:260] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:38.501216 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:38.492539 16502 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:38.503268 16501 raft_consensus.cc:2749] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:38.504247 16502 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:38.475976 16417 raft_consensus.cc:740] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:38.502310 16342 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:38.489188 10981 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:38.505766 16417 consensus_queue.cc:260] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:38.506944 16417 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:38.507380 16322 raft_consensus.cc:3055] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:38.507761 16322 raft_consensus.cc:740] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:38.489434 11097 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:38.509538 11673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41762 (request call id 1053) took 1232 ms. Trace:
I20260709 12:25:38.512424 11643 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:38.498601 11127 raft_consensus.cc:1240] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:38.508687 16322 consensus_queue.cc:260] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:38.521270 16426 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:38.522074 11097 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:38.522524 16211 raft_consensus.cc:2804] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:38.522728 16501 raft_consensus.cc:2804] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:38.493875 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:38.523243 16501 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:38.523033 16211 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.524120 16211 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:38.493482 11128 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 13.
I20260709 12:25:38.526156 10948 leader_election.cc:400] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 13. Current term is 14.
I20260709 12:25:38.509927 11673 rpcz_store.cc:276] 0709 12:25:37.277453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:37.350712 (+ 73259us) service_pool.cc:224] Handling call
0709 12:25:37.380108 (+ 29396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:38.144969 (+764861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:38.509261 (+364292us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b54001b17d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:38.509439 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1553901312}
I20260709 12:25:38.526569 10948 leader_election.cc:403] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:38.526541 10979 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 16.
I20260709 12:25:38.523624 11125 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 16.
I20260709 12:25:38.529594 10975 raft_consensus.cc:2410] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:25:38.506815 16489 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:38.532498 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:38.482046 16330 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:38.500829 16172 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.535751 16172 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:38.538484 16322 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:38.542485 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:38.543329 10979 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:25:38.544324 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:38.544647 11643 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:38.535640 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:38.545780 10978 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:38.544940 10979 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:38.534580 11025 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:38.552757 10975 raft_consensus.cc:2393] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 17: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
W20260709 12:25:38.555989 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 70111us
I20260709 12:25:38.523692 16501 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:38.531886 16342 raft_consensus.cc:2749] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:38.563066 16426 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:38.562057 11025 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:38.563192 16487 consensus_queue.cc:1048] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
W20260709 12:25:38.564095 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 158536us
I20260709 12:25:38.562237 10948 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:38.552556 16446 raft_consensus.cc:2804] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:38.577807 11097 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:38.582506 16446 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.583005 16446 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:38.584013 10981 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 13.
I20260709 12:25:38.585569 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:38.578287 10877 catalog_manager.cc:5697] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 7 to 12, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 12 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:38.591388 10877 catalog_manager.cc:5697] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 9 to 12, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 12 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
W20260709 12:25:38.592635 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.561321 16494 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:38.561548 16502 raft_consensus.cc:2749] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 13. Current term is 14.
I20260709 12:25:38.558558 16330 raft_consensus.cc:697] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:38.587126 16468 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:38.547425 16499 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:38.588119 16486 consensus_queue.cc:1048] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:38.563232 16238 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:38.588835 16497 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:38.610455 16497 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:38.594405 10981 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 16.
I20260709 12:25:38.594990 10979 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:25:38.577905 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:38.611137 11098 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:38.611820 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:38.613124 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:38.599126 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:38.614207 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:38.614300 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:38.614692 10983 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:38.615674 10981 raft_consensus.cc:1240] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:25:38.616983 16499 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:38.601387 11025 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:38.618746 10979 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:38.593379 10877 catalog_manager.cc:5697] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 9 to 11, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 11 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:38.613782 11098 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:38.574551 16435 raft_consensus.cc:2804] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:38.610219 16338 consensus_queue.cc:1048] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:38.604363 16483 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:38.619266 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 50851.8us
I20260709 12:25:38.606056 16330 consensus_queue.cc:237] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:38.603511 10978 raft_consensus.cc:2468] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 16.
I20260709 12:25:38.621340 10982 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:38.629555 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:38.625557 10984 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:25:38.598320 16351 raft_consensus.cc:2749] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:38.598814 16426 raft_consensus.cc:697] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:38.610915 16497 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:38.614332 16477 raft_consensus.cc:2749] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:38.631633 10877 catalog_manager.cc:5697] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 1 to 11, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 11 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:38.603580 16495 consensus_queue.cc:1048] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:25:38.618243 16239 consensus_queue.cc:1048] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:25:38.635617 11023 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:38.641613 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:38.655973 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:25:38.650892 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 67598.9us
I20260709 12:25:38.657626 11057 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:38.624018 16468 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:38.648392 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:38.632409 16335 consensus_queue.cc:1048] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:38.628521 16435 raft_consensus.cc:697] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:38.661155 10983 raft_consensus.cc:2410] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:25:38.659334 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:38.655795 16477 raft_consensus.cc:2749] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:38.678030 11675 raft_consensus.cc:1275] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:25:38.661969 11051 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 15.
I20260709 12:25:38.681908 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:38.681068 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 45870.6us
I20260709 12:25:38.682173 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:38.681509 10948 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:38.677873 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:38.683815 11056 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:38.661680 16468 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:25:38.685933 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 72231.1us
I20260709 12:25:38.676250 16355 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.679885 16494 raft_consensus.cc:697] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 18 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:38.692217 16500 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:38.692874 16500 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:38.693704 16338 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:38.694160 16338 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.694463 16512 consensus_queue.cc:1048] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 12:25:38.695631 11023 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:38.678292 16419 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:38.697512 11023 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:38.689751 16468 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:38.702782 11023 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:38.675705 16364 consensus_queue.cc:1059] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:25:38.694497 16338 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:38.715364 16364 raft_consensus.cc:3055] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:38.715817 16494 consensus_queue.cc:237] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:38.700680 16355 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:38.692802 16172 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:38.705456 16265 raft_consensus.cc:2804] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:38.720289 16265 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:38.706673 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.721179 11059 raft_consensus.cc:2368] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 16. Current term is 17.
I20260709 12:25:38.706544 10877 catalog_manager.cc:5697] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 5 to 11, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 11 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:38.708742 10975 raft_consensus.cc:1240] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 15. Current term is 16. Ops: [14.12-15.13]
I20260709 12:25:38.709174 16426 consensus_queue.cc:237] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:38.710139 16435 consensus_queue.cc:237] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:38.711293 16444 raft_consensus.cc:2749] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:38.739017 11098 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:38.720726 16265 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:38.740351 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 58924us
W20260709 12:25:38.741520 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 165160us
I20260709 12:25:38.755867 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:38.756652 11129 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:38.706393 16500 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:38.715781 16364 raft_consensus.cc:740] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:38.720096 16172 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:38.763017 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.767236 10981 raft_consensus.cc:1240] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:38.771392 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:38.774945 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:38.777753 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:38.777223 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:38.782649 11127 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:25:38.753352 16427 raft_consensus.cc:2804] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:38.758244 16239 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.797200 11056 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 15.
I20260709 12:25:38.796412 11128 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:25:38.766081 16486 raft_consensus.cc:2749] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:38.813058 11129 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 17.
I20260709 12:25:38.718286 16513 consensus_queue.cc:1048] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 12:25:38.747848 16211 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:38.823196 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 119328us
I20260709 12:25:38.760826 16482 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:38.831267 11133 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:38.765849 16446 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:38.766510 16502 consensus_queue.cc:1048] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 12:25:38.823621 16427 raft_consensus.cc:697] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:38.853176 11673 raft_consensus.cc:2393] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 16: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:38.855834 11127 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 13.
I20260709 12:25:38.803337 16468 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:38.870116 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 167397us
I20260709 12:25:38.881361 11098 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:38.883636 16469 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:38.895188 16469 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:38.895973 16507 log.cc:927] Time spent T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:25:38.897433 16469 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:38.898747 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:38.899384 10980 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:38.901609 16330 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:38.902215 16330 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:38.873843 16355 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:38.905321 10976 raft_consensus.cc:2410] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:25:38.906530 16330 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:38.883496 11098 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:38.909698 11098 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:38.911130 11098 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:38.821929 16239 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:38.892419 11644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.890270 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:38.929271 10980 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 17.
I20260709 12:25:38.929962 11057 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 15.
I20260709 12:25:38.933947 10977 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:38.884047 16510 log.cc:927] Time spent T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 12:25:38.991627 10981 raft_consensus.cc:1275] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:25:39.018250 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 237684us
I20260709 12:25:39.027670 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:39.027885 11025 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:39.028478 11051 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
I20260709 12:25:39.021922 10948 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:39.032068 10948 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:39.074637 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 163574us
W20260709 12:25:39.075788 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 43815.4us
I20260709 12:25:39.078833 11130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2786) took 1225 ms. Trace:
I20260709 12:25:39.017486 16513 raft_consensus.cc:2804] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:39.083951 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:39.017406 16495 raft_consensus.cc:2749] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:38.838691 10877 catalog_manager.cc:5697] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:39.090145 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:39.091267 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:39.091960 10981 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:39.018607 16322 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:39.089586 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 51768.9us
I20260709 12:25:39.021780 16475 raft_consensus.cc:2749] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:38.889632 16497 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:39.101616 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 380946us
I20260709 12:25:38.872625 16364 consensus_queue.cc:260] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:39.115931 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:38.991324 16469 consensus_queue.cc:1059] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.095s
I20260709 12:25:39.119623 11678 raft_consensus.cc:1240] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 16. Current term is 17. Ops: []
W20260709 12:25:39.094144 16224 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.937s	user 0.020s	sys 0.049s
I20260709 12:25:39.089938 16513 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:39.085245 16500 raft_consensus.cc:2804] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:39.080433 11130 rpcz_store.cc:276] 0709 12:25:37.853084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:37.854252 (+  1168us) service_pool.cc:224] Handling call
0709 12:25:37.854590 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:37.854861 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:38.047209 (+192348us) log.cc:844] Serialized 14 byte log entry
0709 12:25:38.921758 (+874549us) spinlock_profiling.cc:243] Waited 4.81 ms on lock 0x7b18003c0d00. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f8b98c4bc 00007f8f88cda48b 00007f8f91b349a9 00007f8f88cf669b 00007f8f88cf493f 00007f8f88cf6c02 00007f8f8b97e20b 00007f8f8b983d23 00007f8f8b98423a
0709 12:25:39.077855 (+156097us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:39.077923 (+    68us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:39.077969 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:39.078644 (+   675us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:39.078771 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":244580,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":145391,"spinlock_wait_cycles":11066752,"thread_start_us":407123,"threads_started":3,"wal-append.queue_time_us":170241}
I20260709 12:25:39.099833 16211 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:39.186595 16364 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:39.140854 16513 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:39.130198 16224 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.020s	sys 0.049s
I20260709 12:25:39.132113 16419 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.191514 16419 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:39.099650 16427 consensus_queue.cc:237] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:39.145725 11643 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:25:39.195015 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 49409.6us
I20260709 12:25:39.203521 10981 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 14.
I20260709 12:25:39.210875 10977 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:25:39.221127 11133 raft_consensus.cc:2468] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 19.
I20260709 12:25:39.223657 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:39.146749 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:39.147068 16484 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:39.228154 16484 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:39.230635 16484 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:39.147929 16528 log.cc:927] Time spent T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 12:25:39.231707 16417 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:39.232368 16417 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:39.148243 16516 raft_consensus.cc:2804] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:39.154991 10877 catalog_manager.cc:5697] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 4 to 9, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 9 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:39.233389 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:39.156724 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:25:39.227758 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 233290us
I20260709 12:25:39.234411 11129 raft_consensus.cc:2393] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 17: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:39.235409 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:39.235736 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:39.236531 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:39.237676 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:39.234215 11132 raft_consensus.cc:2368] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 16. Current term is 17.
I20260709 12:25:39.238961 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:39.239670 10877 catalog_manager.cc:5697] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
W20260709 12:25:39.240473 16519 log.cc:927] Time spent T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.406s	user 0.000s	sys 0.001s
I20260709 12:25:39.237888 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:39.158249 16526 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:39.162206 16538 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:39.163203 16530 log.cc:927] Time spent T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:25:39.164486 16239 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:39.165400 16501 consensus_meta.cc:287] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb: Time spent flushing consensus metadata: real 0.564s	user 0.004s	sys 0.002s
I20260709 12:25:39.166823 16446 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:39.170729 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:39.172518 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:39.172231 16338 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:39.173650 16482 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:39.174331 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:39.174499 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:39.173812 11127 raft_consensus.cc:1275] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:25:39.176048 16468 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:39.178511 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:39.106972 16322 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:39.180266 16497 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:39.131515 11097 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:39.226085 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:39.335554 10977 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:39.147204 16531 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:39.336604 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:39.241554 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:39.239696 11132 raft_consensus.cc:2368] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 14. Current term is 15.
I20260709 12:25:39.250218 11056 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 15.
I20260709 12:25:39.254149 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:39.194082 16419 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:39.254287 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:39.224833 16211 raft_consensus.cc:2804] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:39.346864 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:39.347519 11060 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:39.258569 11129 raft_consensus.cc:2376] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bc01179655564f29b83babe396377cbb in term 14. Re-sending same reply.
I20260709 12:25:39.320837 11676 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:39.322220 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:39.327659 10981 raft_consensus.cc:2393] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 16: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:39.338917 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:39.349195 11052 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 14.
I20260709 12:25:39.339507 11051 raft_consensus.cc:3060] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:39.329932 16522 log.cc:927] Time spent T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:25:39.343340 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:39.328336 16526 raft_consensus.cc:697] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:25:39.351089 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 108354us
I20260709 12:25:39.352175 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:25:39.350042 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 245657us
I20260709 12:25:39.353960 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:39.356559 11125 raft_consensus.cc:2393] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 17: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
W20260709 12:25:39.355652 10984 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.015s	sys 0.038s
I20260709 12:25:39.331525 16537 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:25:39.359521 10984 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.016s	sys 0.039s
I20260709 12:25:39.324546 16501 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:39.367826 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:39.367789 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:39.377952 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:39.379714 11057 raft_consensus.cc:1240] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:39.264654 16538 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:39.358693 16265 consensus_meta.cc:287] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.590s	user 0.011s	sys 0.008s
I20260709 12:25:39.415202 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:39.399384 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:39.415700 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:39.334872 10877 catalog_manager.cc:5697] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:39.412050 11054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 824) took 1551 ms. Trace:
I20260709 12:25:39.424443 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:39.354734 16494 raft_consensus.cc:2764] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:25:39.431630 11024 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:39.415766 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:39.433279 15570 consensus_queue.cc:1059] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:25:39.434434 16419 raft_consensus.cc:3055] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:25:39.416999 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.386896 11130 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:39.408569 11023 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:39.383062 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:39.460019 11644 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:39.419353 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:39.401401 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:39.421936 11129 raft_consensus.cc:2376] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bc01179655564f29b83babe396377cbb in term 16. Re-sending same reply.
I20260709 12:25:39.419423 11679 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 20.
I20260709 12:25:39.431277 16538 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:39.369793 16211 raft_consensus.cc:697] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:39.438645 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:39.441684 11643 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:39.397622 16417 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:39.443877 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:39.444114 15570 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:39.473666 11132 raft_consensus.cc:2393] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 17: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:39.474138 11053 raft_consensus.cc:2393] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 19: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:39.445616 10977 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:25:39.410374 16501 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:39.445219 10877 catalog_manager.cc:5697] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 8 to 11, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 11 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:39.407392 16338 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:39.447925 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:25:39.386211 16524 log.cc:927] Time spent T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.433s	user 0.002s	sys 0.008s
I20260709 12:25:39.455293 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:39.423971 11054 rpcz_store.cc:276] 0709 12:25:37.860582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:38.048504 (+187922us) service_pool.cc:224] Handling call
0709 12:25:38.053330 (+  4826us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:38.065000 (+ 11670us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:38.065030 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:38.309596 (+244566us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b2c00000de8. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8a6dda11 00007f8f8a6ed372 00007f8f8be1fa01 00007f8f8bde443a 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2
0709 12:25:38.310325 (+   729us) log.cc:844] Serialized 26 byte log entry
0709 12:25:38.405212 (+ 94887us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:38.405251 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:39.411740 (+1006489us) spinlock_profiling.cc:243] Waited 8.25 ms on lock 0x7b54002ddf54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:39.411788 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:39.411831 (+    43us) raft_consensus.cc:1685] finished
0709 12:25:39.411843 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:39.411971 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1748,"raft.queue_time_us":17173,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":1865,"spinlock_wait_cycles":22960768,"thread_start_us":94309,"threads_started":1,"wal-append.queue_time_us":180454}
I20260709 12:25:39.399398 16322 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:39.459112 11059 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 20.
I20260709 12:25:39.394438 16529 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.457430 16494 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.462244 16446 raft_consensus.cc:2749] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:39.443636 16419 raft_consensus.cc:740] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:39.466461 11024 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:39.461282 11644 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:39.467576 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 59121.7us
I20260709 12:25:39.470808 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:39.471071 16468 raft_consensus.cc:2749] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:39.471549 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:39.468112 16531 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:39.477047 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.483176 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:39.484941 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:39.491288 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:39.518064 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:39.497296 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:39.519521 11133 raft_consensus.cc:3060] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:39.520363 11025 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:39.496335 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:39.497627 11645 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:39.495563 10976 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 19.
I20260709 12:25:39.438558 16265 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:39.498216 16514 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:39.527330 16514 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:39.394488 16526 consensus_queue.cc:237] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:39.503301 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:39.377683 16537 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:39.473287 16489 raft_consensus.cc:2804] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:39.473483 15570 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:39.500102 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:39.501309 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
W20260709 12:25:39.510991 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 49799.5us
I20260709 12:25:39.514798 16494 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:39.515152 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:39.494346 16497 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.538002 11679 raft_consensus.cc:2410] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 21 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 12:25:39.521967 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:39.523089 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:39.523856 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:39.541102 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:39.541615 11053 raft_consensus.cc:1275] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 12:25:39.542011 11053 pending_rounds.cc:85] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting all ops after (but not including) 6
I20260709 12:25:39.542274 11053 pending_rounds.cc:107] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:25:39.542564 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:39.524009 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:39.523151 16531 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:39.524729 16525 raft_consensus.cc:3055] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:39.525463 16513 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:39.526691 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:39.533275 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:25:39.585237 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 53683.4us
I20260709 12:25:39.534781 16489 raft_consensus.cc:697] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:39.518025 16347 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:39.542550 11053 raft_consensus.cc:2889] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:39.562630 11132 raft_consensus.cc:2410] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:25:39.537217 11644 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
W20260709 12:25:39.601295 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 64190.3us
I20260709 12:25:39.530057 16467 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:25:39.605788 16489 consensus_queue.cc:237] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:39.606854 16482 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:39.607306 16482 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:39.607681 16482 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:39.611575 16500 raft_consensus.cc:697] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 15 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
W20260709 12:25:39.612254 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.612623 16500 consensus_queue.cc:237] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:39.579257 16540 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:39.595960 16417 consensus_queue.cc:1059] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:25:39.616025 16516 raft_consensus.cc:697] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 15 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:39.617159 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2928) took 1121 ms. Trace:
I20260709 12:25:39.617703 16516 consensus_queue.cc:237] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:39.617578 10984 rpcz_store.cc:276] 0709 12:25:38.495807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:38.653495 (+157688us) service_pool.cc:224] Handling call
0709 12:25:38.681099 (+ 27604us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:38.739957 (+ 58858us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:38.739989 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:38.740525 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 12:25:38.796798 (+ 56273us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:39.218700 (+421902us) spinlock_profiling.cc:243] Waited 5.92 ms on lock 0x7b2400182d38. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88b7d9c4 00007f8f88b7bacb 00007f8f88d36dc9 00007f8f88d36a55 00007f8f88d3609d 00007f8f8b96810e 00007f8f8b97f88c 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221
0709 12:25:39.359951 (+141251us) log.cc:844] Serialized 14 byte log entry
0709 12:25:39.616727 (+256776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:39.616808 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:39.616847 (+    39us) raft_consensus.cc:1685] finished
0709 12:25:39.616939 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:39.617100 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":256502,"prepare.queue_time_us":192401,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":268886,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":13606272,"thread_start_us":640290,"threads_started":3,"wal-append.queue_time_us":83991}
I20260709 12:25:39.621527 11131 raft_consensus.cc:1240] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:39.633090 11023 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:39.581315 11057 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 18.
I20260709 12:25:39.534003 16446 raft_consensus.cc:2804] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:39.537794 15570 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:39.598780 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 522246us
I20260709 12:25:39.646590 10948 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:39.646790 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 153943us
I20260709 12:25:39.606638 16467 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:39.616360 16417 raft_consensus.cc:3055] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:25:39.623175 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 168411us
I20260709 12:25:39.623415 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2925) took 1128 ms. Trace:
I20260709 12:25:39.533787 16435 consensus_queue.cc:1059] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 12:25:39.507296 16529 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:39.585384 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 52200.4us
I20260709 12:25:39.631736 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:39.637384 11130 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 13.
I20260709 12:25:39.603943 11644 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:39.665071 11125 raft_consensus.cc:1275] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 12:25:39.522918 16419 consensus_queue.cc:260] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:39.623960 16338 consensus_queue.cc:1048] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:39.655059 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:39.660194 11133 raft_consensus.cc:2468] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 14.
I20260709 12:25:39.631528 11129 raft_consensus.cc:2393] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 11: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:39.651273 10979 rpcz_store.cc:276] 0709 12:25:38.494915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:38.625455 (+130540us) service_pool.cc:224] Handling call
0709 12:25:38.630195 (+  4740us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:38.988398 (+358203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:38.988428 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:38.989045 (+   617us) log.cc:844] Serialized 26 byte log entry
0709 12:25:39.088298 (+ 99253us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:39.142824 (+ 54526us) log.cc:844] Serialized 14 byte log entry
0709 12:25:39.623105 (+480281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:39.623180 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:39.623223 (+    43us) raft_consensus.cc:1685] finished
0709 12:25:39.623236 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:39.623357 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":486345,"prepare.queue_time_us":56293,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":514784,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":165,"thread_start_us":409289,"threads_started":2,"wal-append.queue_time_us":343625}
I20260709 12:25:39.506119 16211 consensus_queue.cc:237] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:39.661886 10948 leader_election.cc:400] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 16. Current term is 17.
I20260709 12:25:39.672817 10948 leader_election.cc:403] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 12:25:39.662560 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 62702.5us
I20260709 12:25:39.591710 16525 raft_consensus.cc:740] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:39.666348 11131 raft_consensus.cc:1275] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 6. (term mismatch)
I20260709 12:25:39.667315 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:39.572046 16497 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:39.668566 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 65328.6us
I20260709 12:25:39.673733 11134 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 20.
I20260709 12:25:39.673504 11131 pending_rounds.cc:85] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 5
I20260709 12:25:39.673235 11130 raft_consensus.cc:1240] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:39.674901 11131 pending_rounds.cc:107] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 13.6
I20260709 12:25:39.675323 11131 raft_consensus.cc:2889] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:39.629966 16537 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:39.676275 16347 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:25:39.685067 16497 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:39.685644 16347 raft_consensus.cc:697] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:39.680608 16355 raft_consensus.cc:2749] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 16. Current term is 17.
I20260709 12:25:39.686702 16347 consensus_queue.cc:237] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:39.688215 16484 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.688416 11060 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 16.
I20260709 12:25:39.688795 16484 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:39.689802 16550 log.cc:927] Time spent T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:25:39.691023 16427 consensus_queue.cc:1048] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:39.682828 11023 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:39.694746 11023 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:39.695477 16435 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:39.696125 16265 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:39.685199 16531 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:39.698524 16484 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:39.701082 16427 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:39.701596 16427 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:39.701946 16427 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:39.702868 16529 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:39.661679 16417 raft_consensus.cc:740] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:39.704082 16417 consensus_queue.cc:260] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:39.705349 16417 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:39.661230 16364 raft_consensus.cc:2804] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:39.706580 16364 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:39.706923 16364 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:39.696066 16435 raft_consensus.cc:697] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:39.709254 16435 consensus_queue.cc:237] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:39.711170 16513 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:39.711833 16262 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:39.712390 16262 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:39.715687 16514 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:39.663404 16467 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:39.664045 16446 raft_consensus.cc:697] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:39.717634 16446 consensus_queue.cc:237] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:39.720995 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:39.730135 11678 raft_consensus.cc:1240] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 15. Current term is 16. Ops: []
W20260709 12:25:39.679559 11098 connection.cc:256] RPC call timeout handler was delayed by -2.24272151499963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
W20260709 12:25:39.734480 11098 connection.cc:256] RPC call timeout handler was delayed by -1.8495979869999246s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
W20260709 12:25:39.736222 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.738909 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:39.739193 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:39.739660 10978 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 16.
I20260709 12:25:39.739877 11059 raft_consensus.cc:2393] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 16: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:39.672199 16540 raft_consensus.cc:2749] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:25:39.734820 11098 connection.cc:256] RPC call timeout handler was delayed by -1.811288195999623s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31010000000000004s for a response
W20260709 12:25:39.744426 11098 connection.cc:256] RPC call timeout handler was delayed by -1.7450215149997348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2077s for a response
W20260709 12:25:39.744774 11098 connection.cc:256] RPC call timeout handler was delayed by -1.7370979869997427s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19740000000000002s for a response
W20260709 12:25:39.741109 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.741254 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:39.745800 10976 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:39.742070 10949 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:39.746654 11098 connection.cc:256] RPC call timeout handler was delayed by -1.4741001979996327s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20030000000000003s for a response
W20260709 12:25:39.747059 11098 connection.cc:256] RPC call timeout handler was delayed by -1.1387397809994582s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
W20260709 12:25:39.747330 11098 connection.cc:256] RPC call timeout handler was delayed by -1.1315397809994465s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
W20260709 12:25:39.748592 11098 connection.cc:256] RPC call timeout handler was delayed by -1.0001397809996888s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1805s for a response
I20260709 12:25:39.750689 11131 raft_consensus.cc:1240] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:39.745105 10977 raft_consensus.cc:1275] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:25:39.735401 11023 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:39.770069 11130 raft_consensus.cc:1275] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:39.770519 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:39.772568 11676 raft_consensus.cc:2393] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 16: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:39.784467 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:39.801265 11051 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 13.
I20260709 12:25:39.801117 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:39.803591 11127 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 15.
I20260709 12:25:39.790506 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:39.804848 11676 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 15.
I20260709 12:25:39.774036 16529 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:39.817018 11131 raft_consensus.cc:1275] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:25:39.770112 16531 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:39.772657 16494 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:39.819010 11645 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:39.810547 16500 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:39.769867 16532 consensus_queue.cc:1059] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 12:25:39.844518 11131 raft_consensus.cc:1240] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:39.834965 16484 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.799954 16538 consensus_queue.cc:1048] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:25:39.642334 10877 catalog_manager.cc:5697] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 9 to 11, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 11 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:39.864915 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:39.870672 16557 log.cc:927] Time spent T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 12:25:39.828665 16531 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:39.873456 16531 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:39.839140 15864 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:39.874714 15864 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:39.875085 15864 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:39.878403 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 67507.7us
I20260709 12:25:39.880657 16513 consensus_queue.cc:1048] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:39.881138 11098 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:39.845969 16262 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:39.896296 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:39.881302 10877 catalog_manager.cc:5697] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:39.865036 16532 consensus_queue.cc:1243] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 log is divergent from this leader: its last log entry 16.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:25:39.902446 11644 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:39.903187 11059 raft_consensus.cc:1240] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:39.920158 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:39.921041 11127 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 16.
I20260709 12:25:39.908267 16330 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:39.898988 16513 consensus_queue.cc:1059] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:25:39.930171 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:39.863564 16484 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:39.900795 16475 raft_consensus.cc:2804] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:39.955150 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:39.935886 16330 raft_consensus.cc:697] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:39.986557 11025 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
W20260709 12:25:39.990557 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.954411 16475 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:39.998862 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 117820us
I20260709 12:25:39.982084 16500 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.960683 16364 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:40.000702 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 267642us
I20260709 12:25:40.009788 11131 raft_consensus.cc:3055] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:39.997921 16475 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:40.012754 11131 raft_consensus.cc:740] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:40.015861 10949 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:40.019901 10949 leader_election.cc:400] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 election: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 14. Current term is 15.
I20260709 12:25:40.021087 10949 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:40.022413 10949 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:40.024259 10949 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:40.026705 10949 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:40.014997 10877 catalog_manager.cc:5697] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:40.029755 10949 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:40.027663 16364 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:40.040005 10948 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:40.036507 11131 consensus_queue.cc:260] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:40.059254 10977 raft_consensus.cc:1275] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:25:40.063113 10948 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:40.009743 16500 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:40.075641 11131 raft_consensus.cc:3060] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:40.100519 10976 raft_consensus.cc:2468] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 16.
W20260709 12:25:40.113765 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 100771us
I20260709 12:25:40.094491 16347 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:40.108805 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 195159us
W20260709 12:25:40.123322 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 60381.6us
I20260709 12:25:40.124909 10948 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:25:40.113590 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 84036.4us
I20260709 12:25:40.127566 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:40.117139 16513 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.130963 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:40.108702 16567 raft_consensus.cc:2749] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:40.141965 10984 raft_consensus.cc:2393] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 17: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:40.134871 10981 raft_consensus.cc:1240] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 15. Current term is 16. Ops: [14.9-15.10]
I20260709 12:25:40.144757 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:40.146848 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:40.122071 16516 raft_consensus.cc:2749] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:40.119577 16569 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:40.124550 16484 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
I20260709 12:25:40.155021 10982 raft_consensus.cc:1240] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:25:40.091511 16330 consensus_queue.cc:237] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:40.150815 16561 log.cc:927] Time spent T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:25:40.148797 16211 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.159667 16569 raft_consensus.cc:697] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 14 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:40.152586 16351 raft_consensus.cc:2749] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:40.198746 10982 raft_consensus.cc:1240] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 15 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 12:25:40.211824 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 86947.9us
W20260709 12:25:40.191417 15570 consensus_meta.cc:287] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.517s	user 0.012s	sys 0.000s
I20260709 12:25:40.125389 16347 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:40.129456 16518 consensus_queue.cc:1059] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:25:40.156905 16573 raft_consensus.cc:2749] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:40.158612 16583 raft_consensus.cc:2749] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:40.195077 16564 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:40.199271 16569 consensus_queue.cc:237] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:40.200403 16419 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:40.203751 15864 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:40.151716 16513 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:40.204550 16467 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:40.206756 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 220301us
W20260709 12:25:40.206997 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 274348us
W20260709 12:25:40.207928 16482 consensus_meta.cc:287] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.600s	user 0.007s	sys 0.003s
I20260709 12:25:40.215440 15570 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:40.206557 16444 raft_consensus.cc:2749] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:40.176131 16484 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.176766 16333 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:40.155656 16514 consensus_queue.cc:1059] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:25:40.221833 16347 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:40.232008 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:40.232007 10976 raft_consensus.cc:1240] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:40.232463 10948 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:40.232018 11131 raft_consensus.cc:1275] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 12:25:40.221694 16435 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.270211 10980 raft_consensus.cc:1240] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 13. Ops: []
I20260709 12:25:40.301891 11025 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:40.302335 11058 raft_consensus.cc:2393] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 21: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
W20260709 12:25:40.229606 16566 log.cc:927] Time spent T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 12:25:40.271710  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:40.215445 16211 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:40.225703 16330 raft_consensus.cc:3055] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:40.280721 10975 raft_consensus.cc:1240] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:40.302809 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:25:40.278354 16568 log.cc:927] Time spent T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 12:25:40.305302 11131 pending_rounds.cc:85] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 9
I20260709 12:25:40.308393 11023 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:40.308979 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 76603.9us
I20260709 12:25:40.317847 10979 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:40.270805 10982 raft_consensus.cc:1240] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 15 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:25:40.318775 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:40.227087 16564 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:40.324736 11131 pending_rounds.cc:107] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 12:25:40.329568 11131 raft_consensus.cc:2889] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:40.324707 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 167629us
I20260709 12:25:40.332515 11025 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:40.334326 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:40.335187 10980 raft_consensus.cc:2393] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 11: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:40.302327 16364 raft_consensus.cc:2749] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:40.316596 16531 raft_consensus.cc:3055] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:40.343086 16500 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:40.316562 16351 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:40.326694 16330 raft_consensus.cc:740] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:25:40.340380 16427 consensus_meta.cc:287] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.638s	user 0.012s	sys 0.000s
I20260709 12:25:40.298764 16529 consensus_queue.cc:1048] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:25:40.278384 16484 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:40.335424 16526 raft_consensus.cc:2749] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:40.278959 16482 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:40.316403 16262 consensus_queue.cc:1048] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:25:40.383929 11098 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:40.384382 16513 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:40.385936 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:40.350450 16514 consensus_queue.cc:1048] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
W20260709 12:25:40.353493 16417 consensus_meta.cc:287] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.648s	user 0.008s	sys 0.007s
I20260709 12:25:40.394239 16537 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:40.394833 16580 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:40.395344 16580 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.395700 16580 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:40.323999 16426 consensus_queue.cc:1059] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:25:40.398084 16419 raft_consensus.cc:3055] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:40.398564 16419 raft_consensus.cc:740] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:40.398998 10975 raft_consensus.cc:1275] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:25:40.356032 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:40.338682 16469 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:40.400665 16469 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.316982 16435 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:40.335054 16444 consensus_queue.cc:1059] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:25:40.344673 16531 raft_consensus.cc:740] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:40.401852 16444 raft_consensus.cc:3055] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:40.402360 16444 raft_consensus.cc:740] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:40.402877 16435 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:40.403196 16444 consensus_queue.cc:260] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:40.404094 11097 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:40.401103 16469 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:40.327821 16172 consensus_queue.cc:1048] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
W20260709 12:25:40.409582 16494 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
W20260709 12:25:40.376379 16565 log.cc:927] Time spent T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:25:40.378324 16525 consensus_queue.cc:260] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:40.379155 16582 log.cc:927] Time spent T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 12:25:40.415922 16494 consensus_queue.cc:1059] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:40.437668 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:40.428809 10979 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
W20260709 12:25:40.443219 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 59365.9us
I20260709 12:25:40.401868 16531 consensus_queue.cc:260] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:40.447829 10978 raft_consensus.cc:2393] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 11: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:40.437700 16513 raft_consensus.cc:2749] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:40.417848 16333 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:40.437896 16514 raft_consensus.cc:2749] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:40.453183 11132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 2246) took 1222 ms. Trace:
I20260709 12:25:40.457767 11132 rpcz_store.cc:276] 0709 12:25:39.231182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:39.610640 (+379458us) service_pool.cc:224] Handling call
0709 12:25:39.611017 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:39.664882 (+ 53865us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:39.664915 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:39.681399 (+ 16484us) log.cc:844] Serialized 26 byte log entry
0709 12:25:40.055507 (+374108us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:40.127917 (+ 72410us) log.cc:844] Serialized 14 byte log entry
0709 12:25:40.128261 (+   344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:40.128501 (+   240us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:40.452936 (+324435us) raft_consensus.cc:1685] finished
0709 12:25:40.452957 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:40.453105 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41639,"prepare.queue_time_us":143774,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":54326,"raft.run_cpu_time_us":524,"raft.run_wall_time_us":27454,"spinlock_wait_cycles":1055104,"thread_start_us":305597,"threads_started":2,"wal-append.queue_time_us":366716}
I20260709 12:25:40.460453 16333 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:40.461724 16560 log.cc:927] Time spent T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.594s	user 0.005s	sys 0.000s
I20260709 12:25:40.455981 11098 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:40.463716 16333 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:40.359210 16427 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:40.471115 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:40.447605 16419 consensus_queue.cc:260] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:40.474422 16419 raft_consensus.cc:3060] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:40.475430 16475 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:40.448875 16525 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:40.473114 11058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41294 (request call id 1955) took 1047 ms. Trace:
I20260709 12:25:40.482851 11058 rpcz_store.cc:276] 0709 12:25:39.426021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:39.526422 (+100401us) service_pool.cc:224] Handling call
0709 12:25:40.472843 (+946421us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b54003714d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:40.473023 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1576415104}
I20260709 12:25:40.489488 16427 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:40.490664 16577 log.cc:927] Time spent T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.169s	user 0.000s	sys 0.005s
W20260709 12:25:40.508255 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 175819us
I20260709 12:25:40.509960 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:40.511385 11133 raft_consensus.cc:1275] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:40.510759 11132 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 13.
I20260709 12:25:40.512684 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:40.514252 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:40.514986 11133 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 14.
I20260709 12:25:40.517596 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:40.518260 11133 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:40.519937 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:40.527776 11129 raft_consensus.cc:1275] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:25:40.528931 16559 log.cc:927] Time spent T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.637s	user 0.003s	sys 0.000s
I20260709 12:25:40.530771 16501 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:40.532552 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 115337us
I20260709 12:25:40.547314 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:40.548419 11052 raft_consensus.cc:2410] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 12:25:40.554682 11056 raft_consensus.cc:1275] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:25:40.557024 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:40.564070 11059 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:40.565152 11133 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 21.
I20260709 12:25:40.569067 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:40.510954 16513 consensus_queue.cc:1059] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:25:40.584287 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:40.533725 16468 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:40.593782 11059 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 13.
W20260709 12:25:40.597754 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 268787us
I20260709 12:25:40.608909 10948 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:40.610844 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 154915us
I20260709 12:25:40.612941 11098 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:40.614538 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 80870.3us
I20260709 12:25:40.567976 16364 consensus_queue.cc:1048] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:25:40.616396 11023 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:40.616374 16534 consensus_queue.cc:1048] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:40.562572 16435 consensus_queue.cc:1048] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:25:40.607456 16513 consensus_queue.cc:1243] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer bc01179655564f29b83babe396377cbb log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 12:25:40.628861 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.635751 16355 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.635964 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:40.636374 16355 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:40.637367 16595 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:25:40.637784 16586 log.cc:927] Time spent T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.359s	user 0.002s	sys 0.000s
I20260709 12:25:40.637965 16595 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:40.639424 11643 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:40.640919 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:40.641567 11053 raft_consensus.cc:2468] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 13.
I20260709 12:25:40.641692 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:40.642489 16351 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.644075 10981 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:25:40.640285 16595 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:40.648617 10980 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 16.
I20260709 12:25:40.643044 16351 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:40.651532 16351 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:40.653756 16469 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:40.654700 16602 consensus_queue.cc:1059] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:25:40.656281 16469 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:40.669090 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:40.669756 11052 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 15.
I20260709 12:25:40.673241 16514 raft_consensus.cc:3055] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:40.673728 16514 raft_consensus.cc:740] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
W20260709 12:25:40.674228 10949 leader_election.cc:336] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 2.015s (SENT)
I20260709 12:25:40.674696 10949 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:40.618523 16588 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:40.675974 16475 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:40.676424 16588 raft_consensus.cc:2749] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:25:40.676667 10949 leader_election.cc:336] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 2.118s (SENT)
I20260709 12:25:40.637089 16564 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:40.677217 10949 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:40.678292 16333 raft_consensus.cc:2749] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:40.656555 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:40.625499 16600 consensus_queue.cc:1059] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:25:40.598683 16468 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:40.660953 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:40.665050 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:40.680878 10984 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 13.
W20260709 12:25:40.658684 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.666697 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:40.667392 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:40.625767 16417 raft_consensus.cc:2804] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:40.663105 16580 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:40.666455 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:40.682893 11025 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:40.701184 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:40.690387 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 132149us
W20260709 12:25:40.711988 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 72643.8us
I20260709 12:25:40.712883 11643 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:40.713884 11054 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 21 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 20. Current term is 21. Ops: []
I20260709 12:25:40.697118 10978 raft_consensus.cc:1275] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:40.715567 11129 raft_consensus.cc:1275] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:25:40.715824 11054 raft_consensus.cc:1240] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:40.718375 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:40.720785 10982 raft_consensus.cc:1240] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:40.718984 11056 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:25:40.711298 16603 raft_consensus.cc:2749] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:40.639451 16355 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:40.678491 16484 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:40.726447 16609 raft_consensus.cc:3055] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:40.701884 16333 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.727267 16333 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:40.727268 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:40.729964 10984 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:40.730278 16598 raft_consensus.cc:2804] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:40.729632 11645 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:40.731523 11645 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:40.732636 16468 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:40.734323 16605 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:40.734870 16605 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.735253 16605 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:40.736479 16484 raft_consensus.cc:2804] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:40.736873 16484 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.737232 16484 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:40.737986 10983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2946) took 1012 ms. Trace:
I20260709 12:25:40.738406 10983 rpcz_store.cc:276] 0709 12:25:39.725617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:39.725827 (+   210us) service_pool.cc:224] Handling call
0709 12:25:39.745764 (+ 19937us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:39.932876 (+187112us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b4800002dd8. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f90d0daa1 00007f8f90d04b37 00007f8f90d049ca 00007f8f90dfc26f 00007f8f90dfbf37 00007f8f90e1055c 00007f8f90e10508 00007f8f90e10488 00007f8f90e10443 00007f8f90e0f6ec 00007f8f8fd39a96
0709 12:25:40.026533 (+ 93657us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:40.026569 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:40.027108 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 12:25:40.119775 (+ 92667us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:40.119838 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:40.119918 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:40.637108 (+517190us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:25:40.737782 (+100674us) raft_consensus.cc:1685] finished
0709 12:25:40.737806 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:40.737929 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33773,"raft.run_cpu_time_us":2173,"raft.run_wall_time_us":119184,"spinlock_wait_cycles":10752640,"thread_start_us":332177,"threads_started":2,"wal-append.queue_time_us":248593}
I20260709 12:25:40.740231 16435 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:25:40.740819 16435 raft_consensus.cc:697] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 21 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:40.737730 16581 consensus_queue.cc:1048] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:40.741752 16435 consensus_queue.cc:237] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:40.725472 11054 raft_consensus.cc:1275] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:25:40.745097 10978 raft_consensus.cc:1240] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 15. Current term is 16. Ops: [14.12-15.13]
W20260709 12:25:40.748227 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 135392us
I20260709 12:25:40.749318 10984 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:25:40.753935 11055 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:25:40.758554 10981 raft_consensus.cc:2393] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 16: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:40.736040 16333 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:40.730396 16564 consensus_queue.cc:1048] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:25:40.768245 16580 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:40.770251 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.770459 16520 consensus_queue.cc:1059] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 12:25:40.774317 16514 consensus_queue.cc:260] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:40.775190 16520 raft_consensus.cc:3055] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:25:40.763230 10978 raft_consensus.cc:1275] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:25:40.730850 16598 raft_consensus.cc:697] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:40.781049 11052 raft_consensus.cc:1275] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:25:40.763087 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:40.722314 16417 raft_consensus.cc:697] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:40.766538 11054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:40.802000 11054 raft_consensus.cc:606] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:40.802407 11054 raft_consensus.cc:614] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:40.767303 16322 consensus_queue.cc:1059] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:40.776587 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:40.735008 16449 raft_consensus.cc:2749] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:40.800942 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:40.726913 16609 raft_consensus.cc:740] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:40.802526 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:40.808252 11676 raft_consensus.cc:2393] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 16: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:40.803124 11098 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:40.754817 16265 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.715169 16513 consensus_queue.cc:1059] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
W20260709 12:25:40.812327 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 132654us
I20260709 12:25:40.783200 16520 raft_consensus.cc:740] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:40.814566 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:40.800645 16603 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.777501 16514 raft_consensus.cc:3060] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:40.816944 10976 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:40.816413 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 83152.8us
I20260709 12:25:40.823307 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:40.824064 11132 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:25:40.825559 11127 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 21 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 20. Current term is 21. Ops: []
I20260709 12:25:40.814568 16265 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:40.827929 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:40.834679 11054 raft_consensus.cc:1275] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 12:25:40.849866 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 74162.6us
I20260709 12:25:40.850003 11125 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 10.
I20260709 12:25:40.855316 11645 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
W20260709 12:25:40.857010 16593 log.cc:927] Time spent T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.412s	user 0.003s	sys 0.000s
I20260709 12:25:40.863289 16482 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:40.865365 15864 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:40.867102 16211 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:40.874609 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:25:40.877393 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 262037us
W20260709 12:25:40.881065 10949 leader_election.cc:336] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Timed out: RequestConsensusVote RPC to 127.9.145.195:42537 timed out after 2.138s (SENT)
I20260709 12:25:40.881659 10949 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:40.830955 16475 raft_consensus.cc:2749] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:40.876873 11023 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:40.827939 16600 raft_consensus.cc:3055] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:40.851683 16239 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.896667 11645 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:40.811817 16540 consensus_queue.cc:1048] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:25:40.899863 11097 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:40.903031 11054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:40.903550 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:40.890758 16449 raft_consensus.cc:2804] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:40.879213 16444 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:40.908442 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:40.909169 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 57590.4us
I20260709 12:25:40.910943 11054 raft_consensus.cc:606] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:40.911468 11054 raft_consensus.cc:614] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:40.926605 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:40.927503 11134 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:40.929098 10976 raft_consensus.cc:2468] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 17.
I20260709 12:25:40.930122 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:40.905556 16512 raft_consensus.cc:2804] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:40.900261 16600 raft_consensus.cc:740] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:40.900519 16580 raft_consensus.cc:2749] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:40.891197 16262 consensus_queue.cc:1048] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:25:40.907812 16333 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:40.945765 11098 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:40.921684 16449 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:40.935842 16494 raft_consensus.cc:3055] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:40.896275 16497 consensus_queue.cc:1059] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
W20260709 12:25:40.950376 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 73604.7us
I20260709 12:25:40.965517 11023 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:40.905815 16239 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:40.901022 16602 consensus_queue.cc:1048] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:25:40.905392 16598 consensus_queue.cc:237] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:40.903347 16417 consensus_queue.cc:237] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:40.849879 16603 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:40.894335 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 181534us
I20260709 12:25:40.830783 16520 consensus_queue.cc:260] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:40.833495 16609 consensus_queue.cc:260] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:40.936091 16475 raft_consensus.cc:2804] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:40.937880 16512 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.977423 11643 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:40.967298 16468 raft_consensus.cc:2749] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:40.968577 16172 raft_consensus.cc:2749] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:40.967428 16449 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:40.967571 16494 raft_consensus.cc:740] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:40.998001 16600 consensus_queue.cc:260] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:40.999455 16603 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:40.978727 16446 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.108s	user 0.018s	sys 0.017s
I20260709 12:25:41.004355 11132 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 17.
I20260709 12:25:41.019708 16484 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:41.022347 16609 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:25:40.992060 16512 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:41.006405 16489 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:41.033605 16489 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:41.034042 16489 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:40.973429 16419 consensus_queue.cc:1048] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:25:40.981067 16534 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.981258 16482 consensus_queue.cc:1059] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.033s
W20260709 12:25:41.012496 16624 log.cc:927] Time spent T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:25:41.013180 16494 consensus_queue.cc:260] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:41.014338 16487 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:25:40.967840 16333 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:41.013760 11098 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:41.011122 11023 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:41.042805 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:41.044564 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 137706us
I20260709 12:25:41.052899 11097 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:41.045846 16605 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:41.046782 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 291234us
I20260709 12:25:41.048447 16534 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:41.056175 16494 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:41.056449 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.057075 16534 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:41.058236 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:41.058598 10976 raft_consensus.cc:1240] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:41.059204 10983 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 16.
I20260709 12:25:41.059473 16265 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:41.042181 16484 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
W20260709 12:25:41.053165 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.061806 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:41.019735 16446 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.150s	user 0.019s	sys 0.017s
I20260709 12:25:41.063509 11134 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 16.
W20260709 12:25:41.066015 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 54966.1us
I20260709 12:25:41.066896 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:41.067137 16333 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:41.067653 16426 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:41.062743 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:41.047055 16602 raft_consensus.cc:2749] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:41.049701 16600 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:41.062772 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 50970.9us
I20260709 12:25:41.077441 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:41.077893 11097 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:41.113409 11053 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 15: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:41.107769 11673 raft_consensus.cc:1240] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 12:25:41.059114 16239 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:41.117679 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:41.118669 10977 raft_consensus.cc:2410] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:25:41.069525 16497 consensus_queue.cc:1243] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer bc01179655564f29b83babe396377cbb log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:41.108858 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:41.056552 16605 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:41.109215 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:41.126901 11672 raft_consensus.cc:2393] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 17: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:41.125319 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:41.128742 10978 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 15: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:41.126323 11058 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 17.
W20260709 12:25:41.133106 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.106514 16355 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:41.112118 16537 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.072495 16518 consensus_queue.cc:1048] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:25:41.139756 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:41.141965 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:41.143078 10948 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:41.107218 16487 consensus_queue.cc:1048] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:25:41.157997 11126 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 16.
I20260709 12:25:41.127082 16265 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.166952 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:41.130384 16475 raft_consensus.cc:697] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:41.130645 16497 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:41.165712 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:41.126930 16426 raft_consensus.cc:697] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:41.168013 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:41.131712 16486 raft_consensus.cc:2804] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:41.191033 16486 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.191485 16486 raft_consensus.cc:3060] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:41.182124 10977 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 16.
I20260709 12:25:41.153700 16588 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.194623 16588 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:41.187318 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:41.190075 11678 raft_consensus.cc:2393] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 15: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:41.199697 16588 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:41.189831 16426 consensus_queue.cc:237] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:41.146013 16602 consensus_queue.cc:1059] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:25:41.203895 11675 raft_consensus.cc:1217] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Deduplicated request from leader. Original: 11.11->[14.12-15.13]   Dedup: 15.13->[]
I20260709 12:25:41.204434 11675 raft_consensus.cc:1240] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 15. Current term is 16. Ops: [14.12-15.13]
I20260709 12:25:41.205319 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:41.178279 16580 raft_consensus.cc:2804] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:41.169353 16633 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:41.155411 16355 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:41.223779 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:41.162853 16537 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:41.229544 10977 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:41.222944 11643 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:41.202261 16427 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.231807 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:41.237576 10978 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:25:41.242692 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:41.209988 16529 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:41.180687 16265 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:41.189972 16475 consensus_queue.cc:237] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:41.261086 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:41.228677 16633 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.272341 10983 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 16.
I20260709 12:25:41.236793 16322 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:41.233409 16580 raft_consensus.cc:697] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 13 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:41.240034 16638 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:41.287923 16586 log.cc:927] Time spent T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:25:41.303329 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:41.286834 16633 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:25:41.340741 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 327069us
I20260709 12:25:41.239708 16514 raft_consensus.cc:3055] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:41.343281 16580 consensus_queue.cc:237] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:41.368791 10977 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 14.
W20260709 12:25:41.313057 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.242863 16427 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:41.381099 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:25:41.419929 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 276875us
I20260709 12:25:41.421497 10948 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:41.286088 16529 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:41.379215 16514 raft_consensus.cc:740] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
W20260709 12:25:41.429211 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 205021us
I20260709 12:25:41.432698 11024 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:41.381628 16322 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.428473 10948 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:41.381322 16534 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:41.441015 16634 log.cc:927] Time spent T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:25:41.441578 16646 consensus_queue.cc:1048] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:41.441390 16330 consensus_queue.cc:260] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:41.441390 11098 leader_election.cc:400] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 16. Current term is 17.
W20260709 12:25:41.428998 16635 log.cc:927] Time spent T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7: Append to log took a long time: real 0.161s	user 0.003s	sys 0.000s
I20260709 12:25:41.461849 16333 raft_consensus.cc:2749] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:41.462987 16494 consensus_queue.cc:1048] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:41.461679 11132 raft_consensus.cc:1275] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:25:41.460121 10983 raft_consensus.cc:1275] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:41.465553 10983 raft_consensus.cc:3055] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:41.465889 10983 raft_consensus.cc:740] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:41.466701 10983 consensus_queue.cc:260] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:41.467852 10983 raft_consensus.cc:3060] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:41.463158 11098 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:41.469847 11098 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:41.458292 16534 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:41.471107 16494 raft_consensus.cc:2749] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:41.470747 16497 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:41.472223 16355 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:41.472311 16497 raft_consensus.cc:697] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 15 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:41.473318 16497 consensus_queue.cc:237] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:41.435596 16531 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:41.476454 16514 consensus_queue.cc:260] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:41.478011 16514 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:41.455945 16468 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:41.480123 11098 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:41.480948 16494 raft_consensus.cc:2749] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:41.425540 16500 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:41.482724 16537 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:41.482764 16500 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.483798 16500 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:41.454623 16322 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:41.484989 16630 raft_consensus.cc:3055] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:41.485423 16630 raft_consensus.cc:740] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:41.487903 10978 raft_consensus.cc:1275] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:25:41.489627 11098 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:41.496272 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:41.497129 11058 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 17.
I20260709 12:25:41.498252 16630 consensus_queue.cc:260] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:41.500916 11644 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:41.501163 16630 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:41.505153 16631 log.cc:927] Time spent T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.297s	user 0.000s	sys 0.003s
I20260709 12:25:41.472565 16534 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:41.506271 16637 log.cc:927] Time spent T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.129s	user 0.000s	sys 0.002s
I20260709 12:25:41.506476 11131 raft_consensus.cc:1275] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:25:41.509438 16449 consensus_meta.cc:287] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.508s	user 0.007s	sys 0.002s
I20260709 12:25:41.510978 16265 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:41.512398 16633 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:41.516258 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.485884 16322 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:41.518790 11023 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:41.519403 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 59482.6us
W20260709 12:25:41.519871 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.471019 16427 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:41.523341 16239 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.528317 16239 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:41.523072 16355 consensus_queue.cc:1048] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:25:41.531778 16489 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:41.533885 16239 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:41.378609 16638 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:41.525147 16534 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:41.525276 16487 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:41.524485 16600 raft_consensus.cc:2749] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:41.509940 16449 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:41.526484 16588 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.562090 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:41.594849 11057 raft_consensus.cc:2393] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 19: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:41.548476 16489 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:41.557641 16512 consensus_meta.cc:287] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.002s
W20260709 12:25:41.577147 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 87599.4us
I20260709 12:25:41.597795 11098 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:41.599538 11098 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:41.562361 16534 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.608569 15570 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:41.596311 16487 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.529316 16486 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:41.601855 16494 raft_consensus.cc:2749] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:41.610003 16534 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:41.613511 16469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.006s	sys 0.017s
I20260709 12:25:41.605105 16512 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:41.625789 11134 raft_consensus.cc:2393] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 17: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:41.613597 16487 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:41.602389 16588 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:41.621253 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 100849us
I20260709 12:25:41.614712 16603 raft_consensus.cc:2749] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:41.616127 16497 consensus_queue.cc:1048] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:25:41.639796 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:41.640820 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:41.640944 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:41.641958 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:41.642174 11060 raft_consensus.cc:1275] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:25:41.643250 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:41.661628 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:41.662364 10981 raft_consensus.cc:2410] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:25:41.642849 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:41.642366 11673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41784 (request call id 866) took 1990 ms. Trace:
I20260709 12:25:41.663174 11673 rpcz_store.cc:276] 0709 12:25:39.652030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:39.652182 (+   152us) service_pool.cc:224] Handling call
0709 12:25:39.652527 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:41.115843 (+1463316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:41.642053 (+526210us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54005631d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:41.642304 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3346056064}
W20260709 12:25:41.656607 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.659294 10975 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:25:41.662024 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:41.667430 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:41.667886 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:41.668349 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
W20260709 12:25:41.623916 16469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.007s	sys 0.018s
I20260709 12:25:41.669360 11053 raft_consensus.cc:2393] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 11: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:41.672115 11675 raft_consensus.cc:2368] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12.
I20260709 12:25:41.670292 16633 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:41.691291 11677 raft_consensus.cc:1240] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:41.694591 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:41.670563 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:41.694591 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:41.695983 11678 raft_consensus.cc:2393] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 15: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:41.696939 11130 raft_consensus.cc:2410] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:25:41.700137 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:41.700834 11678 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 17.
W20260709 12:25:41.704500 11098 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.705552 11098 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:41.705474 11057 raft_consensus.cc:2468] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:25:41.718350 16588 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:41.722755 11098 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:41.709275 10948 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:41.727756 16520 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:41.769043 11054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:41.769714 11054 raft_consensus.cc:606] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:41.728706 11055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52804 (request call id 842) took 2317 ms. Trace:
I20260709 12:25:41.770081 11054 raft_consensus.cc:614] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:41.770319 11055 rpcz_store.cc:276] 0709 12:25:39.411189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:39.580459 (+169270us) service_pool.cc:224] Handling call
0709 12:25:39.593485 (+ 13026us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:40.754516 (+1161031us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:41.728402 (+973886us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54003e0654. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:41.728607 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2666979584}
I20260709 12:25:41.729394 11051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41302 (request call id 2224) took 1187 ms. Trace:
I20260709 12:25:41.730466 16638 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:41.732409 16512 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:41.734457 16449 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:41.774111 11054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:41.734886 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52828 (request call id 2958) took 1012 ms. Trace:
I20260709 12:25:41.774835 11054 raft_consensus.cc:606] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:41.775983 11054 raft_consensus.cc:614] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:41.774863 10979 rpcz_store.cc:276] 0709 12:25:40.722535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.722742 (+   207us) service_pool.cc:224] Handling call
0709 12:25:40.723025 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:40.745619 (+ 22594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:40.745652 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:40.746093 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 12:25:40.872481 (+126388us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:40.872531 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:41.734444 (+861913us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b5400229f54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:41.734498 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:41.734544 (+    46us) raft_consensus.cc:1685] finished
0709 12:25:41.734557 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:41.734804 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":6558,"spinlock_wait_cycles":51098880,"thread_start_us":63944,"threads_started":1,"wal-append.queue_time_us":122692}
I20260709 12:25:41.735574 16486 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:41.724542 16497 raft_consensus.cc:2749] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:41.741905 16467 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 21 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:41.747089 16500 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:41.778669 11055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:41.779263 11055 raft_consensus.cc:606] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:41.779868 16500 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:41.752378 10984 raft_consensus.cc:1275] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:25:41.781378  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:25:41.746989 16652 log.cc:927] Time spent T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.134s	user 0.002s	sys 0.000s
I20260709 12:25:41.783208 16487 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:41.783963 11679 raft_consensus.cc:2410] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 21 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 12:25:41.785418 16487 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:41.769490 16534 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:41.788833 11645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.784201  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:41.761689 11098 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:41.753799 11023 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:41.763762 16630 raft_consensus.cc:2749] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:41.771334 11051 rpcz_store.cc:276] 0709 12:25:40.541564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.543792 (+  2228us) service_pool.cc:224] Handling call
0709 12:25:40.635603 (+ 91811us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:40.680205 (+ 44602us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:40.680240 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:40.680286 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:40.680326 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:41.729170 (+1048844us) spinlock_profiling.cc:243] Waited 44.4 ms on lock 0x7b54001888d4. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:41.729218 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:41.729337 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102068096}
I20260709 12:25:41.794279 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:41.794906 11133 raft_consensus.cc:3060] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:41.789724 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 80543.8us
I20260709 12:25:41.796567 10948 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:41.798487 11098 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:41.804809 11645 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:41.809531 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:41.810434 11054 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 19.
I20260709 12:25:41.813290 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:41.820405 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:41.855099 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:41.879382 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.879628 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:41.880339 11126 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:41.881050 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 82626.4us
W20260709 12:25:41.881565 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.882388 11098 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:41.821201 11052 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:25:41.884271 11098 leader_election.cc:400] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12.
W20260709 12:25:41.887563 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 89908.8us
I20260709 12:25:41.886170 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:41.894698 11052 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:41.888015 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 83284.8us
I20260709 12:25:41.895833 11645 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:41.894351 11098 leader_election.cc:403] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:41.915902 11675 raft_consensus.cc:1240] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:41.918782 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:41.902063 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:41.887560 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 92245.1us
I20260709 12:25:41.925374 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:41.930579 11673 raft_consensus.cc:1240] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:41.900269 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:41.929006 11678 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 19.
I20260709 12:25:41.878659 16525 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:41.887789 16638 raft_consensus.cc:2749] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:41.945147 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:41.945923 11128 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:41.946182 10948 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:41.906270 16620 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:41.943835 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:41.953835 11675 raft_consensus.cc:2410] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:25:41.950736 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:41.888813 16514 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:41.917092 16486 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:25:41.955081 11127 raft_consensus.cc:2368] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 16. Current term is 17.
I20260709 12:25:41.888089 16662 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:41.924976 16626 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:41.924750 16643 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:41.951074 11133 raft_consensus.cc:2468] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 14.
I20260709 12:25:41.960742 11643 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:41.943084 16525 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.970695 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:41.972568 11133 raft_consensus.cc:1240] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:25:41.974233 11131 raft_consensus.cc:2393] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 16: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:41.975540 11024 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:41.976775 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:41.977675 11133 raft_consensus.cc:2410] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:25:41.934237 16427 consensus_queue.cc:1048] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:25:41.962445 16580 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:41.963928 16626 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.982999 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:41.952080 16333 consensus_queue.cc:1059] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:25:41.963709 16662 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:41.973937 16525 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:41.995790 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:41.994874 16662 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:41.991827 16419 raft_consensus.cc:2749] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:42.007753 11052 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 16.
I20260709 12:25:41.975925 16620 raft_consensus.cc:697] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:42.011139 16620 consensus_queue.cc:237] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:41.984340 16512 raft_consensus.cc:2804] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:41.987809 16580 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.016587 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:41.990887 16626 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:42.021763 11127 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 16.
I20260709 12:25:42.024850 11057 raft_consensus.cc:1240] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:42.026345 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:42.027113 11054 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:42.028489 11672 raft_consensus.cc:1275] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 21 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260709 12:25:42.028671 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:42.028946 11672 pending_rounds.cc:85] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Aborting all ops after (but not including) 14
I20260709 12:25:42.030218 11672 pending_rounds.cc:107] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 12:25:42.030640 11672 raft_consensus.cc:2889] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:42.030009 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 83958.8us
W20260709 12:25:42.033273 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.970686 16643 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:42.008900 16333 raft_consensus.cc:3055] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:42.043243 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:42.046468 11060 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:42.058745 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:42.060519 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:42.029500 16580 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:42.043264 16627 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:42.066817 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.074457 11126 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 15.
I20260709 12:25:42.075510 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:42.075906 11645 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:42.076336 11126 raft_consensus.cc:2368] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 13. Current term is 14.
I20260709 12:25:42.029359 16512 raft_consensus.cc:697] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:42.063380 11133 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 13.
I20260709 12:25:42.079264 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:42.081282 16449 consensus_queue.cc:1048] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:42.082121 16564 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:42.046123 16333 raft_consensus.cc:740] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:42.083716 16497 raft_consensus.cc:2749] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:42.085747 16643 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:42.086582 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:42.139675 11056 raft_consensus.cc:2393] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 15: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:42.091531 11060 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 18.
I20260709 12:25:42.093582 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:42.083676 16333 consensus_queue.cc:260] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:42.097875 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:42.140962 11058 raft_consensus.cc:2410] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 15 because replica has last-logged OpId of term: 14 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
W20260709 12:25:42.099334 16640 log.cc:927] Time spent T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.719s	user 0.002s	sys 0.000s
I20260709 12:25:42.102392 16534 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:42.104929 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:42.148279 11131 raft_consensus.cc:2393] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 16: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:42.107582 16330 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:42.118090  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:42.079638 16500 raft_consensus.cc:2749] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:25:42.120962 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.121977 16239 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.123399 16605 consensus_queue.cc:1048] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:25:42.125514 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.128952 11054 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
I20260709 12:25:42.130223 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:42.164979 11051 raft_consensus.cc:1240] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 13. Ops: [11.7-11.7]
I20260709 12:25:42.141348 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:42.146807 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:42.165417 11054 raft_consensus.cc:1217] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 12.7->[14.8-14.8]   Dedup: 14.8->[]
I20260709 12:25:42.055984 16588 consensus_queue.cc:1059] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 12:25:42.165941 11054 raft_consensus.cc:1240] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:25:42.166211 11133 raft_consensus.cc:2410] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:25:42.147830 11056 raft_consensus.cc:1240] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:25:42.107045 16580 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:42.148485 11134 raft_consensus.cc:1275] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:42.158562 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:42.167806 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:42.168525 11134 raft_consensus.cc:2393] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 16: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:42.149071 11126 raft_consensus.cc:2410] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:25:42.169497 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:42.170116 11126 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:42.170990 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:42.171407 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:42.156963 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:42.158336 16333 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:42.158964 11025 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:42.160550 11058 raft_consensus.cc:1240] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:42.175040 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:42.176375 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:42.179605 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:42.105713 16662 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:42.064055 16487 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.086s
I20260709 12:25:42.180255 11126 raft_consensus.cc:2376] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bc01179655564f29b83babe396377cbb in term 13. Re-sending same reply.
I20260709 12:25:42.183346 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:42.185776 11134 raft_consensus.cc:2410] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:25:42.184099 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:42.186345 11057 raft_consensus.cc:1240] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:25:42.186669 11131 raft_consensus.cc:2393] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 16: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:42.188095 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:42.191723 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:42.192435 11126 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 17.
I20260709 12:25:42.183146 11644 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:42.161126 16486 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 11. Current term is 12.
I20260709 12:25:42.197355 16426 consensus_queue.cc:1048] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
W20260709 12:25:42.202317 16666 log.cc:927] Time spent T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.492s	user 0.006s	sys 0.000s
I20260709 12:25:42.190943 16532 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:42.080261 16627 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:42.197537 16444 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.203871 16444 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:42.204993 16627 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:42.203873 11133 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:25:42.205991 16444 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:42.218279 16512 consensus_queue.cc:237] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:42.197942 11134 raft_consensus.cc:1240] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:42.162283 16265 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:42.162340 16427 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:42.162235 16239 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:42.237723 11131 raft_consensus.cc:1275] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 12:25:42.278645 11131 pending_rounds.cc:85] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 7
I20260709 12:25:42.278930 11131 pending_rounds.cc:107] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:25:42.279206 11131 raft_consensus.cc:2889] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:42.203218 16532 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:42.286599 10982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 2061) took 1228 ms. Trace:
I20260709 12:25:42.236613 16518 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:42.287101 10982 rpcz_store.cc:276] 0709 12:25:41.057974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:41.059536 (+  1562us) service_pool.cc:224] Handling call
0709 12:25:41.059878 (+   342us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:41.060232 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:41.060264 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:41.072777 (+ 12513us) log.cc:844] Serialized 52 byte log entry
0709 12:25:41.179230 (+106453us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:41.179270 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:41.179342 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:42.098680 (+919338us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:25:42.282557 (+183877us) raft_consensus.cc:1685] finished
0709 12:25:42.282598 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:42.286517 (+  3919us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":482,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":5365120,"thread_start_us":51613,"threads_started":1,"wal-append.queue_time_us":130080}
I20260709 12:25:42.291436 11128 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
W20260709 12:25:42.283831 16654 log.cc:927] Time spent T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:25:42.294979 16580 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 20 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:42.232192 16427 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:42.301239 16427 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:42.302881 16518 raft_consensus.cc:697] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:42.304351 16239 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:42.306728 16662 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:42.231711 16265 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:42.312158 16265 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:42.312834 11060 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:42.303947 16518 consensus_queue.cc:237] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:42.289088 16532 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:42.235190 16610 consensus_queue.cc:1048] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:25:42.364220 11060 raft_consensus.cc:2410] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 12:25:42.370534 16631 log.cc:927] Time spent T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 12:25:42.401575 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 261512us
W20260709 12:25:42.426388 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 349207us
I20260709 12:25:42.421216 16647 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.423282 16525 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:42.448021 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:42.429498 16330 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:42.460997 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 276937us
I20260709 12:25:42.472007 11025 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:42.453289 16647 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:42.459378 16564 raft_consensus.cc:697] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:42.476931 11025 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:42.463696 16330 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:42.474462 16427 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:42.495144 16419 raft_consensus.cc:2749] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:42.495748 16564 consensus_queue.cc:237] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:42.500048 16525 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:42.473588 16265 consensus_queue.cc:1048] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:25:42.497356 16529 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:42.526814 11125 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
I20260709 12:25:42.504143 16427 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:42.540620 16427 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:42.559062 16427 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:42.562646 16691 log.cc:927] Time spent T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 12:25:42.565923 16626 consensus_meta.cc:287] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.515s	user 0.006s	sys 0.003s
I20260709 12:25:42.566550 16626 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:42.567868 11673 raft_consensus.cc:2393] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 18: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:42.569754 16647 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:42.550195 16532 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:42.585355 16669 log.cc:927] Time spent T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.608s	user 0.007s	sys 0.000s
I20260709 12:25:42.574335 16330 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:42.597707 10950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.599227 16600 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.599828 16600 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:42.602658 16500 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:42.603266 16500 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:42.597620 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.605640 16638 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:42.605881 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:42.606634 10976 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:25:42.608850 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:42.609442 11059 raft_consensus.cc:2368] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 15. Current term is 16.
W20260709 12:25:42.614581 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 436353us
I20260709 12:25:42.615316 10975 raft_consensus.cc:1275] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:25:42.615903 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:42.615350 16500 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:42.616113 11098 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:42.602052 16600 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:42.619406 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:42.620157 11098 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:42.616449 16494 consensus_queue.cc:1048] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:25:42.615407 16638 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:42.621866 16643 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:42.622823 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.624797 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:42.618476 16588 raft_consensus.cc:3055] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:42.625418 11059 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:42.625438 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:42.625967 11129 raft_consensus.cc:1275] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 12:25:42.626528 11052 raft_consensus.cc:2368] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 17. Current term is 18.
I20260709 12:25:42.626457 11129 pending_rounds.cc:85] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 7
I20260709 12:25:42.627029 11129 pending_rounds.cc:107] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:25:42.627298 11129 raft_consensus.cc:2889] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:42.627635 11098 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:42.622493 16643 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:42.630057 11128 raft_consensus.cc:1275] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 12:25:42.637563 11128 pending_rounds.cc:85] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb: Aborting all ops after (but not including) 9
I20260709 12:25:42.595400 16626 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:42.631152 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:42.635517 10948 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:42.638278 11133 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 16.
I20260709 12:25:42.638950 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:42.637838 11128 pending_rounds.cc:107] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 12:25:42.638422 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:42.633510 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:42.639277 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:42.640542 11134 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 16.
I20260709 12:25:42.639931 11128 raft_consensus.cc:2889] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:42.640767 11133 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:42.641418 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:42.635047 11098 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:42.641673 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:42.643857 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:42.618724 16486 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:42.645689 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:42.650417 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:42.644716 11132 raft_consensus.cc:2393] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in current term 14: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:42.646968 11023 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:42.647249 11098 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:42.647142 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.648072 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:42.644261 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:42.652374 10980 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:42.652467 11676 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:42.618412 16674 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.657521 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:42.663482 11126 raft_consensus.cc:1275] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 21 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:25:42.668129 10984 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 17.
I20260709 12:25:42.633185 16514 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.628734 16494 raft_consensus.cc:2749] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:42.665300 11129 raft_consensus.cc:1275] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:25:42.686079 10980 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 16.
I20260709 12:25:42.628546 16588 raft_consensus.cc:740] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:42.633373 16627 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:42.669740 16500 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:42.670389 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:42.671088 16529 consensus_queue.cc:1048] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:42.673605 16662 raft_consensus.cc:2804] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:42.655880 16333 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.655287 16513 raft_consensus.cc:2749] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:42.676579 16643 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:42.654460 16580 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:42.677376 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:42.714861 10982 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:42.677898 10981 raft_consensus.cc:1275] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:42.684335 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:42.715970 10983 raft_consensus.cc:3060] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:42.708416 16500 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:42.667326 11059 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 20.
I20260709 12:25:42.669056 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:42.687785 11023 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:42.688560 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:42.641273 16633 raft_consensus.cc:2749] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:42.644124 16673 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.693863 11128 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:25:42.693300 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:42.722806 10977 raft_consensus.cc:2368] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 19. Current term is 20.
I20260709 12:25:42.654690 16239 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:42.663877 16265 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:42.723825 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:42.711746 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
W20260709 12:25:42.718971 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 71799.3us
I20260709 12:25:42.724501 10978 raft_consensus.cc:3060] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:25:42.729023 10983 raft_consensus.cc:2468] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 12.
I20260709 12:25:42.729931 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:42.708142 16486 raft_consensus.cc:2749] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:42.731706 10984 raft_consensus.cc:2368] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 15. Current term is 16.
I20260709 12:25:42.709506 16662 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.733162 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:42.736955 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:42.751065 11098 leader_election.cc:400] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 15. Current term is 16.
I20260709 12:25:42.756336 11098 leader_election.cc:403] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:42.691922 16514 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:42.761735 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:42.685431 16674 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:42.765630 11128 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 16.
I20260709 12:25:42.765534 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:42.769109 10980 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 11.
I20260709 12:25:42.766404 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:42.695539 16627 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:42.718186 16532 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:42.730656 16265 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.770947 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:42.760756 16513 consensus_queue.cc:1059] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:25:42.753089 16444 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:42.758139 16662 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:42.791456 10975 raft_consensus.cc:1275] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:25:42.715039 16333 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:42.793358 10949 leader_election.cc:400] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 16. Current term is 17.
I20260709 12:25:42.785907 10978 raft_consensus.cc:2468] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 18.
I20260709 12:25:42.795248 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:42.782779 11024 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:42.796955 11052 raft_consensus.cc:1240] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:42.725345 16580 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:42.796200 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:42.801040 11024 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:42.772148 16467 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.806609 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:42.796389 16700 raft_consensus.cc:2749] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 15. Current term is 16.
I20260709 12:25:42.809368 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:42.806375 16526 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:42.813149 16514 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:42.752745 16239 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:42.815845 16239 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:42.732563 16673 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:42.819212 16673 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:42.821180 16674 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:42.824203 10983 raft_consensus.cc:2393] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 17: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:42.826767 11057 raft_consensus.cc:1240] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:42.799373 16444 raft_consensus.cc:697] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:42.829743 16444 consensus_queue.cc:237] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:42.819252 10975 raft_consensus.cc:1275] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 12:25:42.835062 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:42.835453 10975 pending_rounds.cc:85] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 11
I20260709 12:25:42.835785 10975 pending_rounds.cc:107] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:25:42.836090 10975 raft_consensus.cc:2889] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:42.837536 11098 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:42.838056 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:42.840003 11025 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:42.802440 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:42.803265 11059 raft_consensus.cc:1275] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:42.801614 11053 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 11.
I20260709 12:25:42.781559 16265 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:42.850992 11098 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:42.851883 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:42.808864 16680 log.cc:927] Time spent T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 12:25:42.854302 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 61090.8us
I20260709 12:25:42.806789 16686 raft_consensus.cc:2749] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:42.855948 11098 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:42.864986 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:42.865042 11025 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
W20260709 12:25:42.854022 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 183317us
I20260709 12:25:42.876883 11053 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 17.
I20260709 12:25:42.797168 16638 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:42.878186 10948 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:42.903812 10975 raft_consensus.cc:1240] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:42.904495 11025 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:42.908154 11054 raft_consensus.cc:1240] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 12:25:42.821722 16588 consensus_queue.cc:260] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:42.900238 16419 raft_consensus.cc:2749] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:42.913920 16333 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:42.863792 16700 consensus_queue.cc:1048] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:25:42.876439 16494 raft_consensus.cc:2804] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:42.832878 16500 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:42.832854 16598 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:42.800310 16643 consensus_queue.cc:1048] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:25:42.918071 10980 raft_consensus.cc:1275] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:42.936483 16673 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:42.853382 16600 raft_consensus.cc:2749] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:42.876066 16497 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.875767 16513 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.934026 16588 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:42.944690 16513 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:42.923373 10982 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 18.
I20260709 12:25:42.924511 11676 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 20.
I20260709 12:25:42.892724 16469 raft_consensus.cc:2804] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:42.926366 10949 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:42.901104 16486 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:42.914773 16683 consensus_queue.cc:1048] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:25:42.848697 16467 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:42.853782 16514 consensus_queue.cc:1059] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
W20260709 12:25:42.932536 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 54478.9us
I20260709 12:25:42.832924 16529 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.111s
I20260709 12:25:42.917285 16525 raft_consensus.cc:2749] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:42.939604 11025 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:42.937275 16673 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:42.942914 16570 consensus_queue.cc:1048] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:42.940550 16598 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:42.938431 16674 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:42.929175 16494 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:42.985455 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 47737.4us
W20260709 12:25:42.991410 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 65122.9us
I20260709 12:25:43.026343 10949 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
W20260709 12:25:43.013441 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 73927.8us
I20260709 12:25:43.018630 10948 leader_election.cc:400] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 election: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 17. Current term is 18.
I20260709 12:25:43.027237 10948 leader_election.cc:403] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:25:43.027907 16444 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:43.029912 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:43.030741 11125 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 16.
I20260709 12:25:42.972708 16469 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:42.932006 16698 consensus_queue.cc:1059] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 12:25:43.035863 11644 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:43.040050 11134 raft_consensus.cc:1275] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:43.026363 11645 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:43.042757 11645 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:42.998238 16696 raft_consensus.cc:2749] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:43.050912 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:43.053682 11125 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 21.
I20260709 12:25:43.031051 16494 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:43.059101 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:43.039017 16514 raft_consensus.cc:3055] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:43.040706 16469 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:43.046288 16486 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.063651 11127 raft_consensus.cc:2393] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 18: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:42.962204 16497 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:43.025275 16686 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 12:25:43.035127 16674 raft_consensus.cc:697] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 16 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:43.059219 16643 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:43.077282 16662 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:43.065343 16514 raft_consensus.cc:740] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:43.065490 16706 raft_consensus.cc:2749] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483) with higher term. Message: Invalid argument: T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 17. Current term is 18.
I20260709 12:25:43.064890 16713 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:43.052320 16518 raft_consensus.cc:2804] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:43.072753 16633 raft_consensus.cc:3055] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:43.080129 16605 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:43.073890 16696 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.087452 16606 raft_consensus.cc:2804] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:43.161180 10977 raft_consensus.cc:2393] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 12: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:43.113894 16580 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:43.082121 16486 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:43.129472 16633 raft_consensus.cc:740] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:43.149807 16518 raft_consensus.cc:697] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:25:43.190887 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 163525us
I20260709 12:25:43.147595 16605 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.165226 16703 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:43.188505 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 131946us
I20260709 12:25:43.169057 16606 raft_consensus.cc:697] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:25:43.182219 10947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.199307 16605 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:43.206243 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:43.117892 16643 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:43.201949 11025 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:43.130882 16713 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:43.215327 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:43.224246 16570 raft_consensus.cc:2749] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:43.190539 16598 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:43.264480 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 47460.6us
W20260709 12:25:43.264418 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 221752us
I20260709 12:25:43.213305 16513 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:43.161459 16696 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:43.188386 16674 consensus_queue.cc:237] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:43.297972 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 271706us
I20260709 12:25:43.298955 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:43.189929 16514 consensus_queue.cc:260] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:43.263525 16704 raft_consensus.cc:493] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:43.307739 16729 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:43.307977 16662 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:43.311385 10949 leader_election.cc:400] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 13. Current term is 14.
I20260709 12:25:43.279721 16673 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:43.277841 16467 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:43.322526 11645 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:43.268025 16633 consensus_queue.cc:260] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:43.319787 16729 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:43.320137 16606 consensus_queue.cc:237] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:43.319082 10949 leader_election.cc:403] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
W20260709 12:25:43.337045 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 129047us
I20260709 12:25:43.354058 16532 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.362588 16696 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:43.364100 16715 log.cc:927] Time spent T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:25:43.335469 16486 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:43.361876 16532 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:43.353698 16494 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:43.388770 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 85771.2us
I20260709 12:25:43.391386 10949 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:43.401029 10949 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:43.402299 16698 raft_consensus.cc:2749] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:43.402820 16729 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:43.403434 16729 raft_consensus.cc:2749] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:43.341781 16610 consensus_queue.cc:1048] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:25:43.403924 10949 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:43.405067 16696 raft_consensus.cc:2749] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:43.399775 16709 log.cc:927] Time spent T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 12:25:43.407258 16494 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:43.406780 10949 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:43.311936 16518 consensus_queue.cc:237] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:43.369372 16497 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:43.316877 16704 raft_consensus.cc:515] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:43.418467 11643 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.145.193:46777 timed out after 1.616s (SENT) [suppressed 21 similar messages]
W20260709 12:25:43.367858 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 155239us
I20260709 12:25:43.426360 10949 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:43.429282 16239 raft_consensus.cc:2749] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:43.430075 10949 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:43.431352 10949 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:43.432173 16728 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:43.417181 16696 raft_consensus.cc:2749] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:43.434958 16696 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:43.435350 16696 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:43.435756 16696 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:43.431684 11644 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:43.419643 16265 consensus_meta.cc:287] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.543s	user 0.012s	sys 0.000s
I20260709 12:25:43.388057 16732 raft_consensus.cc:2749] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) with higher term. Message: Invalid argument: T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 13. Current term is 14.
I20260709 12:25:43.455289 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:43.460462 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:43.462172 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:43.463768 16729 consensus_queue.cc:1048] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:43.466981 11132 raft_consensus.cc:1275] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:43.458351 16239 consensus_queue.cc:1048] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
W20260709 12:25:43.469341 16588 consensus_meta.cc:287] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb: Time spent flushing consensus metadata: real 0.524s	user 0.006s	sys 0.004s
I20260709 12:25:43.471096 16713 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:43.435854 16605 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:43.440287 16643 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:43.474466 16731 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:25:43.475049 16605 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:43.444437 16598 raft_consensus.cc:2749] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:43.422039 16727 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:43.484647 16727 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:43.486950 16727 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:43.476380 16265 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:43.489792 16265 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:43.426576 16717 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:43.480563 11130 raft_consensus.cc:1275] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:25:43.481536 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:43.483569 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:43.503567 10979 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:25:43.504822 11132 raft_consensus.cc:2410] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:25:43.458881 16581 consensus_queue.cc:1059] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 12:25:43.508177 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:43.509912 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:43.511124 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:43.513545 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 95102.6us
I20260709 12:25:43.517228 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:43.518030 11130 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:25:43.475911 16704 leader_election.cc:290] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:43.527945 10984 raft_consensus.cc:1275] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:43.526983 10979 pending_rounds.cc:85] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 9
I20260709 12:25:43.538506 10979 pending_rounds.cc:107] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 12:25:43.538825 10979 raft_consensus.cc:2889] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:43.526268 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:43.528463 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:43.530658 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:43.531886 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:43.541311 10982 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 15.
I20260709 12:25:43.541247 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:43.535121 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:43.543988 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:43.548630 11130 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 18.
I20260709 12:25:43.549916 11645 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:43.527112 16598 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:25:43.552428 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:43.553655 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:43.552261 11643 leader_election.cc:400] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 election: Vote denied by peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777) with higher term. Message: Invalid argument: T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 19. Current term is 20.
I20260709 12:25:43.555099 11643 leader_election.cc:403] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:25:43.554853 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:43.557511 11643 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:43.554702 16605 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:43.558949 16581 raft_consensus.cc:2749] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777) with higher term. Message: Invalid argument: T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 19. Current term is 20.
I20260709 12:25:43.562598 16605 raft_consensus.cc:697] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:43.563730 16605 consensus_queue.cc:237] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:43.564800 16627 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:43.569727 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:43.549777 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:43.572288 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:43.572508 11130 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:43.578722 11134 raft_consensus.cc:2410] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:25:43.539749 16532 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:43.579229 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:43.542194 16744 raft_consensus.cc:3055] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:43.580044 16744 raft_consensus.cc:740] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:43.580165 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:43.581069 16744 consensus_queue.cc:260] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:43.573697 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:43.574934 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:43.507442 16717 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:43.582741 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:43.583572 11057 raft_consensus.cc:2410] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:25:43.582521 11672 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 15.
I20260709 12:25:43.584262 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:43.585860 11132 raft_consensus.cc:2410] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:25:43.584339 16717 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:43.587507 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:43.578495 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:43.582376 16744 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:43.580309 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:43.589170 11059 raft_consensus.cc:3060] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:43.575302 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:43.592181 10949 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:43.587255 16696 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:43.594360 16239 consensus_queue.cc:1048] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:43.595423 16696 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 18 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:43.595855 16239 raft_consensus.cc:2749] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:43.579921 11054 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 15.
W20260709 12:25:43.598062 16711 log.cc:927] Time spent T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.583s	user 0.000s	sys 0.003s
I20260709 12:25:43.584430 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:43.608376 11060 raft_consensus.cc:2410] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:25:43.613255 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:43.615705 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:43.616780 11054 raft_consensus.cc:2410] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:25:43.620249 16731 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 21 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:43.620889 16731 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:25:43.628271 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:43.603915 11130 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 17.
W20260709 12:25:43.630897 10948 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.007s	sys 0.022s
W20260709 12:25:43.634436 10948 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.008s	sys 0.022s
W20260709 12:25:43.634899 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 616352us
I20260709 12:25:43.635768 10948 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:43.603104 11134 raft_consensus.cc:2393] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 12: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:43.636708 11131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2854) took 1006 ms. Trace:
I20260709 12:25:43.629837 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:43.637511 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:43.639099 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:43.637471 11131 rpcz_store.cc:276] 0709 12:25:42.630002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:42.630133 (+   131us) service_pool.cc:224] Handling call
0709 12:25:42.648446 (+ 18313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:42.713053 (+ 64607us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:42.713094 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:42.782957 (+ 69863us) log.cc:844] Serialized 26 byte log entry
0709 12:25:42.895734 (+112777us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:42.896041 (+   307us) log.cc:844] Serialized 14 byte log entry
0709 12:25:42.939813 (+ 43772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:42.939893 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:43.597500 (+657607us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:25:43.636396 (+ 38896us) raft_consensus.cc:1685] finished
0709 12:25:43.636530 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:43.636649 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22296,"prepare.queue_time_us":912,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":38119,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":7383,"spinlock_wait_cycles":31344384,"thread_start_us":93196,"threads_started":3,"wal-append.queue_time_us":124176}
I20260709 12:25:43.645604 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:43.634019 16610 raft_consensus.cc:2804] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:43.648478 10982 raft_consensus.cc:1240] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:43.649693 11098 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:43.579159 16469 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:43.656134 11098 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:43.652889 11059 raft_consensus.cc:2468] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:43.574036 11025 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:43.654465 16724 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:43.655683 10948 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:43.598963 16728 raft_consensus.cc:2749] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:43.659826 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:43.662935 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:43.670455 11672 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:25:43.673810 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:43.674445 11053 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:43.674633 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:43.675170 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:25:43.669687 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 95727.9us
I20260709 12:25:43.667004 10948 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:43.636607 16580 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:25:43.677775 10948 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:43.683171 11098 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:43.685377 11025 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:43.685818 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5f0c97d6e4662b2fe7ef12f7e7284" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:43.683411 10948 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:43.692013 16643 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:43.692970 10948 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:43.693986 16643 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:43.696537 16570 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:43.697186 16570 raft_consensus.cc:697] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:43.698774 16419 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:43.699436 16419 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:43.702785 16570 consensus_queue.cc:237] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:43.701893 16419 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:43.707830 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:43.710326 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:43.713299 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:43.715417 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:43.717219 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:43.717705 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:43.718797 10948 leader_election.cc:304] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:43.724761 10978 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:43.655102 16610 raft_consensus.cc:697] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:43.731067 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:43.730254 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:43.741240 11676 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 15.
I20260709 12:25:43.741397 11059 raft_consensus.cc:2393] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 12: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:25:43.735307 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:43.737416 11060 raft_consensus.cc:1240] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:43.650280 16744 consensus_queue.cc:1048] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 12:25:43.647871 16355 consensus_queue.cc:1059] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:25:43.738346 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:43.679533 16239 raft_consensus.cc:2749] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:43.664765 16627 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:43.762226 11057 raft_consensus.cc:1240] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 14. Current term is 15. Ops: []
W20260709 12:25:43.740641 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 46465.5us
I20260709 12:25:43.739064 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:43.684418 16684 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:43.651721 16626 consensus_queue.cc:1048] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 12:25:43.681275 16696 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:43.731915 16419 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:43.722114 16736 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:43.721482 16704 raft_consensus.cc:2749] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:43.745932 11054 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 15.
I20260709 12:25:43.767000 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:43.727501 16494 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:43.728127 16580 raft_consensus.cc:697] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 20 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:43.669624 16676 consensus_queue.cc:1048] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 12:25:43.774963 10948 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:43.659332 16751 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.112s
I20260709 12:25:43.744202 16600 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:25:43.791503 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 165738us
I20260709 12:25:43.761818 16627 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.816138 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:43.743703 16713 raft_consensus.cc:2804] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:43.769256 16265 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.682883 16724 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:43.823305 10978 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 17.
I20260709 12:25:43.847711 11097 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:43.771238 16735 raft_consensus.cc:2749] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:43.816744 10948 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:43.856241 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:43.867252 11097 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:43.879618 11097 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:43.817293 16643 raft_consensus.cc:2749] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:43.847191 16627 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:43.880964 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 96111.6us
W20260709 12:25:43.870434 16755 log.cc:927] Time spent T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:25:43.783668 16419 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:43.891492 11055 raft_consensus.cc:1275] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:43.886734 16696 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:43.887229 10948 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:43.885484 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 68790.8us
I20260709 12:25:43.855221 16600 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:43.888499 16494 raft_consensus.cc:2749] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:43.862920 16713 raft_consensus.cc:697] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 12 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:43.774209 16684 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:43.869740 16610 consensus_queue.cc:237] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:43.814476 16736 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:43.902020 11053 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 18.
I20260709 12:25:43.870764 16265 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:43.905707 10948 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:43.878940 16513 raft_consensus.cc:2749] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:43.903079 11127 raft_consensus.cc:1275] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:25:43.884397 16742 raft_consensus.cc:2749] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:25:43.907749 16643 raft_consensus.cc:2749] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:43.909004 16580 consensus_queue.cc:237] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:43.971210 16736 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:43.981943 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:43.995857 16419 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:43.998669 16753 log.cc:927] Time spent T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:25:43.999877 10976 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:25:44.001120 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:44.001864 16713 consensus_queue.cc:237] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:44.004617 16686 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.004835 10981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52820 (request call id 2062) took 1311 ms. Trace:
I20260709 12:25:44.005218 16686 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:44.005192 10981 rpcz_store.cc:276] 0709 12:25:42.693933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:42.831143 (+137210us) service_pool.cc:224] Handling call
0709 12:25:42.831442 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:42.866056 (+ 34614us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:42.895059 (+ 29003us) log.cc:844] Serialized 14 byte log entry
0709 12:25:43.172029 (+276970us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:43.172101 (+    72us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:43.172151 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:44.004558 (+832407us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b54001a0754. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:44.004624 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:44.004778 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18685,"prepare.queue_time_us":36655,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":3728,"raft.queue_time_us":38617,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":4956,"spinlock_wait_cycles":78949248,"thread_start_us":286390,"threads_started":3,"wal-append.queue_time_us":266804}
I20260709 12:25:43.972760 16494 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.962450 16469 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:44.007954 16686 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:44.019587 16525 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:43.971076 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:43.951409 16727 consensus_queue.cc:1059] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:25:44.025554 10977 raft_consensus.cc:2376] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 18. Re-sending same reply.
I20260709 12:25:44.031793 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:44.028970 16727 consensus_queue.cc:1243] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Peer bc01179655564f29b83babe396377cbb log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 12:25:44.042754 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 161251us
I20260709 12:25:44.045811 11126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 2861) took 1374 ms. Trace:
I20260709 12:25:44.046363 11126 rpcz_store.cc:276] 0709 12:25:42.671133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:42.691762 (+ 20629us) service_pool.cc:224] Handling call
0709 12:25:42.712770 (+ 21008us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:42.788122 (+ 75352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:42.788152 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:42.788595 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 12:25:42.933472 (+144877us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:42.933819 (+   347us) log.cc:844] Serialized 14 byte log entry
0709 12:25:42.933991 (+   172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:44.002905 (+1068914us) spinlock_profiling.cc:243] Waited 5.1 ms on lock 0x7b18002d7480. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cf73f3 00007f8f88cf97c1 00007f8f88cf9779 00007f8f88cf9709 00007f8f88cf96d1 00007f8f88cf89cd 0000000000388634 0000000000388479 00007f8f88cda83a
0709 12:25:44.045440 (+ 42535us) spinlock_profiling.cc:243] Waited 75 ms on lock 0x7b5400373554. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde4e01 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:44.045506 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:44.045562 (+    56us) raft_consensus.cc:1685] finished
0709 12:25:44.045574 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:44.045738 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4393,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":46994,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":7743,"spinlock_wait_cycles":184155264,"thread_start_us":144573,"threads_started":1,"wal-append.queue_time_us":199895,"wal-append.run_cpu_time_us":1979,"wal-append.run_wall_time_us":1001985}
I20260709 12:25:44.024106 16494 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:44.052951 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:44.057217 16600 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:44.059693 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:44.068485 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:44.076897 11097 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:44.080627 16742 raft_consensus.cc:2749] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:44.082088 11097 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:44.083772 16684 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:44.084729 16742 raft_consensus.cc:2749] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:44.086087 11097 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:44.086530 16762 log.cc:927] Time spent T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:25:44.088162 11097 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:44.090775 16724 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:44.091002 16771 raft_consensus.cc:2749] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:44.097903 16742 raft_consensus.cc:2749] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:44.093732 11097 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:44.151911 11643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.093143 16600 consensus_queue.cc:1048] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
W20260709 12:25:44.162881 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 69216.8us
I20260709 12:25:44.163964 16713 raft_consensus.cc:2749] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:44.116338 16731 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:44.179944 16731 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 22 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:44.180962 16494 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:44.183634 16627 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:44.188961 16627 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:44.190008 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:44.191838 11055 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:44.198279 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:44.200892 11055 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 16.
I20260709 12:25:44.212597 11132 raft_consensus.cc:1240] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:25:44.217245 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:44.218690 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:44.219225 10975 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:44.219810 16633 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:44.226092 10975 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 16.
I20260709 12:25:44.228735 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:44.229516 10975 raft_consensus.cc:2368] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 15. Current term is 16.
I20260709 12:25:44.230357 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:44.231220 10975 raft_consensus.cc:2410] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:25:44.231789 16265 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:44.243193 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 337751us
I20260709 12:25:44.243042 16729 raft_consensus.cc:2749] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:44.244093 10948 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:44.244946 16239 raft_consensus.cc:2749] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:44.245666 16239 consensus_queue.cc:1059] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:44.246536 16239 raft_consensus.cc:3055] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:44.246874 16239 raft_consensus.cc:740] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:44.245705 10948 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:44.249611 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 52481us
I20260709 12:25:44.251899 10948 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:44.247699 16239 consensus_queue.cc:260] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:44.266389 10948 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:44.257169 16732 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:44.261109 16627 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:44.274675 11097 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:44.278543 11097 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:44.271888 16333 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:44.281184 16718 raft_consensus.cc:2804] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:44.281813 16718 raft_consensus.cc:697] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 16 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:44.282932 10982 raft_consensus.cc:1275] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:44.283937 11097 leader_election.cc:400] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Vote denied by peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777) with higher term. Message: Invalid argument: T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 15. Current term is 16.
I20260709 12:25:44.282797 16718 consensus_queue.cc:237] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:44.284884 10948 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:44.289330 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:44.290452 16704 raft_consensus.cc:2749] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:25:44.291549 11133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58414 (request call id 984) took 1272 ms. Trace:
I20260709 12:25:44.291831 16500 raft_consensus.cc:3055] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:25:44.292133 16778 log.cc:927] Time spent T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:25:44.271116 16729 consensus_queue.cc:1059] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.013s
W20260709 12:25:44.269999 16698 consensus_queue.cc:1175] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7518bdeb78f24e67a530754ae48547eb" responder_term: 16 status { last_received { term: 16 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 16 index: 10 } }
I20260709 12:25:44.276552 16486 raft_consensus.cc:2749] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:44.293954 16694 raft_consensus.cc:2749] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:44.294399 16724 consensus_queue.cc:1048] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:44.277032 16239 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:44.295161 16500 raft_consensus.cc:740] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:44.278404 16627 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:44.269791 16696 consensus_queue.cc:1059] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 14.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:25:44.296300 16696 raft_consensus.cc:3055] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:44.296674 16696 raft_consensus.cc:740] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:44.297492 16696 consensus_queue.cc:260] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:44.297617 16627 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:44.298563 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:44.299391 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:44.293754 11133 rpcz_store.cc:276] 0709 12:25:43.019044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:43.021891 (+  2847us) service_pool.cc:224] Handling call
0709 12:25:43.022251 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:43.181418 (+159167us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:43.197115 (+ 15697us) log.cc:844] Serialized 14 byte log entry
0709 12:25:44.083982 (+886867us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b18003c56e0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cd9e07 00007f8f91b349a9 00007f8f88cf669b 00007f8f88cf493f 00007f8f88cf6c02 00007f8f8b97e20b 00007f8f8b983d23 00007f8f8b98423a 00007f8f8bdeea2a
0709 12:25:44.166909 (+ 82927us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:44.167768 (+   859us) log.cc:844] Serialized 26 byte log entry
0709 12:25:44.168035 (+   267us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:44.168287 (+   252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:44.168358 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:44.291252 (+122894us) raft_consensus.cc:1685] finished
0709 12:25:44.291354 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:44.291486 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3162,"prepare.queue_time_us":13795,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":188205,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":23837,"spinlock_wait_cycles":24307584,"thread_start_us":240456,"threads_started":2,"wal-append.queue_time_us":1050600}
I20260709 12:25:44.305892 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:44.319005 10982 raft_consensus.cc:1275] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 11 index: 13. (index mismatch)
I20260709 12:25:44.298741 16696 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:44.326483 11097 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:44.327791 16494 raft_consensus.cc:2749] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:44.336750 16750 log.cc:927] Time spent T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.490s	user 0.004s	sys 0.000s
I20260709 12:25:44.341650 11125 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 15.
W20260709 12:25:44.342304 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.351063 16514 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:44.374398 16703 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:44.375048 16703 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:44.377122 16703 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:44.379783 10983 raft_consensus.cc:1275] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:25:44.380208 10983 pending_rounds.cc:85] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 11
I20260709 12:25:44.380422 10983 pending_rounds.cc:107] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:25:44.380645 10983 raft_consensus.cc:2889] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:44.380899 10948 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:44.381759 16703 raft_consensus.cc:2764] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 12:25:44.334563 16783 log.cc:927] Time spent T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 12:25:44.331665 16605 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.012s	sys 0.007s
W20260709 12:25:44.384828 16605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.013s	sys 0.008s
I20260709 12:25:44.384377 16500 consensus_queue.cc:260] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:44.384920 10948 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:44.386238 16791 raft_consensus.cc:2749] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:44.389348 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:44.392346 10949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.395900 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:44.396234 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:44.396879 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:44.396904 11677 raft_consensus.cc:3060] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:44.385908 16500 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:44.400888 11098 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:44.414521 16633 raft_consensus.cc:2749] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:44.420725 11127 raft_consensus.cc:1275] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:44.424434 11677 raft_consensus.cc:2468] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 16.
I20260709 12:25:44.425490 11132 raft_consensus.cc:1275] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:44.426797 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:43.606859  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:44.453435 11055 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:25:44.453540 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:44.459574 10976 raft_consensus.cc:1275] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:44.471801 16355 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.472437 16355 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:44.476511 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:44.482978 10948 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:44.486393 16676 consensus_queue.cc:1048] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:25:44.494783 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:44.495697 11055 raft_consensus.cc:2410] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:25:44.498206 11055 raft_consensus.cc:1275] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:44.484051 16718 consensus_queue.cc:1048] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:25:44.503513 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:44.504416 11129 raft_consensus.cc:2410] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:25:44.489517 16482 consensus_queue.cc:1048] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:25:44.493948 16696 raft_consensus.cc:2749] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:44.516628 10949 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:44.518450 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:44.521157 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:44.506354 16355 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:44.523691 16564 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:25:44.528119 10981 raft_consensus.cc:1275] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:25:44.530778 16688 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.532442 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:44.533197 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:44.540467 10981 raft_consensus.cc:1275] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:25:44.534538 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:44.541707 10975 raft_consensus.cc:2410] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:25:44.533891 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:44.543943 10983 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 18.
I20260709 12:25:44.538996 10980 raft_consensus.cc:2468] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:25:44.565972 11645 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:44.521706 16696 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:44.585522 11023 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
W20260709 12:25:44.584197 16794 log.cc:927] Time spent T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:25:44.564553 16688 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:44.590988 16688 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:44.592764 11129 raft_consensus.cc:1275] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 13. (index mismatch)
W20260709 12:25:44.594847 11097 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:44.599270 16792 log.cc:927] Time spent T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:25:44.600030 11676 raft_consensus.cc:1275] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 12:25:44.600782 16790 log.cc:927] Time spent T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:25:44.606356 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:44.607281 11676 raft_consensus.cc:2410] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:25:44.610515 11643 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:44.611088 16347 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:25:44.574927 16676 raft_consensus.cc:2749] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:25:44.614738 16355 consensus_queue.cc:1048] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:25:44.616464 11677 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 22 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 21. Current term is 22. Ops: []
I20260709 12:25:44.620074 11126 raft_consensus.cc:1275] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:25:44.620281 11056 raft_consensus.cc:1275] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:44.620568 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:44.621917 16514 consensus_queue.cc:1048] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:44.635842 16704 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.636456 16704 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:44.638407 11128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36576 (request call id 2298) took 1117 ms. Trace:
I20260709 12:25:44.639819 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:44.638849 11128 rpcz_store.cc:276] 0709 12:25:43.520573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:43.601877 (+ 81304us) service_pool.cc:224] Handling call
0709 12:25:43.602270 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:43.602643 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:43.602670 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:43.603100 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 12:25:43.747538 (+144438us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:44.500124 (+752586us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b180043dce0. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cd9e07 00007f8f91b349a9 00007f8f88cf669b 00007f8f88cf493f 00007f8f88cf4455 00007f8f8f7dc3c7 00007f8f8bdee9a7 00007f8f8bdfe0bf 00007f8f8bdfe038
0709 12:25:44.636988 (+136864us) log.cc:844] Serialized 14 byte log entry
0709 12:25:44.637958 (+   970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:44.638037 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:44.638079 (+    42us) raft_consensus.cc:1685] finished
0709 12:25:44.638202 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:44.638341 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69864,"prepare.queue_time_us":205945,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":26653,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":203,"spinlock_wait_cycles":5493504,"thread_start_us":280730,"threads_started":2,"wal-append.queue_time_us":276926}
I20260709 12:25:44.640468 11127 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 11.
I20260709 12:25:44.642057 10949 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
W20260709 12:25:44.653018 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 67583.8us
I20260709 12:25:44.655251 10979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 834) took 1129 ms. Trace:
I20260709 12:25:44.651193 16751 raft_consensus.cc:2749] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:44.581889 16736 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.669732 16736 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:44.671674 11023 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:44.672065 16736 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:44.669632 16688 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:25:44.650485 16728 raft_consensus.cc:2749] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:44.682441 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:44.683357 11127 raft_consensus.cc:2410] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c979ef00e0ad4157b49ebbdc13ce7cd7 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:25:44.685400 11023 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:44.686249 16688 raft_consensus.cc:2749] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:44.687012 16688 consensus_queue.cc:1059] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:44.687932 16683 raft_consensus.cc:2749] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:44.689229 16683 raft_consensus.cc:3055] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:44.689577 16683 raft_consensus.cc:740] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:44.690429 11023 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:44.691382 16714 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:44.690495 16683 consensus_queue.cc:260] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:44.694504 16714 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:44.650051 16330 consensus_queue.cc:1048] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:25:44.669162 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36576 (request call id 2288) took 1211 ms. Trace:
I20260709 12:25:44.696250 11125 rpcz_store.cc:276] 0709 12:25:43.454847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:43.455006 (+   159us) service_pool.cc:224] Handling call
0709 12:25:44.666539 (+1211533us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b540012dc54. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4d571 00007f8f8bde82fa 00007f8f90da9b17 00007f8f8a3246d4 00007f8f8a324662 00007f8f8a324591 00007f8f8a32450c 00007f8f8a3237c2 00007f8f8a11f48c 00007f8f8a11e8c6 00007f8f8a11e26f
0709 12:25:44.666689 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2030255360}
I20260709 12:25:44.697551 16647 consensus_queue.cc:1048] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:44.700474 16610 consensus_queue.cc:1048] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:25:44.702476 16322 consensus_queue.cc:1048] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:44.651064 16729 raft_consensus.cc:2804] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:44.703299 16729 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.703693 16729 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:44.706045 11023 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:44.656306 16686 raft_consensus.cc:2764] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:25:44.691524 16525 raft_consensus.cc:2749] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:44.694172 16683 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:44.660671 10979 rpcz_store.cc:276] 0709 12:25:43.526340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:43.526476 (+   136us) service_pool.cc:224] Handling call
0709 12:25:43.526798 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:43.539436 (+ 12638us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:43.539471 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:44.520550 (+981079us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b2c00030d28. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8a6dda11 00007f8f8a6ed372 00007f8f8be1fa01 00007f8f8bde443a 00007f8f8bde383e 00007f8f90da8419 00007f8f8a31fbd4 00007f8f8a31fb62 00007f8f8a31fa91 00007f8f8a31fa0c 00007f8f8a31ecc2
0709 12:25:44.521017 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 12:25:44.634528 (+113511us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:44.635184 (+   656us) log.cc:844] Serialized 14 byte log entry
0709 12:25:44.644224 (+  9040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:44.644754 (+   530us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:44.644800 (+    46us) raft_consensus.cc:1685] finished
0709 12:25:44.655013 (+ 10213us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:44.655178 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":175,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":2253,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"spinlock_wait_cycles":9222912,"thread_start_us":113197,"threads_started":1,"wal-append.queue_time_us":113475}
I20260709 12:25:44.730468 10949 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:44.739799 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 45504.6us
W20260709 12:25:44.747833 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 232886us
I20260709 12:25:44.750217 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:25:44.763659 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 66415.3us
I20260709 12:25:44.766696 16791 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:44.767259 16791 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:44.767648 16791 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:44.724502 16513 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:44.769160 16513 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:44.748667 16704 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:44.771059 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 64060.7us
I20260709 12:25:44.773123 16427 raft_consensus.cc:2749] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:44.773774 16322 consensus_queue.cc:1048] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:44.774351 16427 consensus_queue.cc:1059] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:25:44.775800 11023 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:44.777019 11023 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:44.778373 11023 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:44.819626 10977 raft_consensus.cc:1275] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:25:44.813644 16725 raft_consensus.cc:2749] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:44.838887 16714 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.833137 16417 raft_consensus.cc:2804] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:44.854687 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:44.878468 11677 raft_consensus.cc:1275] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:25:44.860811 16417 raft_consensus.cc:697] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:44.892606 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:44.841889 16714 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:44.923096 11673 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 22 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 21. Current term is 22. Ops: []
I20260709 12:25:44.925961 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:44.898854 16718 consensus_queue.cc:1048] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:25:44.927963 16513 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:44.929311 16265 consensus_queue.cc:1059] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.018s
I20260709 12:25:44.955122 16791 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:44.968871 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 88075.9us
I20260709 12:25:44.969863 16736 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:44.982650 16497 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:44.983433 16497 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:44.984800 16696 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:44.985359 16696 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:44.986485 16497 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:44.986553 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:44.987560 16696 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:44.990434 16714 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:44.998553 16812 log.cc:927] Time spent T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:25:44.998294 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:44.999653 11673 raft_consensus.cc:2393] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 22: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:25:44.936925 16417 consensus_queue.cc:237] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:45.000864 11098 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:45.001705 16742 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:25:45.012748 16789 log.cc:927] Time spent T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.574s	user 0.003s	sys 0.002s
I20260709 12:25:45.013723 16469 raft_consensus.cc:3055] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:25:45.021787 16469 raft_consensus.cc:740] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:45.022921 16469 consensus_queue.cc:260] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:45.024318 16469 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:25:45.025403 11058 raft_consensus.cc:1275] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:25:45.026417 10984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60928 (request call id 844) took 1080 ms. Trace:
I20260709 12:25:45.014791 16742 raft_consensus.cc:2749] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:25:45.017637 16736 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:45.026873 10984 rpcz_store.cc:276] 0709 12:25:43.946409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:44.176558 (+230149us) service_pool.cc:224] Handling call
0709 12:25:44.176936 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:44.249348 (+ 72412us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:25:44.261362 (+ 12014us) log.cc:844] Serialized 14 byte log entry
0709 12:25:44.428594 (+167232us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:44.432124 (+  3530us) log.cc:844] Serialized 26 byte log entry
0709 12:25:44.432226 (+   102us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:44.432246 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:44.432294 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:44.464615 (+ 32321us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b180038e900. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cf73f3 00007f8f88cf97c1 00007f8f88cf9779 00007f8f88cf9709 00007f8f88cf96d1 00007f8f88cf89cd 0000000000388634 0000000000388479 00007f8f88cda83a
0709 12:25:44.608275 (+143660us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b180038e900. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f91bbfab1 00007f8f91bcc281 00007f8f88cf7522 00007f8f88cf97c1 00007f8f88cf9779 00007f8f88cf9709 00007f8f88cf96d1 00007f8f88cf89cd 0000000000388634 0000000000388479 00007f8f88cda83a
0709 12:25:44.986551 (+378276us) spinlock_profiling.cc:243] Waited 39.7 ms on lock 0x7b4400022b4c. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88c1dc85 00007f8f88c1e6a2 00007f8f8b9901db 00007f8f8b98baaf 00007f8f8b97f86e 00007f8f8b97ebb6 00007f8f8b97e7d8 00007f8f8b988221 00007f8f8b9881d9 00007f8f8b988169
0709 12:25:45.026228 (+ 39677us) raft_consensus.cc:1685] finished
0709 12:25:45.026252 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:45.026363 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83130,"prepare.queue_time_us":12609,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":73761,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":13457,"spinlock_wait_cycles":121747840,"thread_start_us":155777,"threads_started":1,"wal-append.queue_time_us":174432}
I20260709 12:25:45.019574 16718 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.941612 16729 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:44.966267 16686 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:45.035807 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:45.045775 11132 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:45.049618 11025 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:45.059648 11127 raft_consensus.cc:1240] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 22 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 21. Current term is 22. Ops: []
I20260709 12:25:45.036675 16211 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.041298 16736 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:45.069588 16704 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:45.065176 10980 raft_consensus.cc:1240] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 11. Current term is 12. Ops: [11.13-11.13]
I20260709 12:25:45.058460 16427 raft_consensus.cc:2749] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:45.052591 16718 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:45.113493 16791 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:45.088428 16211 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:45.060832 16686 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:45.119925 16514 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:45.120586 16514 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:45.099591 16714 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.090803 16704 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:45.155969 16791 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:45.180687 16729 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:45.216483 16815 log.cc:927] Time spent T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 12:25:45.218556 16819 log.cc:927] Time spent T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.114s	user 0.000s	sys 0.002s
I20260709 12:25:45.180760 16791 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:45.197227 16729 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:45.225816 16729 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:45.294266 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:45.295018 10976 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:25:45.306895 11023 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:45.326797 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:45.325670 16526 raft_consensus.cc:2749] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:45.357452 11023 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:45.324358 16824 log.cc:927] Time spent T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:25:45.326320 16694 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:45.385847 10979 raft_consensus.cc:1275] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:25:45.177394 16714 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:45.403684 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:45.405759 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:45.406760 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
W20260709 12:25:45.393447 16822 log.cc:927] Time spent T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:25:45.414362 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:45.387908 16172 raft_consensus.cc:2804] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:45.418793 16742 consensus_queue.cc:1048] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:25:45.414413 16683 consensus_meta.cc:287] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.663s	user 0.015s	sys 0.010s
I20260709 12:25:45.435561 11132 raft_consensus.cc:1275] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:25:45.421348 16172 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.396409 16694 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:45.446197 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 389849us
I20260709 12:25:45.445156 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:45.452056 10976 raft_consensus.cc:2393] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 15: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:45.441771 16514 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:45.449209 16172 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:45.473680 11128 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 15.
W20260709 12:25:45.474678 16825 log.cc:927] Time spent T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:25:45.451025 16791 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:45.444777 16731 consensus_queue.cc:1059] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 12:25:45.481433 16704 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:45.456534 16333 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.500054 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 21 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:45.500864 16694 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:45.496858 16791 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:45.501725 16791 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:45.503964 16791 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:45.503700 16333 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:45.501881 16731 raft_consensus.cc:3055] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:45.498459 16427 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.493685 16686 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:45.553987 16835 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:45.554695 16835 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:45.506054 16333 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:45.556569 11059 raft_consensus.cc:1275] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:25:45.556984 16835 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:45.557910 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:45.564905 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 70923us
I20260709 12:25:45.566675 16449 consensus_queue.cc:1048] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:25:45.501461 16736 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:45.570043 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:45.573307 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:45.624341 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 119987us
I20260709 12:25:45.626780 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:45.623067 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 21 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:25:45.675817 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 215308us
I20260709 12:25:45.499466 16729 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:45.506395 16731 raft_consensus.cc:740] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:45.568878 16427 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:45.623418 16742 consensus_queue.cc:1048] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:25:45.702592 11054 raft_consensus.cc:2393] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 17: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:45.701100 16797 consensus_queue.cc:1048] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 12:25:45.705660 16427 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:45.713373 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:45.713954 10975 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 17.
I20260709 12:25:45.715161 11023 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:45.751185 16525 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:45.751775 16525 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.752132 16525 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:45.753906 16736 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 19 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:45.756191 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:45.727533 16731 consensus_queue.cc:260] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.13, Last appended by leader: 13, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:45.763020 16731 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:45.722010 16211 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:45.767554 16843 consensus_queue.cc:1175] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7518bdeb78f24e67a530754ae48547eb" responder_term: 11 status { last_received { term: 11 index: 13 } last_committed_idx: 12 last_received_current_leader { term: 11 index: 13 } }
W20260709 12:25:45.751413 16830 log.cc:927] Time spent T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 12:25:45.784420 11097 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:45.785945 11097 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:45.787824 16833 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:45.788654 16833 raft_consensus.cc:3060] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:45.791055 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:45.791077 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:45.792865 10882 catalog_manager.cc:5697] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:45.794317 11132 raft_consensus.cc:1275] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:25:45.798873 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:45.801748 16729 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:45.802059 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:45.802426 16729 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:45.803608 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:45.804454 10975 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 16.
I20260709 12:25:45.805728 16729 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:45.802977 16714 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:45.808809 11024 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:45.809708 16714 raft_consensus.cc:2749] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:45.810349 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:45.817179 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:45.821913 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:45.822623 11059 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 17.
I20260709 12:25:45.828166 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:45.829056 11056 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 16.
I20260709 12:25:45.830341 11059 raft_consensus.cc:1240] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:45.831705 11024 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:45.832669 16265 raft_consensus.cc:2749] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:25:45.837036 16724 consensus_queue.cc:1048] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:25:45.843565 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:45.844288 11679 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 17.
I20260709 12:25:45.853252 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:45.854629 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:45.857460 11098 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:45.858428 16742 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:45.858840 16742 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.858934 10948 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:45.859300 16742 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:45.860325 16724 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:45.860737 16724 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:45.861084 16724 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:45.871174 16718 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:45.875331 16724 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:45.887637 16742 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:45.893673 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:45.685372 16172 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:45.896104 16172 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:45.897656 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:45.898440 10982 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:45.892059 16724 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:45.900892 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 58526us
I20260709 12:25:45.903225 16742 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:45.905663 16833 raft_consensus.cc:2749] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:45.770035 16525 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:45.901759 11644 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:45.923062 10882 catalog_manager.cc:5697] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 13 to 15, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 15 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:45.925195 10882 catalog_manager.cc:5697] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:45.925829 10975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:45.926661 10975 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:45.927794 10882 catalog_manager.cc:5697] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:45.931416 16647 consensus_queue.cc:1059] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:25:45.934994 16525 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 18 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:45.937033 16833 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:45.948160 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:45.950544 11054 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:45.929754 10882 catalog_manager.cc:5697] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 5 to 12, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 12 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:45.948160 16833 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:45.969005 16347 raft_consensus.cc:3055] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:45.976006 16347 raft_consensus.cc:740] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:45.976970 16347 consensus_queue.cc:260] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:45.978731 16347 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:45.967639 10949 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:45.972002 16833 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:45.973579 11673 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 17.
I20260709 12:25:45.987142 16724 raft_consensus.cc:2749] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:45.990412 16605 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:45.991631 10948 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:45.994320 16724 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:45.994925 16724 raft_consensus.cc:697] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 17 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:45.995843 16724 consensus_queue.cc:237] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:46.019537 10882 catalog_manager.cc:5697] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:46.020592 16605 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.021184 16605 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:45.941851 10982 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:25:45.998919 10975 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 18.
I20260709 12:25:46.064361 10882 catalog_manager.cc:5697] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 9 to 16, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 16 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:46.073689 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:46.074282 10949 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:46.076973 10949 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:46.066663 10882 catalog_manager.cc:5697] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:46.077984 11054 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 17.
I20260709 12:25:46.080397 10882 catalog_manager.cc:5697] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 8 to 15, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 15 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:46.084928 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:46.084997 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:46.086553 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:46.086653 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:46.086974 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:46.087401 11057 raft_consensus.cc:2393] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 15: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:46.088078 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:46.088485 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:46.088699 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:46.088806 11058 raft_consensus.cc:2393] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 17: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:46.089949 11059 raft_consensus.cc:1240] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:46.090873 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:46.094481 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:46.095285 11132 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 16.
I20260709 12:25:46.097522 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d10a1bcd84a0e9845113d5b0a2495" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:46.098976 11134 raft_consensus.cc:3060] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:46.086756 11098 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:46.103029 11098 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:46.104085 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:46.112854 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:46.113499 11127 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:25:46.087085 10882 catalog_manager.cc:5697] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 11 to 13, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 13 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:46.117251 11023 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:46.078929 16729 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:46.122920 10882 catalog_manager.cc:5697] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 9 to 15, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 15 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:46.128026 11128 raft_consensus.cc:1275] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:25:46.128311 11023 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:46.129340 10882 catalog_manager.cc:5697] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 13 to 16, leader changed from <none> to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 16 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:46.131387 10882 catalog_manager.cc:5697] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 8 to 10, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 10 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:46.133291 10882 catalog_manager.cc:5697] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:46.104677 16833 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:46.119681 16721 raft_consensus.cc:2749] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:46.124306 16333 raft_consensus.cc:2749] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:46.141409 11127 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 18.
I20260709 12:25:46.118443 16513 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:46.118403 16718 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:46.148710 11134 raft_consensus.cc:2468] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:25:46.135776 10882 catalog_manager.cc:5697] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 10 to 18. New cstate: current_term: 18 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:46.154739 10882 catalog_manager.cc:5697] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:46.156888 10882 catalog_manager.cc:5697] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 11 to 15, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 15 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:46.158643 10882 catalog_manager.cc:5697] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 11 to 13, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 13 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:46.160343 10882 catalog_manager.cc:5697] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:46.161761 10882 catalog_manager.cc:5697] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 9 to 17. New cstate: current_term: 17 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:46.163800 10882 catalog_manager.cc:5697] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:46.165483 10882 catalog_manager.cc:5697] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 7 to 11, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 11 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:46.167403 10882 catalog_manager.cc:5697] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 7 to 14. New cstate: current_term: 14 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:46.169034 10882 catalog_manager.cc:5697] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 11 to 14, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 14 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:46.170787 10882 catalog_manager.cc:5697] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 10 to 13, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 13 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:46.172624 10882 catalog_manager.cc:5697] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 11 to 14, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 14 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
W20260709 12:25:46.188417 10877 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41120 (request call id 267) took 27176 ms (client timeout 15000 ms). Trace:
W20260709 12:25:46.188952 10877 rpcz_store.cc:269] 0709 12:25:19.011851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.070935 (+ 59084us) service_pool.cc:224] Handling call
0709 12:25:19.771602 (+700667us) spinlock_profiling.cc:243] Waited 898 us on lock 0x7b5400002490. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfb71 00007f8f88cc00b2 00007f8f91c39759 00007f8f91bd1a76 00007f8f91ba2d58 00007f8f91ca104e 00007f8f901622a4 00007f8f90162232 00007f8f90162161 00007f8f901620dc
0709 12:25:20.440134 (+668532us) spinlock_profiling.cc:243] Waited 78.3 ms on lock 0x7b54002e9854. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4e090 00007f8f8bdecf3a 00007f8f91ba2e9c 00007f8f91ca104e 00007f8f901622a4 00007f8f90162232 00007f8f90162161 00007f8f901620dc 00007f8f90161392 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:46.188290 (+25748156us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:40.930976 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:40.961583 (+ 30607us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:40.961650 (+    67us) write_op.cc:435] Acquired schema lock
0709 12:25:40.961664 (+    14us) tablet.cc:662] Decoding operations
0709 12:25:41.000840 (+ 39176us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:41.000934 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:41.000965 (+    31us) tablet.cc:685] Acquiring locks for 27 operations
0709 12:25:41.003121 (+  2156us) tablet.cc:701] Row locks acquired
0709 12:25:41.003180 (+    59us) write_op.cc:260] PREPARE: finished
0709 12:25:41.003371 (+   191us) write_op.cc:270] Start()
0709 12:25:41.003536 (+   165us) write_op.cc:276] Timestamp: P: 1783599941003301 usec, L: 0
0709 12:25:41.003581 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 12:25:41.012015 (+  8434us) log.cc:844] Serialized 10654 byte log entry
0709 12:25:41.689028 (+677013us) op_driver.cc:464] REPLICATION: finished
0709 12:25:41.996938 (+307910us) write_op.cc:301] APPLY: starting
0709 12:25:42.013067 (+ 16129us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:42.560902 (+547835us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:42.561024 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:43.404448 (+843424us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:43.404882 (+   434us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=54,key_file_lookups=54,delta_file_lookups=0,mrs_lookups=0
0709 12:25:43.404944 (+    62us) write_op.cc:312] APPLY: finished
0709 12:25:43.405499 (+   555us) log.cc:844] Serialized 236 byte log entry
0709 12:25:43.504073 (+ 98574us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:43.539933 (+ 35860us) write_op.cc:454] Released schema lock
0709 12:25:43.540040 (+   107us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:43.551659 (+ 11619us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:43.559259 (+  7600us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":275,"reported_tablets":50,"spinlock_wait_cycles":182174720,"child_traces":[["op",{"apply.queue_time_us":282202,"apply.run_cpu_time_us":52075,"apply.run_wall_time_us":1559920,"cfile_cache_hit":110,"cfile_cache_hit_bytes":116609,"num_ops":27,"prepare.queue_time_us":329238,"prepare.run_cpu_time_us":18926,"prepare.run_wall_time_us":256050,"raft.queue_time_us":217096,"raft.run_cpu_time_us":35179,"raft.run_wall_time_us":266570,"replication_time_us":683581,"thread_start_us":781006,"threads_started":5,"wal-append.queue_time_us":320122,"wal-append.run_cpu_time_us":24588,"wal-append.run_wall_time_us":2412281}]]}
W20260709 12:25:46.203841 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 75620us
W20260709 12:25:46.210631 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 85299.7us
W20260709 12:25:46.211061 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 58300.4us
I20260709 12:25:46.211465 11025 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:46.211068 10981 raft_consensus.cc:1275] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:25:46.149739 16683 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:25:46.216792 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 64934.3us
I20260709 12:25:46.223919 11055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:46.224581 11055 raft_consensus.cc:606] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:46.224881 11055 raft_consensus.cc:614] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:25:46.224098 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 131759us
I20260709 12:25:46.226621 10948 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:46.235416 10948 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:46.148767 16694 consensus_queue.cc:1048] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:25:46.214183 16417 raft_consensus.cc:2804] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:46.147903 16833 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:46.247678 16729 raft_consensus.cc:697] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 15 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
W20260709 12:25:46.264518 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 184527us
W20260709 12:25:46.265079 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 53712.9us
W20260709 12:25:46.268875 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 45166.6us
I20260709 12:25:46.256912 16694 consensus_queue.cc:1243] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [LEADER]: Peer 7518bdeb78f24e67a530754ae48547eb log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:46.207208 16718 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:46.256234 16835 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:46.266520 16791 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:46.268894 16720 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:46.273291 16683 raft_consensus.cc:697] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:46.294991 11055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:46.295732 11055 raft_consensus.cc:606] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:46.280645 16853 raft_consensus.cc:2749] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:46.284240 16417 raft_consensus.cc:697] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:46.303072 16417 consensus_queue.cc:237] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:25:46.292397 16731 consensus_meta.cc:287] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent flushing consensus metadata: real 0.529s	user 0.008s	sys 0.008s
I20260709 12:25:46.281885 16835 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:46.286159 16427 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.306241 16854 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:25:46.306926 16854 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:46.308080 16835 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:46.309082 16854 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:46.309605 16827 log.cc:927] Time spent T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.056s	user 0.003s	sys 0.000s
I20260709 12:25:46.301143 16683 consensus_queue.cc:237] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:46.287252 16791 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:46.284240 16513 raft_consensus.cc:697] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 17 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:46.300514 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:46.316727 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:46.325879 16513 consensus_queue.cc:237] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:46.332751 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:46.294112 16852 raft_consensus.cc:2749] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:46.283982 16605 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:46.365273 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 129916us
W20260709 12:25:46.398480 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 59983.1us
I20260709 12:25:46.306707 16427 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:46.421072 10948 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:46.425927 10948 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:46.428967 10948 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:46.434894 11055 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 18.
I20260709 12:25:46.438429 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:46.422241 16724 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.442763 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:46.411412 16858 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:46.443007 10949 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:46.447750 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:46.424412 16694 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:46.453193 10984 raft_consensus.cc:2393] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 18: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:46.454694 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:46.455507 10982 raft_consensus.cc:2368] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 17. Current term is 18.
I20260709 12:25:46.456439 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:46.343727 16729 consensus_queue.cc:237] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:46.426321 16845 consensus_queue.cc:1048] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:25:46.466977 16427 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:46.467582 16736 consensus_queue.cc:1048] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:46.467959 16833 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:46.468822 16525 raft_consensus.cc:993] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7: : Instructing follower bc01179655564f29b83babe396377cbb to start an election
I20260709 12:25:46.459538 16694 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:46.473533 16694 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:46.475229 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:46.484601 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:46.486724 11098 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:46.453580 16858 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:46.453193 16724 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:46.498711 16858 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:46.488390 16850 log.cc:927] Time spent T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 12:25:46.513115 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:46.513911 11673 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:46.516088 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:25:46.522251 16866 log.cc:927] Time spent T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:25:46.495298 16859 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:46.491767 16525 raft_consensus.cc:1081] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Signalling peer bc01179655564f29b83babe396377cbb to start an election
I20260709 12:25:46.458408 16861 raft_consensus.cc:2749] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:46.492821 16852 raft_consensus.cc:2749] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:46.499365 16862 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.530611 16718 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:46.497401 16860 raft_consensus.cc:2749] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:46.516772 11128 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 17.
I20260709 12:25:46.528805 16605 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:46.534873 11098 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:46.535066 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:46.548525 16833 raft_consensus.cc:2804] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:46.549002 16833 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:46.549371 16833 raft_consensus.cc:3060] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:46.514189 16694 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:25:46.528028 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 99126us
W20260709 12:25:46.545080 16863 log.cc:927] Time spent T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:25:46.528822 16791 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:46.563474 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 121940us
I20260709 12:25:46.571056 11097 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:46.577248 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:46.588259 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:46.602923 11097 leader_election.cc:400] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Vote denied by peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777) with higher term. Message: Invalid argument: T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 17. Current term is 18.
I20260709 12:25:46.603308 11097 leader_election.cc:403] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:25:46.602968 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 48555.7us
I20260709 12:25:46.563508 16860 consensus_queue.cc:1059] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:25:46.620097 16860 raft_consensus.cc:3055] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:46.620478 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:46.621511 11025 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:46.626068 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:46.625706 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:46.605983 16859 raft_consensus.cc:2749] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:46.542603 16862 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:46.633908 10949 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:46.642943 11051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:46.644642 11097 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:25:46.614030 16858 raft_consensus.cc:2749] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777) with higher term. Message: Invalid argument: T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb for earlier term 17. Current term is 18.
I20260709 12:25:46.647094 11130 raft_consensus.cc:1217] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 17 LEADER]: Deduplicated request from leader. Original: 11.7->[13.8-16.10]   Dedup: 13.8->[14.9-16.10]
I20260709 12:25:46.620492 16860 raft_consensus.cc:740] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:46.650357 11130 raft_consensus.cc:1240] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 17 LEADER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 16. Current term is 17. Ops: [13.8-16.10]
I20260709 12:25:46.627481 16427 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:46.658121 10948 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:25:46.644985 16855 log.cc:927] Time spent T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:25:46.649698 16718 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:46.658674 16427 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.683629 16873 raft_consensus.cc:2749] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:46.678624 16427 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:46.690164 16610 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.706640 16610 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:46.708972 16610 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:46.710209 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:46.710924 11134 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 22.
I20260709 12:25:46.712281 11645 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:46.713239 16610 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:25:46.713760 16610 raft_consensus.cc:493] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.683609 16833 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:46.710117 16724 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:46.733973 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:46.721865 16610 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:25:46.742707 11673 raft_consensus.cc:2468] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 12.
I20260709 12:25:46.744031 11098 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:46.746735 16835 raft_consensus.cc:2804] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:46.747295 16835 raft_consensus.cc:697] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 12 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:46.748226 16835 consensus_queue.cc:237] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.13, Last appended by leader: 13, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:46.748576 16427 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:46.742509 16833 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:46.755074 11673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e"
dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:45814
I20260709 12:25:46.755780 11673 raft_consensus.cc:606] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:46.758370 16427 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 19 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:46.758870 11052 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:46.759516 11052 raft_consensus.cc:606] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:46.759869 11052 raft_consensus.cc:614] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:46.761648 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:46.762418 11132 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:25:46.759006 16860 consensus_queue.cc:260] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:46.780686 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:46.778788 11098 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:46.787693 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:46.788329 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:46.788627 10979 raft_consensus.cc:2393] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 12: Already voted for candidate bc01179655564f29b83babe396377cbb in this term.
I20260709 12:25:46.812721 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:46.813416 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:46.817340 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:46.818022 11056 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:46.823969 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:46.831929 10948 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:46.834364 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:46.835088 11055 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 22.
I20260709 12:25:46.803859 16694 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:46.843957 11056 raft_consensus.cc:2468] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 18.
I20260709 12:25:46.845049 11052 raft_consensus.cc:1240] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 17. Current term is 18. Ops: []
W20260709 12:25:46.849264 16878 log.cc:927] Time spent T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:25:46.857828 11679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2"
dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:45814
I20260709 12:25:46.859848 11679 raft_consensus.cc:606] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:46.863662 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:46.864624 11056 raft_consensus.cc:2393] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 19: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:46.866703 16862 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:25:46.868381 16882 log.cc:927] Time spent T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:25:46.835069 16871 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:25:46.849125 16880 log.cc:927] Time spent T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:25:46.833976 16860 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:46.874054 11673 raft_consensus.cc:1240] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:46.860340 11679 raft_consensus.cc:614] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:25:46.900403 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 46935.3us
W20260709 12:25:46.908162 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 61714us
W20260709 12:25:46.882476 16883 log.cc:927] Time spent T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 12:25:46.895952 16850 log.cc:927] Time spent T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.065s	user 0.000s	sys 0.003s
W20260709 12:25:46.912317 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 54908.2us
I20260709 12:25:46.917146 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:46.918668 10981 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 18.
I20260709 12:25:46.931348 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:46.933732  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:46.935858  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:46.936872  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:46.944453 10949 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:46.929574 10979 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d"
dest_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:52828
I20260709 12:25:46.955736 10979 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:46.956209 10979 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:46.924396 16791 consensus_queue.cc:1059] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 12:25:46.966202 11644 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:25:46.968827 11126 raft_consensus.cc:1275] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:46.971858 11055 raft_consensus.cc:1275] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:25:46.952720 16873 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:46.975543 16833 consensus_queue.cc:1048] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:46.992895 16172 consensus_queue.cc:1048] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:47.010005 10979 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:47.019423 10976 raft_consensus.cc:1275] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:47.023183 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:47.031659 11126 raft_consensus.cc:1275] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:25:47.031987 10980 raft_consensus.cc:1275] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:25:47.018078 16211 raft_consensus.cc:2804] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:47.052827 16833 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.053486 16833 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:47.057858 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:47.058653 11052 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 15.
I20260709 12:25:47.060145 11098 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:47.061333 16854 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:47.061777 16854 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.062146 16854 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:47.070276 16833 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:47.077137 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:47.080011 11132 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 19.
I20260709 12:25:47.081766 11025 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:47.025981 16871 consensus_queue.cc:1059] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.057s
I20260709 12:25:47.083040 16211 raft_consensus.cc:697] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:47.084061 16211 consensus_queue.cc:237] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:47.086880 16497 raft_consensus.cc:2764] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:25:47.090850 16872 consensus_queue.cc:1048] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:47.100217 16683 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:47.100965 16683 raft_consensus.cc:697] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:47.069855 16610 raft_consensus.cc:515] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:47.111351 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:47.112231 11052 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:25:47.113336 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 74769.8us
I20260709 12:25:47.127830 11052 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 23.
I20260709 12:25:47.129833 11644 leader_election.cc:304] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:47.134334 10975 raft_consensus.cc:1275] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 12:25:47.134765 10975 pending_rounds.cc:85] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 9
I20260709 12:25:47.134979 10975 pending_rounds.cc:107] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 12:25:47.135197 10975 raft_consensus.cc:2889] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:47.135767 16647 raft_consensus.cc:993] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95: : Instructing follower bc01179655564f29b83babe396377cbb to start an election
I20260709 12:25:47.136243 16647 raft_consensus.cc:1081] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Signalling peer bc01179655564f29b83babe396377cbb to start an election
I20260709 12:25:47.137120 16730 raft_consensus.cc:2804] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:25:47.137673 16730 raft_consensus.cc:697] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 23 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:47.137773 16686 consensus_queue.cc:1048] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:47.138325 10976 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e"
dest_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:60928
I20260709 12:25:47.138875 10976 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:47.139200 10976 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:47.139757 16686 consensus_queue.cc:1048] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:47.156967 16610 leader_election.cc:290] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 23 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:47.158144 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4be143c296464e86202c1a42e3d3ee" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:47.158808 11132 raft_consensus.cc:3060] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:25:47.168095 10976 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:47.081189 16873 raft_consensus.cc:2749] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:47.171069 11134 raft_consensus.cc:1275] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:25:47.177181 11132 raft_consensus.cc:2468] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 23.
I20260709 12:25:47.184886 10976 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:47.187654 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:47.188480 11134 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:47.117812 16854 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:47.206670 10981 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 19.
I20260709 12:25:47.214046 11134 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 17.
I20260709 12:25:47.215593 11130 raft_consensus.cc:1240] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:25:47.128134 16683 consensus_queue.cc:237] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:47.216735 10949 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:47.190369 16834 consensus_queue.cc:1048] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:25:47.234699 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:47.235390 11055 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:47.232791 16854 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:47.223798 16872 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:47.250566 16872 raft_consensus.cc:697] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 17 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:47.257952 10976 raft_consensus.cc:1240] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Rejecting Update request from peer c979ef00e0ad4157b49ebbdc13ce7cd7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:47.264827 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:47.245265 16598 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.321954 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:47.322784 11679 raft_consensus.cc:3055] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:47.325130 11055 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 16.
I20260709 12:25:47.323120 11679 raft_consensus.cc:740] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:47.220362 16730 consensus_queue.cc:237] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:47.348466 11673 raft_consensus.cc:1275] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 11 index: 13. Preceding OpId from leader: term: 12 index: 14. (index mismatch)
I20260709 12:25:47.351392 16833 consensus_queue.cc:1048] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:25:47.251595 16872 consensus_queue.cc:237] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:47.320822 16870 log.cc:927] Time spent T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:25:47.320742 16598 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:47.345801 16729 raft_consensus.cc:3055] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:47.331131 11679 consensus_queue.cc:260] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:47.368029 11679 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:47.369686 16322 consensus_queue.cc:1175] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7518bdeb78f24e67a530754ae48547eb" responder_term: 16 status { last_received { term: 16 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 16 index: 12 } }
I20260709 12:25:47.370388 16729 raft_consensus.cc:740] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:47.390492 16598 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:47.395578 16729 consensus_queue.cc:260] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:47.401500 11679 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 17.
I20260709 12:25:47.402827 16729 raft_consensus.cc:3060] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:25:47.401521 16889 log.cc:927] Time spent T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.367s	user 0.001s	sys 0.001s
W20260709 12:25:47.450991 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 81541.2us
I20260709 12:25:47.459995 11098 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:47.480255 16721 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:47.481357 16721 raft_consensus.cc:697] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 16 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:47.492794 16729 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:47.495122 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:47.485834 16724 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:47.496642 11055 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 19.
I20260709 12:25:47.502231 16853 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:47.503419 16853 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:47.503010 16721 consensus_queue.cc:237] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:47.539721 16853 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:47.494060 16729 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:47.576953 11647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.582016 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:47.585299 16729 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:47.575392 16172 consensus_queue.cc:1059] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:25:47.592054 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:47.576375 16724 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:47.585995 16729 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:47.595896 16724 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:47.596482 16729 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:47.598687 16729 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:47.593726 16172 raft_consensus.cc:3055] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:47.599829 16172 raft_consensus.cc:740] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:47.601029 16172 consensus_queue.cc:260] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:47.602890 16172 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:47.611390 11644 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:47.621841 16427 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:25:47.622867 16427 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:47.611301 11056 raft_consensus.cc:1240] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Rejecting Update request from peer bc01179655564f29b83babe396377cbb for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:47.613847 16841 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:47.634979 16841 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.643318 16841 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:47.654191 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:47.629894 16427 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:47.675405 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:47.676299 11132 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:47.679709 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:47.677868 10979 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:47.680806 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:47.681867 11056 raft_consensus.cc:2393] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb in current term 19: Already voted for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in this term.
I20260709 12:25:47.681878 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:25:47.684412 11026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.690382 11132 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 16.
I20260709 12:25:47.716656 16694 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.717440 16694 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:47.719126 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:47.720057 16694 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:47.721235 16835 consensus_queue.cc:1048] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:47.722337 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:47.722143 16835 consensus_queue.cc:1243] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer bc01179655564f29b83babe396377cbb log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:25:47.734464 11056 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:25:47.737509 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:47.739323 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:47.742589 16620 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:25:47.771687 16694 consensus_queue.cc:1059] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:47.773048 16852 raft_consensus.cc:3055] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:47.773530 16852 raft_consensus.cc:740] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:47.774850 16852 consensus_queue.cc:260] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:47.788646 16852 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:47.795423 10979 raft_consensus.cc:1275] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 12 index: 14. (index mismatch)
I20260709 12:25:47.801534 10983 pending_rounds.cc:85] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 8
I20260709 12:25:47.801955 10983 pending_rounds.cc:107] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:25:47.802330 10983 raft_consensus.cc:2889] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:47.838577 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:47.848421 10949 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:47.849529 10949 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:47.851276 16871 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:47.851816 16871 raft_consensus.cc:697] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 16 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:47.852859 16871 consensus_queue.cc:237] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:47.854282 16729 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:47.862207 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 45069.7us
I20260709 12:25:47.813933 11055 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 16.
I20260709 12:25:47.885982 10948 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:47.887741 10948 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:47.883296 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:47.890688 16724 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:47.890443 16694 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:47.939302 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:47.944144 11055 raft_consensus.cc:1275] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 23 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
W20260709 12:25:47.944890 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 61019.2us
I20260709 12:25:47.948900 16841 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:47.949747 16843 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:25:47.955140 11676 raft_consensus.cc:2368] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 19. Current term is 20.
I20260709 12:25:47.956777 11130 raft_consensus.cc:1275] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:25:47.959990 10980 raft_consensus.cc:1275] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 15. (term mismatch)
I20260709 12:25:47.960602 10980 pending_rounds.cc:85] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 14
I20260709 12:25:47.960897 10980 pending_rounds.cc:107] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 17.15
I20260709 12:25:47.961169 10980 raft_consensus.cc:2889] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:47.962993 10981 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 18.
I20260709 12:25:47.939425 11679 raft_consensus.cc:1275] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:25:47.969576 11130 raft_consensus.cc:1275] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 23 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:25:47.971547 16620 consensus_queue.cc:1048] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:25:47.973122 11023 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:47.975486 16791 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:47.986426 11134 raft_consensus.cc:1275] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:25:47.995430 16896 consensus_queue.cc:1048] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:47.996397 16834 raft_consensus.cc:2749] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:47.999079 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:47.995510 10979 raft_consensus.cc:1275] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:25:48.021883 10949 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:48.023566 16856 consensus_queue.cc:1048] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 12:25:48.038425 16862 raft_consensus.cc:2749] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:48.027592 16871 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:25:48.111639 10948 leader_election.cc:400] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 19 pre-election: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 19. Current term is 20.
I20260709 12:25:48.111984 10948 leader_election.cc:403] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:48.007066  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:48.142256 16841 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:48.148432 16532 consensus_queue.cc:1048] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 12:25:48.139428 16729 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Advancing to term 20
W20260709 12:25:48.170181 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 66545.4us
I20260709 12:25:48.176898 11052 raft_consensus.cc:1275] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:25:48.187405 16841 consensus_queue.cc:1048] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:25:48.199581 10977 raft_consensus.cc:1275] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 12:25:48.200052 10977 pending_rounds.cc:85] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb: Aborting all ops after (but not including) 9
I20260709 12:25:48.200311 10977 pending_rounds.cc:107] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 12:25:48.200557 10977 raft_consensus.cc:2889] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:48.223356 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:48.225167 16497 consensus_queue.cc:1048] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:25:48.282202 16859 consensus_queue.cc:1048] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:25:48.293332 16729 raft_consensus.cc:2749] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) with higher term. Message: Invalid argument: T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc01179655564f29b83babe396377cbb for earlier term 19. Current term is 20.
I20260709 12:25:48.298002 16896 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:25:48.298934 16896 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:48.282567 16914 log.cc:927] Time spent T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.287s	user 0.004s	sys 0.006s
I20260709 12:25:48.314612 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:48.315377 11059 raft_consensus.cc:3060] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:48.316360 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:48.325654 16896 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:48.375820 10984 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 20.
I20260709 12:25:48.379281 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:48.416045 11059 raft_consensus.cc:2468] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 20.
I20260709 12:25:48.423657 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:48.442238 11056 raft_consensus.cc:1275] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:25:48.457113 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 45358.3us
I20260709 12:25:48.491636 10879 catalog_manager.cc:5697] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
W20260709 12:25:48.510368 16931 log.cc:927] Time spent T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 12:25:48.511579 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 108047us
W20260709 12:25:48.539386 16927 log.cc:927] Time spent T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.065s	user 0.002s	sys 0.000s
I20260709 12:25:48.546384 11125 raft_consensus.cc:1275] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:25:48.550050 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 141347us
I20260709 12:25:48.549790 11644 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:25:48.576213 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 160939us
I20260709 12:25:48.563228 10879 catalog_manager.cc:5697] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:48.578989 16694 consensus_queue.cc:1048] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:25:48.594223 16724 consensus_queue.cc:1048] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:48.599200 10879 catalog_manager.cc:5697] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 6 to 14, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 14 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:48.624768 11023 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:25:48.613781 16933 raft_consensus.cc:2804] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:25:48.648654 16933 raft_consensus.cc:697] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:48.658630 16532 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:48.649770 16933 consensus_queue.cc:237] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:48.730048 10879 catalog_manager.cc:5697] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 4 to 10, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 10 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:48.732108 10879 catalog_manager.cc:5697] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 6 to 13, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 13 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:48.752494 10879 catalog_manager.cc:5697] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 11 to 12, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 12 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:48.783808 10879 catalog_manager.cc:5697] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:48.799779 10879 catalog_manager.cc:5697] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 9 to 11, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 11 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:48.834750 10882 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41106 (request call id 284) took 10007 ms. Trace:
I20260709 12:25:48.815162 10879 catalog_manager.cc:5697] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 9 to 12, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 12 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:48.885916 11676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e"
dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:45814
I20260709 12:25:48.886844 11676 raft_consensus.cc:606] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEADER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:48.904438 10879 catalog_manager.cc:5697] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:48.835224 10882 rpcz_store.cc:276] 0709 12:25:38.878266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:38.880548 (+  2282us) service_pool.cc:224] Handling call
0709 12:25:48.834507 (+9953959us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:46.436788 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:46.550401 (+113613us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:46.550438 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:25:46.550457 (+    19us) tablet.cc:662] Decoding operations
0709 12:25:46.559401 (+  8944us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:46.559465 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:46.559490 (+    25us) tablet.cc:685] Acquiring locks for 26 operations
0709 12:25:46.561574 (+  2084us) tablet.cc:701] Row locks acquired
0709 12:25:46.561594 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:25:46.561740 (+   146us) write_op.cc:270] Start()
0709 12:25:46.561865 (+   125us) write_op.cc:276] Timestamp: P: 1783599946561692 usec, L: 0
0709 12:25:46.561888 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:25:46.632148 (+ 70260us) log.cc:844] Serialized 10236 byte log entry
0709 12:25:47.037121 (+404973us) op_driver.cc:464] REPLICATION: finished
0709 12:25:47.198794 (+161673us) write_op.cc:301] APPLY: starting
0709 12:25:47.198886 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:47.407762 (+208876us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:47.407881 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:47.691820 (+283939us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:47.692297 (+   477us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=52,key_file_lookups=52,delta_file_lookups=0,mrs_lookups=0
0709 12:25:47.692348 (+    51us) write_op.cc:312] APPLY: finished
0709 12:25:47.692930 (+   582us) log.cc:844] Serialized 228 byte log entry
0709 12:25:47.693247 (+   317us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:47.706893 (+ 13646us) write_op.cc:454] Released schema lock
0709 12:25:47.715744 (+  8851us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:47.813502 (+ 97758us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:47.813555 (+    53us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":696078,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":161406,"apply.run_cpu_time_us":38683,"apply.run_wall_time_us":590849,"cfile_cache_hit":106,"cfile_cache_hit_bytes":112443,"num_ops":26,"prepare.queue_time_us":227828,"prepare.run_cpu_time_us":13171,"prepare.run_wall_time_us":256965,"raft.queue_time_us":166993,"raft.run_cpu_time_us":49241,"raft.run_wall_time_us":149193,"replication_time_us":474918,"spinlock_wait_cycles":1792,"thread_start_us":393554,"threads_started":4,"wal-append.queue_time_us":89627,"wal-append.run_cpu_time_us":29337,"wal-append.run_wall_time_us":1974936}]]}
I20260709 12:25:48.925804 11676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e"
dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:45814
I20260709 12:25:48.926491 11676 raft_consensus.cc:606] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:48.941972 11676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "820ab313402049dfa58d12167763953e"
dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:45814
I20260709 12:25:48.942624 11676 raft_consensus.cc:606] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:48.947763 11676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1"
dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:45814
I20260709 12:25:48.948397 11676 raft_consensus.cc:606] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEADER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:48.953634 11676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee"
dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:45814
I20260709 12:25:48.954306 11676 raft_consensus.cc:606] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
W20260709 12:25:48.956911 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 156482us
I20260709 12:25:48.958021 11056 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:48.958760 11056 raft_consensus.cc:606] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:48.959137 11056 raft_consensus.cc:614] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:25:48.961283 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 112320us
I20260709 12:25:48.972718  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:25:48.974684  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:48.975725  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:49.012995 16936 raft_consensus.cc:993] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95: : Instructing follower bc01179655564f29b83babe396377cbb to start an election
I20260709 12:25:49.013616 16936 raft_consensus.cc:1081] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Signalling peer bc01179655564f29b83babe396377cbb to start an election
I20260709 12:25:49.015620 10983 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e"
dest_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:60928
I20260709 12:25:49.016861 10983 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:49.017231 10983 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:49.023198 16840 raft_consensus.cc:993] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: : Instructing follower bc01179655564f29b83babe396377cbb to start an election
I20260709 12:25:49.023819 16840 raft_consensus.cc:1081] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Signalling peer bc01179655564f29b83babe396377cbb to start an election
I20260709 12:25:49.026060 10976 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee"
dest_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:60928
I20260709 12:25:49.030823 10976 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:49.031216 10976 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:49.029160 10983 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:49.041501 10976 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:49.046687 10976 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:49.047821 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:49.048475 11676 raft_consensus.cc:3055] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:49.048771 11676 raft_consensus.cc:740] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:49.049207 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:49.049011 10983 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:49.049820 11056 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:49.051120 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:49.051733 11059 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:49.049609 11676 consensus_queue.cc:260] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:49.059473 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:49.059729 11676 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:49.060146 11673 raft_consensus.cc:3055] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:49.060467 11673 raft_consensus.cc:740] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:49.061280 11673 consensus_queue.cc:260] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:49.063814 11673 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:49.067963 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:49.068751 11126 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:49.071897 11056 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 17.
I20260709 12:25:49.076097 10948 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:49.076992 16860 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:49.077488 11673 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 17.
I20260709 12:25:49.077533 16860 raft_consensus.cc:697] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 17 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:49.079737 16860 consensus_queue.cc:237] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:49.087045 11059 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 17.
I20260709 12:25:49.090464 10948 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:49.091341 16724 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:49.091876 16724 raft_consensus.cc:697] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 17 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:49.092622 11676 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 17.
I20260709 12:25:49.092823 16724 consensus_queue.cc:237] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:49.107755 11126 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 17.
I20260709 12:25:49.231603 10976 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 20 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:25:49.240945 16936 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:25:49.250440 11056 raft_consensus.cc:1275] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:25:49.257311 16936 consensus_queue.cc:1048] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:25:49.317232 16744 raft_consensus.cc:993] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95: : Instructing follower bc01179655564f29b83babe396377cbb to start an election
I20260709 12:25:49.333559 16840 raft_consensus.cc:1081] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Signalling peer bc01179655564f29b83babe396377cbb to start an election
I20260709 12:25:49.340118 10980 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "820ab313402049dfa58d12167763953e"
dest_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:60928
I20260709 12:25:49.340767 10980 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:49.341080 10980 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:49.347100 10879 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41098 (request call id 286) took 17061 ms (client timeout 15000 ms). Trace:
W20260709 12:25:49.349650 10879 rpcz_store.cc:269] 0709 12:25:32.337241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.357490 (+ 20249us) service_pool.cc:224] Handling call
0709 12:25:49.345348 (+16987858us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:49.012688 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:49.031276 (+ 18588us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:49.031327 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:25:49.031348 (+    21us) tablet.cc:662] Decoding operations
0709 12:25:49.032455 (+  1107us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:49.032568 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:49.032594 (+    26us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:25:49.033466 (+   872us) tablet.cc:701] Row locks acquired
0709 12:25:49.033511 (+    45us) write_op.cc:260] PREPARE: finished
0709 12:25:49.033698 (+   187us) write_op.cc:270] Start()
0709 12:25:49.033846 (+   148us) write_op.cc:276] Timestamp: P: 1783599949033632 usec, L: 0
0709 12:25:49.033864 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:25:49.034566 (+   702us) log.cc:844] Serialized 4130 byte log entry
0709 12:25:49.167191 (+132625us) op_driver.cc:464] REPLICATION: finished
0709 12:25:49.177987 (+ 10796us) write_op.cc:301] APPLY: starting
0709 12:25:49.178122 (+   135us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:49.192363 (+ 14241us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:49.192473 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:49.211730 (+ 19257us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:49.211978 (+   248us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=0,mrs_lookups=0
0709 12:25:49.212050 (+    72us) write_op.cc:312] APPLY: finished
0709 12:25:49.212345 (+   295us) log.cc:844] Serialized 97 byte log entry
0709 12:25:49.213225 (+   880us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:49.213372 (+   147us) write_op.cc:454] Released schema lock
0709 12:25:49.213428 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:49.304533 (+ 91105us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:49.305275 (+   742us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":820654,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":10545,"apply.run_cpu_time_us":13618,"apply.run_wall_time_us":95508,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45787,"num_ops":10,"prepare.queue_time_us":92588,"prepare.run_cpu_time_us":16591,"prepare.run_wall_time_us":104579,"raft.queue_time_us":42172,"raft.run_cpu_time_us":7446,"raft.run_wall_time_us":39958,"replication_time_us":133173,"thread_start_us":242404,"threads_started":4,"wal-append.queue_time_us":87713}]]}
I20260709 12:25:49.395968 10980 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:49.410393 16933 raft_consensus.cc:993] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95: : Instructing follower 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:25:49.410979 16933 raft_consensus.cc:1081] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEADER]: Signalling peer 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:25:49.416180 11126 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:58414
I20260709 12:25:49.416788 11126 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:49.417177 11126 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:49.420457 10875 catalog_manager.cc:5697] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 1 to 19, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 19 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:49.424335 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:49.425276 11057 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:49.424782 10875 catalog_manager.cc:5697] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 10 to 11, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 11 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:49.426726 10875 catalog_manager.cc:5697] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 11 to 13, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 13 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:49.428949 10875 catalog_manager.cc:5697] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:49.430992 10875 catalog_manager.cc:5697] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 9 to 16. New cstate: current_term: 16 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:49.432780 10875 catalog_manager.cc:5697] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:49.433465 10983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f"
dest_uuid: "bc01179655564f29b83babe396377cbb"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:58332
I20260709 12:25:49.434201 10983 raft_consensus.cc:606] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Received request to transfer leadership
I20260709 12:25:49.434562 10983 raft_consensus.cc:614] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:49.450191 11057 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 17.
I20260709 12:25:49.451869 10980 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:49.451835 10948 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:49.455718 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:49.456424 11676 raft_consensus.cc:3055] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:49.456717 11676 raft_consensus.cc:740] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:49.459038 16860 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:49.459013 11126 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:49.460343 16860 raft_consensus.cc:697] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 17 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:49.461283 16860 consensus_queue.cc:237] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:49.463135 10875 catalog_manager.cc:5697] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 10 to 16, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 16 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:49.464577 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:49.466365 11057 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:49.464818 10875 catalog_manager.cc:5697] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 10 to 11, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 11 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:49.467027 11676 consensus_queue.cc:260] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:49.472453 11676 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:49.473739 11126 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:49.475378 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:49.475997 11673 raft_consensus.cc:3055] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:49.476297 11673 raft_consensus.cc:740] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:49.479463 11673 consensus_queue.cc:260] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:49.481648 11673 raft_consensus.cc:3060] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:49.494124 16840 raft_consensus.cc:993] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: : Instructing follower 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:25:49.494681 16840 raft_consensus.cc:1081] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEADER]: Signalling peer 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:25:49.498615 11134 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:58414
I20260709 12:25:49.499210 11134 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:49.499583 11134 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:49.506485 11676 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 17.
I20260709 12:25:49.506867 10875 catalog_manager.cc:5697] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 12 to 14, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 14 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:49.509727 11134 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:49.508843 10875 catalog_manager.cc:5697] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 8 to 10, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 10 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:49.510952 11673 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 19.
I20260709 12:25:49.512382 11098 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:25:49.515564 11134 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:49.517607 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:49.517798 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:49.518407 11059 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:49.518476 11673 raft_consensus.cc:3055] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:49.519021 11673 raft_consensus.cc:740] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:49.519693 16950 raft_consensus.cc:2804] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:49.523257 16950 raft_consensus.cc:697] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 19 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:49.524276 16950 consensus_queue.cc:237] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:49.535447 11673 consensus_queue.cc:260] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:49.537649 11673 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:49.537074 10875 catalog_manager.cc:5697] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 12 to 14, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 14 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:49.539841 10875 catalog_manager.cc:5697] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 12 to 14, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 14 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:49.541966 11059 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 16.
I20260709 12:25:49.543550 11098 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:49.546217 11057 raft_consensus.cc:2468] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 19.
I20260709 12:25:49.547973 16835 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:49.548651 16835 raft_consensus.cc:697] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 16 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:49.549608 16835 consensus_queue.cc:237] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:49.572090 11059 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:25:49.575754 16724 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:49.582710 11676 raft_consensus.cc:1275] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:25:49.590997 11134 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:25:49.597694 16860 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:25:49.604207 11056 raft_consensus.cc:1275] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:25:49.604825 11673 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 16.
I20260709 12:25:49.605737 16860 consensus_queue.cc:1048] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:49.616410 16967 consensus_queue.cc:1048] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:25:49.619532 11673 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:25:49.626518 16967 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:25:49.630205 10930 auto_rebalancer.cc:893] Removing replace marker failed: Replica bc01179655564f29b83babe396377cbb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
W20260709 12:25:49.631146 10930 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:25:49.631548 10930 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:25:49.591626 10875 catalog_manager.cc:5697] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 17 to 18, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 18 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:49.653406 10875 catalog_manager.cc:5697] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 13 to 15, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 15 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:49.656103 10875 catalog_manager.cc:5697] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 13 to 14, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 14 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:49.658387 10875 catalog_manager.cc:5697] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 8 to 14, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 14 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:49.980705 11673 raft_consensus.cc:1275] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:25:49.983170 11057 raft_consensus.cc:1275] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:25:49.985177 16856 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:25:49.991536 16967 consensus_queue.cc:1048] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:25:50.037819 10874 catalog_manager.cc:5697] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 12 to 17, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 17 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:50.061990 11676 raft_consensus.cc:1275] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:25:50.059046 10874 catalog_manager.cc:5697] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 7 to 12, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 12 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:50.066649 11676 raft_consensus.cc:1275] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:25:50.068596 16791 consensus_queue.cc:1048] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:25:50.063410 11056 raft_consensus.cc:1275] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:25:50.071236 16950 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:50.078328 16950 consensus_queue.cc:1048] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:25:50.078856 11057 raft_consensus.cc:1275] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:25:50.083153 16950 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:25:50.105266 10874 catalog_manager.cc:5697] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 16 to 20, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 20 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:50.107352 10874 catalog_manager.cc:5697] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:50.109063 10874 catalog_manager.cc:5697] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 16 to 19, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 19 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:50.120260 10875 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41120 (request call id 268) took 7297 ms. Trace:
I20260709 12:25:50.121399 10874 catalog_manager.cc:5697] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 11 to 14, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 14 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:50.143250 10874 catalog_manager.cc:5697] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:50.149397 10874 catalog_manager.cc:5697] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:50.123576 10875 rpcz_store.cc:276] 0709 12:25:42.822654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:42.823010 (+   356us) service_pool.cc:224] Handling call
0709 12:25:44.178347 (+1355337us) spinlock_profiling.cc:243] Waited 4.54 ms on lock 0x7b54002e9854. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4e090 00007f8f8bdecf3a 00007f8f91ba2e9c 00007f8f91ca104e 00007f8f901622a4 00007f8f90162232 00007f8f90162161 00007f8f901620dc 00007f8f90161392 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:50.120143 (+5941796us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:49.781093 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:49.781626 (+   533us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:49.781671 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:25:49.781691 (+    20us) tablet.cc:662] Decoding operations
0709 12:25:49.783326 (+  1635us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:49.783390 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:49.783418 (+    28us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:25:49.784266 (+   848us) tablet.cc:701] Row locks acquired
0709 12:25:49.784279 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:25:49.784392 (+   113us) write_op.cc:270] Start()
0709 12:25:49.784479 (+    87us) write_op.cc:276] Timestamp: P: 1783599949784353 usec, L: 0
0709 12:25:49.784495 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:25:49.785077 (+   582us) log.cc:844] Serialized 6454 byte log entry
0709 12:25:49.832858 (+ 47781us) op_driver.cc:464] REPLICATION: finished
0709 12:25:49.859422 (+ 26564us) write_op.cc:301] APPLY: starting
0709 12:25:49.859513 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:49.920620 (+ 61107us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:49.920716 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:49.940698 (+ 19982us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:49.941001 (+   303us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=0,mrs_lookups=0
0709 12:25:49.941050 (+    49us) write_op.cc:312] APPLY: finished
0709 12:25:49.941407 (+   357us) log.cc:844] Serialized 148 byte log entry
0709 12:25:49.941615 (+   208us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:49.941792 (+   177us) write_op.cc:454] Released schema lock
0709 12:25:49.959820 (+ 18028us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:49.960234 (+   414us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:49.960269 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":213935,"reported_tablets":50,"spinlock_wait_cycles":10440576,"child_traces":[["op",{"apply.queue_time_us":22671,"apply.run_cpu_time_us":19944,"apply.run_wall_time_us":100803,"cfile_cache_hit":66,"cfile_cache_hit_bytes":70783,"num_ops":16,"prepare.queue_time_us":46978,"prepare.run_cpu_time_us":4070,"prepare.run_wall_time_us":4310,"replication_time_us":48202,"thread_start_us":62948,"threads_started":2}]]}
I20260709 12:25:50.158329 10874 catalog_manager.cc:5697] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:50.216615 10874 catalog_manager.cc:5697] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 16 to 20, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 20 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:50.218442 10874 catalog_manager.cc:5697] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:50.220803 10874 catalog_manager.cc:5697] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:50.258740 10874 catalog_manager.cc:5697] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 12 to 16, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 16 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:50.263731 10874 catalog_manager.cc:5697] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 12 to 23. New cstate: current_term: 23 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:50.297297 10874 catalog_manager.cc:5697] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 15 to 18, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 18 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:50.300797 10874 catalog_manager.cc:5697] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:50.329087  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:50.478327 11056 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:50.479142 11056 raft_consensus.cc:606] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:50.490773 11673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2cdd07e6995141b68c257e6c93f15f2e"
dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:45814
I20260709 12:25:50.491405 11673 raft_consensus.cc:606] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:50.491828 11673 raft_consensus.cc:614] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:50.503214 11673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59"
dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:45814
I20260709 12:25:50.503865 11673 raft_consensus.cc:606] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:50.508620 11673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0"
dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:45814
I20260709 12:25:50.509276 11673 raft_consensus.cc:606] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:50.518643 11673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e"
dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:45814
I20260709 12:25:50.533214 11673 raft_consensus.cc:606] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:50.533663 11673 raft_consensus.cc:614] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:50.543922 11673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2"
dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:45814
I20260709 12:25:50.544690 11673 raft_consensus.cc:606] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:50.545157 11673 raft_consensus.cc:614] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:50.546433  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:25:50.548362  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:50.549189  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:50.667973 16828 raft_consensus.cc:993] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7: : Instructing follower bc01179655564f29b83babe396377cbb to start an election
I20260709 12:25:50.668562 16828 raft_consensus.cc:1081] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Signalling peer bc01179655564f29b83babe396377cbb to start an election
I20260709 12:25:50.675886 10983 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e"
dest_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:52828
I20260709 12:25:50.676517 10983 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:50.676874 10983 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:50.751247 10983 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:50.761270 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:50.761884 11059 raft_consensus.cc:3055] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:50.762233 11059 raft_consensus.cc:740] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:50.762933 11059 consensus_queue.cc:260] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:50.764007 11059 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:50.780367 11059 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 14.
I20260709 12:25:50.783849 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: true dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:50.784482 11126 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:50.797610 11126 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 14.
I20260709 12:25:50.798935 10949 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:50.799909 16791 raft_consensus.cc:2804] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:50.800503 16791 raft_consensus.cc:697] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 14 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:50.801782 16791 consensus_queue.cc:237] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:50.838304 10983 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:50.878573 10882 catalog_manager.cc:5697] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:50.880080 10882 catalog_manager.cc:5697] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:50.881397 10882 catalog_manager.cc:5697] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:50.919409 10882 catalog_manager.cc:5697] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 14 to 15, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 15 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:50.921710 10882 catalog_manager.cc:5697] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 14 to 15, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 15 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:50.923504 10882 catalog_manager.cc:5697] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 15 to 17, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 17 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:50.925171 10882 catalog_manager.cc:5697] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:50.888131 10874 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39956 (request call id 182) took 1786 ms. Trace:
I20260709 12:25:50.930605 10874 rpcz_store.cc:276] 0709 12:25:49.101761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:49.102016 (+   255us) service_pool.cc:224] Handling call
0709 12:25:49.126788 (+ 24772us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b54002e9854. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f8bd4e090 00007f8f8bdecf3a 00007f8f91ba2e9c 00007f8f91ca104e 00007f8f901622a4 00007f8f90162232 00007f8f90162161 00007f8f901620dc 00007f8f90161392 00007f8f8a11f48c 00007f8f8a11e8c6
0709 12:25:50.888018 (+1761230us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:50.410907 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:50.411469 (+   562us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:50.411504 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:25:50.411522 (+    18us) tablet.cc:662] Decoding operations
0709 12:25:50.412825 (+  1303us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:50.412909 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:50.412935 (+    26us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:25:50.414060 (+  1125us) tablet.cc:701] Row locks acquired
0709 12:25:50.414091 (+    31us) write_op.cc:260] PREPARE: finished
0709 12:25:50.426290 (+ 12199us) write_op.cc:270] Start()
0709 12:25:50.426416 (+   126us) write_op.cc:276] Timestamp: P: 1783599950426233 usec, L: 0
0709 12:25:50.426440 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:25:50.431618 (+  5178us) log.cc:844] Serialized 6404 byte log entry
0709 12:25:50.470996 (+ 39378us) op_driver.cc:464] REPLICATION: finished
0709 12:25:50.543125 (+ 72129us) write_op.cc:301] APPLY: starting
0709 12:25:50.543233 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:50.607683 (+ 64450us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:50.607806 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:50.651418 (+ 43612us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:50.651722 (+   304us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=0,mrs_lookups=0
0709 12:25:50.651772 (+    50us) write_op.cc:312] APPLY: finished
0709 12:25:50.652115 (+   343us) log.cc:844] Serialized 148 byte log entry
0709 12:25:50.679027 (+ 26912us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:50.679217 (+   190us) write_op.cc:454] Released schema lock
0709 12:25:50.679277 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:50.679770 (+   493us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:50.679803 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":313,"mutex_wait_us":46528,"reported_tablets":31,"spinlock_wait_cycles":5962112,"child_traces":[["op",{"apply.queue_time_us":66599,"apply.run_cpu_time_us":21629,"apply.run_wall_time_us":136548,"cfile_cache_hit":66,"cfile_cache_hit_bytes":70783,"num_ops":16,"prepare.queue_time_us":27560,"prepare.run_cpu_time_us":4841,"prepare.run_wall_time_us":23831,"replication_time_us":44399,"thread_start_us":34942,"threads_started":2}]]}
I20260709 12:25:50.938634 16985 raft_consensus.cc:993] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95: : Instructing follower bc01179655564f29b83babe396377cbb to start an election
I20260709 12:25:50.939210 16985 raft_consensus.cc:1081] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 LEADER]: Signalling peer bc01179655564f29b83babe396377cbb to start an election
I20260709 12:25:50.943186 10983 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59"
dest_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:60928
I20260709 12:25:50.943862 10983 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:50.944231 10983 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:50.944746 10882 catalog_manager.cc:5697] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:50.946130 10882 catalog_manager.cc:5697] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 7 to 17. New cstate: current_term: 17 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:50.947345 10882 catalog_manager.cc:5697] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:50.948537 10882 catalog_manager.cc:5697] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:50.956023 10882 catalog_manager.cc:5697] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 11 to 13, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 13 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:50.966320 10983 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:50.971704 10882 catalog_manager.cc:5697] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 14 to 16, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 16 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:50.983349 10983 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:50.984603 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:50.985270 11673 raft_consensus.cc:3055] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:50.985615 11673 raft_consensus.cc:740] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:50.985394 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:50.986719 11673 consensus_queue.cc:260] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:50.987478 11134 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:50.988160 11673 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:50.999125 11676 consensus_queue.cc:237] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:51.002836 11134 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
I20260709 12:25:51.013078 10949 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:51.013863 16724 raft_consensus.cc:2804] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:51.014424 16724 raft_consensus.cc:697] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:51.015334 16724 consensus_queue.cc:237] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:51.026777 11134 raft_consensus.cc:1275] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:51.031356 16920 consensus_queue.cc:1048] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:51.004377 10882 catalog_manager.cc:5697] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 15 to 16, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 16 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
W20260709 12:25:51.006229 10867 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 46989f4f6130442698a2028fb5bcbf0e with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0f3b1ccd8aa5412393aa7eb90f2bef95 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:51.007298 11679 consensus_queue.cc:237] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:51.029488 11059 raft_consensus.cc:1275] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:51.047717 10882 catalog_manager.cc:5697] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:51.004755 11673 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
I20260709 12:25:51.053092 10882 catalog_manager.cc:5697] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 9 to 12, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 12 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
I20260709 12:25:51.112994 10882 catalog_manager.cc:5697] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 13 to 19, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 19 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } }
W20260709 12:25:51.051496 10867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 45520.6us
I20260709 12:25:51.114403 16920 consensus_queue.cc:1048] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
W20260709 12:25:51.301302 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 130131us
I20260709 12:25:51.337172 11052 raft_consensus.cc:1275] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:51.382627 16999 raft_consensus.cc:2955] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 6 to 11, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
W20260709 12:25:51.386556 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 47559.2us
I20260709 12:25:51.388116 16997 consensus_queue.cc:1048] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:25:51.402992 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 86132.1us
I20260709 12:25:51.406210 11134 raft_consensus.cc:2955] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 6 to 11, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:51.415799 11128 raft_consensus.cc:1275] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:25:51.431910 17002 consensus_queue.cc:1048] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:51.437119 11128 raft_consensus.cc:1275] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:51.426676 10980 raft_consensus.cc:1275] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:51.443435 16996 consensus_queue.cc:1048] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:25:51.487084 10867 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 03bda770d3504576acc9bfb2923fb9ff with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:51.543241 11059 raft_consensus.cc:1275] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:25:51.550750 17002 consensus_queue.cc:1048] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:51.551939 16986 raft_consensus.cc:993] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95: : Instructing follower bc01179655564f29b83babe396377cbb to start an election
I20260709 12:25:51.552520 16986 raft_consensus.cc:1081] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEADER]: Signalling peer bc01179655564f29b83babe396377cbb to start an election
I20260709 12:25:51.551517 16998 raft_consensus.cc:2955] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 3 to 10, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:51.557809 11059 raft_consensus.cc:2955] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 6 to 11, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
W20260709 12:25:51.574738 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 92039us
I20260709 12:25:51.581091 11056 raft_consensus.cc:2955] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 3 to 10, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:51.603513 11679 raft_consensus.cc:1275] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:51.634733 16985 consensus_queue.cc:1048] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:51.645490 10980 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0"
dest_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:60928
I20260709 12:25:51.646131 10980 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:51.646494 10980 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:51.657758 10867 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d3ee878370114c8d8434e02b9c0aa6be with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:51.618755 16996 consensus_queue.cc:1048] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
W20260709 12:25:51.673839 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 202045us
I20260709 12:25:51.675493  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:51.740759 10980 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:51.758937 10980 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:51.760015 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:51.760711 11130 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:51.769749 11673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7"
dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:45814
I20260709 12:25:51.770538 11673 raft_consensus.cc:606] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:51.797750 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:51.798498 11673 raft_consensus.cc:3055] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:51.798844 11673 raft_consensus.cc:740] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:51.799662 11673 consensus_queue.cc:260] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:51.812366 11673 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:51.836340 11676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134"
dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:45814
I20260709 12:25:51.837049 11676 raft_consensus.cc:606] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEADER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:51.843748 11130 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 16.
I20260709 12:25:51.856709 10949 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:51.876235 11673 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 16.
I20260709 12:25:51.878610 10983 raft_consensus.cc:2955] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 3 to 10, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:51.883574 11673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59"
dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:45814
I20260709 12:25:51.884184 11673 raft_consensus.cc:606] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:51.884560 11673 raft_consensus.cc:614] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:25:51.892215 17029 log.cc:927] Time spent T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:25:51.897277 16999 raft_consensus.cc:993] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95: : Instructing follower 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:25:51.897845 16999 raft_consensus.cc:1081] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEADER]: Signalling peer 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:25:51.900588 11676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd"
dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:45814
I20260709 12:25:51.901197 11676 raft_consensus.cc:606] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:51.905853 11673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c"
dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:45814
I20260709 12:25:51.906507 11673 raft_consensus.cc:606] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEADER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:51.906903 11127 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:58414
I20260709 12:25:51.907495 11127 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:51.907845 11127 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:51.876125 16791 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:51.918416 16791 raft_consensus.cc:697] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 16 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:51.933333 11057 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:51.934002 11057 raft_consensus.cc:606] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
W20260709 12:25:51.935534 17031 log.cc:927] Time spent T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:25:51.938999 16791 consensus_queue.cc:237] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:51.939886  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:25:51.992038 11127 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:52.016996 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 45094.3us
I20260709 12:25:52.058082 11127 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:52.060899 16999 raft_consensus.cc:993] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95: : Instructing follower 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:25:52.061390 16999 raft_consensus.cc:1081] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEADER]: Signalling peer 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:25:52.064417  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:52.064985 16998 raft_consensus.cc:993] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95: : Instructing follower bc01179655564f29b83babe396377cbb to start an election
I20260709 12:25:52.065449 16998 raft_consensus.cc:1081] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEADER]: Signalling peer bc01179655564f29b83babe396377cbb to start an election
I20260709 12:25:52.070458 17007 raft_consensus.cc:993] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95: : Instructing follower 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:25:52.071061 17007 raft_consensus.cc:1081] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Signalling peer 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:25:52.075502 10980 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd"
dest_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:60928
I20260709 12:25:52.076167 10980 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:52.076545 10980 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:52.080571 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:52.080977 11126 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:58414
I20260709 12:25:52.081458 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:52.081606 11126 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:52.082065 11056 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:52.082145 11126 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:52.065364 11127 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:58414
I20260709 12:25:52.086671 11127 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:52.087054 11127 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:52.099695 11676 raft_consensus.cc:3055] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:52.100095 11676 raft_consensus.cc:740] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:52.100839 11676 consensus_queue.cc:260] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:52.101563 11056 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 19.
I20260709 12:25:52.065495  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:52.113054 11098 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:52.116885 16989 raft_consensus.cc:2804] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:52.117450 16989 raft_consensus.cc:697] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 19 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:52.118362 16989 consensus_queue.cc:237] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:52.123041 10980 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:52.122820 10874 catalog_manager.cc:5697] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 16 to 17, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 17 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:52.127508 10980 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:52.132145 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:52.132819 11056 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:52.140233 11056 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 16.
I20260709 12:25:52.141295 11057 raft_consensus.cc:1240] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:52.145223 10948 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:52.150991 11676 raft_consensus.cc:3060] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:52.146158 17020 raft_consensus.cc:2804] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:52.154969 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:52.158881 11679 raft_consensus.cc:3055] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:52.159283 11679 raft_consensus.cc:740] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:52.159381 11126 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:52.165583 11679 consensus_queue.cc:260] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:52.167946 11127 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:52.170333 11679 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:52.171564 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:52.172202 11056 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:52.176244 11676 raft_consensus.cc:2468] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 19.
I20260709 12:25:52.168357 17020 raft_consensus.cc:697] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 16 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:52.215010 17020 consensus_queue.cc:237] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:52.219081 11127 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:52.212934 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 60183.8us
I20260709 12:25:52.222676 11679 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 16.
I20260709 12:25:52.225152 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:52.225776 11052 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:52.227011 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:52.227986 11679 raft_consensus.cc:3055] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:52.228318 11679 raft_consensus.cc:740] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:52.227068 11126 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:52.235713 11128 raft_consensus.cc:1240] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Rejecting Update request from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:52.238466 10874 catalog_manager.cc:5697] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 16 to 17, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 17 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:52.240433 10874 catalog_manager.cc:5697] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 16 to 17, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 17 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:52.242437 10874 catalog_manager.cc:5697] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 15 to 16, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 16 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:52.244232 16998 consensus_queue.cc:1059] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:25:52.246598 16998 raft_consensus.cc:3055] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:52.247001 16998 raft_consensus.cc:740] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:25:52.247838 16998 consensus_queue.cc:260] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:52.249146 16998 raft_consensus.cc:3060] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:52.251471 16469 raft_consensus.cc:993] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7: : Instructing follower bc01179655564f29b83babe396377cbb to start an election
I20260709 12:25:52.251995 16469 raft_consensus.cc:1081] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 LEADER]: Signalling peer bc01179655564f29b83babe396377cbb to start an election
I20260709 12:25:52.243147 11679 consensus_queue.cc:260] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:52.244246 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:52.256095 11056 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:52.262933 11098 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:52.267663 10980 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9"
dest_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:52828
I20260709 12:25:52.268430 10980 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:52.268893 10980 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:52.270560 16989 raft_consensus.cc:2804] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:52.254712 11679 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:52.250543 10874 catalog_manager.cc:5697] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 18 to 19, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 19 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:52.274386 11052 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 15.
I20260709 12:25:52.276561 11098 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:52.278180 16989 raft_consensus.cc:697] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:52.290058 16989 consensus_queue.cc:237] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:52.304375 17010 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:52.305003 17010 raft_consensus.cc:697] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 15 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:52.305940 17010 consensus_queue.cc:237] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:52.313421 11673 raft_consensus.cc:2468] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:52.315429 11679 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 15.
I20260709 12:25:52.323608 10980 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:52.327621 10882 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41098 (request call id 287) took 3363 ms. Trace:
I20260709 12:25:52.329072 10882 rpcz_store.cc:276] 0709 12:25:48.963859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:48.964119 (+   260us) service_pool.cc:224] Handling call
0709 12:25:52.327518 (+3363399us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:51.331385 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:51.332031 (+   646us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:51.332062 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:25:51.332079 (+    17us) tablet.cc:662] Decoding operations
0709 12:25:51.342689 (+ 10610us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:51.342762 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:51.342791 (+    29us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:25:51.344037 (+  1246us) tablet.cc:701] Row locks acquired
0709 12:25:51.344054 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:25:51.344208 (+   154us) write_op.cc:270] Start()
0709 12:25:51.344360 (+   152us) write_op.cc:276] Timestamp: P: 1783599951344157 usec, L: 0
0709 12:25:51.344386 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:25:51.345281 (+   895us) log.cc:844] Serialized 6750 byte log entry
0709 12:25:51.409375 (+ 64094us) op_driver.cc:464] REPLICATION: finished
0709 12:25:51.474192 (+ 64817us) write_op.cc:301] APPLY: starting
0709 12:25:51.480880 (+  6688us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:51.559666 (+ 78786us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:51.559756 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:51.748349 (+188593us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:51.748648 (+   299us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=0,mrs_lookups=0
0709 12:25:51.748692 (+    44us) write_op.cc:312] APPLY: finished
0709 12:25:51.749507 (+   815us) log.cc:844] Serialized 156 byte log entry
0709 12:25:51.749709 (+   202us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:51.749881 (+   172us) write_op.cc:454] Released schema lock
0709 12:25:51.749941 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:51.764404 (+ 14463us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:51.764442 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":115180,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":41078,"apply.run_cpu_time_us":27598,"apply.run_wall_time_us":302740,"cfile_cache_hit":70,"cfile_cache_hit_bytes":74949,"num_ops":17,"prepare.queue_time_us":154199,"prepare.run_cpu_time_us":5184,"prepare.run_wall_time_us":14233,"replication_time_us":64870,"thread_start_us":172862,"threads_started":2}]]}
I20260709 12:25:52.340317 10980 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 18 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:52.353219 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:52.353955 11052 raft_consensus.cc:3055] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:52.354360 11052 raft_consensus.cc:740] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:52.355449 11052 consensus_queue.cc:260] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:52.356659 11052 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:52.361861 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:52.362576 11127 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:52.375913 11127 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 18.
W20260709 12:25:52.395260 17042 log.cc:927] Time spent T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.071s	user 0.003s	sys 0.020s
W20260709 12:25:52.395682 16953 log.cc:927] Time spent T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7: Append to log took a long time: real 0.061s	user 0.017s	sys 0.007s
W20260709 12:25:52.395223 17041 log.cc:927] Time spent T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.064s	user 0.000s	sys 0.008s
I20260709 12:25:52.402904 17020 raft_consensus.cc:493] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:52.403082 10949 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:52.403594 17020 raft_consensus.cc:515] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:52.404305 17026 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:52.404874 17026 raft_consensus.cc:697] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 18 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:52.406188 17026 consensus_queue.cc:237] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:52.413014 17020 leader_election.cc:290] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:52.415405 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:25:52.415678 10867 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 46989f4f6130442698a2028fb5bcbf0e with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0f3b1ccd8aa5412393aa7eb90f2bef95 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:52.430593 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:25:52.436703 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bda770d3504576acc9bfb2923fb9ff" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:52.454159 10949 leader_election.cc:304] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:52.455230 17026 raft_consensus.cc:2749] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:52.457412 17001 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:25:52.458069 17001 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:52.460798 11052 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 18.
I20260709 12:25:52.466696 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc01179655564f29b83babe396377cbb" is_pre_election: true
I20260709 12:25:52.473445 11679 raft_consensus.cc:1275] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:25:52.475651 17020 consensus_queue.cc:1048] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:25:52.461002 17001 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:52.498572 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:25:52.500279 11098 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:52.501360 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:25:52.507251 17001 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:52.514966 11679 raft_consensus.cc:1275] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:25:52.525961 17001 consensus_queue.cc:1048] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:52.532891 10874 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39956 (request call id 183) took 1564 ms. Trace:
I20260709 12:25:52.533455 10874 rpcz_store.cc:276] 0709 12:25:50.968585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.968774 (+   189us) service_pool.cc:224] Handling call
0709 12:25:52.532801 (+1564027us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:52.322978 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:52.331913 (+  8935us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:52.331953 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:25:52.331971 (+    18us) tablet.cc:662] Decoding operations
0709 12:25:52.332751 (+   780us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:52.332831 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:52.332857 (+    26us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:25:52.333356 (+   499us) tablet.cc:701] Row locks acquired
0709 12:25:52.333370 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:25:52.333547 (+   177us) write_op.cc:270] Start()
0709 12:25:52.333669 (+   122us) write_op.cc:276] Timestamp: P: 1783599952333479 usec, L: 0
0709 12:25:52.333686 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:25:52.334380 (+   694us) log.cc:844] Serialized 2132 byte log entry
0709 12:25:52.454372 (+119992us) op_driver.cc:464] REPLICATION: finished
0709 12:25:52.492470 (+ 38098us) write_op.cc:301] APPLY: starting
0709 12:25:52.492561 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:52.510481 (+ 17920us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:52.510594 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:52.523985 (+ 13391us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:52.524205 (+   220us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 12:25:52.524250 (+    45us) write_op.cc:312] APPLY: finished
0709 12:25:52.524484 (+   234us) log.cc:844] Serialized 57 byte log entry
0709 12:25:52.524658 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:52.524770 (+   112us) write_op.cc:454] Released schema lock
0709 12:25:52.524813 (+    43us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":119015,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":37839,"cfile_cache_hit":22,"cfile_cache_hit_bytes":24957,"num_ops":5,"prepare.queue_time_us":5244,"prepare.run_cpu_time_us":3542,"prepare.run_wall_time_us":15539,"replication_time_us":120517,"thread_start_us":93692,"threads_started":2}]]}
I20260709 12:25:52.545537 11126 raft_consensus.cc:1275] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:25:52.548758 17003 consensus_queue.cc:1048] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 12:25:52.585716 11056 raft_consensus.cc:1275] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:25:52.595543 17001 consensus_queue.cc:1048] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 12:25:52.622797 10882 catalog_manager.cc:5697] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 15 to 16, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 16 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:52.625263 10882 catalog_manager.cc:5697] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb reported cstate change: config changed from index 3 to 10, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New cstate: current_term: 12 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:52.640487 10882 catalog_manager.cc:5697] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 11 to 12, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 12 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:52.643028 10882 catalog_manager.cc:5697] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 15 to 16, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 16 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:52.645310 10882 catalog_manager.cc:5697] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 13 to 14, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 14 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:52.707427 10877 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41106 (request call id 285) took 3696 ms. Trace:
I20260709 12:25:52.714264 10877 rpcz_store.cc:276] 0709 12:25:49.010535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:49.011281 (+   746us) service_pool.cc:224] Handling call
0709 12:25:52.707254 (+3695973us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":157044,"reported_tablets":40}
I20260709 12:25:52.739130 11056 raft_consensus.cc:1275] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:25:52.741853 17021 consensus_queue.cc:1048] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:25:52.743942 11679 raft_consensus.cc:1275] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:25:52.745851 11052 raft_consensus.cc:1275] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:25:52.776479 16989 consensus_queue.cc:1048] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:25:52.793529 17010 consensus_queue.cc:1048] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:25:52.826073 11679 raft_consensus.cc:1275] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:25:52.844619 17003 consensus_queue.cc:1048] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:25:52.940963 11052 raft_consensus.cc:1275] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:25:52.950309 17026 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:52.989024 11128 raft_consensus.cc:1275] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:25:52.994374 11056 raft_consensus.cc:1275] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:53.012111 17003 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:53.027832 11676 raft_consensus.cc:1275] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:53.033174 10882 catalog_manager.cc:5697] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 17 to 18, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 18 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:53.040906 16856 consensus_queue.cc:1048] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:53.046851 16856 consensus_queue.cc:1048] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:53.138180 11121 tablet_service.cc:1558] Processing DeleteTablet for tablet d3ee878370114c8d8434e02b9c0aa6be with delete_type TABLET_DATA_TOMBSTONED (TS 7518bdeb78f24e67a530754ae48547eb not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:48956
W20260709 12:25:53.211992 10880 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41106 (request call id 283) took 35135 ms (client timeout 15000 ms). Trace:
W20260709 12:25:53.212462 10880 rpcz_store.cc:269] 0709 12:25:18.189642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.191634 (+  1992us) service_pool.cc:224] Handling call
0709 12:25:53.211767 (+35020133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":437,"reported_tablets":49}
I20260709 12:25:53.214550 17065 tablet_replica.cc:333] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:25:53.249140 17065 raft_consensus.cc:2243] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:53.250173 17065 raft_consensus.cc:2272] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:53.253093 17065 ts_tablet_manager.cc:1916] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:25:53.302997 10881 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39956 (request call id 180) took 39245 ms (client timeout 15000 ms). Trace:
W20260709 12:25:53.310302 10881 rpcz_store.cc:269] 0709 12:25:14.057510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.063901 (+  6391us) service_pool.cc:224] Handling call
0709 12:25:53.302810 (+39238909us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1934281,"reported_tablets":31}
I20260709 12:25:53.303201  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:53.313279 11128 consensus_queue.cc:237] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:53.340433 10876 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39956 (request call id 181) took 19385 ms (client timeout 15000 ms). Trace:
I20260709 12:25:53.368177 17065 ts_tablet_manager.cc:1929] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.9
W20260709 12:25:53.373457 10876 rpcz_store.cc:269] 0709 12:25:33.955231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.957350 (+  2119us) service_pool.cc:224] Handling call
0709 12:25:34.392972 (+435622us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b5400002490. stack: 00007f8f88cc5343 00007f8f88cc5240 00007f8f886541d4 00007f8f92392304 00007f8f92392299 00007f8f88b7fdb1 00007f8f88cbfe9c 00007f8f88cc00f6 00007f8f91c39759 00007f8f91bd1a76 00007f8f91ba2d58 00007f8f91ca104e 00007f8f901622a4 00007f8f90162232 00007f8f90162161 00007f8f901620dc
0709 12:25:53.340322 (+18947350us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2513931,"reported_tablets":31,"spinlock_wait_cycles":3440512}
I20260709 12:25:53.380431 11676 raft_consensus.cc:1275] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:25:53.382802 17001 consensus_queue.cc:1048] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:53.395593 17065 log.cc:1199] T d3ee878370114c8d8434e02b9c0aa6be P 7518bdeb78f24e67a530754ae48547eb: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-2-root/wals/d3ee878370114c8d8434e02b9c0aa6be
I20260709 12:25:53.396049 11052 raft_consensus.cc:1275] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:25:53.398247 17061 consensus_queue.cc:1048] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:53.429913 16856 raft_consensus.cc:2955] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 3 to 12, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:53.400615 10868 catalog_manager.cc:5028] TS 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): tablet d3ee878370114c8d8434e02b9c0aa6be (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:25:53.442865 11676 raft_consensus.cc:2955] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 3 to 12, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
W20260709 12:25:53.448057 10866 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 46989f4f6130442698a2028fb5bcbf0e with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader bc01179655564f29b83babe396377cbb (127.9.145.193:46777) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer bc01179655564f29b83babe396377cbb from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 17 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:53.458228 10878 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet d3ee878370114c8d8434e02b9c0aa6be with cas_config_opid_index 3: aborting the task: latest config opid_index 10; task opid_index 3
W20260709 12:25:53.466302 10878 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41106 (request call id 282) took 57169 ms (client timeout 15000 ms). Trace:
W20260709 12:25:53.466863 10867 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 03bda770d3504576acc9bfb2923fb9ff with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 6 but the committed config has opid_index of 11
I20260709 12:25:53.467604 10874 catalog_manager.cc:5697] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 6 to 11, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New cstate: current_term: 13 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:53.489377 10878 rpcz_store.cc:269] 0709 12:24:56.296690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.296935 (+   245us) service_pool.cc:224] Handling call
0709 12:25:53.466209 (+57169274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":477382,"reported_tablets":49}
I20260709 12:25:53.473223 11056 raft_consensus.cc:2955] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 3 to 12, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:53.499818 10874 catalog_manager.cc:5697] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 18 to 19, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 19 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:53.511372 10868 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2d9fad3893d845fa9208a48c76eb609f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:53.521170 10969 tablet_service.cc:1558] Processing DeleteTablet for tablet 03bda770d3504576acc9bfb2923fb9ff with delete_type TABLET_DATA_TOMBSTONED (TS bc01179655564f29b83babe396377cbb not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:58332
I20260709 12:25:53.547688 17069 tablet_replica.cc:333] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:25:53.550243 17069 raft_consensus.cc:2243] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:53.551638 17069 raft_consensus.cc:2272] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:53.555855 17069 ts_tablet_manager.cc:1916] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:53.583812 11121 tablet_service.cc:1558] Processing DeleteTablet for tablet d3ee878370114c8d8434e02b9c0aa6be with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 10)) from {username='slave'} at 127.0.0.1:48956
I20260709 12:25:53.567763 10874 catalog_manager.cc:5697] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 14 to 15, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 15 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:53.586568 10868 catalog_manager.cc:5028] TS 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): tablet d3ee878370114c8d8434e02b9c0aa6be (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:25:53.580955 17069 ts_tablet_manager.cc:1929] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.10
I20260709 12:25:53.585659 10874 catalog_manager.cc:5697] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 3 to 12, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New cstate: current_term: 16 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:53.588598 17069 log.cc:1199] T 03bda770d3504576acc9bfb2923fb9ff P bc01179655564f29b83babe396377cbb: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-0-root/wals/03bda770d3504576acc9bfb2923fb9ff
W20260709 12:25:53.589057 10868 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 2d9fad3893d845fa9208a48c76eb609f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 12
I20260709 12:25:53.591639 10866 catalog_manager.cc:5028] TS bc01179655564f29b83babe396377cbb (127.9.145.193:46777): tablet 03bda770d3504576acc9bfb2923fb9ff (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:25:53.597958 11052 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:53.598085 10875 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41120 (request call id 269) took 3319 ms. Trace:
I20260709 12:25:53.598637 11052 raft_consensus.cc:606] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 LEADER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:53.598630 10875 rpcz_store.cc:276] 0709 12:25:50.278548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.280170 (+  1622us) service_pool.cc:224] Handling call
0709 12:25:53.598016 (+3317846us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61051,"reported_tablets":42,"spinlock_wait_cycles":21376}
I20260709 12:25:53.590184 10874 catalog_manager.cc:5697] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 12 to 13, leader changed from 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 13 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:53.602941 10983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e"
dest_uuid: "bc01179655564f29b83babe396377cbb"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:41958
I20260709 12:25:53.603628 10983 raft_consensus.cc:606] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 17 LEADER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:53.630928 10969 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d9fad3893d845fa9208a48c76eb609f with delete_type TABLET_DATA_TOMBSTONED (TS bc01179655564f29b83babe396377cbb not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:58332
I20260709 12:25:53.631979 17069 tablet_replica.cc:333] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:25:53.632974 17069 raft_consensus.cc:2243] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:53.633649 17069 raft_consensus.cc:2272] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:53.637054 17069 ts_tablet_manager.cc:1916] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:53.640887 10983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59"
dest_uuid: "bc01179655564f29b83babe396377cbb"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:41958
I20260709 12:25:53.641664 10983 raft_consensus.cc:606] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:53.649887 11052 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:53.650677 11052 raft_consensus.cc:606] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:53.652100  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:25:53.653967  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:53.657493  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:53.676620 17003 raft_consensus.cc:993] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb: : Instructing follower 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:25:53.677229 17003 raft_consensus.cc:1081] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Signalling peer 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:25:53.679095 11127 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:36576
I20260709 12:25:53.679692 11127 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:53.680044 11127 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:53.697877 11127 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:53.709619 11127 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:53.709754 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:53.710379 10983 raft_consensus.cc:3055] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:53.710752 10983 raft_consensus.cc:740] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:53.711462 10983 consensus_queue.cc:260] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:53.712514 10983 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:53.730248 17026 raft_consensus.cc:993] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb: : Instructing follower 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:25:53.730248 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:53.734380 11673 raft_consensus.cc:3060] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:53.734875 17026 raft_consensus.cc:1081] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 17 LEADER]: Signalling peer 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:25:53.742188 11126 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:36576
I20260709 12:25:53.744971 11126 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:53.745502 11126 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:53.757628 17069 ts_tablet_manager.cc:1929] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.11
I20260709 12:25:53.758177 17069 log.cc:1199] T 2d9fad3893d845fa9208a48c76eb609f P bc01179655564f29b83babe396377cbb: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-0-root/wals/2d9fad3893d845fa9208a48c76eb609f
I20260709 12:25:53.769238 10866 catalog_manager.cc:5028] TS bc01179655564f29b83babe396377cbb (127.9.145.193:46777): tablet 2d9fad3893d845fa9208a48c76eb609f (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:25:53.766781 10983 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:53.779049 11097 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:53.780036 16856 raft_consensus.cc:2804] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:53.779507 11126 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:53.783545 11126 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:53.759572 11673 raft_consensus.cc:2468] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 13.
I20260709 12:25:53.789410 16856 raft_consensus.cc:697] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:53.790544 16856 consensus_queue.cc:237] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:53.791788 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:53.792402 10980 raft_consensus.cc:3055] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:53.792702 10980 raft_consensus.cc:740] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:53.793648 10980 consensus_queue.cc:260] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:53.795471 10980 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:53.800171 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:53.807723 11052 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:53.816411 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:53.817405 11673 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:53.847682 11052 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 18.
I20260709 12:25:53.852196 10980 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 18.
I20260709 12:25:53.859241 11097 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:53.862517 17061 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:53.863133 17061 raft_consensus.cc:697] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 18 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:53.864163 17061 consensus_queue.cc:237] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:53.882545 11673 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 18.
I20260709 12:25:53.936724 10875 catalog_manager.cc:5697] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 12 to 13, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 13 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:53.970031 10875 catalog_manager.cc:5697] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 17 to 18, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 18 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:53.971921 17058 raft_consensus.cc:993] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7: : Instructing follower bc01179655564f29b83babe396377cbb to start an election
I20260709 12:25:53.972612 17058 raft_consensus.cc:1081] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Signalling peer bc01179655564f29b83babe396377cbb to start an election
I20260709 12:25:53.975874 10980 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6"
dest_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:52828
I20260709 12:25:53.976465 10980 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:53.976812 10980 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:53.985558 10980 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:53.988827 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:53.989439 11052 raft_consensus.cc:3055] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:53.989744 11052 raft_consensus.cc:740] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:53.990568 11052 consensus_queue.cc:260] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:53.992460 10980 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:53.991709 11052 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:53.994417 11673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:53.995041 11673 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:54.004565 11673 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
I20260709 12:25:54.005518 11052 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 12.
I20260709 12:25:54.006731 10948 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:54.008704 16996 raft_consensus.cc:2804] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:54.012549 16996 raft_consensus.cc:697] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:54.013510 16996 consensus_queue.cc:237] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:54.088872 10875 catalog_manager.cc:5697] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 11 to 12, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 12 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:54.155891 17015 raft_consensus.cc:993] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7: : Instructing follower 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:25:54.156486 17015 raft_consensus.cc:1081] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 LEADER]: Signalling peer 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:25:54.159000 11127 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:36582
I20260709 12:25:54.159605 11127 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:54.159966 11127 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:54.179550 11127 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:54.182387 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:54.183050 10980 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:54.191781 11127 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:54.192399 10980 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 17.
I20260709 12:25:54.192857 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:54.195149 11056 raft_consensus.cc:3055] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:54.195465 11056 raft_consensus.cc:740] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:54.196306 11056 consensus_queue.cc:260] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:54.197623 11056 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:54.207801 11097 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:54.208925 16856 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:54.209517 16856 raft_consensus.cc:697] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 17 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:54.210489 16856 consensus_queue.cc:237] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:54.216272 11056 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 17.
I20260709 12:25:54.261101 10875 catalog_manager.cc:5697] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 16 to 17, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 17 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:54.344933 10980 raft_consensus.cc:1275] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:54.346772 17061 consensus_queue.cc:1048] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:54.359650 11673 raft_consensus.cc:1275] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:54.362179 17061 consensus_queue.cc:1048] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:54.402066 11679 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:25:54.404096 17061 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:54.434744 10983 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:25:54.436728 16856 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:54.520751 11056 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:25:54.531508 11676 raft_consensus.cc:1275] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:25:54.551806 17061 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:54.625381 17003 consensus_queue.cc:1048] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:54.630085 11054 raft_consensus.cc:1275] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:25:54.653589 16996 consensus_queue.cc:1048] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:25:54.669673 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 147502us
I20260709 12:25:54.766892  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:54.788662 11052 raft_consensus.cc:1275] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:25:54.864017 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 130775us
W20260709 12:25:54.917001 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 97955.3us
W20260709 12:25:54.934571 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 139339us
I20260709 12:25:54.944579 10980 raft_consensus.cc:1275] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:25:54.939988 17087 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 12:25:54.958050 11128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
mode: GRACEFUL
new_leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
 from {username='slave'} at 127.0.0.1:54492
I20260709 12:25:54.959198 11128 raft_consensus.cc:606] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 18 LEADER]: Received request to transfer leadership to TS c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:54.970260 17061 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:25:55.013494 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 70416.3us
W20260709 12:25:55.021981 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 67261.3us
W20260709 12:25:55.068961 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 45315.1us
W20260709 12:25:55.147323 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 131285us
I20260709 12:25:55.169353 10976 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e"
dest_uuid: "bc01179655564f29b83babe396377cbb"
mode: GRACEFUL
new_leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
 from {username='slave'} at 127.0.0.1:41958
I20260709 12:25:55.170258 10976 raft_consensus.cc:606] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 19 LEADER]: Received request to transfer leadership to TS c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:55.171921  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:55.173734  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:55.181897 16996 raft_consensus.cc:993] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb: : Instructing follower c979ef00e0ad4157b49ebbdc13ce7cd7 to start an election
I20260709 12:25:55.182592 17084 raft_consensus.cc:1081] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 19 LEADER]: Signalling peer c979ef00e0ad4157b49ebbdc13ce7cd7 to start an election
I20260709 12:25:55.189121 11052 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
 from {username='slave'} at 127.0.0.1:41302
I20260709 12:25:55.189756 11052 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:55.190196 11052 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:55.197674 17096 raft_consensus.cc:993] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb: : Instructing follower c979ef00e0ad4157b49ebbdc13ce7cd7 to start an election
I20260709 12:25:55.198307 17096 raft_consensus.cc:1081] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 18 LEADER]: Signalling peer c979ef00e0ad4157b49ebbdc13ce7cd7 to start an election
I20260709 12:25:55.201079 11052 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:55.204546 11052 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 20 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:55.207978 11053 consensus_queue.cc:237] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:25:55.193614  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:55.299183 11056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
 from {username='slave'} at 127.0.0.1:41294
I20260709 12:25:55.301327 11056 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:55.301888 11056 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:25:55.309736 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 287378us
I20260709 12:25:55.313050 11126 raft_consensus.cc:1275] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:55.316123 11056 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:55.313874 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 146836us
I20260709 12:25:55.315126 16469 consensus_queue.cc:1048] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:25:55.344515 11056 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 19 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:55.347875 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:55.367050 10980 raft_consensus.cc:3055] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:25:55.367249 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:55.350890 10983 raft_consensus.cc:1275] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:55.368047 11128 raft_consensus.cc:3055] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:55.368412 11128 raft_consensus.cc:740] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:55.367460 10980 raft_consensus.cc:740] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 19 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:55.369570 10980 consensus_queue.cc:260] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:55.373418 10980 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:55.369279 11128 consensus_queue.cc:260] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:55.383107 11128 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:55.390175 11679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:55.390985 11679 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:55.403676 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:55.404361 10983 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:55.411960 10983 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 19.
I20260709 12:25:55.426920 11679 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 20.
I20260709 12:25:55.443305 11134 raft_consensus.cc:2955] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:25:55.444787 17115 consensus_queue.cc:1048] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:55.449019 10980 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 20.
I20260709 12:25:55.432580 11128 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 19.
I20260709 12:25:55.436551 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:55.498366 11672 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:25:55.440272 11024 consensus_peers.cc:597] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 42f9fb63946447bdadbb789c9398031d. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:55.502408 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 62253us
I20260709 12:25:55.440524 17073 raft_consensus.cc:2955] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:25:55.522629 11672 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 19.
I20260709 12:25:55.539749 11025 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:55.540774 17113 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:55.541326 17113 raft_consensus.cc:697] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:55.542299 11024 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:55.543572 17099 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:25:55.544111 17099 raft_consensus.cc:697] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:55.542337 17113 consensus_queue.cc:237] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:55.544957 17099 consensus_queue.cc:237] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:25:55.545325 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 49733.6us
I20260709 12:25:55.564682 10874 catalog_manager.cc:5697] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index -1 to 9, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 14 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:25:55.577080 10980 raft_consensus.cc:2955] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
W20260709 12:25:55.589092 10868 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 46989f4f6130442698a2028fb5bcbf0e with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7518bdeb78f24e67a530754ae48547eb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:55.599562 10983 consensus_queue.cc:237] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
W20260709 12:25:55.644582 10948 consensus_peers.cc:597] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1edc7e1c10ce4d21b4ad909d703ace3e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:55.645358 11054 raft_consensus.cc:1275] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:55.651250 11128 raft_consensus.cc:1275] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:55.655325 17003 consensus_queue.cc:1048] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:55.659716 17085 consensus_queue.cc:1048] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:55.684535 10875 catalog_manager.cc:5697] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 18 to 19, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 19 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:55.686721 10875 catalog_manager.cc:5697] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 19 to 20, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 20 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:55.723999 17003 raft_consensus.cc:2955] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 14 LEADER]: Committing config change with OpId 14.8: config changed from index -1 to 8, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:25:55.735505 11134 raft_consensus.cc:2955] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Committing config change with OpId 14.8: config changed from index -1 to 8, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:25:55.783393 17129 ts_tablet_manager.cc:933] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:55.786444 17129 tablet_copy_client.cc:323] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.194:44483
I20260709 12:25:55.789170 11070 tablet_copy_service.cc:140] P c979ef00e0ad4157b49ebbdc13ce7cd7: Received BeginTabletCopySession request for tablet 42f9fb63946447bdadbb789c9398031d from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:52804)
I20260709 12:25:55.789886 11070 tablet_copy_service.cc:161] P c979ef00e0ad4157b49ebbdc13ce7cd7: Beginning new tablet copy session on tablet 42f9fb63946447bdadbb789c9398031d from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:52804: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-42f9fb63946447bdadbb789c9398031d
I20260709 12:25:55.793480 11054 raft_consensus.cc:2955] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Committing config change with OpId 14.8: config changed from index -1 to 8, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:25:55.817754 11070 tablet_copy_source_session.cc:215] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:55.825091 10980 consensus_queue.cc:237] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:25:55.845216 17129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42f9fb63946447bdadbb789c9398031d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.874385 10877 catalog_manager.cc:5697] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index -1 to 8, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 14 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
W20260709 12:25:55.909894 10948 consensus_peers.cc:597] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 87a7b71cfb864c1b9ab4c85887ca32ad. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:55.912653 11054 raft_consensus.cc:1275] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:55.917748 17085 consensus_queue.cc:1048] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:55.918188 11134 raft_consensus.cc:1275] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:55.920100 17003 consensus_queue.cc:1048] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:55.958146 11679 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:25:55.961027 17113 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:25:55.961416 17129 tablet_copy_client.cc:806] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:55.962121 17129 tablet_copy_client.cc:670] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:55.964212 10977 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:25:55.971230 17003 raft_consensus.cc:2955] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 15 LEADER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:25:55.977496 17113 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:55.982787 11056 raft_consensus.cc:2955] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:25:55.990979 11134 raft_consensus.cc:2955] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:25:56.002887 11128 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:25:56.020857 17099 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:25:56.025451 10875 catalog_manager.cc:5697] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index -1 to 9, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 15 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:25:56.044757 17129 tablet_copy_client.cc:538] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:56.048473 11054 consensus_queue.cc:237] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:25:56.091526 11672 raft_consensus.cc:1275] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:25:56.093293 17099 consensus_queue.cc:1048] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:25:56.143079 17129 tablet_bootstrap.cc:492] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:25:56.179319 17145 ts_tablet_manager.cc:933] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
W20260709 12:25:56.190814 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 69597.6us
I20260709 12:25:56.229542 10980 raft_consensus.cc:1275] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 20 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 12:25:56.230279 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 99852.2us
I20260709 12:25:56.232379 17113 consensus_queue.cc:1048] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:25:56.232410 10980 raft_consensus.cc:1275] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:25:56.243817 11126 raft_consensus.cc:1275] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:25:56.248884 17147 consensus_queue.cc:1048] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:25:56.268482 17112 consensus_queue.cc:1048] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:56.272603 17145 tablet_copy_client.cc:323] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.193:46777
W20260709 12:25:56.290690 11024 consensus_peers.cc:597] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 702d64a1236147a784daa11e58563721. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:56.298538 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 49340.6us
I20260709 12:25:56.317723 10994 tablet_copy_service.cc:140] P bc01179655564f29b83babe396377cbb: Received BeginTabletCopySession request for tablet 1edc7e1c10ce4d21b4ad909d703ace3e from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:60928)
I20260709 12:25:56.318409 10994 tablet_copy_service.cc:161] P bc01179655564f29b83babe396377cbb: Beginning new tablet copy session on tablet 1edc7e1c10ce4d21b4ad909d703ace3e from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:60928: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-1edc7e1c10ce4d21b4ad909d703ace3e
W20260709 12:25:56.350731 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 64045.7us
I20260709 12:25:56.394784 10994 tablet_copy_source_session.cc:215] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:56.404783 17145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1edc7e1c10ce4d21b4ad909d703ace3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.437160  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:25:56.442013 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 63211.2us
I20260709 12:25:56.506182 17162 ts_tablet_manager.cc:933] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
I20260709 12:25:56.521713 11056 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:56.532069 11056 raft_consensus.cc:606] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:25:56.547887 11053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:25:56.549983 11053 raft_consensus.cc:606] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:25:56.562075  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:56.577611  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:56.578505  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:56.584873 10980 raft_consensus.cc:2955] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:25:56.586410 17151 raft_consensus.cc:993] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7: : Instructing follower bc01179655564f29b83babe396377cbb to start an election
I20260709 12:25:56.587013 17149 raft_consensus.cc:1081] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 LEADER]: Signalling peer bc01179655564f29b83babe396377cbb to start an election
I20260709 12:25:56.594655 17149 raft_consensus.cc:2955] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:25:56.609956 10983 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e"
dest_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:52828
I20260709 12:25:56.610704 10983 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:56.610996 10983 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:56.627282 17162 tablet_copy_client.cc:323] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.193:46777
I20260709 12:25:56.631987 10994 tablet_copy_service.cc:140] P bc01179655564f29b83babe396377cbb: Received BeginTabletCopySession request for tablet 87a7b71cfb864c1b9ab4c85887ca32ad from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:60928)
I20260709 12:25:56.632592 10994 tablet_copy_service.cc:161] P bc01179655564f29b83babe396377cbb: Beginning new tablet copy session on tablet 87a7b71cfb864c1b9ab4c85887ca32ad from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:60928: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-87a7b71cfb864c1b9ab4c85887ca32ad
I20260709 12:25:56.638484 11126 raft_consensus.cc:2955] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:25:56.642292 10994 tablet_copy_source_session.cc:215] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:56.643070 17145 tablet_copy_client.cc:806] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:56.648321 10983 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:56.653028 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:56.653650 11056 raft_consensus.cc:3055] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:25:56.653981 11056 raft_consensus.cc:740] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:56.655122 11056 consensus_queue.cc:260] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:56.656214 11056 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:56.659366 10983 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 21 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:25:56.659433 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: true dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:56.660434 11672 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:56.660434 10877 catalog_manager.cc:5697] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb reported cstate change: config changed from index -1 to 8, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 15 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
W20260709 12:25:56.661396 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 179815us
I20260709 12:25:56.662632 17145 tablet_copy_client.cc:670] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:56.690999 17162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87a7b71cfb864c1b9ab4c85887ca32ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.698441 11056 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 21.
I20260709 12:25:56.699389 17145 tablet_copy_client.cc:538] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:56.712220 17145 tablet_bootstrap.cc:492] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:25:56.725260 17129 tablet_bootstrap.cc:492] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:56.730423 10948 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:56.731653 17085 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:25:56.732218 17085 raft_consensus.cc:697] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 21 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:56.733039 17085 consensus_queue.cc:237] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:56.745651 11672 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 21.
I20260709 12:25:56.762588 17129 tablet_bootstrap.cc:492] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:25:56.763686 17129 ts_tablet_manager.cc:1403] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.621s	user 0.041s	sys 0.016s
I20260709 12:25:56.784622 17129 raft_consensus.cc:359] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:25:56.799475 17129 raft_consensus.cc:740] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:25:56.816905 17129 consensus_queue.cc:260] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:25:56.820246 17129 ts_tablet_manager.cc:1434] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.001s
I20260709 12:25:56.826622 17168 ts_tablet_manager.cc:933] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:25:56.845537 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 50726us
I20260709 12:25:56.876498 11070 tablet_copy_service.cc:342] P c979ef00e0ad4157b49ebbdc13ce7cd7: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-42f9fb63946447bdadbb789c9398031d received from {username='slave'} at 127.0.0.1:52804
I20260709 12:25:56.877038 11070 tablet_copy_service.cc:434] P c979ef00e0ad4157b49ebbdc13ce7cd7: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-42f9fb63946447bdadbb789c9398031d on tablet 42f9fb63946447bdadbb789c9398031d with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:56.881192 17157 raft_consensus.cc:993] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7: : Instructing follower 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:25:56.881770 17157 raft_consensus.cc:1081] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Signalling peer 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:25:56.891436 11130 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:36582
I20260709 12:25:56.892057 11130 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:56.892408 11130 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:56.876821 17162 tablet_copy_client.cc:806] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:56.894376 17162 tablet_copy_client.cc:670] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:56.901877 17162 tablet_copy_client.cc:538] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:56.933861 17168 tablet_copy_client.cc:323] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.194:44483
I20260709 12:25:56.935959 11070 tablet_copy_service.cc:140] P c979ef00e0ad4157b49ebbdc13ce7cd7: Received BeginTabletCopySession request for tablet 702d64a1236147a784daa11e58563721 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:52804)
I20260709 12:25:56.936549 11070 tablet_copy_service.cc:161] P c979ef00e0ad4157b49ebbdc13ce7cd7: Beginning new tablet copy session on tablet 702d64a1236147a784daa11e58563721 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:52804: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-702d64a1236147a784daa11e58563721
I20260709 12:25:56.983840 17162 tablet_bootstrap.cc:492] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:25:56.954770 11130 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:56.993431 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:56.994072 10980 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:56.994547 11130 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:25:56.995716 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:25:56.996201 11055 raft_consensus.cc:3055] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:56.996430 11055 raft_consensus.cc:740] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
W20260709 12:25:56.991931 17145 log.cc:927] Time spent T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.050s	user 0.004s	sys 0.000s
I20260709 12:25:57.002023 10980 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 15.
I20260709 12:25:57.002355 11055 consensus_queue.cc:260] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:57.004895 11097 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:25:57.006877 17158 raft_consensus.cc:2804] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:57.007076 11055 raft_consensus.cc:3060] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:57.010769 17158 raft_consensus.cc:697] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 15 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:57.011765 17158 consensus_queue.cc:237] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:57.017725 11055 raft_consensus.cc:2468] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 15.
I20260709 12:25:57.024169 11070 tablet_copy_source_session.cc:215] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:57.027778 17168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 702d64a1236147a784daa11e58563721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.051574 10877 catalog_manager.cc:5697] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 20 to 21, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 21 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.076757 17145 tablet_bootstrap.cc:492] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=2 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:57.088518 17145 tablet_bootstrap.cc:492] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:25:57.108595 17145 ts_tablet_manager.cc:1403] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.397s	user 0.033s	sys 0.013s
I20260709 12:25:57.086530 10874 catalog_manager.cc:5697] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 14 to 15, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 15 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:57.122308 17145 raft_consensus.cc:359] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:25:57.129882 11677 raft_consensus.cc:1275] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 21 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:25:57.131966 17084 consensus_queue.cc:1048] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:25:57.129961 17145 raft_consensus.cc:740] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:25:57.135052 17145 consensus_queue.cc:260] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:25:57.137594 17145 ts_tablet_manager.cc:1434] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.000s
I20260709 12:25:57.149112 10994 tablet_copy_service.cc:342] P bc01179655564f29b83babe396377cbb: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-1edc7e1c10ce4d21b4ad909d703ace3e received from {username='slave'} at 127.0.0.1:60928
I20260709 12:25:57.149636 10994 tablet_copy_service.cc:434] P bc01179655564f29b83babe396377cbb: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-1edc7e1c10ce4d21b4ad909d703ace3e on tablet 1edc7e1c10ce4d21b4ad909d703ace3e with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:57.164017 17168 tablet_copy_client.cc:806] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:57.164683 17168 tablet_copy_client.cc:670] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:57.180781 17168 tablet_copy_client.cc:538] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:57.197924 11059 raft_consensus.cc:1275] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 21 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:25:57.202616 17003 consensus_queue.cc:1048] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:25:57.211112 11672 raft_consensus.cc:1217] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.7->[14.8-14.8]   Dedup: 14.8->[]
I20260709 12:25:57.240335 17168 tablet_bootstrap.cc:492] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:25:57.366544 11677 raft_consensus.cc:1217] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.8->[14.9-14.9]   Dedup: 14.9->[]
W20260709 12:25:57.470279 17162 log.cc:927] Time spent T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.064s	user 0.004s	sys 0.000s
I20260709 12:25:57.493934 17162 tablet_bootstrap.cc:492] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:57.531165 17162 tablet_bootstrap.cc:492] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:25:57.532135 17162 ts_tablet_manager.cc:1403] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.549s	user 0.052s	sys 0.019s
I20260709 12:25:57.569949 11059 raft_consensus.cc:1275] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:57.570497 17162 raft_consensus.cc:359] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:25:57.571524 17162 raft_consensus.cc:740] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:25:57.572418 17162 consensus_queue.cc:260] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:25:57.574199 17170 consensus_queue.cc:1048] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:57.582633 17162 ts_tablet_manager.cc:1434] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 12:25:57.590637 10983 raft_consensus.cc:1275] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:57.620414 17158 consensus_queue.cc:1048] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:25:57.627655 17168 tablet_bootstrap.cc:492] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=1 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:57.628643 17168 tablet_bootstrap.cc:492] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:25:57.630614 17168 ts_tablet_manager.cc:1403] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.391s	user 0.038s	sys 0.006s
I20260709 12:25:57.635154 17168 raft_consensus.cc:359] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:25:57.636217 17168 raft_consensus.cc:740] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:25:57.619558 10994 tablet_copy_service.cc:342] P bc01179655564f29b83babe396377cbb: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-87a7b71cfb864c1b9ab4c85887ca32ad received from {username='slave'} at 127.0.0.1:60928
I20260709 12:25:57.661128 10994 tablet_copy_service.cc:434] P bc01179655564f29b83babe396377cbb: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-87a7b71cfb864c1b9ab4c85887ca32ad on tablet 87a7b71cfb864c1b9ab4c85887ca32ad with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:25:57.731948  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:57.636994 17168 consensus_queue.cc:260] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:25:57.763320 17168 ts_tablet_manager.cc:1434] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.132s	user 0.002s	sys 0.008s
I20260709 12:25:57.876135 11677 raft_consensus.cc:1217] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.7->[15.8-15.8]   Dedup: 15.8->[]
I20260709 12:25:57.925757 11070 tablet_copy_service.cc:342] P c979ef00e0ad4157b49ebbdc13ce7cd7: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-702d64a1236147a784daa11e58563721 received from {username='slave'} at 127.0.0.1:52804
I20260709 12:25:57.926393 11070 tablet_copy_service.cc:434] P c979ef00e0ad4157b49ebbdc13ce7cd7: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-702d64a1236147a784daa11e58563721 on tablet 702d64a1236147a784daa11e58563721 with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
W20260709 12:25:57.930423 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 57746.5us
W20260709 12:25:57.935825 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 52594.3us
I20260709 12:25:58.014009 16996 raft_consensus.cc:1064] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:25:58.060184 17112 raft_consensus.cc:1064] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:25:58.049360 16996 consensus_queue.cc:237] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 6, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:58.107267 17112 consensus_queue.cc:237] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 7, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:58.114729 11672 raft_consensus.cc:1217] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.8->[15.9-15.9]   Dedup: 15.9->[]
W20260709 12:25:58.131968 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 99566.2us
W20260709 12:25:58.206269 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 138077us
I20260709 12:25:58.225669 11672 raft_consensus.cc:1275] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEARNER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:25:58.229173 11128 raft_consensus.cc:1275] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:25:58.232733 17180 consensus_queue.cc:1048] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:58.255460 11056 raft_consensus.cc:1275] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:58.256975 17157 consensus_queue.cc:1048] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:25:58.264349 11677 raft_consensus.cc:1275] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEARNER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:58.265093 10977 raft_consensus.cc:1275] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:25:58.268865 17185 consensus_queue.cc:1048] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:58.283762 11130 raft_consensus.cc:1275] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:58.286055 17184 consensus_queue.cc:1048] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:25:58.291560 17112 raft_consensus.cc:1064] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:25:58.295428 17112 consensus_queue.cc:237] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 6, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:58.317878 17184 consensus_queue.cc:1048] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:25:58.372769 11673 raft_consensus.cc:1275] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEARNER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:58.374963 11128 raft_consensus.cc:1275] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:58.376075 17112 consensus_queue.cc:1048] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:58.382543 10976 raft_consensus.cc:1275] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:58.393010 17180 consensus_queue.cc:1048] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:58.398546 17147 consensus_queue.cc:1048] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:58.418457 17184 raft_consensus.cc:2955] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index 8 to 9, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:58.419649 17112 consensus_queue.cc:1048] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:25:58.497846 17206 log.cc:927] Time spent T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:25:58.500581 17112 raft_consensus.cc:2955] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Committing config change with OpId 15.9: config changed from index 8 to 9, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:58.504161 10977 raft_consensus.cc:2955] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:58.466502 11056 raft_consensus.cc:2955] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index 8 to 9, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:58.521330 17147 raft_consensus.cc:2955] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:58.538735 11134 raft_consensus.cc:2955] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index 8 to 9, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:58.582403 11672 raft_consensus.cc:2955] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index 8 to 9, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:58.587044 11677 raft_consensus.cc:2955] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:58.620198 10875 catalog_manager.cc:5697] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb reported cstate change: config changed from index 8 to 9, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:58.624352 10980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6"
dest_uuid: "bc01179655564f29b83babe396377cbb"
mode: GRACEFUL
new_leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
 from {username='slave'} at 127.0.0.1:41958
I20260709 12:25:58.625195 10980 raft_consensus.cc:606] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Received request to transfer leadership to TS c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:58.627094 10876 catalog_manager.cc:5697] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index 8 to 9, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:58.635958 11128 raft_consensus.cc:2955] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:58.640744 11672 raft_consensus.cc:2955] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
W20260709 12:25:58.646175 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 61856.2us
I20260709 12:25:58.657722 10979 raft_consensus.cc:2955] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:58.702530 11134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
mode: GRACEFUL
new_leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
 from {username='slave'} at 127.0.0.1:54492
I20260709 12:25:58.703230 11134 raft_consensus.cc:606] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 16 LEADER]: Received request to transfer leadership to TS c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:25:58.713388 17185 raft_consensus.cc:1064] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:25:58.723285 17185 consensus_queue.cc:237] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 7, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:58.781908  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:58.787331  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:58.798496 16996 raft_consensus.cc:993] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb: : Instructing follower c979ef00e0ad4157b49ebbdc13ce7cd7 to start an election
I20260709 12:25:58.799126 16996 raft_consensus.cc:1081] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Signalling peer c979ef00e0ad4157b49ebbdc13ce7cd7 to start an election
W20260709 12:25:58.878263 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 56980.7us
I20260709 12:25:58.879523 11128 raft_consensus.cc:2955] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:58.880545 11672 raft_consensus.cc:1275] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEARNER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:25:58.880474 11059 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
 from {username='slave'} at 127.0.0.1:41302
I20260709 12:25:58.881870 11059 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:58.882262 11059 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:58.887054 17218 consensus_queue.cc:1048] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:58.891125 11056 raft_consensus.cc:1275] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:25:58.895876 17218 consensus_queue.cc:1048] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:58.897948 11059 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:58.902343 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:25:58.903021 11677 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:58.906131 11059 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:25:58.911175 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 121862us
I20260709 12:25:58.919178 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c233c491e1b4126b9d776bfd98023b6" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:58.919800 10979 raft_consensus.cc:3055] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:58.925115  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:58.920113 10979 raft_consensus.cc:740] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:25:58.927374 10979 consensus_queue.cc:260] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:58.935424 10979 raft_consensus.cc:3060] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:58.952324 10979 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
W20260709 12:25:58.950241 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 130291us
I20260709 12:25:58.971820 11677 raft_consensus.cc:2468] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:25:58.974478 17220 raft_consensus.cc:993] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb: : Instructing follower c979ef00e0ad4157b49ebbdc13ce7cd7 to start an election
I20260709 12:25:58.983659 17220 raft_consensus.cc:1081] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 16 LEADER]: Signalling peer c979ef00e0ad4157b49ebbdc13ce7cd7 to start an election
I20260709 12:25:58.984999 11134 raft_consensus.cc:1275] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:25:58.975469 11023 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:58.993355 17112 raft_consensus.cc:2804] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:58.993919 17112 raft_consensus.cc:697] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:58.994882 17112 consensus_queue.cc:237] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:59.012565 11055 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
 from {username='slave'} at 127.0.0.1:41294
I20260709 12:25:59.013247 11055 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:59.013633 11055 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:59.034602 10979 consensus_queue.cc:237] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:59.054798 17222 consensus_queue.cc:1048] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:59.068873 17185 raft_consensus.cc:2955] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index 9 to 10, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:59.083233 11056 raft_consensus.cc:2955] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:59.090616 11677 raft_consensus.cc:1275] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:25:59.093062 17218 consensus_queue.cc:1048] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:59.116748 11134 raft_consensus.cc:1275] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:25:59.121690 17218 raft_consensus.cc:2955] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 9 to 10, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:59.126871 11677 raft_consensus.cc:2955] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:59.127139 10877 catalog_manager.cc:5697] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 9 to 10, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:59.132663 11672 raft_consensus.cc:2955] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:59.116323 11055 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:59.158288 11055 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:25:59.160697 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:25:59.162701 11130 raft_consensus.cc:3055] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:59.163093 11130 raft_consensus.cc:740] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:25:59.186971 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:25:59.188009 10980 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:59.192376 11130 consensus_queue.cc:260] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:59.193636 11130 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:59.216936 10980 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 17.
I20260709 12:25:59.221750 17085 consensus_queue.cc:1048] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:59.222477 11130 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 17.
I20260709 12:25:59.245653 10866 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1edc7e1c10ce4d21b4ad909d703ace3e with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:59.268178 11025 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:25:59.269105 17180 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:59.269614 17180 raft_consensus.cc:697] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:25:59.252251 10875 catalog_manager.cc:5697] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 12 to 13, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 13 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.270612 17180 consensus_queue.cc:237] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:25:59.271235 10875 catalog_manager.cc:5697] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index 9 to 10, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:59.281108 11125 raft_consensus.cc:2955] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:59.313324 10877 catalog_manager.cc:5697] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 9 to 10, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New cstate: current_term: 14 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:59.316622 11128 raft_consensus.cc:2955] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:59.388684 10979 consensus_queue.cc:237] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:59.410837 11054 raft_consensus.cc:1275] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:25:59.411197 11677 raft_consensus.cc:1275] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:25:59.413367 17218 consensus_queue.cc:1048] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:59.415369 17218 consensus_queue.cc:1048] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:59.412858 10875 catalog_manager.cc:5697] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 16 to 17, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 17 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.427906 11047 tablet_service.cc:1558] Processing DeleteTablet for tablet 1edc7e1c10ce4d21b4ad909d703ace3e with delete_type TABLET_DATA_TOMBSTONED (TS c979ef00e0ad4157b49ebbdc13ce7cd7 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:59404
I20260709 12:25:59.429832 11054 consensus_queue.cc:237] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:59.432891 11055 consensus_queue.cc:237] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:59.441224 11679 raft_consensus.cc:1275] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:59.442988 17232 tablet_replica.cc:333] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:25:59.445034 17221 consensus_queue.cc:1048] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:59.445552 10979 raft_consensus.cc:1275] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:25:59.447211 17221 consensus_queue.cc:1048] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:59.447507 17232 raft_consensus.cc:2243] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.448662 17232 raft_consensus.cc:2272] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.450340 11679 raft_consensus.cc:1275] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:25:59.451712 17185 raft_consensus.cc:2955] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:59.459445 17112 consensus_queue.cc:1048] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:59.461802 11677 raft_consensus.cc:2955] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:59.464851 17232 ts_tablet_manager.cc:1916] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:59.466691 10979 raft_consensus.cc:2955] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:59.470764 11672 raft_consensus.cc:2955] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:59.461736 17112 raft_consensus.cc:2955] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index 9 to 10, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:59.475723 11134 raft_consensus.cc:1275] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:59.478214 17180 raft_consensus.cc:2955] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:59.499024 10867 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 702d64a1236147a784daa11e58563721 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:59.511883 11679 raft_consensus.cc:2955] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:59.523222 10875 catalog_manager.cc:5697] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index 9 to 10, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New cstate: current_term: 15 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.540998 11121 tablet_service.cc:1558] Processing DeleteTablet for tablet 702d64a1236147a784daa11e58563721 with delete_type TABLET_DATA_TOMBSTONED (TS 7518bdeb78f24e67a530754ae48547eb not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:48956
I20260709 12:25:59.551476 17151 consensus_queue.cc:1048] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:59.562445 10979 raft_consensus.cc:1275] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:25:59.564040 17151 consensus_queue.cc:1048] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:25:59.568259 11126 raft_consensus.cc:2955] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:59.579743 11679 raft_consensus.cc:1275] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:25:59.582055 17151 consensus_queue.cc:1048] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:25:59.590749 17233 tablet_replica.cc:333] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:25:59.592156 17233 raft_consensus.cc:2243] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.594533 17233 raft_consensus.cc:2272] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.600513 17232 ts_tablet_manager.cc:1929] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.9
I20260709 12:25:59.601154 17232 log.cc:1199] T 1edc7e1c10ce4d21b4ad909d703ace3e P c979ef00e0ad4157b49ebbdc13ce7cd7: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-1-root/wals/1edc7e1c10ce4d21b4ad909d703ace3e
I20260709 12:25:59.620826 10867 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 42f9fb63946447bdadbb789c9398031d with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:59.632085 11055 raft_consensus.cc:2955] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:59.646963 10866 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 87a7b71cfb864c1b9ab4c85887ca32ad with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:59.647704 17233 ts_tablet_manager.cc:1916] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:59.658411 10867 catalog_manager.cc:5028] TS c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): tablet 1edc7e1c10ce4d21b4ad909d703ace3e (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:25:59.670037 10877 catalog_manager.cc:5697] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index 10 to 11, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New cstate: current_term: 14 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:59.703286 10969 tablet_service.cc:1558] Processing DeleteTablet for tablet 42f9fb63946447bdadbb789c9398031d with delete_type TABLET_DATA_TOMBSTONED (TS bc01179655564f29b83babe396377cbb not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:58332
I20260709 12:25:59.708638 17233 ts_tablet_manager.cc:1929] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.9
I20260709 12:25:59.709138 17233 log.cc:1199] T 702d64a1236147a784daa11e58563721 P 7518bdeb78f24e67a530754ae48547eb: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-2-root/wals/702d64a1236147a784daa11e58563721
I20260709 12:25:59.714370 10868 catalog_manager.cc:5028] TS 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): tablet 702d64a1236147a784daa11e58563721 (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:25:59.733624 10875 catalog_manager.cc:5697] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 10 to 11, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New cstate: current_term: 15 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:25:59.746315 11056 consensus_queue.cc:237] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:25:59.769603 11130 raft_consensus.cc:1275] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:25:59.776469 17181 consensus_queue.cc:1048] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:59.794657 11121 tablet_service.cc:1558] Processing DeleteTablet for tablet 87a7b71cfb864c1b9ab4c85887ca32ad with delete_type TABLET_DATA_TOMBSTONED (TS 7518bdeb78f24e67a530754ae48547eb not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:48956
I20260709 12:25:59.811578 17233 tablet_replica.cc:333] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:25:59.818235 17239 tablet_replica.cc:333] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:25:59.840500 17233 raft_consensus.cc:2243] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.841796 17233 raft_consensus.cc:2272] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.819598 17239 raft_consensus.cc:2243] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.862794 10979 raft_consensus.cc:1275] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:25:59.875635 11126 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:25:59.865367 17151 consensus_queue.cc:1048] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 12:25:59.878481 17181 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 12:25:59.884262 11677 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:25:59.889739 17233 ts_tablet_manager.cc:1916] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:59.890496 17181 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:25:59.892014 17239 raft_consensus.cc:2272] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.908476 17239 ts_tablet_manager.cc:1916] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:26:00.034454 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 116898us
W20260709 12:26:00.100577 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 54377.3us
W20260709 12:26:00.107722 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 60479.1us
I20260709 12:26:00.108140 17249 raft_consensus.cc:2955] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index 7 to 14, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:00.143043 17233 ts_tablet_manager.cc:1929] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.10
I20260709 12:26:00.150617 17233 log.cc:1199] T 87a7b71cfb864c1b9ab4c85887ca32ad P 7518bdeb78f24e67a530754ae48547eb: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-2-root/wals/87a7b71cfb864c1b9ab4c85887ca32ad
I20260709 12:26:00.143549 17239 ts_tablet_manager.cc:1929] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.10
W20260709 12:26:00.157349 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 102004us
I20260709 12:26:00.158816 10868 catalog_manager.cc:5028] TS 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): tablet 87a7b71cfb864c1b9ab4c85887ca32ad (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:26:00.159191 17239 log.cc:1199] T 42f9fb63946447bdadbb789c9398031d P bc01179655564f29b83babe396377cbb: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-0-root/wals/42f9fb63946447bdadbb789c9398031d
I20260709 12:26:00.195434 10866 catalog_manager.cc:5028] TS bc01179655564f29b83babe396377cbb (127.9.145.193:46777): tablet 42f9fb63946447bdadbb789c9398031d (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:26:00.222757 11130 raft_consensus.cc:2955] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 7 to 14, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
W20260709 12:26:00.247498 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 84747.1us
I20260709 12:26:00.260782 10867 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 46989f4f6130442698a2028fb5bcbf0e with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 10)
W20260709 12:26:00.262181 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 108729us
I20260709 12:26:00.270311 10875 catalog_manager.cc:5697] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index 7 to 14, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New cstate: current_term: 19 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:00.275489 11679 raft_consensus.cc:2955] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 7 to 14, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:00.326574  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:00.517848 10969 tablet_service.cc:1558] Processing DeleteTablet for tablet 46989f4f6130442698a2028fb5bcbf0e with delete_type TABLET_DATA_TOMBSTONED (TS bc01179655564f29b83babe396377cbb not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:58332
I20260709 12:26:00.522639 17239 tablet_replica.cc:333] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:00.523756 17239 raft_consensus.cc:2243] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:00.524526 17239 raft_consensus.cc:2272] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:00.530745 17239 ts_tablet_manager.cc:1916] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:26:00.578250 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 69382.7us
I20260709 12:26:00.587028 17239 ts_tablet_manager.cc:1929] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.13
I20260709 12:26:00.587710 17239 log.cc:1199] T 46989f4f6130442698a2028fb5bcbf0e P bc01179655564f29b83babe396377cbb: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-0-root/wals/46989f4f6130442698a2028fb5bcbf0e
I20260709 12:26:00.592015 11055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:26:00.595786 10866 catalog_manager.cc:5028] TS bc01179655564f29b83babe396377cbb (127.9.145.193:46777): tablet 46989f4f6130442698a2028fb5bcbf0e (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:26:00.601555 11055 raft_consensus.cc:606] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:26:00.602125 11055 raft_consensus.cc:630] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 LEADER]: Rejecting request to transfer leadership because tablet server bc01179655564f29b83babe396377cbb is not a voter in the active config
I20260709 12:26:00.605209 11055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "709d2903489748c8a8490194704bc3ca"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:26:00.605897 11055 raft_consensus.cc:606] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 LEADER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:26:00.607522  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:00.609444  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:00.610306  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:00.775374 17221 raft_consensus.cc:993] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7: : Instructing follower 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:26:00.776778 17258 raft_consensus.cc:1081] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 LEADER]: Signalling peer 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:26:00.778970 11130 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "709d2903489748c8a8490194704bc3ca"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:36582
I20260709 12:26:00.779611 11130 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:00.779953 11130 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:00.789633 11130 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:00.794430 11130 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 20 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:26:00.795481 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:26:00.799494 11055 raft_consensus.cc:3055] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:00.799816 11055 raft_consensus.cc:740] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:26:00.800602 11055 consensus_queue.cc:260] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:00.801863 11055 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:00.805786 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:26:00.806450 10979 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:00.816375 11055 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 20.
I20260709 12:26:00.823899 11098 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:26:00.825469 10979 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 20.
I20260709 12:26:00.825984 17170 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:00.832500 17170 raft_consensus.cc:697] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 20 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:26:00.834164 17170 consensus_queue.cc:237] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:00.879762 10877 catalog_manager.cc:5697] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 19 to 20, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 20 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:01.179860 11130 consensus_queue.cc:237] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:26:01.310133 10984 raft_consensus.cc:1275] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:26:01.313225 17170 consensus_queue.cc:1048] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:01.320111 11055 raft_consensus.cc:1275] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 12:26:01.333168 11098 consensus_peers.cc:597] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6506ec2922c24d099538b52b0df81502. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:01.339375 17170 consensus_queue.cc:1048] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:01.360136 11054 raft_consensus.cc:1275] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:26:01.361796 17188 consensus_queue.cc:1048] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:01.405090 17170 raft_consensus.cc:2955] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 18 LEADER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:26:01.408004 10979 raft_consensus.cc:2955] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:26:01.442893 10980 raft_consensus.cc:1275] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 20 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:26:01.445210 17188 consensus_queue.cc:1048] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:01.464462 10877 catalog_manager.cc:5697] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index -1 to 11, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 18 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:01.461936 11055 raft_consensus.cc:2955] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:26:01.483981 10979 consensus_queue.cc:237] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:26:01.586378 11130 raft_consensus.cc:1275] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:26:01.586557 10948 consensus_peers.cc:597] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f28a3d1504ca450d9efd93115b1164f9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:01.588030 17185 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:01.588434 11054 raft_consensus.cc:1275] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:26:01.592139 17248 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:01.679514 17248 raft_consensus.cc:2955] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:26:01.682462 11130 raft_consensus.cc:2955] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:26:01.717284  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:01.723604 10877 catalog_manager.cc:5697] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index -1 to 13, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 18 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
W20260709 12:26:01.744791 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 65771.8us
I20260709 12:26:01.751464 17287 ts_tablet_manager.cc:933] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:01.757294 11056 raft_consensus.cc:2955] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:26:01.794600 17287 tablet_copy_client.cc:323] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.195:42537
I20260709 12:26:01.797689 11144 tablet_copy_service.cc:140] P 7518bdeb78f24e67a530754ae48547eb: Received BeginTabletCopySession request for tablet 6506ec2922c24d099538b52b0df81502 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:58414)
I20260709 12:26:01.793627 11055 consensus_queue.cc:237] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:26:01.798352 11144 tablet_copy_service.cc:161] P 7518bdeb78f24e67a530754ae48547eb: Beginning new tablet copy session on tablet 6506ec2922c24d099538b52b0df81502 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:58414: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-6506ec2922c24d099538b52b0df81502
I20260709 12:26:01.808957 11144 tablet_copy_source_session.cc:215] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:01.838761 17287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6506ec2922c24d099538b52b0df81502. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.889882 17287 tablet_copy_client.cc:806] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:01.918860 17287 tablet_copy_client.cc:670] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:02.250355 17287 tablet_copy_client.cc:538] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:26:02.293349 11056 consensus_meta.cc:287] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7: Time spent flushing consensus metadata: real 0.531s	user 0.011s	sys 0.004s
I20260709 12:26:02.415349 10979 raft_consensus.cc:1275] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:26:02.417075 17290 consensus_queue.cc:1048] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:02.480114 11126 raft_consensus.cc:1275] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:26:02.487788 17300 raft_consensus.cc:2955] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:26:02.492547 17287 tablet_bootstrap.cc:492] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:26:02.490039 10977 raft_consensus.cc:2955] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:26:02.490134 17296 consensus_queue.cc:1048] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:26:02.527774 11059 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:26:02.528604 11059 raft_consensus.cc:606] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
W20260709 12:26:02.554813 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 44463.8us
W20260709 12:26:02.572919 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 82075.9us
W20260709 12:26:02.593730 17305 log.cc:927] Time spent T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:26:02.610380 10877 catalog_manager.cc:5697] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index -1 to 10, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 15 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:02.618644 17309 ts_tablet_manager.cc:933] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
W20260709 12:26:02.614632 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 71077.7us
W20260709 12:26:02.642313 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 67376.9us
W20260709 12:26:02.640690 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 83936.2us
W20260709 12:26:02.643860 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 69579.1us
I20260709 12:26:02.652379 11128 consensus_queue.cc:237] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:26:02.689291 11130 raft_consensus.cc:2955] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
W20260709 12:26:02.711525 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 133182us
W20260709 12:26:02.723675 11024 consensus_peers.cc:597] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 227d10a1bcd84a0e9845113d5b0a2495. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:02.741595 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:02.754136 17309 tablet_copy_client.cc:323] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.193:46777
I20260709 12:26:02.756289 10994 tablet_copy_service.cc:140] P bc01179655564f29b83babe396377cbb: Received BeginTabletCopySession request for tablet f28a3d1504ca450d9efd93115b1164f9 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:60928)
I20260709 12:26:02.756887 10994 tablet_copy_service.cc:161] P bc01179655564f29b83babe396377cbb: Beginning new tablet copy session on tablet f28a3d1504ca450d9efd93115b1164f9 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:60928: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-f28a3d1504ca450d9efd93115b1164f9
W20260709 12:26:02.758421 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 124196us
I20260709 12:26:02.773803 10994 tablet_copy_source_session.cc:215] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:02.797020 17309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f28a3d1504ca450d9efd93115b1164f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.806586 10977 raft_consensus.cc:1275] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:26:02.811484 17295 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:26:02.781289 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 144025us
I20260709 12:26:02.847414 11130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
mode: GRACEFUL
new_leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
 from {username='slave'} at 127.0.0.1:54492
I20260709 12:26:02.847966 11130 raft_consensus.cc:606] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 16 LEADER]: Received request to transfer leadership to TS c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:02.852361  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:02.854328 11056 raft_consensus.cc:1275] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:26:02.854329  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:02.879776 17263 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:26:02.885859  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:02.915795 10979 raft_consensus.cc:2955] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:26:02.912873 17316 raft_consensus.cc:2955] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:26:02.926328 17309 tablet_copy_client.cc:806] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:02.927024 17309 tablet_copy_client.cc:670] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
W20260709 12:26:02.939224 11098 consensus_peers.cc:597] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0bb240ba9bd84493aa3cda1c24e646f1. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:02.939766 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 57471.9us
I20260709 12:26:02.975769 17309 tablet_copy_client.cc:538] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:02.992097 17309 tablet_bootstrap.cc:492] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:26:03.002804 11054 raft_consensus.cc:2955] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:26:03.012383 17296 raft_consensus.cc:993] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7: : Instructing follower bc01179655564f29b83babe396377cbb to start an election
I20260709 12:26:03.013015 17296 raft_consensus.cc:1081] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Signalling peer bc01179655564f29b83babe396377cbb to start an election
I20260709 12:26:03.017014 10979 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2"
dest_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:52828
I20260709 12:26:03.017618 10979 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:03.017987 10979 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:03.028818 10877 catalog_manager.cc:5697] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index -1 to 12, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 17 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:03.054347 17287 tablet_bootstrap.cc:492] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=3 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:03.051842 10979 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:03.064236 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:26:03.064942 11054 raft_consensus.cc:3055] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:03.065310 11054 raft_consensus.cc:740] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:26:03.067019 10979 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:03.069247 17287 tablet_bootstrap.cc:492] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:26:03.070220 17287 ts_tablet_manager.cc:1403] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.578s	user 0.048s	sys 0.013s
I20260709 12:26:03.070617 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:26:03.073309 11678 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:03.066504 11054 consensus_queue.cc:260] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:03.080855 11054 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:03.089557 11054 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 13.
I20260709 12:26:03.091277 10948 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:26:03.092315 17248 raft_consensus.cc:2804] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:03.092829 17248 raft_consensus.cc:697] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 13 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:26:03.093715 17248 consensus_queue.cc:237] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:03.085795 17287 raft_consensus.cc:359] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:26:03.100682 17287 raft_consensus.cc:740] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:26:03.106287 17287 consensus_queue.cc:260] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:26:03.116077 17287 ts_tablet_manager.cc:1434] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 12:26:03.119233 11678 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 13.
I20260709 12:26:03.121228 11144 tablet_copy_service.cc:342] P 7518bdeb78f24e67a530754ae48547eb: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-6506ec2922c24d099538b52b0df81502 received from {username='slave'} at 127.0.0.1:58414
I20260709 12:26:03.121793 11144 tablet_copy_service.cc:434] P 7518bdeb78f24e67a530754ae48547eb: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-6506ec2922c24d099538b52b0df81502 on tablet 6506ec2922c24d099538b52b0df81502 with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:26:03.178690 17287 ts_tablet_manager.cc:933] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:26:03.186546 17287 tablet_copy_client.cc:323] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.194:44483
I20260709 12:26:03.188828 11070 tablet_copy_service.cc:140] P c979ef00e0ad4157b49ebbdc13ce7cd7: Received BeginTabletCopySession request for tablet 227d10a1bcd84a0e9845113d5b0a2495 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:52804)
I20260709 12:26:03.189481 11070 tablet_copy_service.cc:161] P c979ef00e0ad4157b49ebbdc13ce7cd7: Beginning new tablet copy session on tablet 227d10a1bcd84a0e9845113d5b0a2495 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:52804: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-227d10a1bcd84a0e9845113d5b0a2495
I20260709 12:26:03.215775 10877 catalog_manager.cc:5697] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 12 to 13, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 13 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:03.228997 11070 tablet_copy_source_session.cc:215] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:03.236657 17287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 227d10a1bcd84a0e9845113d5b0a2495. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:03.271999 11156 debug-util.cc:398] Leaking SignalData structure 0x7b0800061de0 after lost signal to thread 9802
W20260709 12:26:03.273310 11156 debug-util.cc:398] Leaking SignalData structure 0x7b08001d1600 after lost signal to thread 10916
W20260709 12:26:03.274842 11156 debug-util.cc:398] Leaking SignalData structure 0x7b08000d2920 after lost signal to thread 11009
W20260709 12:26:03.276153 11156 debug-util.cc:398] Leaking SignalData structure 0x7b08001af3c0 after lost signal to thread 11084
W20260709 12:26:03.277410 11156 debug-util.cc:398] Leaking SignalData structure 0x7b080018f000 after lost signal to thread 11159
W20260709 12:26:03.308362 11156 debug-util.cc:398] Leaking SignalData structure 0x7b08003a0ae0 after lost signal to thread 11705
W20260709 12:26:03.308806 11156 debug-util.cc:398] Leaking SignalData structure 0x7b08003fa060 after lost signal to thread 17185
I20260709 12:26:03.367637 17287 tablet_copy_client.cc:806] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:03.368347 17287 tablet_copy_client.cc:670] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:03.381233 11679 raft_consensus.cc:1217] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.10->[18.11-18.11]   Dedup: 18.11->[]
I20260709 12:26:03.395166 17287 tablet_copy_client.cc:538] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:03.462306 17309 tablet_bootstrap.cc:492] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:03.464957 17309 tablet_bootstrap.cc:492] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:26:03.465741 17316 raft_consensus.cc:993] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb: : Instructing follower c979ef00e0ad4157b49ebbdc13ce7cd7 to start an election
I20260709 12:26:03.470569 17316 raft_consensus.cc:1081] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 16 LEADER]: Signalling peer c979ef00e0ad4157b49ebbdc13ce7cd7 to start an election
I20260709 12:26:03.471346 17309 ts_tablet_manager.cc:1403] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.480s	user 0.052s	sys 0.020s
W20260709 12:26:03.472187 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 47504.8us
I20260709 12:26:03.480859 11059 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
 from {username='slave'} at 127.0.0.1:41294
I20260709 12:26:03.481570 11059 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:03.482074 11059 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:03.493577 17309 raft_consensus.cc:359] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:26:03.494556 17309 raft_consensus.cc:740] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:26:03.495286 17309 consensus_queue.cc:260] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:26:03.497779 17309 ts_tablet_manager.cc:1434] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 12:26:03.514698 17329 ts_tablet_manager.cc:933] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:03.536000 11059 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:03.543773 17287 tablet_bootstrap.cc:492] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:26:03.552233 10994 tablet_copy_service.cc:342] P bc01179655564f29b83babe396377cbb: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-f28a3d1504ca450d9efd93115b1164f9 received from {username='slave'} at 127.0.0.1:60928
I20260709 12:26:03.552750 10994 tablet_copy_service.cc:434] P bc01179655564f29b83babe396377cbb: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-f28a3d1504ca450d9efd93115b1164f9 on tablet f28a3d1504ca450d9efd93115b1164f9 with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:26:03.570163 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:26:03.570422 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:26:03.570837 11127 raft_consensus.cc:3055] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:03.571189 11127 raft_consensus.cc:740] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:26:03.572108 11059 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:03.571930 11127 consensus_queue.cc:260] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:03.573100 11127 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:03.570955 11678 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:03.578207 17329 tablet_copy_client.cc:323] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.195:42537
I20260709 12:26:03.580227 11144 tablet_copy_service.cc:140] P 7518bdeb78f24e67a530754ae48547eb: Received BeginTabletCopySession request for tablet 0bb240ba9bd84493aa3cda1c24e646f1 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:58414)
I20260709 12:26:03.580794 11144 tablet_copy_service.cc:161] P 7518bdeb78f24e67a530754ae48547eb: Beginning new tablet copy session on tablet 0bb240ba9bd84493aa3cda1c24e646f1 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:58414: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-0bb240ba9bd84493aa3cda1c24e646f1
I20260709 12:26:03.590457 11144 tablet_copy_source_session.cc:215] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:03.592757 11054 raft_consensus.cc:1275] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:26:03.602317 11127 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 17.
I20260709 12:26:03.604869 11678 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 17.
I20260709 12:26:03.606333 11024 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:26:03.607759 17304 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:03.608357 17304 raft_consensus.cc:697] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:26:03.609275 17304 consensus_queue.cc:237] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:03.615231 17329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bb240ba9bd84493aa3cda1c24e646f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:03.626785 17288 consensus_queue.cc:1048] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:03.692772 11678 raft_consensus.cc:1275] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:26:03.695156 17286 consensus_queue.cc:1048] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:03.708729 10875 catalog_manager.cc:5697] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 16 to 17, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 17 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:03.891606 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 71025.8us
W20260709 12:26:03.884513 17327 log.cc:927] Time spent T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 12:26:03.970280 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 83689.7us
W20260709 12:26:04.013883 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 97659.2us
I20260709 12:26:04.022434 17329 tablet_copy_client.cc:806] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:04.015044 17340 raft_consensus.cc:1064] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:26:04.066599 17287 tablet_bootstrap.cc:492] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:26:04.015341 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 106508us
W20260709 12:26:04.071719 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 186535us
I20260709 12:26:04.109728 17287 tablet_bootstrap.cc:492] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:26:04.110687 17287 ts_tablet_manager.cc:1403] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.567s	user 0.035s	sys 0.020s
I20260709 12:26:04.099013 17329 tablet_copy_client.cc:670] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
W20260709 12:26:04.148213 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 60870.6us
I20260709 12:26:04.173614  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:04.212314 17287 raft_consensus.cc:359] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:26:04.213287 17287 raft_consensus.cc:740] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:26:04.214022 17287 consensus_queue.cc:260] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
W20260709 12:26:04.259182 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 97478.6us
W20260709 12:26:04.264921 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 121001us
I20260709 12:26:04.272861 17287 ts_tablet_manager.cc:1434] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.162s	user 0.008s	sys 0.000s
I20260709 12:26:04.288401 11677 raft_consensus.cc:1275] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:26:04.318779 11677 raft_consensus.cc:1217] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.12->[18.13-18.13]   Dedup: 18.13->[]
I20260709 12:26:04.322019 17329 tablet_copy_client.cc:538] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:26:04.375859 11100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:04.383594 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 267126us
W20260709 12:26:04.390439 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 96964.6us
W20260709 12:26:04.399127 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 92724us
I20260709 12:26:04.378966 17329 tablet_bootstrap.cc:492] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:26:04.405964 11679 raft_consensus.cc:1217] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.9->[15.10-15.10]   Dedup: 15.10->[]
W20260709 12:26:04.410514 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 218049us
I20260709 12:26:04.410346 17367 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
W20260709 12:26:04.459385 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 45815.2us
I20260709 12:26:04.491253 11070 tablet_copy_service.cc:342] P c979ef00e0ad4157b49ebbdc13ce7cd7: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-227d10a1bcd84a0e9845113d5b0a2495 received from {username='slave'} at 127.0.0.1:52804
I20260709 12:26:04.491811 11070 tablet_copy_service.cc:434] P c979ef00e0ad4157b49ebbdc13ce7cd7: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-227d10a1bcd84a0e9845113d5b0a2495 on tablet 227d10a1bcd84a0e9845113d5b0a2495 with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
W20260709 12:26:04.556660 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 47544.8us
I20260709 12:26:04.577713 17340 consensus_queue.cc:237] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 9, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:04.584652 11053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:26:04.585325 11053 raft_consensus.cc:606] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:26:04.590592 10984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98"
dest_uuid: "bc01179655564f29b83babe396377cbb"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:41958
I20260709 12:26:04.591496 10984 raft_consensus.cc:606] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 13 LEADER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
W20260709 12:26:04.598781 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 61112.6us
I20260709 12:26:04.603037 11127 raft_consensus.cc:1275] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:26:04.612816 17157 raft_consensus.cc:993] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7: : Instructing follower bc01179655564f29b83babe396377cbb to start an election
I20260709 12:26:04.613384 17157 raft_consensus.cc:1081] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 LEADER]: Signalling peer bc01179655564f29b83babe396377cbb to start an election
I20260709 12:26:04.620895 10980 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8"
dest_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:52828
I20260709 12:26:04.621537 10980 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:04.621935 10980 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:04.624536  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:04.626487  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:04.637609  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:04.644207 10980 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:04.645129 17376 raft_consensus.cc:993] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb: : Instructing follower 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:26:04.645704 17376 raft_consensus.cc:1081] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 13 LEADER]: Signalling peer 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:26:04.669230 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:26:04.678047 11053 raft_consensus.cc:3055] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:04.678429 11053 raft_consensus.cc:740] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:26:04.678388 17157 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:04.682384 10980 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 19 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:04.683781 11053 consensus_queue.cc:260] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:04.685258 11053 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:04.691035 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:26:04.691715 11130 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:04.693625 11128 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:36576
I20260709 12:26:04.698549 17286 raft_consensus.cc:1064] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:26:04.699864 11128 raft_consensus.cc:493] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:04.700322 11128 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:04.704411 11679 raft_consensus.cc:1275] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEARNER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:26:04.704594 11130 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 19.
I20260709 12:26:04.708508 11054 raft_consensus.cc:1275] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:26:04.716465 10949 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:26:04.717439 17288 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:04.717973 17288 raft_consensus.cc:697] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 19 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:26:04.718901 17288 consensus_queue.cc:237] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:04.723977 10983 raft_consensus.cc:1275] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:26:04.724004 17344 consensus_queue.cc:1048] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:04.737025 11053 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 19.
I20260709 12:26:04.756150 11128 raft_consensus.cc:515] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:04.727435 17378 consensus_queue.cc:1048] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:04.760421 17344 consensus_queue.cc:1048] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:04.773294 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:26:04.774343 10980 raft_consensus.cc:3055] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:04.774672 10980 raft_consensus.cc:740] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:26:04.701311 17286 consensus_queue.cc:237] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:04.777484 10980 consensus_queue.cc:260] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:04.792376 10980 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:04.800774 11128 leader_election.cc:290] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:26:04.828748 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a3074c9b841b6a602953195c8ef98" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:26:04.829346 11059 raft_consensus.cc:3060] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:04.888172 11059 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:26:04.891381 10980 raft_consensus.cc:2468] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 14.
I20260709 12:26:04.938045 11098 leader_election.cc:304] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:26:04.976101 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 85902.3us
W20260709 12:26:05.000754 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 62815.1us
I20260709 12:26:05.180330 17310 raft_consensus.cc:2804] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:26:05.186770 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 74380us
I20260709 12:26:05.180670 17366 raft_consensus.cc:1064] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:26:05.072320 17340 raft_consensus.cc:2955] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
W20260709 12:26:05.188117 17390 log.cc:927] Time spent T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.278s	user 0.002s	sys 0.000s
I20260709 12:26:05.243188 10877 catalog_manager.cc:5697] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 18 to 19, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 19 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:05.205044 17310 raft_consensus.cc:697] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
W20260709 12:26:05.287736 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 81764.5us
I20260709 12:26:05.318948 10980 raft_consensus.cc:2955] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
W20260709 12:26:05.326886 17286 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.019s	sys 0.052s
W20260709 12:26:05.327507 17286 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.019s	sys 0.052s
W20260709 12:26:05.397743 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 50574.2us
I20260709 12:26:05.391330 17310 consensus_queue.cc:237] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:26:05.496348 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 69835.5us
W20260709 12:26:05.560674 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 95820.8us
W20260709 12:26:05.579762 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 78680.4us
I20260709 12:26:05.584327 11053 raft_consensus.cc:1275] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:26:05.626343 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 121808us
W20260709 12:26:05.627380 11024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:05.628008 11127 raft_consensus.cc:1275] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:26:05.628270 17419 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 12:26:05.641973 11057 raft_consensus.cc:1275] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:26:05.636030 17366 consensus_queue.cc:237] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:05.739387 17356 consensus_queue.cc:1048] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 12:26:05.760910 11052 raft_consensus.cc:2955] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
W20260709 12:26:05.772675 17417 log.cc:927] Time spent T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:26:05.821511 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 71864.1us
I20260709 12:26:05.801823 17286 consensus_queue.cc:1048] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:26:05.858560 11675 raft_consensus.cc:1275] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEARNER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:26:05.860744 11677 raft_consensus.cc:2955] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
W20260709 12:26:05.893224 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 55798.3us
W20260709 12:26:05.926601 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 91322.1us
I20260709 12:26:05.932708 17373 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:05.933698 11053 raft_consensus.cc:1275] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:26:05.943807 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 70219.9us
W20260709 12:26:05.945060 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 51047.8us
W20260709 12:26:05.955659 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 61407.6us
I20260709 12:26:05.975793 10874 catalog_manager.cc:5697] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 13 to 14, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 14 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:05.997464 10875 catalog_manager.cc:5697] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 11 to 12, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
W20260709 12:26:06.003942 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 58434.1us
I20260709 12:26:06.018590 10980 raft_consensus.cc:1275] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:26:06.052500 11131 raft_consensus.cc:1275] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:26:06.052659 11673 raft_consensus.cc:1275] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEARNER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:26:06.021831 17396 consensus_queue.cc:1048] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:26:06.056705 17316 consensus_queue.cc:1048] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:06.060963 17366 consensus_queue.cc:1048] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:06.062901 10977 raft_consensus.cc:1275] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:26:06.076244  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:06.092538 17393 consensus_queue.cc:1048] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:26:06.122838 17329 tablet_bootstrap.cc:492] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:06.123886 17329 tablet_bootstrap.cc:492] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:26:06.124655 17329 ts_tablet_manager.cc:1403] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 1.754s	user 0.044s	sys 0.033s
I20260709 12:26:06.126555 17345 consensus_queue.cc:1048] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:26:06.157110 11672 raft_consensus.cc:2955] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:06.163842 17329 raft_consensus.cc:359] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:26:06.164806 17329 raft_consensus.cc:740] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:26:06.165494 17329 consensus_queue.cc:260] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:26:06.196112 17329 ts_tablet_manager.cc:1434] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.000s
I20260709 12:26:06.205235 11144 tablet_copy_service.cc:342] P 7518bdeb78f24e67a530754ae48547eb: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-0bb240ba9bd84493aa3cda1c24e646f1 received from {username='slave'} at 127.0.0.1:58414
I20260709 12:26:06.205736 11144 tablet_copy_service.cc:434] P 7518bdeb78f24e67a530754ae48547eb: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-0bb240ba9bd84493aa3cda1c24e646f1 on tablet 0bb240ba9bd84493aa3cda1c24e646f1 with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:26:06.224582 11052 raft_consensus.cc:2955] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:06.252377 11131 raft_consensus.cc:2955] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:06.256716 17312 raft_consensus.cc:2955] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 13 to 14, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
W20260709 12:26:06.353776 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 45622.2us
W20260709 12:26:06.369287 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 56181.8us
W20260709 12:26:06.378744 17437 log.cc:927] Time spent T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 12:26:06.450346 17438 log.cc:927] Time spent T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 12:26:06.495447 17436 log.cc:927] Time spent T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:26:06.514050 17351 raft_consensus.cc:2955] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:06.536211 11128 raft_consensus.cc:2955] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:06.596431 10983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "820ab313402049dfa58d12167763953e"
dest_uuid: "bc01179655564f29b83babe396377cbb"
mode: GRACEFUL
new_leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
 from {username='slave'} at 127.0.0.1:41958
I20260709 12:26:06.603667 10877 catalog_manager.cc:5697] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 13 to 14, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:06.621649 11676 raft_consensus.cc:2955] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:06.598014 10983 raft_consensus.cc:606] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 17 LEADER]: Received request to transfer leadership to TS 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:26:06.627362 10979 raft_consensus.cc:2955] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:06.660467 10976 consensus_queue.cc:237] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:06.673460 10876 catalog_manager.cc:5697] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index 10 to 11, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:06.682560 11673 raft_consensus.cc:1217] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.11->[17.12-17.12]   Dedup: 17.12->[]
I20260709 12:26:06.688922 11678 raft_consensus.cc:1275] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:26:06.691321 11134 raft_consensus.cc:1275] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:26:06.718262 11134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
mode: GRACEFUL
new_leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
 from {username='slave'} at 127.0.0.1:54492
I20260709 12:26:06.718986 11134 raft_consensus.cc:606] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Received request to transfer leadership to TS c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:06.728922  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:06.730891  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:06.731766  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:06.740022 11056 consensus_queue.cc:237] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:06.768347 11676 raft_consensus.cc:1275] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:26:06.770341 10976 raft_consensus.cc:1275] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:26:06.770362 17449 consensus_queue.cc:1048] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:06.774029 17449 consensus_queue.cc:1048] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:06.782160 17351 raft_consensus.cc:2955] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:06.812083 11676 raft_consensus.cc:2955] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
W20260709 12:26:06.834173 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 82355us
I20260709 12:26:06.850811 17409 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 12:26:06.836035 10976 raft_consensus.cc:2955] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
W20260709 12:26:06.834610 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 68664.9us
I20260709 12:26:06.862089 10867 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 227d10a1bcd84a0e9845113d5b0a2495 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:06.863663 17421 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:06.904093 17421 raft_consensus.cc:993] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb: : Instructing follower 0f3b1ccd8aa5412393aa7eb90f2bef95 to start an election
I20260709 12:26:06.904613 17409 raft_consensus.cc:1081] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 17 LEADER]: Signalling peer 0f3b1ccd8aa5412393aa7eb90f2bef95 to start an election
I20260709 12:26:06.917497 11673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "820ab313402049dfa58d12167763953e"
dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
 from {username='slave'} at 127.0.0.1:41784
I20260709 12:26:06.918249 11673 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:06.918689 11673 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:06.920679 17288 raft_consensus.cc:2955] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 18 LEADER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:06.925630 11676 raft_consensus.cc:2955] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:06.942222 10876 catalog_manager.cc:5697] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index 11 to 12, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New cstate: current_term: 15 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:06.955578 11128 consensus_queue.cc:237] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:06.964179 11673 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:06.980356 11673 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:26:06.982249 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:26:06.983040 11052 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:07.007833 10976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:26:07.008536 10976 raft_consensus.cc:3055] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:07.008836 10976 raft_consensus.cc:740] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:26:07.009930 11121 tablet_service.cc:1558] Processing DeleteTablet for tablet 227d10a1bcd84a0e9845113d5b0a2495 with delete_type TABLET_DATA_TOMBSTONED (TS 7518bdeb78f24e67a530754ae48547eb not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:48956
I20260709 12:26:07.018934 17355 raft_consensus.cc:993] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb: : Instructing follower c979ef00e0ad4157b49ebbdc13ce7cd7 to start an election
I20260709 12:26:07.020246 10976 consensus_queue.cc:260] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:07.022017 10976 raft_consensus.cc:3060] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:07.019585 17355 raft_consensus.cc:1081] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Signalling peer c979ef00e0ad4157b49ebbdc13ce7cd7 to start an election
I20260709 12:26:07.035863 17445 raft_consensus.cc:1064] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:26:07.032029 11052 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 18.
I20260709 12:26:07.040310 10976 raft_consensus.cc:2468] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 18.
I20260709 12:26:07.040937 11056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
 from {username='slave'} at 127.0.0.1:41294
I20260709 12:26:07.041527 11056 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:07.041858 11056 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:07.041740 11128 raft_consensus.cc:2955] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:07.043032 11643 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:26:07.051403 10877 catalog_manager.cc:5697] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 14 to 15, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New cstate: current_term: 18 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:07.068658 11056 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:07.094571 11056 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:07.095335 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:26:07.096122 10983 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:07.066987 17402 raft_consensus.cc:2804] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:07.098387 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37077b3b6d34e6f9558c96b2d955211" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:26:07.099277 11128 raft_consensus.cc:3055] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:07.099625 11128 raft_consensus.cc:740] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:26:07.100363 11128 consensus_queue.cc:260] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:07.102476 17402 raft_consensus.cc:697] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:26:07.106628 11128 raft_consensus.cc:3060] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:07.110834 11673 raft_consensus.cc:1275] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:26:07.121378 11128 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:26:07.122927 17340 consensus_queue.cc:1048] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:07.122864 11025 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:26:07.137372 10976 raft_consensus.cc:1275] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:26:07.130951 17449 raft_consensus.cc:2804] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:07.147091 10866 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f28a3d1504ca450d9efd93115b1164f9 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:07.118356 17445 consensus_queue.cc:237] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:07.146337 17449 raft_consensus.cc:697] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:26:07.142680 17316 consensus_queue.cc:1048] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 12:26:07.162631 17453 tablet_replica.cc:333] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:07.140983 17402 consensus_queue.cc:237] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:07.196507 17449 consensus_queue.cc:237] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:07.218158 10983 raft_consensus.cc:2468] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 15.
I20260709 12:26:07.250717 11047 tablet_service.cc:1558] Processing DeleteTablet for tablet f28a3d1504ca450d9efd93115b1164f9 with delete_type TABLET_DATA_TOMBSTONED (TS c979ef00e0ad4157b49ebbdc13ce7cd7 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:59404
I20260709 12:26:07.283833 17453 raft_consensus.cc:2243] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:07.284873 17453 raft_consensus.cc:2272] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:07.318776 17344 raft_consensus.cc:2955] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:07.339022 17453 ts_tablet_manager.cc:1916] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:07.389001 10876 catalog_manager.cc:5697] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 17 to 18, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 18 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:07.398121 17461 tablet_replica.cc:333] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
W20260709 12:26:07.399307 17456 log.cc:927] Time spent T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:26:07.407713 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 102828us
I20260709 12:26:07.413467 10875 catalog_manager.cc:5697] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 14 to 15, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 15 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.427197 11052 raft_consensus.cc:1275] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:26:07.450048 11673 raft_consensus.cc:1275] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 LEARNER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:26:07.459380 17422 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:07.470681 10976 raft_consensus.cc:2955] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:07.483598 10978 raft_consensus.cc:1275] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:26:07.491073 17464 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:26:07.502645 17461 raft_consensus.cc:2243] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:07.503683 17461 raft_consensus.cc:2272] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:07.511967 17462 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:07.519404 17461 ts_tablet_manager.cc:1916] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:07.521066 11678 raft_consensus.cc:2955] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:07.571951 10876 catalog_manager.cc:5697] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb reported cstate change: config changed from index 12 to 13, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New cstate: current_term: 18 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:07.580968 10868 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6506ec2922c24d099538b52b0df81502 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:07.589916 17453 ts_tablet_manager.cc:1929] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.11
I20260709 12:26:07.603986 17453 log.cc:1199] T 227d10a1bcd84a0e9845113d5b0a2495 P 7518bdeb78f24e67a530754ae48547eb: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-2-root/wals/227d10a1bcd84a0e9845113d5b0a2495
I20260709 12:26:07.606483 10868 catalog_manager.cc:5028] TS 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): tablet 227d10a1bcd84a0e9845113d5b0a2495 (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:26:07.617014 11047 tablet_service.cc:1558] Processing DeleteTablet for tablet 6506ec2922c24d099538b52b0df81502 with delete_type TABLET_DATA_TOMBSTONED (TS c979ef00e0ad4157b49ebbdc13ce7cd7 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:59404
I20260709 12:26:07.676786 17465 raft_consensus.cc:2955] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:07.691605 17461 ts_tablet_manager.cc:1929] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.14
I20260709 12:26:07.693291 17461 log.cc:1199] T f28a3d1504ca450d9efd93115b1164f9 P c979ef00e0ad4157b49ebbdc13ce7cd7: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-1-root/wals/f28a3d1504ca450d9efd93115b1164f9
I20260709 12:26:07.693831 10983 raft_consensus.cc:1275] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:26:07.698683 17449 consensus_queue.cc:1048] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:07.700488 17461 tablet_replica.cc:333] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:07.706275 10867 catalog_manager.cc:5028] TS c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): tablet f28a3d1504ca450d9efd93115b1164f9 (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:26:07.707067 17461 raft_consensus.cc:2243] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:07.708094 17461 raft_consensus.cc:2272] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:07.709793 10976 raft_consensus.cc:2955] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:07.711217 17461 ts_tablet_manager.cc:1916] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:07.724860 10978 raft_consensus.cc:1275] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:26:07.739586 17413 consensus_queue.cc:1048] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:26:07.772329 11054 raft_consensus.cc:2955] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:07.774389 11052 raft_consensus.cc:1275] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:26:07.776147 17413 consensus_queue.cc:1048] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:26:07.784736 10877 catalog_manager.cc:5697] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb reported cstate change: config changed from index 12 to 13, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:07.803114 11678 raft_consensus.cc:2955] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:07.845981 17461 ts_tablet_manager.cc:1929] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.12
I20260709 12:26:07.846593 17461 log.cc:1199] T 6506ec2922c24d099538b52b0df81502 P c979ef00e0ad4157b49ebbdc13ce7cd7: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-1-root/wals/6506ec2922c24d099538b52b0df81502
W20260709 12:26:07.994824 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 143634us
I20260709 12:26:08.040994  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:08.044301 10867 catalog_manager.cc:5028] TS c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): tablet 6506ec2922c24d099538b52b0df81502 (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:26:08.350910 11128 raft_consensus.cc:1275] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:26:08.356714 17475 consensus_queue.cc:1048] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:08.361697 11130 consensus_queue.cc:237] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:08.592543 11678 raft_consensus.cc:1275] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:26:08.604759 11056 raft_consensus.cc:1275] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:26:08.640182 17316 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 12:26:08.650887 17488 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:08.698410 17488 raft_consensus.cc:2955] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:08.724135 11678 raft_consensus.cc:2955] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:08.749181 11056 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:26:08.750129 11056 raft_consensus.cc:606] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:26:08.751852  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:26:08.753769  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:08.755023  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:08.786625 10874 catalog_manager.cc:5697] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 13 to 14, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New cstate: current_term: 17 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:08.790000 11057 raft_consensus.cc:2955] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:08.820534 10868 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0bb240ba9bd84493aa3cda1c24e646f1 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:09.006328 10969 tablet_service.cc:1558] Processing DeleteTablet for tablet 0bb240ba9bd84493aa3cda1c24e646f1 with delete_type TABLET_DATA_TOMBSTONED (TS bc01179655564f29b83babe396377cbb not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:58332
I20260709 12:26:09.036022 17496 tablet_replica.cc:333] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:09.038075 17496 raft_consensus.cc:2243] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:09.047304 17496 raft_consensus.cc:2272] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:09.051443 17496 ts_tablet_manager.cc:1916] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:09.092211 17496 ts_tablet_manager.cc:1929] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.13
I20260709 12:26:09.093084 17496 log.cc:1199] T 0bb240ba9bd84493aa3cda1c24e646f1 P bc01179655564f29b83babe396377cbb: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-0-root/wals/0bb240ba9bd84493aa3cda1c24e646f1
I20260709 12:26:09.095580 10866 catalog_manager.cc:5028] TS bc01179655564f29b83babe396377cbb (127.9.145.193:46777): tablet 0bb240ba9bd84493aa3cda1c24e646f1 (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:26:09.181056 17475 raft_consensus.cc:993] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7: : Instructing follower bc01179655564f29b83babe396377cbb to start an election
I20260709 12:26:09.181774 17475 raft_consensus.cc:1081] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 LEADER]: Signalling peer bc01179655564f29b83babe396377cbb to start an election
I20260709 12:26:09.264070 10976 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945"
dest_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:52828
I20260709 12:26:09.264865 10976 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:09.265552 10976 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:26:09.368168 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 50748.8us
I20260709 12:26:09.389629 10976 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:26:09.391258 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 104975us
I20260709 12:26:09.405085 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:26:09.405805 11057 raft_consensus.cc:3055] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:09.406140 11057 raft_consensus.cc:740] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:26:09.407032 11057 consensus_queue.cc:260] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:09.408179 11057 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:09.450768 10976 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 18 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:09.453927 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:26:09.454576 11131 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:09.463200 11057 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 18.
I20260709 12:26:09.464597 10948 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:26:09.465941 17397 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:09.466617 17397 raft_consensus.cc:697] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 18 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:26:09.467564 17397 consensus_queue.cc:237] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:09.482662 11131 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 18.
I20260709 12:26:09.506458 10877 catalog_manager.cc:5697] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 17 to 18, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 18 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:09.878794 11131 raft_consensus.cc:1275] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:26:09.888736 17480 consensus_queue.cc:1048] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:09.910995 11056 raft_consensus.cc:1275] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:26:09.912806 17480 consensus_queue.cc:1048] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:09.925760  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:10.090473 10976 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e"
dest_uuid: "bc01179655564f29b83babe396377cbb"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:41958
I20260709 12:26:10.104662 10976 raft_consensus.cc:606] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 17 LEADER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:26:10.107820  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:26:10.109643  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:10.110530  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:10.201406 17397 raft_consensus.cc:993] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb: : Instructing follower 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:26:10.202061 17397 raft_consensus.cc:1081] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 17 LEADER]: Signalling peer 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:26:10.204613 11131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:36576
I20260709 12:26:10.205219 11131 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:10.205560 11131 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:10.222158 11131 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:10.224285 11131 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:10.225812 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:26:10.226485 11676 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:10.233253 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:26:10.233959 10980 raft_consensus.cc:3055] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:10.234289 10980 raft_consensus.cc:740] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:26:10.235129 10980 consensus_queue.cc:260] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:10.236510 10980 raft_consensus.cc:3060] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:10.243773 11676 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 18.
I20260709 12:26:10.254717 11098 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:26:10.255620 17316 raft_consensus.cc:2804] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:10.256155 17316 raft_consensus.cc:697] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 18 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:26:10.257045 17316 consensus_queue.cc:237] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:10.257431 10980 raft_consensus.cc:2468] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 18.
I20260709 12:26:10.371809 11130 consensus_queue.cc:237] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:26:10.372066 10876 catalog_manager.cc:5697] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 17 to 18, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 18 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:10.429037 10976 raft_consensus.cc:1275] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:26:10.430872 17344 consensus_queue.cc:1048] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:10.462755 11052 raft_consensus.cc:1275] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:26:10.486488 11098 consensus_peers.cc:597] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8383ba7a20f343a2bf66fc93ad293a56. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:10.489807 17344 consensus_queue.cc:1048] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:10.505992 17487 raft_consensus.cc:2955] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:26:10.515326 10980 raft_consensus.cc:2955] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:26:10.524947 11057 raft_consensus.cc:2955] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:26:10.544529 10876 catalog_manager.cc:5697] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb reported cstate change: config changed from index -1 to 11, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 17 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:26:10.566601 10980 consensus_queue.cc:237] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
W20260709 12:26:10.582139 10948 consensus_peers.cc:597] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5635e70df91d469ca24e987e2a28c27d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:10.591393 11125 raft_consensus.cc:1275] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:26:10.593386 17409 consensus_queue.cc:1048] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:10.593869 11057 raft_consensus.cc:1275] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:26:10.599428 17409 consensus_queue.cc:1048] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:10.639781 17409 raft_consensus.cc:2955] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:26:10.641083 11057 raft_consensus.cc:2955] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:26:10.648542 11130 raft_consensus.cc:2955] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:26:10.677003 10977 consensus_queue.cc:237] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:26:10.665776 10876 catalog_manager.cc:5697] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index -1 to 11, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 16 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:26:10.711978 11131 raft_consensus.cc:1275] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:26:10.715087 10948 consensus_peers.cc:597] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c5ceb1aa25414d24b15ed1bff03f40c4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:10.716249 17409 consensus_queue.cc:1048] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:10.717325 11057 raft_consensus.cc:1275] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:26:10.719815 17397 consensus_queue.cc:1048] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:10.761495 10980 raft_consensus.cc:1275] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:26:10.762982 17487 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:10.831228 17526 ts_tablet_manager.cc:933] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:10.854700 11676 raft_consensus.cc:1275] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:26:10.856873 17316 consensus_queue.cc:1048] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:10.856345 17480 raft_consensus.cc:2955] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:26:10.862236 17526 tablet_copy_client.cc:323] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.195:42537
I20260709 12:26:10.874397 11144 tablet_copy_service.cc:140] P 7518bdeb78f24e67a530754ae48547eb: Received BeginTabletCopySession request for tablet 8383ba7a20f343a2bf66fc93ad293a56 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:58414)
I20260709 12:26:10.874997 11144 tablet_copy_service.cc:161] P 7518bdeb78f24e67a530754ae48547eb: Beginning new tablet copy session on tablet 8383ba7a20f343a2bf66fc93ad293a56 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:58414: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-8383ba7a20f343a2bf66fc93ad293a56
I20260709 12:26:10.891393 11125 raft_consensus.cc:2955] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:26:10.900430 11144 tablet_copy_source_session.cc:215] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:10.903966 17526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8383ba7a20f343a2bf66fc93ad293a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:10.909757 11057 raft_consensus.cc:2955] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:26:10.919767 11131 consensus_queue.cc:237] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:26:10.945779 10876 catalog_manager.cc:5697] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index -1 to 10, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 16 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:26:11.006070 11057 raft_consensus.cc:1275] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:26:11.024025 17344 consensus_queue.cc:1048] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:11.104629 10980 raft_consensus.cc:1275] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:26:11.121245 11098 consensus_peers.cc:597] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 839b2afaa86144938bdfb973011c3303. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:11.102872 17526 tablet_copy_client.cc:806] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:11.139453 17538 raft_consensus.cc:2955] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
W20260709 12:26:11.171487 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 50969.3us
I20260709 12:26:11.129966 17526 tablet_copy_client.cc:670] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:11.186756 17542 consensus_queue.cc:1048] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:11.210969 17526 tablet_copy_client.cc:538] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:26:11.229631 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 65028.6us
W20260709 12:26:11.237458 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 73558.4us
I20260709 12:26:11.242842 10876 catalog_manager.cc:5697] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index -1 to 9, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 12 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:11.284694 17549 ts_tablet_manager.cc:933] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
I20260709 12:26:11.285576  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:11.266985 11057 raft_consensus.cc:2955] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:26:11.286842 10980 raft_consensus.cc:2955] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:26:11.367913 17526 tablet_bootstrap.cc:492] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:26:11.395406 17555 ts_tablet_manager.cc:933] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777)
W20260709 12:26:11.397589 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 93692.6us
W20260709 12:26:11.402947 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 107876us
I20260709 12:26:11.402521 17549 tablet_copy_client.cc:323] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.193:46777
W20260709 12:26:11.419545 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 81692.8us
I20260709 12:26:11.438376 10994 tablet_copy_service.cc:140] P bc01179655564f29b83babe396377cbb: Received BeginTabletCopySession request for tablet 5635e70df91d469ca24e987e2a28c27d from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:60928)
I20260709 12:26:11.438978 10994 tablet_copy_service.cc:161] P bc01179655564f29b83babe396377cbb: Beginning new tablet copy session on tablet 5635e70df91d469ca24e987e2a28c27d from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:60928: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-5635e70df91d469ca24e987e2a28c27d
I20260709 12:26:11.476034 10994 tablet_copy_source_session.cc:215] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:11.498803 17549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5635e70df91d469ca24e987e2a28c27d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:11.490939 17555 tablet_copy_client.cc:323] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.193:46777
I20260709 12:26:11.546471 10994 tablet_copy_service.cc:140] P bc01179655564f29b83babe396377cbb: Received BeginTabletCopySession request for tablet c5ceb1aa25414d24b15ed1bff03f40c4 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:60928)
I20260709 12:26:11.547675 10994 tablet_copy_service.cc:161] P bc01179655564f29b83babe396377cbb: Beginning new tablet copy session on tablet c5ceb1aa25414d24b15ed1bff03f40c4 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:60928: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-c5ceb1aa25414d24b15ed1bff03f40c4
I20260709 12:26:11.556703 10994 tablet_copy_source_session.cc:215] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:11.589407 17555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5ceb1aa25414d24b15ed1bff03f40c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:11.595626 17549 tablet_copy_client.cc:806] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:11.597630 17549 tablet_copy_client.cc:670] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:11.598052 11128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "709d2903489748c8a8490194704bc3ca"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
mode: GRACEFUL
new_leader_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:54492
I20260709 12:26:11.598749 11128 raft_consensus.cc:606] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 20 LEADER]: Received request to transfer leadership to TS bc01179655564f29b83babe396377cbb
I20260709 12:26:11.600705  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:26:11.602492  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:11.603324  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:11.635851 17549 tablet_copy_client.cc:538] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:11.742916 17553 raft_consensus.cc:993] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb: : Instructing follower bc01179655564f29b83babe396377cbb to start an election
I20260709 12:26:11.743669 17316 raft_consensus.cc:1081] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 20 LEADER]: Signalling peer bc01179655564f29b83babe396377cbb to start an election
I20260709 12:26:11.745961 10976 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "709d2903489748c8a8490194704bc3ca"
dest_uuid: "bc01179655564f29b83babe396377cbb"
 from {username='slave'} at 127.0.0.1:52820
I20260709 12:26:11.746639 10976 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:11.747061 10976 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:11.867236 10976 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:11.870142 17549 tablet_bootstrap.cc:492] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
W20260709 12:26:11.866917 17526 log.cc:927] Time spent T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:26:11.885015 10976 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 21 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:11.885437 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:26:11.887122 11057 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:11.910740 17561 ts_tablet_manager.cc:933] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:11.886966 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:26:11.914340 11128 raft_consensus.cc:3055] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:11.914778 11128 raft_consensus.cc:740] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:26:11.920656 11057 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 21.
I20260709 12:26:11.922353 10948 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:26:11.924435 17540 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:11.928553 17540 raft_consensus.cc:697] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 21 LEADER]: Becoming Leader. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:26:11.929502 17540 consensus_queue.cc:237] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:11.923509 11128 consensus_queue.cc:260] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:11.940770 11128 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:11.980288 11128 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01179655564f29b83babe396377cbb in term 21.
I20260709 12:26:11.987926 17555 tablet_copy_client.cc:806] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:11.988592 17555 tablet_copy_client.cc:670] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:11.984251 17561 tablet_copy_client.cc:323] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.195:42537
I20260709 12:26:11.991439 11144 tablet_copy_service.cc:140] P 7518bdeb78f24e67a530754ae48547eb: Received BeginTabletCopySession request for tablet 839b2afaa86144938bdfb973011c3303 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:58414)
I20260709 12:26:11.992005 11144 tablet_copy_service.cc:161] P 7518bdeb78f24e67a530754ae48547eb: Beginning new tablet copy session on tablet 839b2afaa86144938bdfb973011c3303 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:58414: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-839b2afaa86144938bdfb973011c3303
I20260709 12:26:11.985584 10876 catalog_manager.cc:5697] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb reported cstate change: term changed from 20 to 21, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to bc01179655564f29b83babe396377cbb (127.9.145.193). New cstate: current_term: 21 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.012326 17555 tablet_copy_client.cc:538] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:12.027530 11144 tablet_copy_source_session.cc:215] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:12.031975 17561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 839b2afaa86144938bdfb973011c3303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:12.036284 17555 tablet_bootstrap.cc:492] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:26:12.164309 17526 tablet_bootstrap.cc:492] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.165356 17526 tablet_bootstrap.cc:492] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:26:12.182323 17526 ts_tablet_manager.cc:1403] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.815s	user 0.044s	sys 0.019s
I20260709 12:26:12.205169 17526 raft_consensus.cc:359] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:26:12.212244 17526 raft_consensus.cc:740] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:26:12.213231 17526 consensus_queue.cc:260] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:26:12.216209 17526 ts_tablet_manager.cc:1434] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:26:12.230665 17561 tablet_copy_client.cc:806] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:12.232772 11144 tablet_copy_service.cc:342] P 7518bdeb78f24e67a530754ae48547eb: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-8383ba7a20f343a2bf66fc93ad293a56 received from {username='slave'} at 127.0.0.1:58414
I20260709 12:26:12.233335 11144 tablet_copy_service.cc:434] P 7518bdeb78f24e67a530754ae48547eb: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-8383ba7a20f343a2bf66fc93ad293a56 on tablet 8383ba7a20f343a2bf66fc93ad293a56 with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:26:12.237964 17561 tablet_copy_client.cc:670] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:12.254498 17561 tablet_copy_client.cc:538] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:12.264168 17561 tablet_bootstrap.cc:492] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:26:12.353962 11125 raft_consensus.cc:1275] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 21 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:26:12.356096 17522 consensus_queue.cc:1048] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:12.437842 11677 raft_consensus.cc:1217] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.10->[17.11-17.11]   Dedup: 17.11->[]
I20260709 12:26:12.510947 17555 tablet_bootstrap.cc:492] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.511966 17555 tablet_bootstrap.cc:492] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:26:12.512748 17555 ts_tablet_manager.cc:1403] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.477s	user 0.045s	sys 0.014s
I20260709 12:26:12.518817 11057 raft_consensus.cc:1275] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 21 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:26:12.520960 17546 consensus_queue.cc:1048] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:12.543780 17549 tablet_bootstrap.cc:492] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=3 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.544909 17549 tablet_bootstrap.cc:492] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:26:12.545756 17549 ts_tablet_manager.cc:1403] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.676s	user 0.058s	sys 0.008s
I20260709 12:26:12.554013 17549 raft_consensus.cc:359] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:26:12.555105 17549 raft_consensus.cc:740] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:26:12.555951 17549 consensus_queue.cc:260] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:26:12.610713 17555 raft_consensus.cc:359] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:26:12.611609 17555 raft_consensus.cc:740] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:26:12.612267 17555 consensus_queue.cc:260] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:26:12.636633 17549 ts_tablet_manager.cc:1434] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.091s	user 0.012s	sys 0.004s
I20260709 12:26:12.638486 10994 tablet_copy_service.cc:342] P bc01179655564f29b83babe396377cbb: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-5635e70df91d469ca24e987e2a28c27d received from {username='slave'} at 127.0.0.1:60928
I20260709 12:26:12.638954 10994 tablet_copy_service.cc:434] P bc01179655564f29b83babe396377cbb: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-5635e70df91d469ca24e987e2a28c27d on tablet 5635e70df91d469ca24e987e2a28c27d with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:26:12.643944 17555 ts_tablet_manager.cc:1434] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.131s	user 0.005s	sys 0.005s
I20260709 12:26:12.645915 10994 tablet_copy_service.cc:342] P bc01179655564f29b83babe396377cbb: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-c5ceb1aa25414d24b15ed1bff03f40c4 received from {username='slave'} at 127.0.0.1:60928
I20260709 12:26:12.646369 10994 tablet_copy_service.cc:434] P bc01179655564f29b83babe396377cbb: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-c5ceb1aa25414d24b15ed1bff03f40c4 on tablet c5ceb1aa25414d24b15ed1bff03f40c4 with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:26:12.650893 11677 raft_consensus.cc:1217] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.9->[16.10-16.10]   Dedup: 16.10->[]
I20260709 12:26:12.664804 17561 tablet_bootstrap.cc:492] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.665788 17561 tablet_bootstrap.cc:492] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:26:12.682780 17561 ts_tablet_manager.cc:1403] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.419s	user 0.037s	sys 0.007s
I20260709 12:26:12.690770 17561 raft_consensus.cc:359] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:26:12.692770 17561 raft_consensus.cc:740] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
I20260709 12:26:12.693461 17561 consensus_queue.cc:260] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:26:12.726744 17561 ts_tablet_manager.cc:1434] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.002s
I20260709 12:26:12.729115 11144 tablet_copy_service.cc:342] P 7518bdeb78f24e67a530754ae48547eb: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-839b2afaa86144938bdfb973011c3303 received from {username='slave'} at 127.0.0.1:58414
I20260709 12:26:12.729588 11144 tablet_copy_service.cc:434] P 7518bdeb78f24e67a530754ae48547eb: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-839b2afaa86144938bdfb973011c3303 on tablet 839b2afaa86144938bdfb973011c3303 with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:26:12.875789  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:12.893455 11677 raft_consensus.cc:1217] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
I20260709 12:26:12.970813 10980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee"
dest_uuid: "bc01179655564f29b83babe396377cbb"
mode: GRACEFUL
new_leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
 from {username='slave'} at 127.0.0.1:41958
I20260709 12:26:12.971438 10980 raft_consensus.cc:606] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 17 LEADER]: Received request to transfer leadership to TS c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:12.978286  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:26:12.980176  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:12.986896  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:13.006721 17557 raft_consensus.cc:1064] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:26:13.009723 17557 consensus_queue.cc:237] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:13.033350 17546 raft_consensus.cc:993] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb: : Instructing follower c979ef00e0ad4157b49ebbdc13ce7cd7 to start an election
I20260709 12:26:13.034053 17522 raft_consensus.cc:1081] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 17 LEADER]: Signalling peer c979ef00e0ad4157b49ebbdc13ce7cd7 to start an election
I20260709 12:26:13.035984 11055 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
 from {username='slave'} at 127.0.0.1:41302
I20260709 12:26:13.036568 11055 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:13.036928 11055 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:26:13.047516 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 51033.2us
I20260709 12:26:13.045619 11055 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:13.060284 11055 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 18 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:13.062134 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:26:13.062767 10980 raft_consensus.cc:3055] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:13.063057 10980 raft_consensus.cc:740] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bc01179655564f29b83babe396377cbb, State: Running, Role: LEADER
I20260709 12:26:13.064064 10980 consensus_queue.cc:260] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:13.065774 10980 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:13.069231 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b1fe8f9f246d791d03da03e5c44ee" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:26:13.069904 11672 raft_consensus.cc:3060] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:13.095144 11672 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 18.
I20260709 12:26:13.096613 11024 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:26:13.098373 17498 raft_consensus.cc:2804] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:13.098898 17498 raft_consensus.cc:697] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:26:13.099763 17498 consensus_queue.cc:237] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:13.095162 17397 raft_consensus.cc:1064] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:26:13.112593 10980 raft_consensus.cc:2468] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 18.
I20260709 12:26:13.117204 17397 consensus_queue.cc:237] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 8, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:13.123055 11057 raft_consensus.cc:1275] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:26:13.121083 10877 catalog_manager.cc:5697] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 17 to 18, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 18 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:13.136775 10980 raft_consensus.cc:1275] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:26:13.145663 17316 consensus_queue.cc:1048] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:13.161161 11672 raft_consensus.cc:1275] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 LEARNER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:26:13.163793 11672 raft_consensus.cc:1217] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.8->[12.9-12.9]   Dedup: 12.9->[]
I20260709 12:26:13.175235 17316 consensus_queue.cc:1048] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:13.176553 17557 consensus_queue.cc:1048] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:13.186306 11677 raft_consensus.cc:1275] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEARNER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:26:13.186712 11055 raft_consensus.cc:1275] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:26:13.188704 17546 consensus_queue.cc:1048] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:13.190222 17480 consensus_queue.cc:1048] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:13.208675 11125 raft_consensus.cc:1275] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:26:13.248075 17397 consensus_queue.cc:1048] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:13.288100 17557 raft_consensus.cc:2955] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:13.291508 17397 raft_consensus.cc:2955] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:13.295935 11677 raft_consensus.cc:2955] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:13.320181 11059 raft_consensus.cc:2955] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:13.381064 10877 catalog_manager.cc:5697] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index 11 to 12, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:13.383834 11057 raft_consensus.cc:2955] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:13.399497 10875 catalog_manager.cc:5697] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 10 to 11, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:13.418629 11677 raft_consensus.cc:2955] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
W20260709 12:26:13.425230 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 73204.3us
I20260709 12:26:13.440582 10980 raft_consensus.cc:2955] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:13.443384 11125 raft_consensus.cc:2955] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:13.459124 17597 raft_consensus.cc:1064] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:26:13.469458 17597 consensus_queue.cc:237] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:13.500784 11057 raft_consensus.cc:1275] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:26:13.501331 11676 raft_consensus.cc:1275] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEARNER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:26:13.502899 17480 consensus_queue.cc:1048] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:13.504773 17480 consensus_queue.cc:1048] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:13.511900 10980 raft_consensus.cc:1275] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:26:13.513556 17498 consensus_queue.cc:1048] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:13.584019 10976 consensus_queue.cc:237] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:13.595448 11677 raft_consensus.cc:1275] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:26:13.597203 17595 consensus_queue.cc:1048] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:13.610658 11128 raft_consensus.cc:1275] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:26:13.612044 11125 consensus_queue.cc:237] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:13.625424 11676 raft_consensus.cc:1275] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:26:13.629338 11125 raft_consensus.cc:1275] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:26:13.630877 17595 consensus_queue.cc:1048] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:13.632855 17480 consensus_queue.cc:1048] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:13.638341 11676 raft_consensus.cc:2955] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:13.640959 17559 consensus_queue.cc:1048] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:13.656301 17480 raft_consensus.cc:2955] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:13.667550 11057 raft_consensus.cc:2955] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
W20260709 12:26:13.692838 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 55620.9us
W20260709 12:26:13.718638 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 44881.5us
W20260709 12:26:13.739966 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 91696.7us
I20260709 12:26:13.724046 11672 raft_consensus.cc:2955] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:13.660430 17595 raft_consensus.cc:2955] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:13.775020 10874 catalog_manager.cc:5697] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index 11 to 12, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:13.850092 11125 raft_consensus.cc:2955] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } attrs { replace: true } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
W20260709 12:26:13.862310 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 127022us
I20260709 12:26:13.866461 10875 catalog_manager.cc:5697] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 11 to 12, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New cstate: current_term: 16 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
W20260709 12:26:13.942348 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 61130.3us
I20260709 12:26:13.940918 11128 raft_consensus.cc:2955] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:13.955511 11057 raft_consensus.cc:1275] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:26:14.004129 11677 raft_consensus.cc:1275] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:26:14.023128 11047 tablet_service.cc:1558] Processing DeleteTablet for tablet c5ceb1aa25414d24b15ed1bff03f40c4 with delete_type TABLET_DATA_TOMBSTONED (TS c979ef00e0ad4157b49ebbdc13ce7cd7 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:59404
W20260709 12:26:14.026592 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 69917.2us
I20260709 12:26:14.068282 17618 consensus_queue.cc:1048] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 12:26:14.103176 17604 raft_consensus.cc:1064] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:26:14.109333  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:14.105649 17604 consensus_queue.cc:237] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:14.158645 10866 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c5ceb1aa25414d24b15ed1bff03f40c4 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:14.178061 17630 tablet_replica.cc:333] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:14.195494 10980 raft_consensus.cc:1275] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:26:14.209532 17619 consensus_queue.cc:1048] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:14.216539 10983 consensus_queue.cc:237] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:14.234318 11676 raft_consensus.cc:1275] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:26:14.234402 11059 raft_consensus.cc:1275] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Refusing update from remote peer bc01179655564f29b83babe396377cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:26:14.253919 17397 consensus_queue.cc:1048] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:14.258188 17597 consensus_queue.cc:1048] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:26:14.266250 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 183710us
I20260709 12:26:14.278898 11059 raft_consensus.cc:1275] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:26:14.280177 17397 raft_consensus.cc:2955] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:14.281659 17630 raft_consensus.cc:2243] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:14.282678 17630 raft_consensus.cc:2272] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.289633 11057 raft_consensus.cc:2955] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:14.290942 17604 consensus_queue.cc:1048] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:14.316864 17630 ts_tablet_manager.cc:1916] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:14.328289 11677 raft_consensus.cc:1275] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEARNER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:26:14.331542 17591 raft_consensus.cc:2955] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:14.335556 17604 consensus_queue.cc:1048] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:14.348044 11059 raft_consensus.cc:2955] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:14.350039 10866 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5635e70df91d469ca24e987e2a28c27d with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:14.350636 17604 consensus_queue.cc:1048] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:14.369688 10877 catalog_manager.cc:5697] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb reported cstate change: config changed from index 12 to 13, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New cstate: current_term: 16 leader_uuid: "bc01179655564f29b83babe396377cbb" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:14.382316 11676 raft_consensus.cc:2955] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:14.386341 10868 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8383ba7a20f343a2bf66fc93ad293a56 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:14.399786 10875 catalog_manager.cc:5697] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index 12 to 13, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New cstate: current_term: 17 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:14.407042 11121 tablet_service.cc:1558] Processing DeleteTablet for tablet 5635e70df91d469ca24e987e2a28c27d with delete_type TABLET_DATA_TOMBSTONED (TS 7518bdeb78f24e67a530754ae48547eb not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:48956
I20260709 12:26:14.427855 17634 tablet_replica.cc:333] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:14.446328 11672 raft_consensus.cc:2955] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:14.453995 17604 raft_consensus.cc:2955] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:14.459288 10969 tablet_service.cc:1558] Processing DeleteTablet for tablet 8383ba7a20f343a2bf66fc93ad293a56 with delete_type TABLET_DATA_TOMBSTONED (TS bc01179655564f29b83babe396377cbb not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:58332
I20260709 12:26:14.474732 11055 raft_consensus.cc:2955] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:14.558277 17634 raft_consensus.cc:2243] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:14.576495 17634 raft_consensus.cc:2272] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.492139 10980 raft_consensus.cc:2955] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:14.597851 11057 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75"
dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
mode: GRACEFUL
new_leader_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:53272
I20260709 12:26:14.601790 11057 raft_consensus.cc:606] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Received request to transfer leadership to TS 7518bdeb78f24e67a530754ae48547eb
I20260709 12:26:14.599912 10874 catalog_manager.cc:5697] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: config changed from index 9 to 10, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:14.630262 17634 ts_tablet_manager.cc:1916] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:14.642938 17636 tablet_replica.cc:333] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:14.644150 17636 raft_consensus.cc:2243] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:14.644909 17636 raft_consensus.cc:2272] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.658692 17628 raft_consensus.cc:993] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7: : Instructing follower 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:26:14.659536 17628 raft_consensus.cc:1081] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Signalling peer 7518bdeb78f24e67a530754ae48547eb to start an election
I20260709 12:26:14.660197 17636 ts_tablet_manager.cc:1916] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:14.661466 11131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
 from {username='slave'} at 127.0.0.1:36582
I20260709 12:26:14.662209 11131 raft_consensus.cc:493] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:14.662621 11131 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:14.668463  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:26:14.673290 11677 raft_consensus.cc:2955] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } attrs { replace: true } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:14.681648 17634 ts_tablet_manager.cc:1929] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.12
I20260709 12:26:14.682307 17634 log.cc:1199] T 5635e70df91d469ca24e987e2a28c27d P 7518bdeb78f24e67a530754ae48547eb: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-2-root/wals/5635e70df91d469ca24e987e2a28c27d
I20260709 12:26:14.684612  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:14.685549  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:14.692590 11130 consensus_queue.cc:237] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:14.718132 11678 raft_consensus.cc:1275] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:26:14.716753 10868 catalog_manager.cc:5028] TS 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): tablet 5635e70df91d469ca24e987e2a28c27d (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:26:14.729652 17596 consensus_queue.cc:1048] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:14.728902 11131 raft_consensus.cc:515] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:14.739980 17548 raft_consensus.cc:2955] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:14.742002 10980 raft_consensus.cc:1275] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:26:14.741822 11677 raft_consensus.cc:2955] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:14.746430 17605 consensus_queue.cc:1048] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:14.755000 10980 raft_consensus.cc:2955] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:14.761312 17630 ts_tablet_manager.cc:1929] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.11
I20260709 12:26:14.762410 17630 log.cc:1199] T c5ceb1aa25414d24b15ed1bff03f40c4 P c979ef00e0ad4157b49ebbdc13ce7cd7: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-1-root/wals/c5ceb1aa25414d24b15ed1bff03f40c4
I20260709 12:26:14.776494 10867 catalog_manager.cc:5028] TS c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): tablet c5ceb1aa25414d24b15ed1bff03f40c4 (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:26:14.788259 10868 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 839b2afaa86144938bdfb973011c3303 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:14.787006 10877 catalog_manager.cc:5697] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: config changed from index 10 to 11, VOTER c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) evicted. New cstate: current_term: 12 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:14.811225 11131 leader_election.cc:290] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:26:14.812563 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:26:14.813200 11055 raft_consensus.cc:3055] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:14.813504 11055 raft_consensus.cc:740] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:26:14.814254 11055 consensus_queue.cc:260] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:14.815402 11047 tablet_service.cc:1558] Processing DeleteTablet for tablet 839b2afaa86144938bdfb973011c3303 with delete_type TABLET_DATA_TOMBSTONED (TS c979ef00e0ad4157b49ebbdc13ce7cd7 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:59404
I20260709 12:26:14.815615 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1c6709dd7d464db6e30b204580fe75" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:26:14.816197 10980 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:14.816455 11055 raft_consensus.cc:3060] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:14.816841 17630 tablet_replica.cc:333] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:14.831279 10980 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 15.
I20260709 12:26:14.832697 11097 leader_election.cc:304] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:26:14.836290 17548 raft_consensus.cc:2804] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:14.836826 17548 raft_consensus.cc:697] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 15 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:26:14.837728 17548 consensus_queue.cc:237] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:14.848989 17636 ts_tablet_manager.cc:1929] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.12
I20260709 12:26:14.849514 17636 log.cc:1199] T 8383ba7a20f343a2bf66fc93ad293a56 P bc01179655564f29b83babe396377cbb: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-0-root/wals/8383ba7a20f343a2bf66fc93ad293a56
I20260709 12:26:14.851378 10866 catalog_manager.cc:5028] TS bc01179655564f29b83babe396377cbb (127.9.145.193:46777): tablet 8383ba7a20f343a2bf66fc93ad293a56 (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:26:14.852577 11055 raft_consensus.cc:2468] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 15.
I20260709 12:26:14.856580 17630 raft_consensus.cc:2243] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:14.857695 17630 raft_consensus.cc:2272] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.863698 17630 ts_tablet_manager.cc:1916] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:14.895768 10877 catalog_manager.cc:5697] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 14 to 15, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 15 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:14.917201 17630 ts_tablet_manager.cc:1929] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.10
I20260709 12:26:14.917676 17630 log.cc:1199] T 839b2afaa86144938bdfb973011c3303 P c979ef00e0ad4157b49ebbdc13ce7cd7: Deleting WAL directory at /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599719482688-9799-0/minicluster-data/ts-1-root/wals/839b2afaa86144938bdfb973011c3303
I20260709 12:26:14.919485 10867 catalog_manager.cc:5028] TS c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): tablet 839b2afaa86144938bdfb973011c3303 (table test-workload [id=6c1ad9fda193480d8bac2d4bb1c64b94]) successfully deleted
I20260709 12:26:15.277782 11055 raft_consensus.cc:1275] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:26:15.279425 17605 consensus_queue.cc:1048] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:15.385834 10980 raft_consensus.cc:1275] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:26:15.394981 17605 consensus_queue.cc:1048] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:26:15.753487  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:15.909492 11130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6506ec2922c24d099538b52b0df81502"
dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
mode: GRACEFUL
new_leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
 from {username='slave'} at 127.0.0.1:54492
I20260709 12:26:15.910151 11130 raft_consensus.cc:606] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 18 LEADER]: Received request to transfer leadership to TS 0f3b1ccd8aa5412393aa7eb90f2bef95
I20260709 12:26:15.926373  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:26:15.927934  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:15.928611  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:16.037210 11059 consensus_queue.cc:237] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:26:16.069878 17548 raft_consensus.cc:993] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb: : Instructing follower 0f3b1ccd8aa5412393aa7eb90f2bef95 to start an election
I20260709 12:26:16.070488 17548 raft_consensus.cc:1081] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 18 LEADER]: Signalling peer 0f3b1ccd8aa5412393aa7eb90f2bef95 to start an election
I20260709 12:26:16.072523 11677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6506ec2922c24d099538b52b0df81502"
dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
 from {username='slave'} at 127.0.0.1:41774
I20260709 12:26:16.073127 11677 raft_consensus.cc:493] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:16.073477 11677 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:16.098733 11677 raft_consensus.cc:515] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:16.102604 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "bc01179655564f29b83babe396377cbb"
I20260709 12:26:16.103246 10983 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:16.119719 10983 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 19.
I20260709 12:26:16.121166 11643 leader_election.cc:304] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb; no voters: 
I20260709 12:26:16.122643 17614 raft_consensus.cc:2804] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:16.123365 17614 raft_consensus.cc:697] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:26:16.124349 17614 consensus_queue.cc:237] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:16.137130 10980 raft_consensus.cc:1275] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:26:16.138209 11125 raft_consensus.cc:1275] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:26:16.139871 17628 consensus_queue.cc:1048] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:16.141258 17622 consensus_queue.cc:1048] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:16.147017 11677 leader_election.cc:290] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:26:16.147558 11024 consensus_peers.cc:597] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197): Couldn't send request to peer 0f3b1ccd8aa5412393aa7eb90f2bef95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9824def13ff74f65931445e01ea9cb84. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:16.159480 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6506ec2922c24d099538b52b0df81502" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:26:16.160182 11130 raft_consensus.cc:3055] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:16.160472 11130 raft_consensus.cc:740] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:26:16.161178 11130 consensus_queue.cc:260] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:16.162249 11130 raft_consensus.cc:3060] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:16.171964 11130 raft_consensus.cc:2468] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 19.
I20260709 12:26:16.184784 10877 catalog_manager.cc:5697] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 18 to 19, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 19 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:16.187968 17628 raft_consensus.cc:2955] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 LEADER]: Committing config change with OpId 16.9: config changed from index -1 to 9, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:26:16.194518 10983 raft_consensus.cc:2955] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Committing config change with OpId 16.9: config changed from index -1 to 9, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:26:16.205060 11125 raft_consensus.cc:2955] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Committing config change with OpId 16.9: config changed from index -1 to 9, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:26:16.248869 10874 catalog_manager.cc:5697] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb reported cstate change: config changed from index -1 to 9, NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) added. New cstate: current_term: 16 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } } }
I20260709 12:26:16.539280 10983 raft_consensus.cc:1275] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:26:16.555342 17623 consensus_queue.cc:1048] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:26:16.621368 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 68898.1us
W20260709 12:26:16.673586 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 64799.3us
I20260709 12:26:16.694514 11131 raft_consensus.cc:1275] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:26:16.744474 17663 consensus_queue.cc:1048] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:26:16.767222 10948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 47308.7us
I20260709 12:26:16.771183 17664 ts_tablet_manager.cc:933] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Initiating tablet copy from peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:26:16.786559 17664 tablet_copy_client.cc:323] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Beginning tablet copy session from remote peer at address 127.9.145.194:44483
W20260709 12:26:16.838858 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 49519.1us
I20260709 12:26:16.874637 11070 tablet_copy_service.cc:140] P c979ef00e0ad4157b49ebbdc13ce7cd7: Received BeginTabletCopySession request for tablet 9824def13ff74f65931445e01ea9cb84 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 ({username='slave'} at 127.0.0.1:52804)
I20260709 12:26:16.875252 11070 tablet_copy_service.cc:161] P c979ef00e0ad4157b49ebbdc13ce7cd7: Beginning new tablet copy session on tablet 9824def13ff74f65931445e01ea9cb84 from peer 0f3b1ccd8aa5412393aa7eb90f2bef95 at {username='slave'} at 127.0.0.1:52804: session id = 0f3b1ccd8aa5412393aa7eb90f2bef95-9824def13ff74f65931445e01ea9cb84
I20260709 12:26:16.912986 11070 tablet_copy_source_session.cc:215] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:26:16.926723 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 62070.2us
I20260709 12:26:16.959729 17664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9824def13ff74f65931445e01ea9cb84. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:17.017189 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 126700us
I20260709 12:26:17.045495  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:17.054930 17664 tablet_copy_client.cc:806] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:17.071575 17664 tablet_copy_client.cc:670] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:17.082234 17664 tablet_copy_client.cc:538] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:17.124588 17664 tablet_bootstrap.cc:492] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap starting.
I20260709 12:26:17.189570  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:17.191531  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:17.192333  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:17.244573  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:17.317950  9799 tablet_server.cc:179] TabletServer@127.9.145.193:0 shutting down...
I20260709 12:26:17.324501 17664 tablet_bootstrap.cc:492] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:17.325598 17664 tablet_bootstrap.cc:492] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Bootstrap complete.
I20260709 12:26:17.326427 17664 ts_tablet_manager.cc:1403] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent bootstrapping tablet: real 0.202s	user 0.026s	sys 0.016s
I20260709 12:26:17.345953 17664 raft_consensus.cc:359] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
I20260709 12:26:17.346926 17664 raft_consensus.cc:740] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Initialized, Role: LEARNER
W20260709 12:26:17.362414 11023 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
I20260709 12:26:17.348098 17664 consensus_queue.cc:260] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: NON_VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: true } }
W20260709 12:26:17.406406 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 44037.6us
W20260709 12:26:17.411388 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 47466.4us
W20260709 12:26:17.429211 11643 consensus_peers.cc:597] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:17.448464 17664 ts_tablet_manager.cc:1434] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95: Time spent starting tablet: real 0.122s	user 0.005s	sys 0.005s
W20260709 12:26:17.449401 11643 consensus_peers.cc:597] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.456831 11643 consensus_peers.cc:597] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:17.468595 11070 tablet_copy_service.cc:342] P c979ef00e0ad4157b49ebbdc13ce7cd7: Request end of tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-9824def13ff74f65931445e01ea9cb84 received from {username='slave'} at 127.0.0.1:52804
I20260709 12:26:17.470942 11070 tablet_copy_service.cc:434] P c979ef00e0ad4157b49ebbdc13ce7cd7: ending tablet copy session 0f3b1ccd8aa5412393aa7eb90f2bef95-9824def13ff74f65931445e01ea9cb84 on tablet 9824def13ff74f65931445e01ea9cb84 with peer 0f3b1ccd8aa5412393aa7eb90f2bef95
W20260709 12:26:17.476408 11023 consensus_peers.cc:597] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.482788 11023 consensus_peers.cc:597] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.492046 11643 consensus_peers.cc:597] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.529552 11643 consensus_peers.cc:597] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.555169 11643 consensus_peers.cc:597] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.602957 11643 consensus_peers.cc:597] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.612531 11023 consensus_peers.cc:597] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.620764 11023 consensus_peers.cc:597] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.621450 11023 consensus_peers.cc:597] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.622009 11023 consensus_peers.cc:597] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.632165 11023 consensus_peers.cc:597] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.652544 11643 consensus_peers.cc:597] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.675169 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 99673.2us
W20260709 12:26:17.702212 11023 consensus_peers.cc:597] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.715543 11097 consensus_peers.cc:597] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.716763 11097 consensus_peers.cc:597] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.742774 11097 consensus_peers.cc:597] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.743502 11097 consensus_peers.cc:597] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.747350 11097 consensus_peers.cc:597] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.748127 11097 consensus_peers.cc:597] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:17.770308 11677 raft_consensus.cc:1217] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.8->[16.9-16.9]   Dedup: 16.9->[]
W20260709 12:26:17.792564 11097 consensus_peers.cc:597] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.806452 11643 consensus_peers.cc:597] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.808159 11023 consensus_peers.cc:597] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.810289 11023 consensus_peers.cc:597] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.811169 11643 consensus_peers.cc:597] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.812538 11643 consensus_peers.cc:597] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.816147 11023 consensus_peers.cc:597] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.841171 11097 consensus_peers.cc:597] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:17.857790  9799 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:17.865793  9799 tablet_replica.cc:333] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:17.866856  9799 raft_consensus.cc:2243] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:17.867632  9799 raft_consensus.cc:2272] T e37077b3b6d34e6f9558c96b2d955211 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:17.871822  9799 tablet_replica.cc:333] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:17.872737  9799 raft_consensus.cc:2243] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:17.873327  9799 raft_consensus.cc:2272] T d9e6122a57324bc79c68d46f4cc18aa7 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:17.883390  9799 tablet_replica.cc:333] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:17.884335  9799 raft_consensus.cc:2243] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:17.889441  9799 raft_consensus.cc:2272] T 227d10a1bcd84a0e9845113d5b0a2495 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:17.900306  9799 tablet_replica.cc:333] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:17.901196  9799 raft_consensus.cc:2243] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:17.901796  9799 raft_consensus.cc:2272] T ad5b1fe8f9f246d791d03da03e5c44ee P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:17.904614  9799 tablet_replica.cc:333] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:17.905465  9799 raft_consensus.cc:2243] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:17.906067  9799 raft_consensus.cc:2272] T 6c233c491e1b4126b9d776bfd98023b6 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:17.912562  9799 tablet_replica.cc:333] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:17.913647  9799 raft_consensus.cc:2243] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:17.914407  9799 raft_consensus.cc:2272] T 5d1c6709dd7d464db6e30b204580fe75 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:17.917191  9799 tablet_replica.cc:333] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:17.918022  9799 raft_consensus.cc:2243] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:17.919378  9799 raft_consensus.cc:2272] T c5ceb1aa25414d24b15ed1bff03f40c4 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:17.923666  9799 tablet_replica.cc:333] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:17.925066  9799 raft_consensus.cc:2243] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:17.925711  9799 raft_consensus.cc:2272] T f81a3074c9b841b6a602953195c8ef98 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:17.956463  9799 tablet_replica.cc:333] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:17.961709  9799 raft_consensus.cc:2243] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:26:17.963035  9799 raft_consensus.cc:2272] T d50eacd0821047a9930a0698124ba4f0 P bc01179655564f29b83babe396377cbb [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:17.986409  9799 tablet_replica.cc:333] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:17.987453  9799 raft_consensus.cc:2243] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.011034  9799 raft_consensus.cc:2272] T d10de3c352ba4d7c805da1ea559bfcb5 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.068945  9799 tablet_replica.cc:333] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:18.069872  9799 raft_consensus.cc:2243] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.101961  9799 raft_consensus.cc:2272] T 497ca545c71446259b5dc17afceaaf59 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.171681  9799 tablet_replica.cc:333] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:18.182016  9799 raft_consensus.cc:2243] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.186708  9799 raft_consensus.cc:2272] T d3ee878370114c8d8434e02b9c0aa6be P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.197535  9799 tablet_replica.cc:333] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:18.204105  9799 raft_consensus.cc:2243] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:26:18.207337  9799 raft_consensus.cc:2272] T 0a21734672b8441faae7b5d5d050d2b2 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.256345  9799 tablet_replica.cc:333] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:18.257393  9799 raft_consensus.cc:2243] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:26:18.290961  9799 raft_consensus.cc:2272] T d938b7067315410aa8ef1ecddf452945 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.303879  9799 tablet_replica.cc:333] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:18.323019 17642 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:26:18.324227 17642 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:18.346835 17638 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:18.347970 17638 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:18.352933 17638 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:18.354768 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:26:18.355636 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:18.357462 17638 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:26:18.359246 17638 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:18.360831  9799 raft_consensus.cc:2243] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.346944 17642 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:18.361881  9799 raft_consensus.cc:2272] T c2dcd574d9d144ce853b29000889507e P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.375371 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494450549bab41b6a4c557c9d2afddc7" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:18.375931 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:18.375430 17638 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:18.378497 10949 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:18.378822 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:26:18.379468 17638 raft_consensus.cc:2749] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:18.381295 10949 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:26:18.383239 17638 raft_consensus.cc:2749] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:18.389441 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:18.391592 17678 raft_consensus.cc:493] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:26:18.392557 17678 raft_consensus.cc:515] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:18.401057 17678 leader_election.cc:290] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:18.391726 10948 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:18.404809 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:18.403393 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e22af520a9e4eb795f4a0e920b05a3b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:18.407073 17678 raft_consensus.cc:2749] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:18.409356 10949 leader_election.cc:304] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:26:18.416453 17678 raft_consensus.cc:2749] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:26:18.417413 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 53467.9us
I20260709 12:26:18.458652 17622 raft_consensus.cc:1064] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7: attempting to promote NON_VOTER 0f3b1ccd8aa5412393aa7eb90f2bef95 to VOTER
I20260709 12:26:18.461047 17638 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:26:18.461534  9799 tablet_replica.cc:333] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:18.462584 17638 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:18.465055 17638 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:18.467756 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:18.468979 17642 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:18.469700 17642 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:18.473136 17642 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:18.473827 17680 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:18.474681 17680 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:18.477021 17680 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:18.480417 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:18.486305 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 14 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:18.486371  9799 raft_consensus.cc:2243] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.480389 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d64a1236147a784daa11e58563721" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:26:18.491191 17680 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:18.491958 17680 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:18.497777 10948 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:18.499223 17638 raft_consensus.cc:2706] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Received pre-election callback for term 16 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 12:26:18.500335  9799 raft_consensus.cc:2272] T 702d64a1236147a784daa11e58563721 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.500994 17680 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:18.487725 17622 consensus_queue.cc:237] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 7, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:18.513811 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:26:18.517391 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:18.516614 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:18.519547 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabbb0c174364b1ea4126a4f3d5bb4c2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 14 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:18.526638 17638 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:18.528765  9799 tablet_replica.cc:333] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:18.529995  9799 raft_consensus.cc:2243] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.527489 17638 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:18.536705 17638 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:18.538208 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:26:18.534678  9799 raft_consensus.cc:2272] T 9824def13ff74f65931445e01ea9cb84 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.546064 11130 raft_consensus.cc:1275] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:26:18.546223 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6bc26e6dfc446c9b989b8483864ae4" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:18.547984 17672 consensus_queue.cc:1048] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:18.539368 10949 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:18.549700 17638 raft_consensus.cc:2749] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:18.552989 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 82032us
I20260709 12:26:18.554417 10949 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:26:18.556257 17638 raft_consensus.cc:2749] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:18.557664 10949 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
W20260709 12:26:18.562462 11023 consensus_peers.cc:597] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:18.564854  9799 tablet_replica.cc:333] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:18.566956 11677 raft_consensus.cc:1275] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEARNER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:26:18.571448 17638 raft_consensus.cc:2749] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:18.572322 17687 consensus_queue.cc:1048] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:18.570782  9799 raft_consensus.cc:2243] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:26:18.574589  9799 raft_consensus.cc:2272] T f28a3d1504ca450d9efd93115b1164f9 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.572096 10949 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:18.576743 17638 raft_consensus.cc:2749] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:18.582819 17638 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:18.583528 17638 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:18.586002 17638 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:18.587744 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:26:18.593837  9799 tablet_replica.cc:333] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:18.598642  9799 raft_consensus.cc:2243] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.598816 17638 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:18.605792 17638 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:18.601631 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d049c89d78443e886fd95f8df54f02b" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:18.609550 17638 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:18.610175 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:26:18.610459  9799 raft_consensus.cc:2272] T 6506ec2922c24d099538b52b0df81502 P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.614464 17622 raft_consensus.cc:2955] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index 9 to 10, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:18.619796 11128 raft_consensus.cc:2955] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index 9 to 10, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:18.621155 17638 raft_consensus.cc:493] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:26:18.622116 17638 raft_consensus.cc:515] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:18.624792 17638 leader_election.cc:290] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:18.625972 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:18.627388 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265677e547f5428e992bc91650ec60e2" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:18.630515  9799 tablet_replica.cc:333] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:18.632193 10949 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:18.633512  9799 raft_consensus.cc:2243] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:18.634227 17680 raft_consensus.cc:493] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:26:18.636051 17680 raft_consensus.cc:515] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:18.638669 17642 raft_consensus.cc:2749] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:18.639788 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff0ae92c5347b59bfed7b76061d189" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:18.641865 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:26:18.642223 17680 leader_election.cc:290] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:18.642645 11677 raft_consensus.cc:2955] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index 9 to 10, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:18.643805 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2205be6a7c94913a366d683de188a31" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:18.646625 10948 leader_election.cc:304] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:18.648329 17680 raft_consensus.cc:2749] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:18.650665  9799 raft_consensus.cc:2272] T 65c91dadbee643c4bc2ef982cc40ffe8 P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.635257 10949 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:18.656549 17638 raft_consensus.cc:2749] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:18.662686  9799 tablet_replica.cc:333] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:18.663693  9799 raft_consensus.cc:2243] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:26:18.666185 10949 leader_election.cc:304] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:26:18.667335 17638 raft_consensus.cc:2749] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:18.667747  9799 raft_consensus.cc:2272] T e8083bc5cbd34d98a24be9a390262c19 P bc01179655564f29b83babe396377cbb [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.677520 17638 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:18.678330 17638 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:18.681469 17638 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:18.676623 10875 catalog_manager.cc:5697] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index 9 to 10, 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:18.681691 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:18.686030  9799 tablet_replica.cc:333] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:18.687043  9799 raft_consensus.cc:2243] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.683642 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:18.691072 10949 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:26:18.691999 17638 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:18.687947  9799 raft_consensus.cc:2272] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P bc01179655564f29b83babe396377cbb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.713655  9799 tablet_replica.cc:333] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:18.714775  9799 raft_consensus.cc:2243] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.715986  9799 raft_consensus.cc:2272] T ceabf3208ccf4abbad90d81586377118 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.718686  9799 tablet_replica.cc:333] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:18.719646  9799 raft_consensus.cc:2243] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:26:18.721261  9799 raft_consensus.cc:2272] T a84c56f62e0a4a9990f4969bc324dd7e P bc01179655564f29b83babe396377cbb [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.725970  9799 tablet_replica.cc:333] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:18.738365  9799 raft_consensus.cc:2243] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.751240  9799 raft_consensus.cc:2272] T 6dff0ae92c5347b59bfed7b76061d189 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.754714  9799 tablet_replica.cc:333] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:18.756814  9799 raft_consensus.cc:2243] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:18.758342  9799 raft_consensus.cc:2272] T 5635e70df91d469ca24e987e2a28c27d P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.761193  9799 tablet_replica.cc:333] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:18.762035  9799 raft_consensus.cc:2243] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:18.763422  9799 raft_consensus.cc:2272] T 87a7b71cfb864c1b9ab4c85887ca32ad P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.769766 17638 raft_consensus.cc:493] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:26:18.770479 17638 raft_consensus.cc:515] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:18.773451 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:26:18.776945 17638 leader_election.cc:290] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:18.777762 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7865a5cff5849a2bd74dddc1bcdd8f3" candidate_uuid: "bc01179655564f29b83babe396377cbb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:18.779620 10948 leader_election.cc:304] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc01179655564f29b83babe396377cbb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:18.782312 17638 raft_consensus.cc:2749] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:18.785255  9799 tablet_replica.cc:333] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:18.786675  9799 raft_consensus.cc:2243] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.788043  9799 raft_consensus.cc:2272] T 839b2afaa86144938bdfb973011c3303 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.796204  9799 tablet_replica.cc:333] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:18.797394  9799 raft_consensus.cc:2243] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:18.800408  9799 raft_consensus.cc:2272] T 6875ad729dd0416d88035fd642f6b3bd P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.804050  9799 tablet_replica.cc:333] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:18.805099  9799 raft_consensus.cc:2243] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.806209  9799 raft_consensus.cc:2272] T 494450549bab41b6a4c557c9d2afddc7 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.809221  9799 tablet_replica.cc:333] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:18.810089  9799 raft_consensus.cc:2243] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.810976  9799 raft_consensus.cc:2272] T cf134f8026dd4c7c8bbdf22ddca4edf2 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.814172  9799 tablet_replica.cc:333] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:18.835443 11057 consensus_queue.cc:237] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:18.836998  9799 raft_consensus.cc:2243] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.838968  9799 raft_consensus.cc:2272] T d2205be6a7c94913a366d683de188a31 P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.874857  9799 tablet_replica.cc:333] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:18.875702  9799 raft_consensus.cc:2243] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.876448  9799 raft_consensus.cc:2272] T ed6bc26e6dfc446c9b989b8483864ae4 P bc01179655564f29b83babe396377cbb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.900997 11128 raft_consensus.cc:1275] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:26:18.906669  9799 tablet_replica.cc:333] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:18.907661  9799 raft_consensus.cc:2243] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.908535  9799 raft_consensus.cc:2272] T dabbb0c174364b1ea4126a4f3d5bb4c2 P bc01179655564f29b83babe396377cbb [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.913686  9799 tablet_replica.cc:333] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:18.914609  9799 raft_consensus.cc:2243] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.915611  9799 raft_consensus.cc:2272] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.923023 17622 consensus_queue.cc:1048] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:18.938861 11677 raft_consensus.cc:1275] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:26:18.953169 17672 raft_consensus.cc:2955] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 10 to 11, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:18.968122 11128 raft_consensus.cc:2955] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:18.971375 10867 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9824def13ff74f65931445e01ea9cb84 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:18.977769  9799 tablet_replica.cc:333] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:18.996577 17687 consensus_queue.cc:1048] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:19.006300 10874 catalog_manager.cc:5697] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: config changed from index 10 to 11, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New cstate: current_term: 16 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:19.007508  9799 raft_consensus.cc:2243] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:19.014827  9799 raft_consensus.cc:2272] T 265677e547f5428e992bc91650ec60e2 P bc01179655564f29b83babe396377cbb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:19.071756  9799 tablet_replica.cc:333] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:19.072711  9799 raft_consensus.cc:2243] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:26:19.085196 11672 raft_consensus.cc:2955] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, VOTER bc01179655564f29b83babe396377cbb (127.9.145.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:19.110213  9799 raft_consensus.cc:2272] T 1edc7e1c10ce4d21b4ad909d703ace3e P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:19.111915 17684 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:19.112648 17684 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:19.115907 17684 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:26:19.116236 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
W20260709 12:26:19.120692 11643 leader_election.cc:336] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:19.121179 11643 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:19.122416 17684 raft_consensus.cc:2749] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:19.124560  9799 tablet_replica.cc:333] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:19.125869  9799 raft_consensus.cc:2243] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:19.126605  9799 raft_consensus.cc:2272] T 1e22af520a9e4eb795f4a0e920b05a3b P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:19.127236 10866 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 78307.7us
I20260709 12:26:19.129863  9799 tablet_replica.cc:333] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:19.130744  9799 raft_consensus.cc:2243] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:19.131973  9799 raft_consensus.cc:2272] T 2f4458a30aab4e97ae1d0e1d465fae04 P bc01179655564f29b83babe396377cbb [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:19.145124 10866 catalog_manager.cc:4755] TS bc01179655564f29b83babe396377cbb (127.9.145.193:46777): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9824def13ff74f65931445e01ea9cb84: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 12:26:19.147816 17694 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:19.148572 17694 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:26:19.154817 11097 leader_election.cc:336] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:19.157231 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:19.159276 11098 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:26:19.160372 17679 raft_consensus.cc:2749] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:19.161314 17694 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:19.148095  9799 tablet_replica.cc:333] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:19.163015  9799 raft_consensus.cc:2243] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:26:19.164283  9799 raft_consensus.cc:2272] T 709d2903489748c8a8490194704bc3ca P bc01179655564f29b83babe396377cbb [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:19.167446  9799 tablet_replica.cc:333] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:19.168265  9799 raft_consensus.cc:2243] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:19.169055  9799 raft_consensus.cc:2272] T 5d049c89d78443e886fd95f8df54f02b P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:19.172811  9799 tablet_replica.cc:333] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:19.173574  9799 raft_consensus.cc:2243] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:19.179574  9799 raft_consensus.cc:2272] T 820ab313402049dfa58d12167763953e P bc01179655564f29b83babe396377cbb [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:19.184397  9799 tablet_replica.cc:333] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:19.185166  9799 raft_consensus.cc:2243] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:19.186486  9799 raft_consensus.cc:2272] T 634832ddce4348f1bb6c7bbf1b9045f0 P bc01179655564f29b83babe396377cbb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:19.189685  9799 tablet_replica.cc:333] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:19.199815  9799 raft_consensus.cc:2243] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:19.200749  9799 raft_consensus.cc:2272] T 49ef051819cd4f229ac2b37858ee3db5 P bc01179655564f29b83babe396377cbb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:19.212163  9799 tablet_replica.cc:333] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb: stopping tablet replica
I20260709 12:26:19.212859  9799 raft_consensus.cc:2243] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:19.213461  9799 raft_consensus.cc:2272] T c7865a5cff5849a2bd74dddc1bcdd8f3 P bc01179655564f29b83babe396377cbb [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:19.298220 17684 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:19.299037 17684 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:19.302917 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:19.307797 11128 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 16.
W20260709 12:26:19.307015 11643 leader_election.cc:336] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:19.309970 11645 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:26:19.301609 17684 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:19.312526 17684 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:19.317835 17684 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:19.318323 17684 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:19.336151 17691 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:19.336925 17691 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:19.340600 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:19.341387 11128 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 11.
I20260709 12:26:19.343154 11025 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:26:19.344606 17672 raft_consensus.cc:2804] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:19.345031 17672 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:19.345376 17672 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:19.350414 17691 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:19.352847 17684 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:19.360354 17684 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:26:19.382153 11023 leader_election.cc:336] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:19.384377 11643 leader_election.cc:336] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:19.387791 17672 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:26:19.414296 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 104520us
W20260709 12:26:19.419330 11023 leader_election.cc:336] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:19.422222 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50eacd0821047a9930a0698124ba4f0" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:26:19.422906 11125 raft_consensus.cc:3060] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:19.435667 11125 raft_consensus.cc:2468] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 12.
I20260709 12:26:19.436906 11025 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:26:19.437846 17691 raft_consensus.cc:2804] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:19.439407 17691 raft_consensus.cc:697] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:26:19.440523 17691 consensus_queue.cc:237] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:19.444337 17672 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:19.448060 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:26:19.448971 11125 raft_consensus.cc:3060] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:19.458653 11125 raft_consensus.cc:2468] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 17.
I20260709 12:26:19.460152 11645 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:26:19.461021 17684 raft_consensus.cc:2804] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:19.461606 17684 raft_consensus.cc:697] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:26:19.467396 17684 consensus_queue.cc:237] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:19.566529 10876 catalog_manager.cc:5697] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 11 to 12, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 12 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:19.573007 10875 catalog_manager.cc:5697] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 16 to 17, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 17 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:19.605366 17691 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:19.606364 17691 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:19.609689 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:19.610407 11678 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 13.
I20260709 12:26:19.614499 11024 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:26:19.615197 17672 raft_consensus.cc:2804] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:19.615389 17691 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:19.616572 17672 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:19.617033 17672 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:19.623428 17691 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:19.624255 17691 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:19.627732 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
W20260709 12:26:19.628172 11023 leader_election.cc:336] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:19.629977 17672 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:19.631596 17691 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:19.635056 17672 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:19.635637 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a21734672b8441faae7b5d5d050d2b2" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:26:19.636415 11678 raft_consensus.cc:3060] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:19.641903 11678 raft_consensus.cc:2468] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 14.
I20260709 12:26:19.644343 11024 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:26:19.645444 17691 raft_consensus.cc:2804] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:19.646013 17691 raft_consensus.cc:697] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:26:19.647722 17691 consensus_queue.cc:237] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:26:19.665249 11023 leader_election.cc:336] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:19.665930 11023 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
W20260709 12:26:19.667044 11023 leader_election.cc:336] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:19.666656 10876 catalog_manager.cc:5697] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 13 to 14, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 14 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:19.667631 17691 raft_consensus.cc:2749] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:26:19.737848 11643 consensus_peers.cc:597] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:19.773909 17692 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:19.776803 17692 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:19.789288 17691 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:19.789917 17691 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:26:19.790400 11097 leader_election.cc:336] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:19.792022 17692 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:26:19.795647 17691 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:26:19.801841 11023 leader_election.cc:336] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:19.802546 11643 consensus_peers.cc:597] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:19.816665 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:19.834993 11024 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:26:19.835816 17691 raft_consensus.cc:2749] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:26:19.836607 11023 consensus_peers.cc:597] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:19.837728 17691 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:19.838335 17691 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:26:19.840687 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 49291us
I20260709 12:26:19.840754 17691 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:19.843138 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:26:19.843839 11053 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 18.
I20260709 12:26:19.845839 17672 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:19.846400 17672 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:19.846518 11098 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:26:19.849246 17672 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:19.849854 17719 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:19.850332 17719 raft_consensus.cc:493] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:19.850521 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:19.853649 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:19.854241 17719 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:19.856092 17672 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:19.856630 17672 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:19.859149 17672 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:19.860589 17704 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:19.861020 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:19.861177 17704 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:19.863409 17704 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:26:19.856683 11023 consensus_peers.cc:597] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:19.866329 11125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:19.866714 11128 raft_consensus.cc:1275] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:26:19.869439 17704 consensus_queue.cc:1048] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:26:19.872552 11643 leader_election.cc:336] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:19.873165 11643 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:26:19.874585 17704 raft_consensus.cc:2749] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:26:19.869444 11023 leader_election.cc:336] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:19.876909 11023 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:26:19.877743 17691 raft_consensus.cc:2749] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:26:19.879005 11023 leader_election.cc:336] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:19.879570 11023 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:26:19.883028 17719 raft_consensus.cc:515] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:19.885892 17712 raft_consensus.cc:2749] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:19.889204 17719 leader_election.cc:290] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:26:19.893882 17692 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:19.894526 17692 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:26:19.893000 11023 leader_election.cc:336] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:19.896706 17692 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:26:19.904055 11097 leader_election.cc:336] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:19.903388 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938b7067315410aa8ef1ecddf452945" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:26:19.906733 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:26:19.907224 11057 raft_consensus.cc:3060] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:19.907434 11053 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 19.
I20260709 12:26:19.903144 11023 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:26:19.910674 11098 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:26:19.916532 17672 raft_consensus.cc:2749] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:19.917822 17692 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:19.931291 17692 raft_consensus.cc:493] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:19.931843 17692 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:19.925611 11057 raft_consensus.cc:2468] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 19.
I20260709 12:26:19.929203 17681 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:19.939429 17681 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:19.941689 17681 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:26:19.930442 11643 consensus_peers.cc:597] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:19.930676 17705 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:19.944187 17705 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:19.946452 17705 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:26:19.947386 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:26:19.948596 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:26:19.949286 11053 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 15.
I20260709 12:26:19.951704 11644 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
W20260709 12:26:19.919570 11097 leader_election.cc:336] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:19.954167 11643 leader_election.cc:336] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:19.954749 11643 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:19.955545 17681 raft_consensus.cc:2804] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:19.956457 17681 raft_consensus.cc:493] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:19.956931 17681 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:19.955996 17705 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:19.963048 11643 leader_election.cc:336] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:19.964074 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 48251.4us
I20260709 12:26:19.966075 11098 leader_election.cc:304] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:26:19.975221 17720 raft_consensus.cc:2804] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:19.976073 17720 raft_consensus.cc:697] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 19 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:26:19.977097 17720 consensus_queue.cc:237] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:26:19.979167 11023 consensus_peers.cc:597] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:19.982569 17672 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:19.983214 17672 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:26:19.984086 11643 consensus_peers.cc:597] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:19.988065 17692 raft_consensus.cc:515] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:19.990288 17672 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:19.991854 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:26:19.999567 11023 leader_election.cc:336] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:20.000118 11023 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:26:20.000900 17672 raft_consensus.cc:2749] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:20.006615 11097 leader_election.cc:336] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:20.008213 17692 leader_election.cc:290] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 20 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:26:20.009233 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c91dadbee643c4bc2ef982cc40ffe8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:26:20.009989 11053 raft_consensus.cc:3060] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:20.016870 17694 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:20.017423 17694 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:20.019328 17694 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:20.021968 17672 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:20.022675 17672 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:26:20.028582 11097 leader_election.cc:336] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:20.028409 17672 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:19.994027 17681 raft_consensus.cc:515] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:20.026423 11053 raft_consensus.cc:2468] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 20.
I20260709 12:26:20.031931 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:20.032795 11678 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 18.
I20260709 12:26:20.031896 17705 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:20.034523 17705 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:20.034909 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a7b71cfb864c1b9ab4c85887ca32ad" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:26:20.035518 11053 raft_consensus.cc:3060] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:20.037562 17705 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:26:20.037791 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:26:20.038527 11055 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 20.
W20260709 12:26:20.039746 11023 consensus_peers.cc:597] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:20.040505 11644 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:26:20.043321 17704 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:20.043782 17704 raft_consensus.cc:493] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:20.031973 11098 leader_election.cc:304] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:26:20.044158 17704 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:20.050526 17720 raft_consensus.cc:2804] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:20.051115 17720 raft_consensus.cc:697] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 20 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:26:20.053504 17705 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:20.054085 17705 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:20.054917 11098 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:26:20.055779 17719 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:20.056190 17719 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:20.056571 17719 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:20.058499 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:26:20.057888 17705 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:26:20.061187 11055 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 21.
I20260709 12:26:20.058022 10876 catalog_manager.cc:5697] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 18 to 19, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 19 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:20.059820 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:20.062247 11678 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 16.
I20260709 12:26:20.062443 11644 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:26:20.063344 17705 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:20.063786 17705 raft_consensus.cc:493] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 21 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:20.064215 17705 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:20.059751 11128 raft_consensus.cc:1275] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:26:20.068382 17719 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:20.069252 17672 consensus_queue.cc:1048] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:20.052021 17720 consensus_queue.cc:237] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:20.079223 11024 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:26:20.080255 17672 raft_consensus.cc:2804] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:20.081002 17672 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:20.081499 17672 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:26:20.082294 11643 consensus_peers.cc:597] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:20.083472 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:26:20.084184 11678 raft_consensus.cc:3060] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:26:20.082820 11643 leader_election.cc:336] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:20.090554 11643 leader_election.cc:336] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:20.080211 17719 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:20.095976 11678 raft_consensus.cc:2468] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 19.
I20260709 12:26:20.093756 17705 raft_consensus.cc:515] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:20.112257 11098 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:26:20.113503 17692 raft_consensus.cc:2804] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:20.114035 17692 raft_consensus.cc:697] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 19 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:26:20.115024 17692 consensus_queue.cc:237] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:20.083380 17704 raft_consensus.cc:515] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:20.119115 11055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c56f62e0a4a9990f4969bc324dd7e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:26:20.119292 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8083bc5cbd34d98a24be9a390262c19" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:26:20.119771 11055 raft_consensus.cc:3060] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:20.119971 11057 raft_consensus.cc:3060] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:26:20.104233 11643 consensus_peers.cc:597] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:20.121997 11643 leader_election.cc:336] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:20.122709 17705 leader_election.cc:290] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 22 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:26:20.127413 11643 consensus_peers.cc:597] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:20.110405 11053 raft_consensus.cc:2468] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 16.
I20260709 12:26:20.131646 11644 leader_election.cc:304] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:26:20.132802 17705 raft_consensus.cc:2804] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:20.134038 11055 raft_consensus.cc:2468] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 22.
I20260709 12:26:20.136587 11644 leader_election.cc:304] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:26:20.134179 17705 raft_consensus.cc:697] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:26:20.138648 17705 consensus_queue.cc:237] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:20.142323 17684 raft_consensus.cc:2804] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:20.143633 17691 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:20.144253 17691 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:20.147024 17691 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:20.148123 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:20.158529 17704 leader_election.cc:290] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 21 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:26:20.217214 17684 raft_consensus.cc:697] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 22 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:26:20.218510 17684 consensus_queue.cc:237] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:20.150466 17672 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:26:20.221851 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 44654.5us
I20260709 12:26:20.228004 17672 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:26:20.228636 11643 leader_election.cc:336] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:20.265246 11643 leader_election.cc:336] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:20.253649 11057 raft_consensus.cc:2468] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 21.
I20260709 12:26:20.039754 17681 leader_election.cc:290] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:26:20.267271 11643 consensus_peers.cc:597] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:20.269587 11678 raft_consensus.cc:1275] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:26:20.528882  9799 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 11006)
I20260709 12:26:21.118234 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6875ad729dd0416d88035fd642f6b3bd" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:26:21.118924 11672 raft_consensus.cc:3060] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:21.121971 17732 consensus_queue.cc:1048] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:21.125833 11672 raft_consensus.cc:2468] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 17.
I20260709 12:26:21.131678 17736 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:21.132462 17736 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.134847 17736 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:26:21.135470 17736 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:21.136050 17736 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.138698 17736 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:21.143656 11024 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:26:21.144622 17732 raft_consensus.cc:2804] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:21.145223 17732 raft_consensus.cc:697] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:26:21.146268 17736 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:21.146147 17732 consensus_queue.cc:237] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:26:21.147382 11125 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.025s	user 0.005s	sys 0.028s
I20260709 12:26:21.146938 17736 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:26:21.147782 11125 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.026s	user 0.006s	sys 0.029s
I20260709 12:26:21.148893 11125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36582 (request call id 3844) took 1028 ms. Trace:
I20260709 12:26:21.149284 11125 rpcz_store.cc:276] 0709 12:26:20.120441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:20.120572 (+   131us) service_pool.cc:224] Handling call
0709 12:26:20.120898 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:20.121318 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:20.121369 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:20.121837 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 12:26:21.148517 (+1026680us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:21.148560 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:21.148631 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:21.148677 (+    46us) raft_consensus.cc:1685] finished
0709 12:26:21.148687 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:21.148829 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1357,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":65,"thread_start_us":1026228,"threads_started":1,"wal-append.queue_time_us":140695}
I20260709 12:26:21.149413 17736 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:21.163182 17672 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:21.163822 17672 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:21.166004 17672 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:21.172125 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:26:21.172824 11057 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 16.
I20260709 12:26:21.175009 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:26:21.229213 17734 raft_consensus.cc:493] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:26:21.229897 17734 raft_consensus.cc:515] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.232403 17734 leader_election.cc:290] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:21.253772 17733 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:21.254582 17733 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.257022 17733 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:26:21.284775 11156 debug-util.cc:398] Leaking SignalData structure 0x7b08002ccc20 after lost signal to thread 9802
I20260709 12:26:21.308107 11644 leader_election.cc:304] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:26:21.309234 17736 raft_consensus.cc:2804] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:21.309897 17736 raft_consensus.cc:697] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 21 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:26:21.310983 17736 consensus_queue.cc:237] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:26:21.312255 11156 debug-util.cc:398] Leaking SignalData structure 0x7b0800355da0 after lost signal to thread 10916
I20260709 12:26:21.312183 17705 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:21.313006 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:21.316800 17705 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.320278 17691 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:21.323366 17691 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.322306 17705 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:21.322778 17733 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:21.325731 17733 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.328441 17733 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:21.333173 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:21.333994 11677 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 17.
I20260709 12:26:21.337225 11024 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:26:21.339119 17741 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:21.339682 17741 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:21.340184 17741 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:21.344013 17694 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:21.344715 17694 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.346952 17694 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:21.347470 17694 raft_consensus.cc:493] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:26:21.347945 17694 raft_consensus.cc:515] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.348227 17735 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:21.349045 17735 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.351653 17735 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:21.355360 17694 leader_election.cc:290] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:21.356125 17745 raft_consensus.cc:493] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:21.358739 17745 raft_consensus.cc:515] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:21.369443 11053 raft_consensus.cc:1275] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 12:26:21.371716 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 1.21682e+06us
W20260709 12:26:21.372630 11097 consensus_peers.cc:597] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:21.376966 17684 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.113s	user 0.012s	sys 0.001s
W20260709 12:26:21.377911 10866 catalog_manager.cc:4755] TS bc01179655564f29b83babe396377cbb (127.9.145.193:46777): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9824def13ff74f65931445e01ea9cb84: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:21.378844 11156 debug-util.cc:398] Leaking SignalData structure 0x7b0800357240 after lost signal to thread 11084
W20260709 12:26:21.381038 17684 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.117s	user 0.013s	sys 0.001s
W20260709 12:26:21.381767 11156 debug-util.cc:398] Leaking SignalData structure 0x7b0800348e40 after lost signal to thread 11159
W20260709 12:26:21.382157 11156 debug-util.cc:398] Leaking SignalData structure 0x7b0800316aa0 after lost signal to thread 11160
W20260709 12:26:21.383460 11156 debug-util.cc:398] Leaking SignalData structure 0x7b0800231060 after lost signal to thread 11705
I20260709 12:26:21.382017 10876 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41120 (request call id 356) took 1327 ms. Trace:
I20260709 12:26:21.384124 17742 raft_consensus.cc:493] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:26:21.384763 17742 raft_consensus.cc:515] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.384133 10876 rpcz_store.cc:276] 0709 12:26:20.054212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:20.054372 (+   160us) service_pool.cc:224] Handling call
0709 12:26:21.311697 (+1257325us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:21.311727 (+    30us) write_op.cc:454] Released schema lock
0709 12:26:21.381922 (+ 70195us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:20.075612 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:20.076152 (+   540us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:20.076209 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:26:20.076227 (+    18us) tablet.cc:662] Decoding operations
0709 12:26:20.076556 (+   329us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:20.076628 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:20.076655 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:20.076829 (+   174us) tablet.cc:701] Row locks acquired
0709 12:26:20.076846 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:26:20.076990 (+   144us) write_op.cc:270] Start()
0709 12:26:20.077111 (+   121us) write_op.cc:276] Timestamp: P: 1783599980076941 usec, L: 0
0709 12:26:20.077132 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:26:20.077774 (+   642us) log.cc:844] Serialized 541 byte log entry
0709 12:26:20.079791 (+  2017us) op_driver.cc:464] REPLICATION: finished
0709 12:26:20.080262 (+   471us) write_op.cc:301] APPLY: starting
0709 12:26:20.080349 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:20.081241 (+   892us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:20.081349 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:20.082077 (+   728us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:20.082268 (+   191us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:26:20.082307 (+    39us) write_op.cc:312] APPLY: finished
0709 12:26:20.082496 (+   189us) log.cc:844] Serialized 25 byte log entry
0709 12:26:20.082712 (+   216us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:20.082793 (+    81us) write_op.cc:454] Released schema lock
0709 12:26:20.082838 (+    45us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":261,"apply.run_cpu_time_us":2863,"apply.run_wall_time_us":2862,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4166,"num_ops":1,"prepare.queue_time_us":1232,"prepare.run_cpu_time_us":2439,"prepare.run_wall_time_us":2438,"replication_time_us":2534}]]}
I20260709 12:26:21.313812 11644 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:26:21.398304 17684 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:21.399070 17684 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.401228 17684 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:26:21.402170 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 88432.8us
I20260709 12:26:21.406333 17736 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:21.406872 17736 raft_consensus.cc:493] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:21.411396 17743 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:21.412114 17743 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.414567 17743 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:21.409025 17672 raft_consensus.cc:493] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:26:21.415705 17672 raft_consensus.cc:515] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.417899 17672 leader_election.cc:290] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:21.408142 17736 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:21.418183 17742 leader_election.cc:290] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:26:21.419926 11643 consensus_peers.cc:597] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:21.423658 11053 raft_consensus.cc:1275] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:26:21.424371 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:26:21.426190 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10de3c352ba4d7c805da1ea559bfcb5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:21.427364 17735 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:21.428071 17735 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.431337 17679 raft_consensus.cc:493] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:26:21.433107 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9fad3893d845fa9208a48c76eb609f" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:21.434115 17734 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:21.434710 17734 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:21.432020 17679 raft_consensus.cc:515] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.436676 17734 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:26:21.437198 17734 raft_consensus.cc:493] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
I20260709 12:26:21.437950 17692 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:21.438482 17692 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.440514 17692 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:21.441268 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:21.441886 11131 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 21.
I20260709 12:26:21.442575 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:26:21.443190 11054 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 17.
I20260709 12:26:21.444316 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:21.446492 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:21.447926 17738 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:21.448156 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:21.448688 11678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:21.450002 11678 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 17.
I20260709 12:26:21.451123 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:21.452631 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:21.453389 11126 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 16.
I20260709 12:26:21.453430 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:21.452792 17705 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:21.452286 17738 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.454970 17705 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.455909 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:21.457221 17705 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:21.457870 17705 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:21.437621 17734 raft_consensus.cc:515] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.462698 17705 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.464501 17734 leader_election.cc:290] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:21.467270 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:21.467947 11677 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 16.
I20260709 12:26:21.456552 17738 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:21.449669 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:21.460230 17745 leader_election.cc:290] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:21.437495 17679 leader_election.cc:290] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:21.469007 11130 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 14.
I20260709 12:26:21.467878 17692 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:21.424588 17691 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:21.469905 17692 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:21.472322 17692 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:26:21.462136 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 123117us
I20260709 12:26:21.474301 17735 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:21.474642 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ee878370114c8d8434e02b9c0aa6be" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:26:21.475286 11643 consensus_peers.cc:597] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:21.475808 11643 consensus_peers.cc:597] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:21.476265 11643 leader_election.cc:336] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:21.477185 11643 leader_election.cc:336] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:21.477484 11023 leader_election.cc:336] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:21.464725 17705 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:21.484766 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ef051819cd4f229ac2b37858ee3db5" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:21.475917 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ab313402049dfa58d12167763953e" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:21.481138 17741 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.483019 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf134f8026dd4c7c8bbdf22ddca4edf2" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:26:21.483395 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:26:21.487182 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:21.483659 17684 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:21.489807 17684 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.490316 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ceb1aa25414d24b15ed1bff03f40c4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:26:21.490957 11097 leader_election.cc:336] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:21.491801 11097 consensus_peers.cc:597] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:21.493422 11097 consensus_peers.cc:597] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:21.493745 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:21.492309 17684 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:21.496073 11057 raft_consensus.cc:1240] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:21.496133 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:21.497764 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497ca545c71446259b5dc17afceaaf59" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:21.498963 10876 catalog_manager.cc:5697] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 15 to 16, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 16 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:21.500219 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b2afaa86144938bdfb973011c3303" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:21.499413 17736 raft_consensus.cc:515] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.505995 17741 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 18 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:21.520442 11676 raft_consensus.cc:1275] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:26:21.513584 17684 consensus_queue.cc:1048] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
W20260709 12:26:21.511312 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 82507.9us
I20260709 12:26:21.519413 17736 leader_election.cc:290] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:26:21.512368 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 66633.5us
I20260709 12:26:21.488598 11645 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:21.524466 11025 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
W20260709 12:26:21.524891 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 47252.8us
I20260709 12:26:21.516906 11644 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:26:21.527304 17738 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:21.527697 17738 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:21.528170 17684 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:21.524520 11645 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:21.528009 10875 catalog_manager.cc:5697] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 16 to 17, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 17 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:21.528723 17684 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.529378 17739 raft_consensus.cc:2749] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:26:21.530084  9799 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 11006)
I20260709 12:26:21.531020 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2721401e0fa944aea90572c7ec29c134" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:26:21.531603 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:26:21.531603 17691 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:21.532191 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:26:21.532398 17691 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.524410 17705 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:21.534848 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5635e70df91d469ca24e987e2a28c27d" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:26:21.535504 11059 raft_consensus.cc:3060] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:21.518539 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa9f4fbf45b4a0a88651d571f7b49e4" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:21.540205 11053 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 15.
I20260709 12:26:21.528043 17738 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:26:21.510942 11097 consensus_peers.cc:597] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:21.542771 11097 consensus_peers.cc:597] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:21.547159 11097 leader_election.cc:336] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:21.570369 11097 leader_election.cc:304] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:26:21.549288 11059 raft_consensus.cc:2468] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 17.
I20260709 12:26:21.549494 11057 raft_consensus.cc:1275] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:26:21.550005 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:26:21.534821 17691 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:21.551278 11644 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:26:21.533931 17684 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:21.575956 17684 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:21.576397 17684 raft_consensus.cc:493] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:21.576766 17684 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:21.551939 17672 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:21.555044 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:26:21.559487 11025 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:26:21.581768 11056 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 15.
W20260709 12:26:21.560324 11023 consensus_peers.cc:597] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:21.583910 11023 consensus_peers.cc:597] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:21.584439 11023 consensus_peers.cc:597] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:21.584841 11023 leader_election.cc:336] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:21.585215 11023 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:26:21.560752 17733 raft_consensus.cc:493] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:21.586072 17733 raft_consensus.cc:515] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:21.588215 17733 leader_election.cc:290] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:26:21.525435 11643 consensus_peers.cc:597] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:21.564683 17738 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:26:21.589010 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 63619.3us
W20260709 12:26:21.589535 11643 consensus_peers.cc:597] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:21.590649 11643 consensus_peers.cc:597] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:21.565701 11645 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:26:21.540874 11098 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:26:21.591684 11645 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:21.592937 17743 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:21.593343 17743 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:21.593405 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:26:21.593801 17743 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:21.595140 17684 raft_consensus.cc:515] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.595089 11024 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb
I20260709 12:26:21.596213 17751 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:21.596671 17751 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:21.597029 17751 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:21.597528 17684 leader_election.cc:290] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:21.598786 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:26:21.590817 17738 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:21.599493 11056 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:26:21.601544 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 60741.6us
I20260709 12:26:21.602790 11644 leader_election.cc:304] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:26:21.603569 17743 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.605010 17749 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:21.605494 17749 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:21.605871 17749 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:21.607569 17734 consensus_queue.cc:1048] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:26:21.608642 17692 raft_consensus.cc:2749] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:21.605775 17743 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:21.615322 17745 raft_consensus.cc:2749] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:21.615897 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 68766.9us
I20260709 12:26:21.605010 17679 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:21.617296 17679 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:21.617697 17679 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:26:21.605914 11023 leader_election.cc:336] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:21.622931 11023 consensus_peers.cc:597] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:21.623310 11056 raft_consensus.cc:2468] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 16.
W20260709 12:26:21.623533 11023 consensus_peers.cc:597] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:21.623705 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceabf3208ccf4abbad90d81586377118" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:21.624563 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:26:21.631882 17679 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.632277 17749 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:26:21.624097 11023 consensus_peers.cc:597] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:21.634268 11023 leader_election.cc:336] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:21.634721 11643 leader_election.cc:336] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:21.635033 11023 consensus_peers.cc:597] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:21.635977 11023 consensus_peers.cc:597] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:21.639353 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:21.639958 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e6122a57324bc79c68d46f4cc18aa7" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:21.642163 17752 consensus_queue.cc:1048] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:21.643342 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:26:21.646222 11098 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:21.647243 17763 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:21.648025 17734 consensus_queue.cc:1059] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:21.655560 17763 raft_consensus.cc:3055] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:21.656075 17763 raft_consensus.cc:740] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:26:21.657043 17763 consensus_queue.cc:260] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.655895 17751 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:26:21.667418 11023 leader_election.cc:336] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:21.667997 11023 leader_election.cc:304] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
W20260709 12:26:21.668411 11099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:21.669339 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709d2903489748c8a8490194704bc3ca" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:26:21.670070 11130 raft_consensus.cc:3060] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:26:21.678612 11097 consensus_peers.cc:597] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:21.679157 11097 leader_election.cc:336] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:21.679862 11097 leader_election.cc:336] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:21.680269 11097 leader_election.cc:304] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:26:21.681131 17752 raft_consensus.cc:2749] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:21.680296 17749 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 18 election: Requested vote from peers 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:21.680388 17751 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 22 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:21.683420 17679 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:21.690349 11130 raft_consensus.cc:2468] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c979ef00e0ad4157b49ebbdc13ce7cd7 in term 22.
I20260709 12:26:21.692471 11025 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:26:21.693550 17751 raft_consensus.cc:2804] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:21.694209 17751 raft_consensus.cc:697] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 22 LEADER]: Becoming Leader. State: Replica: c979ef00e0ad4157b49ebbdc13ce7cd7, State: Running, Role: LEADER
I20260709 12:26:21.695408 17751 consensus_queue.cc:237] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:21.696842 17692 consensus_queue.cc:1048] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:21.694355 17763 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:21.698910 11098 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:26:21.699719 17692 raft_consensus.cc:2804] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:21.700170 17692 raft_consensus.cc:493] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:21.700608 17692 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:26:21.702725 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 103399us
I20260709 12:26:21.704732 11645 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb
W20260709 12:26:21.706064 11644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 103351us
I20260709 12:26:21.706727 17743 raft_consensus.cc:2804] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:21.707221 17743 raft_consensus.cc:493] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bc01179655564f29b83babe396377cbb)
I20260709 12:26:21.707640 17743 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:21.707021 17738 raft_consensus.cc:2804] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:21.713165 17738 raft_consensus.cc:697] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:26:21.714269 17738 consensus_queue.cc:237] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.716320 17743 raft_consensus.cc:515] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.730247 17743 leader_election.cc:290] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:26:21.739817 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 58475.5us
I20260709 12:26:21.734681 17691 raft_consensus.cc:2749] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:26:21.735651 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 68253.5us
I20260709 12:26:21.733870 17684 raft_consensus.cc:2749] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:21.748265 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:26:21.751454 11023 leader_election.cc:336] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:21.752461 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:21.758328 11023 leader_election.cc:304] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:26:21.755300 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
W20260709 12:26:21.753829 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:44483, user_credentials={real_user=slave}} blocked reactor thread for 55008.3us
I20260709 12:26:21.759537 11024 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
I20260709 12:26:21.763701 17733 raft_consensus.cc:2749] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:21.767498 17692 raft_consensus.cc:515] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:21.771890 11024 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
W20260709 12:26:21.772013 11023 leader_election.cc:336] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:21.773198 11053 raft_consensus.cc:1240] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:21.778707 11023 leader_election.cc:304] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:26:21.785622 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:26:21.781908 11644 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:26:21.770315 17684 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:21.788628 11024 leader_election.cc:304] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb
W20260709 12:26:21.793454 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 88799.7us
I20260709 12:26:21.786588 11672 raft_consensus.cc:2393] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 17: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:26:21.790091 17772 raft_consensus.cc:2804] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:21.791105 17733 raft_consensus.cc:2749] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:21.775544 17742 raft_consensus.cc:2749] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:21.794263 11645 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:21.782261 17741 raft_consensus.cc:2749] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:21.808647 17738 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:21.801532 17749 raft_consensus.cc:2749] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:21.822835 11097 leader_election.cc:336] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:21.823464 11097 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:26:21.824384 11097 leader_election.cc:336] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:21.824790 11097 leader_election.cc:304] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
W20260709 12:26:21.825665 11097 consensus_peers.cc:597] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:21.826387 17752 raft_consensus.cc:2749] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:21.827155 17752 raft_consensus.cc:2749] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:26:21.827739 11097 leader_election.cc:336] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:21.829222 11097 leader_election.cc:304] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:26:21.799902 17684 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.808218 17679 raft_consensus.cc:493] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3b1ccd8aa5412393aa7eb90f2bef95)
W20260709 12:26:21.842551 11097 consensus_peers.cc:597] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:21.843178 11097 leader_election.cc:336] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:21.844022 11097 consensus_peers.cc:597] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:21.844489 11097 consensus_peers.cc:597] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:21.847117 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 52933us
W20260709 12:26:21.851517 11643 leader_election.cc:336] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:21.853289 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb096cdb35c45e785fda6900a7999f7" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:21.853644 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:26:21.854212 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dcd574d9d144ce853b29000889507e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:21.859287 17684 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:21.860631 17692 leader_election.cc:290] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:26:21.853505 11643 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:26:21.848887 17763 raft_consensus.cc:2749] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:21.849786 17679 raft_consensus.cc:515] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.863511 10875 catalog_manager.cc:5697] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 19 to 20, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 20 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:21.873131 10875 catalog_manager.cc:5697] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 18 to 19, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 19 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:21.877317 11057 raft_consensus.cc:1240] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Rejecting Update request from peer 7518bdeb78f24e67a530754ae48547eb for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:21.869691 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8390bc6d251348e398da3cb9bee4bd2c" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:26:21.878908 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4458a30aab4e97ae1d0e1d465fae04" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:26:21.879621 11053 raft_consensus.cc:3060] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:21.880935 17734 consensus_queue.cc:1059] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:21.881887 17692 raft_consensus.cc:3055] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:21.882409 17692 raft_consensus.cc:740] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:26:21.883795 17692 consensus_queue.cc:260] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.887076 17679 leader_election.cc:290] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:21.891470 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:26:21.893241 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:26:21.894042 11130 raft_consensus.cc:2393] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 17: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:26:21.897392 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edc7e1c10ce4d21b4ad909d703ace3e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:26:21.898957 11127 raft_consensus.cc:3060] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:21.898205 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af28bcf443bc457bacfe081d037b6d9c" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:21.889186 17692 raft_consensus.cc:3060] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:26:21.905121 11643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 53631.7us
W20260709 12:26:21.905738 11643 leader_election.cc:336] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:21.906160 11643 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:26:21.907076 11098 leader_election.cc:304] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:26:21.893179 11097 leader_election.cc:336] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:21.909819 11097 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, bc01179655564f29b83babe396377cbb
I20260709 12:26:21.909946 17719 raft_consensus.cc:2749] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:21.912500 17776 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:21.898036 17752 consensus_queue.cc:1059] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
W20260709 12:26:21.911158 11643 leader_election.cc:336] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:21.923772 11643 leader_election.cc:336] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:21.928587 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a3d1504ca450d9efd93115b1164f9" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:21.922919 17694 raft_consensus.cc:2749] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:26:21.932200 17752 raft_consensus.cc:3055] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:21.932643 17752 raft_consensus.cc:740] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:26:21.907562 17684 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:26:21.942454 11023 leader_election.cc:336] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:21.942898 11023 leader_election.cc:304] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:26:21.936859 11645 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:21.933477 17752 consensus_queue.cc:260] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.954342 11645 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:21.957726 17778 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:21.922402 17772 raft_consensus.cc:697] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:26:21.959280 17772 consensus_queue.cc:237] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:21.958524 11056 raft_consensus.cc:1275] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 21 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:26:21.966686 17778 raft_consensus.cc:2749] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:21.977275 10876 catalog_manager.cc:5697] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 21 to 22, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 22 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
I20260709 12:26:21.980001 10876 catalog_manager.cc:5697] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 21 to 22, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194). New cstate: current_term: 22 leader_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:22.001044 11023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 58621.2us
I20260709 12:26:22.002205 11676 raft_consensus.cc:1275] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:26:22.002524 17752 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:26:22.004769 11097 leader_election.cc:336] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:22.006788 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 52536.9us
I20260709 12:26:22.022394 11645 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:26:21.997845 11053 raft_consensus.cc:2468] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 16.
I20260709 12:26:22.014022 17751 raft_consensus.cc:2749] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:26:22.025983 11643 leader_election.cc:336] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:22.039589 11643 leader_election.cc:336] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:22.027382 17779 raft_consensus.cc:2749] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:22.020972 17778 consensus_queue.cc:1048] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:22.042430 11645 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:26:22.046459 17782 raft_consensus.cc:2749] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:26:22.047662 11023 leader_election.cc:336] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:22.063655 11098 leader_election.cc:304] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:26:21.978883 11127 raft_consensus.cc:2468] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 15.
I20260709 12:26:22.067034 17720 raft_consensus.cc:2804] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:26:22.075294 11097 consensus_peers.cc:597] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:22.084029 17720 raft_consensus.cc:697] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 16 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:26:22.085292 17751 consensus_queue.cc:1048] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:22.085152 17720 consensus_queue.cc:237] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:22.086180 11645 leader_election.cc:304] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb
W20260709 12:26:22.138418 11643 leader_election.cc:336] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:22.138998 11643 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
W20260709 12:26:22.144351 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 48770.1us
I20260709 12:26:22.146224 17782 raft_consensus.cc:2749] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:22.156659 17779 raft_consensus.cc:2804] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:22.157559 17779 raft_consensus.cc:697] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:26:22.158136 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 80213.7us
I20260709 12:26:22.158576 17779 consensus_queue.cc:237] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:22.160346 10876 catalog_manager.cc:5697] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 reported cstate change: term changed from 20 to 21, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 21 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } } }
W20260709 12:26:22.162969 11023 consensus_peers.cc:597] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:22.166040 11643 consensus_peers.cc:597] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:22.205128 17789 log.cc:927] Time spent T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7: Append to log took a long time: real 0.056s	user 0.004s	sys 0.001s
I20260709 12:26:22.206115 11131 raft_consensus.cc:1275] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 22 FOLLOWER]: Refusing update from remote peer c979ef00e0ad4157b49ebbdc13ce7cd7: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:26:22.207955 17783 consensus_queue.cc:1048] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:22.208442 10875 catalog_manager.cc:5697] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 15 to 16, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 16 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:22.216164 17785 log.cc:927] Time spent T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.073s	user 0.003s	sys 0.008s
W20260709 12:26:22.217803 11097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 77555.9us
W20260709 12:26:22.231776 11643 consensus_peers.cc:597] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:22.221829 17788 log.cc:927] Time spent T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb: Append to log took a long time: real 0.078s	user 0.000s	sys 0.009s
I20260709 12:26:22.249565 10874 catalog_manager.cc:5697] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 16 to 17, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 17 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:22.268126 11023 consensus_peers.cc:597] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:22.264943 10874 catalog_manager.cc:5697] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 15 to 16, leader changed from 7518bdeb78f24e67a530754ae48547eb (127.9.145.195) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 16 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:22.352022 11053 raft_consensus.cc:1275] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:26:22.360422 17782 consensus_queue.cc:1048] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:26:22.367133 11643 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111) [suppressed 316 similar messages]
I20260709 12:26:22.371760 10874 catalog_manager.cc:5697] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 14 to 15, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 15 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:22.501920 11131 raft_consensus.cc:1275] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:26:22.503839 17737 consensus_queue.cc:1048] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:22.483378 11053 raft_consensus.cc:1275] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:26:22.517617 17737 consensus_queue.cc:1048] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:22.520925 11056 raft_consensus.cc:1275] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:26:22.523947 11097 consensus_peers.cc:597] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:22.530678  9799 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 11006)
I20260709 12:26:22.534090 17679 consensus_queue.cc:1048] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:26:22.631553 10866 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 155402us
W20260709 12:26:22.694263 10866 catalog_manager.cc:4755] TS bc01179655564f29b83babe396377cbb (127.9.145.193:46777): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9824def13ff74f65931445e01ea9cb84: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:22.708129 11643 consensus_peers.cc:597] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:22.722756 11128 raft_consensus.cc:1275] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:26:22.724567 17779 consensus_queue.cc:1048] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:22.898275 17679 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:22.898861 17679 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:22.901079 17679 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:22.903434 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:26:22.922508 11056 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 18.
I20260709 12:26:22.925751 11098 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:26:22.926712 17720 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:22.927119 17720 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:22.927462 17720 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:22.904621 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:22.931151 11672 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 17.
I20260709 12:26:22.968679 17720 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:23.024261 17720 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:23.025377 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:26:23.026515 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8383ba7a20f343a2bf66fc93ad293a56" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:26:23.034610 11676 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:26:23.034610 11056 raft_consensus.cc:3060] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:23.047400 11676 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 19.
I20260709 12:26:23.048834 11098 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:26:23.049842 17720 raft_consensus.cc:2804] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:23.050448 17720 raft_consensus.cc:697] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 19 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:26:23.051331 17720 consensus_queue.cc:237] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:23.060348 11056 raft_consensus.cc:2468] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 19.
I20260709 12:26:23.091985 10876 catalog_manager.cc:5697] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:23.193569 11643 consensus_peers.cc:597] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:23.302846 11643 consensus_peers.cc:597] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:23.306448 11023 consensus_peers.cc:597] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:23.315670 11643 consensus_peers.cc:597] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:23.318210 17720 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:23.318825 17720 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:23.322043 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" is_pre_election: true
I20260709 12:26:23.322744 11056 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 18.
I20260709 12:26:23.324091 11098 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7; no voters: 
I20260709 12:26:23.324903 17694 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:23.325325 17694 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:23.325673 17694 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:23.327754 17720 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:23.329421 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:23.330230 11672 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 18.
I20260709 12:26:23.334167 17694 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:26:23.336885 11023 consensus_peers.cc:597] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:23.339250 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:26:23.342621 11672 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:23.339773 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb240ba9bd84493aa3cda1c24e646f1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7"
I20260709 12:26:23.348881 11056 raft_consensus.cc:3060] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:23.354586 11672 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 19.
I20260709 12:26:23.356320 11098 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:26:23.357959 17720 raft_consensus.cc:2804] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:23.358559 17720 raft_consensus.cc:697] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 19 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:26:23.359440 17720 consensus_queue.cc:237] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:26:23.362849 11643 consensus_peers.cc:597] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:23.377149 11097 consensus_peers.cc:597] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:23.336334 17694 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:26:23.380961 11643 consensus_peers.cc:597] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:23.381381 11056 raft_consensus.cc:2468] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 19.
I20260709 12:26:23.396889 10876 catalog_manager.cc:5697] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:23.434666 11643 consensus_peers.cc:597] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:23.490653 11676 raft_consensus.cc:1275] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:26:23.492440 17720 consensus_queue.cc:1048] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:26:23.531220  9799 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 11006)
W20260709 12:26:23.572417 11643 consensus_peers.cc:597] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:23.589413 11643 consensus_peers.cc:597] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:23.589475 11023 consensus_peers.cc:597] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:23.617488 11055 raft_consensus.cc:1275] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 12:26:23.620409 11643 consensus_peers.cc:597] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:23.631031 17719 consensus_queue.cc:1048] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:26:23.703802 11023 consensus_peers.cc:597] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:23.723344 11097 consensus_peers.cc:597] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:23.739881 11055 raft_consensus.cc:1275] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:26:23.741591 17679 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:26:23.759871 11023 consensus_peers.cc:597] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:23.770853 11643 consensus_peers.cc:597] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:23.796667 11023 consensus_peers.cc:597] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:23.797658 11676 raft_consensus.cc:1275] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 12:26:23.796628 11643 consensus_peers.cc:597] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:23.819442 11023 consensus_peers.cc:597] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:23.834483 17719 consensus_queue.cc:1048] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:23.844208 17720 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:23.849753 17720 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:26:23.817545 11097 consensus_peers.cc:597] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:23.851969 17720 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:23.857295 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:23.858043 11672 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 17.
W20260709 12:26:23.863224 11023 consensus_peers.cc:597] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:23.863817 11023 consensus_peers.cc:597] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:23.869129 11097 leader_election.cc:336] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:23.871016 11098 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb
I20260709 12:26:23.871785 17720 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:23.872185 17720 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:23.872496 17720 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:23.880509 17720 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:23.897122 17720 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 election: Requested vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:23.898725 11672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634832ddce4348f1bb6c7bbf1b9045f0" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:26:23.899411 11672 raft_consensus.cc:3060] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:23.907528 11672 raft_consensus.cc:2468] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 18.
I20260709 12:26:23.908880 11098 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
W20260709 12:26:23.909554 11097 leader_election.cc:336] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:23.911042 17720 raft_consensus.cc:2804] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:23.912164 17720 raft_consensus.cc:697] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 18 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:26:23.913448 17720 consensus_queue.cc:237] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:26:23.963340 11643 consensus_peers.cc:597] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:23.979205 10876 catalog_manager.cc:5697] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 16 to 18, leader changed from bc01179655564f29b83babe396377cbb (127.9.145.193) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 18 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:23.984489 11097 consensus_peers.cc:597] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:23.985060 11097 consensus_peers.cc:597] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:23.985580 11097 consensus_peers.cc:597] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:24.006448 11643 consensus_peers.cc:597] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:24.041839 11643 consensus_peers.cc:597] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:24.049580 11097 consensus_peers.cc:597] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:24.072279 11023 consensus_peers.cc:597] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:24.091158 11023 consensus_peers.cc:597] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:24.136343 11097 consensus_peers.cc:597] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:24.177955 11023 consensus_peers.cc:597] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:24.197348 11097 consensus_peers.cc:597] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:24.321455 11097 consensus_peers.cc:597] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:24.386556 11097 consensus_peers.cc:597] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:24.387806 11678 raft_consensus.cc:1275] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:26:24.391685 17719 consensus_queue.cc:1048] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:26:24.431303 11097 consensus_peers.cc:597] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:24.431303 11643 consensus_peers.cc:597] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:24.444375 11023 consensus_peers.cc:597] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:24.531761  9799 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 11006)
W20260709 12:26:24.623687 11643 consensus_peers.cc:597] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:24.684655 11023 consensus_peers.cc:597] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:24.721125 11097 consensus_peers.cc:597] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:24.792882 10866 catalog_manager.cc:4755] TS bc01179655564f29b83babe396377cbb (127.9.145.193:46777): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9824def13ff74f65931445e01ea9cb84: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:25.486938 11643 consensus_peers.cc:597] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:25.532598  9799 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 11006)
W20260709 12:26:25.550526 11643 consensus_peers.cc:597] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:25.594199 11643 consensus_peers.cc:597] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:25.603157 11023 consensus_peers.cc:597] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:25.798343 11023 consensus_peers.cc:597] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:25.886137 11023 consensus_peers.cc:597] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:25.889959 11643 consensus_peers.cc:597] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:25.899256 11023 consensus_peers.cc:597] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:25.908949 11097 consensus_peers.cc:597] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:25.910574 11643 consensus_peers.cc:597] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:25.949056 11643 consensus_peers.cc:597] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:25.991886 11643 consensus_peers.cc:597] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:26.020334 11643 consensus_peers.cc:597] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:26.083698 11643 consensus_peers.cc:597] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:26.109771 11023 consensus_peers.cc:597] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:26.196614 11023 consensus_peers.cc:597] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:26.249974 11023 consensus_peers.cc:597] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:26.291980 11643 consensus_peers.cc:597] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:26.316443 11097 consensus_peers.cc:597] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:26.340240 11097 consensus_peers.cc:597] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:26.345204 11097 consensus_peers.cc:597] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:26.346480 11643 consensus_peers.cc:597] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:26.348522 11023 consensus_peers.cc:597] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:26.364022 11643 consensus_peers.cc:597] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:26.369845 11643 consensus_peers.cc:597] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:26.437152 11097 consensus_peers.cc:597] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:26.474246 11023 consensus_peers.cc:597] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:26.482728 11023 consensus_peers.cc:597] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:26.533123  9799 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 11006)
W20260709 12:26:26.540153 11023 consensus_peers.cc:597] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:26.599261 11097 consensus_peers.cc:597] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:26.624651 11643 consensus_peers.cc:597] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:26.659147 11643 consensus_peers.cc:597] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:26.631290 11097 consensus_peers.cc:597] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:26.706132 11097 consensus_peers.cc:597] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:26.724958 11023 consensus_peers.cc:597] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:26.808416 11097 consensus_peers.cc:597] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:26.848742 11097 consensus_peers.cc:597] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:26.886237 11097 consensus_peers.cc:597] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:26.990774 11097 consensus_peers.cc:597] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:27.067785 11643 consensus_peers.cc:597] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:27.086846  9799 tablet_server.cc:196] TabletServer@127.9.145.193:0 shutdown complete.
W20260709 12:26:27.159876 11023 consensus_peers.cc:597] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:27.323211 11023 consensus_peers.cc:597] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:27.378607 11643 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111) [suppressed 439 similar messages]
W20260709 12:26:27.454631 11643 consensus_peers.cc:597] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:27.601022 11097 consensus_peers.cc:597] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:27.610200 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 138158us
I20260709 12:26:27.632223  9799 tablet_server.cc:179] TabletServer@127.9.145.194:0 shutting down...
W20260709 12:26:27.639489 11643 consensus_peers.cc:597] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:27.650710 11098 consensus_peers.cc:597] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:27.702828 11098 consensus_peers.cc:597] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:27.717447 11098 consensus_peers.cc:597] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:27.727100 11644 consensus_peers.cc:597] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:27.839880 11644 consensus_peers.cc:597] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:27.840830 11098 consensus_peers.cc:597] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:27.847254 11098 consensus_peers.cc:597] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:27.862933 11644 consensus_peers.cc:597] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:27.874200 11098 consensus_peers.cc:597] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:27.904831 11098 consensus_peers.cc:597] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:27.905547 11098 consensus_peers.cc:597] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:27.922369 11098 consensus_peers.cc:597] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:27.923102 11098 consensus_peers.cc:597] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:27.930757 11644 consensus_peers.cc:597] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:27.931603 11644 consensus_peers.cc:597] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:27.953161 11023 consensus_peers.cc:597] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:27.956389  9799 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:27.957722  9799 tablet_replica.cc:333] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:27.958670  9799 raft_consensus.cc:2243] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:27.959291  9799 raft_consensus.cc:2272] T d9e6122a57324bc79c68d46f4cc18aa7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:27.969051  9799 tablet_replica.cc:333] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:27.970022  9799 raft_consensus.cc:2243] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:27.970882  9799 raft_consensus.cc:2272] T 2cdd07e6995141b68c257e6c93f15f2e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:27.973596  9799 tablet_replica.cc:333] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:27.986765  9799 raft_consensus.cc:2243] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:27.988091  9799 raft_consensus.cc:2272] T e37077b3b6d34e6f9558c96b2d955211 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:27.990938  9799 tablet_replica.cc:333] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:27.991838  9799 raft_consensus.cc:2243] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:27.992633  9799 raft_consensus.cc:2272] T 2d9fad3893d845fa9208a48c76eb609f P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:27.995352  9799 tablet_replica.cc:333] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:27.996192  9799 raft_consensus.cc:2243] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:27.997376  9799 raft_consensus.cc:2272] T 227d10a1bcd84a0e9845113d5b0a2495 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:28.003211 11098 consensus_peers.cc:597] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.000135  9799 tablet_replica.cc:333] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.011102  9799 raft_consensus.cc:2243] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.011818  9799 raft_consensus.cc:2272] T 0bb240ba9bd84493aa3cda1c24e646f1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.015210  9799 tablet_replica.cc:333] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.016114  9799 raft_consensus.cc:2243] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.016819  9799 raft_consensus.cc:2272] T d2205be6a7c94913a366d683de188a31 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.023010  9799 tablet_replica.cc:333] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.023874  9799 raft_consensus.cc:2243] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.027065  9799 raft_consensus.cc:2272] T ad5b1fe8f9f246d791d03da03e5c44ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.029784  9799 tablet_replica.cc:333] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.035997  9799 raft_consensus.cc:2243] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.037657  9799 raft_consensus.cc:2272] T 6c233c491e1b4126b9d776bfd98023b6 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:28.040287 11644 consensus_peers.cc:597] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.040494  9799 tablet_replica.cc:333] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.041376  9799 raft_consensus.cc:2243] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.055081  9799 raft_consensus.cc:2272] T a5d087871c7847629fca3c40460a08b1 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.057964  9799 tablet_replica.cc:333] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.058911  9799 raft_consensus.cc:2243] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.059613  9799 raft_consensus.cc:2272] T 65c91dadbee643c4bc2ef982cc40ffe8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.062139  9799 tablet_replica.cc:333] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.063025  9799 raft_consensus.cc:2243] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.069555  9799 raft_consensus.cc:2272] T 5d1c6709dd7d464db6e30b204580fe75 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:28.070670 11644 consensus_peers.cc:597] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.072438  9799 tablet_replica.cc:333] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.073357  9799 raft_consensus.cc:2243] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.074470  9799 raft_consensus.cc:2272] T 9824def13ff74f65931445e01ea9cb84 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.077184  9799 tablet_replica.cc:333] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
W20260709 12:26:28.079628 11644 consensus_peers.cc:597] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.091436  9799 raft_consensus.cc:2243] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.092247  9799 raft_consensus.cc:2272] T f81a3074c9b841b6a602953195c8ef98 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.095013  9799 tablet_replica.cc:333] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.095957  9799 raft_consensus.cc:2243] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.097118  9799 raft_consensus.cc:2272] T d50eacd0821047a9930a0698124ba4f0 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.099797  9799 tablet_replica.cc:333] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
W20260709 12:26:28.092743 11644 consensus_peers.cc:597] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.107838  9799 raft_consensus.cc:2243] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.108799  9799 raft_consensus.cc:2272] T d3ee878370114c8d8434e02b9c0aa6be P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.111820  9799 tablet_replica.cc:333] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
W20260709 12:26:28.114804 11098 consensus_peers.cc:597] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:28.115284 11643 consensus_peers.cc:597] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:28.118373 11644 consensus_peers.cc:597] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.125147  9799 raft_consensus.cc:2243] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.125907  9799 raft_consensus.cc:2272] T d938b7067315410aa8ef1ecddf452945 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.128587  9799 tablet_replica.cc:333] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.129768  9799 raft_consensus.cc:2243] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.130983  9799 raft_consensus.cc:2272] T 0a21734672b8441faae7b5d5d050d2b2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.133733  9799 tablet_replica.cc:333] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.134548  9799 raft_consensus.cc:2243] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 LEADER]: Raft consensus shutting down.
W20260709 12:26:28.134627 11644 consensus_peers.cc:597] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.147866  9799 raft_consensus.cc:2272] T 702d64a1236147a784daa11e58563721 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.154350  9799 tablet_replica.cc:333] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.155212  9799 raft_consensus.cc:2243] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.155989  9799 raft_consensus.cc:2272] T af28bcf443bc457bacfe081d037b6d9c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.161351  9799 tablet_replica.cc:333] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.162289  9799 raft_consensus.cc:2243] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.162987  9799 raft_consensus.cc:2272] T e8083bc5cbd34d98a24be9a390262c19 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.166157  9799 tablet_replica.cc:333] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.172927  9799 raft_consensus.cc:2243] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.173710  9799 raft_consensus.cc:2272] T ceabf3208ccf4abbad90d81586377118 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.183203  9799 tablet_replica.cc:333] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
W20260709 12:26:28.170670 11643 consensus_peers.cc:597] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:28.166528 11098 consensus_peers.cc:597] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.196063  9799 raft_consensus.cc:2243] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.196940  9799 raft_consensus.cc:2272] T a84c56f62e0a4a9990f4969bc324dd7e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:28.202368 11643 consensus_peers.cc:597] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:28.204100 11644 consensus_peers.cc:597] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.204639  9799 tablet_replica.cc:333] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.205569  9799 raft_consensus.cc:2243] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.206765  9799 raft_consensus.cc:2272] T 46989f4f6130442698a2028fb5bcbf0e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.209414  9799 tablet_replica.cc:333] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.216215  9799 raft_consensus.cc:2243] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.220815  9799 raft_consensus.cc:2272] T 6875ad729dd0416d88035fd642f6b3bd P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.226883  9799 tablet_replica.cc:333] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.227811  9799 raft_consensus.cc:2243] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.232930  9799 raft_consensus.cc:2272] T ec4be143c296464e86202c1a42e3d3ee P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.236723  9799 tablet_replica.cc:333] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.242815  9799 raft_consensus.cc:2243] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.245976  9799 raft_consensus.cc:2272] T ed6bc26e6dfc446c9b989b8483864ae4 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.250272  9799 tablet_replica.cc:333] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.252604  9799 raft_consensus.cc:2243] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.261667  9799 raft_consensus.cc:2272] T 5635e70df91d469ca24e987e2a28c27d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.264427  9799 tablet_replica.cc:333] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.265298  9799 raft_consensus.cc:2243] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Raft consensus shutting down.
W20260709 12:26:28.269115 11023 consensus_peers.cc:597] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:28.269805  9799 raft_consensus.cc:2272] T 42f9fb63946447bdadbb789c9398031d P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:28.302646 11643 consensus_peers.cc:597] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:28.342235  9799 tablet_replica.cc:333] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.345368  9799 raft_consensus.cc:2243] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.350160  9799 raft_consensus.cc:2272] T 87a7b71cfb864c1b9ab4c85887ca32ad P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.355783  9799 tablet_replica.cc:333] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.358028  9799 raft_consensus.cc:2243] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.362025  9799 raft_consensus.cc:2272] T 5d049c89d78443e886fd95f8df54f02b P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:28.404762 11097 consensus_peers.cc:597] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:28.438472 11643 consensus_peers.cc:597] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:26:28.456588  9799 tablet_replica.cc:333] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.458724  9799 raft_consensus.cc:2243] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.460500  9799 raft_consensus.cc:2272] T 820ab313402049dfa58d12167763953e P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:28.483165 11643 consensus_peers.cc:597] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:28.486568  9799 tablet_replica.cc:333] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.487783  9799 raft_consensus.cc:2243] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.489135  9799 raft_consensus.cc:2272] T 8390bc6d251348e398da3cb9bee4bd2c P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.492559  9799 tablet_replica.cc:333] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.522951  9799 raft_consensus.cc:2243] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.524511  9799 raft_consensus.cc:2272] T 03bda770d3504576acc9bfb2923fb9ff P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.537045  9799 tablet_replica.cc:333] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
W20260709 12:26:28.561527 11643 consensus_peers.cc:597] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:28.564136  9799 raft_consensus.cc:2243] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.565097  9799 raft_consensus.cc:2272] T 2721401e0fa944aea90572c7ec29c134 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.569737  9799 tablet_replica.cc:333] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.570621  9799 raft_consensus.cc:2243] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.571617  9799 raft_consensus.cc:2272] T 2f4458a30aab4e97ae1d0e1d465fae04 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:28.598618 11643 consensus_peers.cc:597] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:28.605707 11097 consensus_peers.cc:597] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:26:28.610138  9799 tablet_replica.cc:333] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.611316  9799 raft_consensus.cc:2243] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.612493  9799 raft_consensus.cc:2272] T 0bb096cdb35c45e785fda6900a7999f7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:28.619213 11643 consensus_peers.cc:597] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:28.646044  9799 tablet_replica.cc:333] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.646974  9799 raft_consensus.cc:2243] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.649121  9799 raft_consensus.cc:2272] T 494450549bab41b6a4c557c9d2afddc7 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.656077  9799 tablet_replica.cc:333] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.659703  9799 raft_consensus.cc:2243] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.662779  9799 raft_consensus.cc:2272] T cf134f8026dd4c7c8bbdf22ddca4edf2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.666896  9799 tablet_replica.cc:333] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.667874  9799 raft_consensus.cc:2243] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:28.690322 11643 consensus_peers.cc:597] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:28.696745  9799 raft_consensus.cc:2272] T 8383ba7a20f343a2bf66fc93ad293a56 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.726823  9799 tablet_replica.cc:333] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.727768  9799 raft_consensus.cc:2243] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.729363  9799 raft_consensus.cc:2272] T 265677e547f5428e992bc91650ec60e2 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.732980  9799 tablet_replica.cc:333] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.733767  9799 raft_consensus.cc:2243] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.734746  9799 raft_consensus.cc:2272] T c7865a5cff5849a2bd74dddc1bcdd8f3 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.738306  9799 tablet_replica.cc:333] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.739092  9799 raft_consensus.cc:2243] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.740602  9799 raft_consensus.cc:2272] T 709d2903489748c8a8490194704bc3ca P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.744179  9799 tablet_replica.cc:333] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7: stopping tablet replica
I20260709 12:26:28.744987  9799 raft_consensus.cc:2243] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.746428  9799 raft_consensus.cc:2272] T 1d0463b3e1c746218d71d6d8eb843dc8 P c979ef00e0ad4157b49ebbdc13ce7cd7 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:28.807626 11643 consensus_peers.cc:597] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:28.831126 11643 consensus_peers.cc:597] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:28.899480 11097 consensus_peers.cc:597] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:28.901190 11643 consensus_peers.cc:597] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:28.953418 11097 consensus_peers.cc:597] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:28.964350 11643 consensus_peers.cc:597] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:28.977748 10866 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.145.193:46777, user_credentials={real_user=slave}} blocked reactor thread for 45452.4us
W20260709 12:26:28.978847 11097 consensus_peers.cc:597] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:28.985754 10866 catalog_manager.cc:4755] TS bc01179655564f29b83babe396377cbb (127.9.145.193:46777): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9824def13ff74f65931445e01ea9cb84: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:29.019691 11644 connection.cc:769] client connection to 127.9.145.194:44483 send error: Network error: sendmsg error: Connection reset by peer (error 104)
W20260709 12:26:29.065332 11097 consensus_peers.cc:597] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:29.083624 17844 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:29.084465 17844 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:29.087275 17844 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:26:29.093746 11643 leader_election.cc:336] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:29.095010 11644 leader_election.cc:336] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:29.095552 11644 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:29.102661 17737 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:29.146871 17720 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:29.147471 17720 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:29.152015 17720 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:26:29.156817 17737 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:29.174084 17737 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:29.176313 17737 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:26:29.159387 17844 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:29.178237 17844 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:26:29.168561 11098 leader_election.cc:336] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:29.182302 17844 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:26:29.192298 11097 leader_election.cc:336] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:29.201397 11097 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:29.203110 17843 raft_consensus.cc:2749] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:29.238623 11643 leader_election.cc:336] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:29.243690 11643 leader_election.cc:336] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:29.244424 11097 consensus_peers.cc:597] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:29.251566 11644 leader_election.cc:336] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:29.255781 11644 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:29.262547 17851 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:26:29.264297 11097 consensus_peers.cc:597] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:29.265736 11644 leader_election.cc:336] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:29.276327 11644 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:29.279423 17851 raft_consensus.cc:2749] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:29.320433 11097 consensus_peers.cc:597] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:29.328234 17720 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:29.328858 17720 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:29.330992 17720 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:29.334343 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:26:29.344323 11098 leader_election.cc:336] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:29.344831 17851 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:29.345156 17737 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:26:29.358420 11097 consensus_peers.cc:597] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:29.344798 11098 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:29.358757 17737 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:29.361148 17737 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:26:29.358654 17851 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:29.363159 17851 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:26:29.366616 17843 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:29.367268 17843 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:29.369597 17843 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:29.372285 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:29.373952 17720 raft_consensus.cc:2749] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:26:29.374548 11644 leader_election.cc:336] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
W20260709 12:26:29.375556 11644 leader_election.cc:336] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
W20260709 12:26:29.375998 11643 leader_election.cc:336] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:29.376986 11643 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:29.377821 17851 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:26:29.378126 11643 leader_election.cc:336] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:29.378722 11643 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:29.380679 17851 raft_consensus.cc:2749] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:29.389175 17851 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:29.389886 17851 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:29.392409 17851 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:29.393731 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:29.394158 17851 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:29.394484 11127 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 19.
I20260709 12:26:29.395000 17851 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:29.396157 11645 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
W20260709 12:26:29.396814 11098 leader_election.cc:336] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:29.397316 11098 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:29.397591 17844 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:29.398026 17844 raft_consensus.cc:493] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:29.398475 17844 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:29.403285 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:29.403985 11127 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 14.
I20260709 12:26:29.405292 11645 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:26:29.406169 17737 raft_consensus.cc:2804] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:29.406512 17737 raft_consensus.cc:493] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:29.406826 17737 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:29.409339 17826 raft_consensus.cc:2749] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:29.409014 17844 raft_consensus.cc:515] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:29.416092 17844 leader_election.cc:290] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:26:29.418394 11644 leader_election.cc:336] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:29.419697 17737 raft_consensus.cc:515] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:29.420384 17851 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:29.435070 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46989f4f6130442698a2028fb5bcbf0e" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:26:29.435803 11127 raft_consensus.cc:3060] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:29.445006 11128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f9fb63946447bdadbb789c9398031d" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:26:29.445724 11128 raft_consensus.cc:3060] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:29.454077 11128 raft_consensus.cc:2468] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 15.
I20260709 12:26:29.456039 11645 leader_election.cc:304] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:26:29.458372 17737 leader_election.cc:290] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:29.458767 17831 raft_consensus.cc:2804] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:29.459982 17831 raft_consensus.cc:697] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:26:29.461086 17831 consensus_queue.cc:237] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:29.459249 17852 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:29.462524 17852 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:29.465029 17852 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:29.472607 11127 raft_consensus.cc:2468] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 20.
W20260709 12:26:29.475369 11644 leader_election.cc:336] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
W20260709 12:26:29.476219 11644 leader_election.cc:336] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:29.480481 11645 leader_election.cc:304] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:26:29.480726 11644 leader_election.cc:336] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:29.481846 17844 raft_consensus.cc:2804] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:29.482481 17844 raft_consensus.cc:697] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:26:29.484261 17844 consensus_queue.cc:237] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:26:29.485051 11097 consensus_peers.cc:597] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:29.502907 17854 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:29.504290 17852 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:29.505080 17852 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:29.507606 17852 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:26:29.509217 17854 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:29.512393 17854 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:26:29.513190 11097 leader_election.cc:336] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:29.519591 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:29.520371 11676 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 17.
I20260709 12:26:29.521265 17855 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:29.521938 17855 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:29.524736 17855 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:29.527318 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:29.528064 11131 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 16.
I20260709 12:26:29.531059 11645 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:26:29.532591 17737 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:29.533219 17737 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:29.535260 17737 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:26:29.535689 11644 leader_election.cc:336] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:29.534945 10876 catalog_manager.cc:5697] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 14 to 15, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 15 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:29.538703 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:29.539460 11127 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 17.
I20260709 12:26:29.541258 11645 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:26:29.542308 17855 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:29.542850 17855 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:29.543246 17855 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:29.545892 17854 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:29.538666 17831 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:29.546886 17831 raft_consensus.cc:493] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:29.546702 17854 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:29.547415 17831 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:26:29.551669 11098 leader_election.cc:336] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
W20260709 12:26:29.554879 11097 leader_election.cc:336] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:29.556021 17854 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:26:29.560230 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:26:29.546321 11644 leader_election.cc:336] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:29.572988 11098 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:29.575692 17854 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:29.576102 17854 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:29.576531 17854 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:26:29.576308 11098 leader_election.cc:336] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:29.584342 17831 raft_consensus.cc:515] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:29.578280 11098 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:29.589872 17853 raft_consensus.cc:2749] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:29.590912 17855 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:29.593081 17855 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:26:29.596568 11097 consensus_peers.cc:597] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:29.599891 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:26:29.596858 17854 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:29.601581 11127 raft_consensus.cc:2393] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in current term 18: Already voted for candidate 7518bdeb78f24e67a530754ae48547eb in this term.
I20260709 12:26:29.602283 11676 raft_consensus.cc:2393] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 17: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:26:29.603417 17854 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
W20260709 12:26:29.604254 11643 consensus_peers.cc:597] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:26:29.609202 11127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9824def13ff74f65931445e01ea9cb84" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:26:29.609911 11127 raft_consensus.cc:3060] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:26:29.620522 11644 leader_election.cc:336] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:29.621098 11644 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:26:29.601696 11098 leader_election.cc:336] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:29.622299 17858 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:29.625227 17831 leader_election.cc:290] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:26:29.625891 11098 leader_election.cc:336] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:29.627506 11098 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:29.630419 17854 raft_consensus.cc:2749] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:26:29.625281 11644 leader_election.cc:336] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:29.638293 17831 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:29.621385 11127 raft_consensus.cc:2468] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 17.
I20260709 12:26:29.650547 17831 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:29.651571 11645 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:29.641723 11098 leader_election.cc:304] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:29.652756 17853 raft_consensus.cc:2749] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:29.657286 11098 leader_election.cc:336] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
W20260709 12:26:29.660374 11643 leader_election.cc:336] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:29.663026 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:26:29.663827 11676 raft_consensus.cc:2393] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7518bdeb78f24e67a530754ae48547eb in current term 18: Already voted for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in this term.
I20260709 12:26:29.664355 17844 raft_consensus.cc:2804] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:29.664885 17844 raft_consensus.cc:697] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
I20260709 12:26:29.653030 17831 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:26:29.666033 17844 consensus_queue.cc:237] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:29.682138 11098 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:29.682983 17853 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:29.688509 17853 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:29.689126 17853 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:29.697099 17853 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:26:29.699692 11097 leader_election.cc:336] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:29.707515 11644 leader_election.cc:336] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:29.708166 11644 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:29.712332 17863 raft_consensus.cc:2749] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:29.715600 10876 catalog_manager.cc:5697] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 19 to 20, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 20 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:29.717934 10876 catalog_manager.cc:5697] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 16 to 17, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 17 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:29.724133 11098 leader_election.cc:336] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:29.724650 11098 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:29.725346 17843 raft_consensus.cc:2749] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:29.762028 11643 consensus_peers.cc:597] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:26:29.801678 17843 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:29.802268 17843 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:29.805435 17843 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:26:29.810597 11097 leader_election.cc:336] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:29.814584 11098 leader_election.cc:336] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:29.815071 11098 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:29.815821 17843 raft_consensus.cc:2749] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:29.935591 17843 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:29.936164 17843 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:29.939579 17843 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:26:29.943877 11097 leader_election.cc:336] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:29.947683 11098 leader_election.cc:336] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:29.948185 11098 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:29.949476 17843 raft_consensus.cc:2749] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:29.957715 17843 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:29.958303 17843 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:29.960542 17843 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:26:29.969082 11097 leader_election.cc:336] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:29.971846 11644 consensus_peers.cc:597] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:29.973517 11098 leader_election.cc:336] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:29.974067 11098 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:29.977151 17853 raft_consensus.cc:2749] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:29.989527 11098 consensus_peers.cc:597] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:29.991454 11644 consensus_peers.cc:597] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:30.041436  9799 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 11081)
I20260709 12:26:30.053586 17843 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:30.054320 17843 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:30.056677 17843 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:30.059190 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
W20260709 12:26:30.065296 11098 leader_election.cc:336] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:30.065793 11098 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:30.067094 17843 raft_consensus.cc:2749] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:30.069629 11127 raft_consensus.cc:1275] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 20 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:26:30.071452 17863 consensus_queue.cc:1048] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:26:30.083544 11643 consensus_peers.cc:597] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:30.090467 11098 consensus_peers.cc:597] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:30.095996 11131 raft_consensus.cc:1275] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:26:30.097852 17831 consensus_queue.cc:1048] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:30.124410 17844 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:30.125062 17844 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:30.127512 17844 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:30.138969 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb" is_pre_election: true
I20260709 12:26:30.139745 11131 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 14.
I20260709 12:26:30.145418 17843 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:30.146122 17843 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:30.148337 17843 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:26:30.149724 11131 raft_consensus.cc:1275] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:26:30.148375 11645 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
I20260709 12:26:30.152945 17851 raft_consensus.cc:2804] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:30.153363 17851 raft_consensus.cc:493] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:30.153746 17851 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:26:30.157200 11098 leader_election.cc:336] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
W20260709 12:26:30.158219 11097 leader_election.cc:336] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:30.158350 11644 leader_election.cc:336] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:30.166342 17831 consensus_queue.cc:1048] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:30.158684 11097 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:30.174535 17843 raft_consensus.cc:2749] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:26:30.182992 11098 consensus_peers.cc:597] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:30.183523 11098 consensus_peers.cc:597] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:30.183979 11098 consensus_peers.cc:597] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:30.190896 17851 raft_consensus.cc:515] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:30.224952 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0463b3e1c746218d71d6d8eb843dc8" candidate_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7518bdeb78f24e67a530754ae48547eb"
I20260709 12:26:30.225607 11131 raft_consensus.cc:3060] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:30.228446 17851 leader_election.cc:290] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:26:30.237100 11644 leader_election.cc:336] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
W20260709 12:26:30.238376 11644 consensus_peers.cc:597] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:30.238781 11644 consensus_peers.cc:597] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:30.241324 11131 raft_consensus.cc:2468] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3b1ccd8aa5412393aa7eb90f2bef95 in term 15.
I20260709 12:26:30.242612 11645 leader_election.cc:304] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:30.245422 17851 raft_consensus.cc:2804] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:26:30.245419 11644 consensus_peers.cc:597] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:30.248317 17851 raft_consensus.cc:697] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEADER]: Becoming Leader. State: Replica: 0f3b1ccd8aa5412393aa7eb90f2bef95, State: Running, Role: LEADER
W20260709 12:26:30.251256 11098 consensus_peers.cc:597] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:30.250775 17851 consensus_queue.cc:237] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:30.278810 10875 catalog_manager.cc:5697] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 reported cstate change: term changed from 14 to 15, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196). New cstate: current_term: 15 leader_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:30.298847 11098 consensus_peers.cc:597] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:30.312111 11098 consensus_peers.cc:597] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:30.356045 11098 consensus_peers.cc:597] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:30.367486 11644 consensus_peers.cc:597] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:30.392269 11098 consensus_peers.cc:597] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:30.403757 11098 consensus_peers.cc:597] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:30.453280 11644 consensus_peers.cc:597] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:30.458436 11097 consensus_peers.cc:597] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:30.483614 11644 consensus_peers.cc:597] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:30.493314 11644 consensus_peers.cc:597] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:30.527788 11644 consensus_peers.cc:597] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:30.580247 11643 consensus_peers.cc:597] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:30.622797 11644 consensus_peers.cc:597] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:30.625792 11644 consensus_peers.cc:597] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:30.642400 11644 consensus_peers.cc:597] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:30.645576 11644 consensus_peers.cc:597] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:30.674649 11098 consensus_peers.cc:597] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:30.692250 11131 raft_consensus.cc:1275] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Refusing update from remote peer 0f3b1ccd8aa5412393aa7eb90f2bef95: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:26:30.699970 17851 consensus_queue.cc:1048] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:26:30.704106 11643 consensus_peers.cc:597] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:30.728169 11643 consensus_peers.cc:597] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:30.752673 11644 consensus_peers.cc:597] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:30.766485 17831 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:30.767058 17831 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:30.769200 17831 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:26:30.777721 11643 leader_election.cc:336] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:30.780299 11097 consensus_peers.cc:597] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:30.790755 11643 consensus_peers.cc:597] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:30.861982 11643 consensus_peers.cc:597] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:30.863363 11644 leader_election.cc:336] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:30.877192 17844 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:30.877821 17844 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:30.863899 11644 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:30.880396 17876 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:30.883755 17844 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:26:30.889237 11643 leader_election.cc:336] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:30.933678 11644 consensus_peers.cc:597] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:30.939502 11098 consensus_peers.cc:597] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:30.947767 11097 consensus_peers.cc:597] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:30.934316 11644 leader_election.cc:336] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:30.948694 11644 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:30.949657 17876 raft_consensus.cc:2749] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:30.979238 11643 consensus_peers.cc:597] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:31.068357 11643 consensus_peers.cc:597] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:31.167332 11097 consensus_peers.cc:597] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:31.175474 11643 consensus_peers.cc:597] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:26:31.180675 17853 raft_consensus.cc:493] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:31.181365 17853 raft_consensus.cc:515] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:31.183897 17853 leader_election.cc:290] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:26:31.197187 11097 leader_election.cc:336] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:31.198310 11643 consensus_peers.cc:597] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:31.216636 11098 leader_election.cc:336] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:31.217109 11098 leader_election.cc:304] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:31.218343 17853 raft_consensus.cc:2749] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:31.230594 17853 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.231308 17853 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:31.233623 17853 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:31.253909 17876 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:31.254572 17876 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:31.256798 17876 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:26:31.276839 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" is_pre_election: true
I20260709 12:26:31.277609 11677 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 18.
W20260709 12:26:31.296402 11643 consensus_peers.cc:597] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:26:31.321693 11098 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
W20260709 12:26:31.324723 11644 leader_election.cc:336] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:31.324645 17853 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:31.335050 17853 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:31.335532 17853 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:31.342566 17876 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:31.343358 17876 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:31.345693 17876 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:26:31.356331 11643 leader_election.cc:336] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:31.356920 11643 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:31.359869 17844 raft_consensus.cc:2749] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:31.357074 11644 leader_election.cc:336] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
W20260709 12:26:31.381407 11643 leader_election.cc:336] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:31.381974 11643 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:31.383234 17876 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:26:31.394268 11098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:42197, user_credentials={real_user=slave}} blocked reactor thread for 70651us
I20260709 12:26:31.406548 17853 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:31.408716 17853 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 election: Requested vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 0f3b1ccd8aa5412393aa7eb90f2bef95 (127.9.145.196:42197)
I20260709 12:26:31.434821 17831 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:31.435494 17831 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:31.438575 11677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d087871c7847629fca3c40460a08b1" candidate_uuid: "7518bdeb78f24e67a530754ae48547eb" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95"
I20260709 12:26:31.439219 11677 raft_consensus.cc:3060] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:26:31.446415 11644 leader_election.cc:336] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
W20260709 12:26:31.448941 11643 leader_election.cc:336] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:31.449476 11643 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:31.450445 17831 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:26:31.455703 11098 leader_election.cc:336] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:31.448158 11677 raft_consensus.cc:2468] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7518bdeb78f24e67a530754ae48547eb in term 19.
I20260709 12:26:31.451336 17831 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:26:31.459683 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 55272.5us
I20260709 12:26:31.463898 11098 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95, 7518bdeb78f24e67a530754ae48547eb; no voters: 
W20260709 12:26:31.467794 11643 consensus_peers.cc:597] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:31.474345 17854 raft_consensus.cc:2804] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:31.474992 17854 raft_consensus.cc:697] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 19 LEADER]: Becoming Leader. State: Replica: 7518bdeb78f24e67a530754ae48547eb, State: Running, Role: LEADER
I20260709 12:26:31.475899 17854 consensus_queue.cc:237] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:26:31.478281 11643 consensus_peers.cc:597] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:26:31.479825 17881 raft_consensus.cc:493] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:31.480403 17881 raft_consensus.cc:515] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:31.482897 17881 leader_election.cc:290] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:26:31.489936 11643 consensus_peers.cc:597] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:31.493585 11098 leader_election.cc:336] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
W20260709 12:26:31.494879 11097 leader_election.cc:336] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:31.499116 11098 leader_election.cc:336] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:31.499648 11098 leader_election.cc:304] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:31.500557 17880 raft_consensus.cc:2749] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:31.520332 17876 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:31.520925 17876 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:31.530885 17876 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:26:31.534065 10875 catalog_manager.cc:5697] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb reported cstate change: term changed from 17 to 19, leader changed from c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194) to 7518bdeb78f24e67a530754ae48547eb (127.9.145.195). New cstate: current_term: 19 leader_uuid: "7518bdeb78f24e67a530754ae48547eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:31.542292 11644 leader_election.cc:336] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
W20260709 12:26:31.546681 11643 leader_election.cc:336] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:31.547253 11643 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:31.548077 17876 raft_consensus.cc:2749] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:26:31.619212 11097 consensus_peers.cc:597] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:26:31.698673 17854 raft_consensus.cc:493] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:31.699313 17854 raft_consensus.cc:515] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:26:31.710268 11098 leader_election.cc:336] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
W20260709 12:26:31.712908 11097 leader_election.cc:336] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:31.713495 11097 leader_election.cc:304] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:31.714668 17881 raft_consensus.cc:2749] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:31.710848 17854 leader_election.cc:290] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:26:31.749069 17854 raft_consensus.cc:493] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
W20260709 12:26:31.750499 11097 consensus_peers.cc:597] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:26:31.749681 17854 raft_consensus.cc:515] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:26:31.758956 11098 leader_election.cc:336] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:31.762779 17854 leader_election.cc:290] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:26:31.765414 11097 leader_election.cc:336] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:31.766072 11097 leader_election.cc:304] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:31.767490 17854 raft_consensus.cc:2749] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:26:31.798207 11097 consensus_peers.cc:597] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:31.805083 11643 consensus_peers.cc:597] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:31.814025 11097 consensus_peers.cc:597] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:31.870555 17854 raft_consensus.cc:493] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:31.871132 17854 raft_consensus.cc:515] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:31.873337 17854 leader_election.cc:290] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:26:31.879141 11097 leader_election.cc:336] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:31.900422 11098 leader_election.cc:336] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:31.901019 11098 leader_election.cc:304] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:31.901826 17881 raft_consensus.cc:2749] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:31.903375 17881 raft_consensus.cc:493] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:31.903872 17881 raft_consensus.cc:515] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:31.905951 17881 leader_election.cc:290] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:26:31.911564 11097 leader_election.cc:336] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:31.927186 11098 leader_election.cc:336] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:31.927768 11098 leader_election.cc:304] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:31.928520 17881 raft_consensus.cc:2749] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:31.932521 11643 consensus_peers.cc:597] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:31.959021 17881 raft_consensus.cc:493] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:31.959702 17881 raft_consensus.cc:515] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
W20260709 12:26:31.978356 11098 leader_election.cc:336] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
W20260709 12:26:31.985239 11097 leader_election.cc:336] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:31.961859 17881 leader_election.cc:290] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:26:31.986699 11097 leader_election.cc:304] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:31.990013 17881 raft_consensus.cc:2749] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:31.994815 17881 raft_consensus.cc:493] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:31.995465 17881 raft_consensus.cc:515] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } }
I20260709 12:26:31.999423 17881 leader_election.cc:290] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:26:32.005954 11097 consensus_peers.cc:597] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:32.014319 11098 leader_election.cc:336] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
W20260709 12:26:32.015376 11097 leader_election.cc:336] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:32.015916 11097 leader_election.cc:304] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7518bdeb78f24e67a530754ae48547eb; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:32.016696 17881 raft_consensus.cc:2749] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:32.040690  9799 tablet_server.cc:196] TabletServer@127.9.145.194:0 shutdown complete.
W20260709 12:26:32.049037 11097 consensus_peers.cc:597] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:32.057297 11098 consensus_peers.cc:597] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:32.095507 11677 raft_consensus.cc:1275] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Refusing update from remote peer 7518bdeb78f24e67a530754ae48547eb: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 12:26:32.097743 11097 consensus_peers.cc:597] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:26:32.097661 17881 consensus_queue.cc:1048] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:26:32.185400 11097 consensus_peers.cc:597] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:26:32.240052  9799 tablet_server.cc:179] TabletServer@127.9.145.195:0 shutting down...
W20260709 12:26:32.291812 11645 consensus_peers.cc:597] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Couldn't send request to peer 7518bdeb78f24e67a530754ae48547eb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:32.312466 11097 consensus_peers.cc:597] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:32.318226 11645 consensus_peers.cc:597] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Couldn't send request to peer 7518bdeb78f24e67a530754ae48547eb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:32.333455 11645 consensus_peers.cc:597] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Couldn't send request to peer 7518bdeb78f24e67a530754ae48547eb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:32.346159 11645 consensus_peers.cc:597] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Couldn't send request to peer 7518bdeb78f24e67a530754ae48547eb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:32.359223  9799 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:32.360428  9799 tablet_replica.cc:333] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.361378  9799 raft_consensus.cc:2243] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.362640  9799 raft_consensus.cc:2272] T d9e6122a57324bc79c68d46f4cc18aa7 P 7518bdeb78f24e67a530754ae48547eb [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.365761  9799 tablet_replica.cc:333] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.366758  9799 raft_consensus.cc:2243] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.368095  9799 raft_consensus.cc:2272] T 2cdd07e6995141b68c257e6c93f15f2e P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.370262  9799 tablet_replica.cc:333] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.371184  9799 raft_consensus.cc:2243] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.371824  9799 raft_consensus.cc:2272] T e37077b3b6d34e6f9558c96b2d955211 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.374962  9799 tablet_replica.cc:333] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.375838  9799 raft_consensus.cc:2243] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.377018  9799 raft_consensus.cc:2272] T 0bb240ba9bd84493aa3cda1c24e646f1 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.379854  9799 tablet_replica.cc:333] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.380698  9799 raft_consensus.cc:2243] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.381958  9799 raft_consensus.cc:2272] T 2d9fad3893d845fa9208a48c76eb609f P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.384894  9799 tablet_replica.cc:333] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.385752  9799 raft_consensus.cc:2243] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Raft consensus shutting down.
W20260709 12:26:32.387809 11097 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111) [suppressed 654 similar messages]
I20260709 12:26:32.392175  9799 raft_consensus.cc:2272] T 0bb096cdb35c45e785fda6900a7999f7 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.395618  9799 tablet_replica.cc:333] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.396736  9799 raft_consensus.cc:2243] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.398033  9799 raft_consensus.cc:2272] T 2f4458a30aab4e97ae1d0e1d465fae04 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.401409  9799 tablet_replica.cc:333] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.402366  9799 raft_consensus.cc:2243] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.403111  9799 raft_consensus.cc:2272] T c5ceb1aa25414d24b15ed1bff03f40c4 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.406376  9799 tablet_replica.cc:333] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.407291  9799 raft_consensus.cc:2243] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.408751  9799 raft_consensus.cc:2272] T f81a3074c9b841b6a602953195c8ef98 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.412868  9799 tablet_replica.cc:333] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.413829  9799 raft_consensus.cc:2243] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.421345  9799 raft_consensus.cc:2272] T d50eacd0821047a9930a0698124ba4f0 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.424746  9799 tablet_replica.cc:333] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.425658  9799 raft_consensus.cc:2243] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 19 LEADER]: Raft consensus shutting down.
W20260709 12:26:32.426162 11643 consensus_peers.cc:597] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:32.428884  9799 raft_consensus.cc:2272] T f28a3d1504ca450d9efd93115b1164f9 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.433323  9799 tablet_replica.cc:333] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.434278  9799 raft_consensus.cc:2243] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.435613  9799 raft_consensus.cc:2272] T d938b7067315410aa8ef1ecddf452945 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:32.436877 11643 consensus_peers.cc:597] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:32.438331  9799 tablet_replica.cc:333] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.439296  9799 raft_consensus.cc:2243] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.440863  9799 raft_consensus.cc:2272] T c2dcd574d9d144ce853b29000889507e P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.447011  9799 tablet_replica.cc:333] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
W20260709 12:26:32.447680 11645 consensus_peers.cc:597] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Couldn't send request to peer 7518bdeb78f24e67a530754ae48547eb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:32.447944  9799 raft_consensus.cc:2243] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.448832  9799 raft_consensus.cc:2272] T d10de3c352ba4d7c805da1ea559bfcb5 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.458204  9799 tablet_replica.cc:333] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.459144  9799 raft_consensus.cc:2243] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.460038  9799 raft_consensus.cc:2272] T af28bcf443bc457bacfe081d037b6d9c P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.462877  9799 tablet_replica.cc:333] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.463742  9799 raft_consensus.cc:2243] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.466377  9799 raft_consensus.cc:2272] T 497ca545c71446259b5dc17afceaaf59 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.470472  9799 tablet_replica.cc:333] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.471393  9799 raft_consensus.cc:2243] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 15 LEADER]: Raft consensus shutting down.
W20260709 12:26:32.472107 11645 consensus_peers.cc:597] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Couldn't send request to peer 7518bdeb78f24e67a530754ae48547eb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:32.472571  9799 raft_consensus.cc:2272] T 5d1c6709dd7d464db6e30b204580fe75 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.475435  9799 tablet_replica.cc:333] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
W20260709 12:26:32.475821 11644 consensus_peers.cc:597] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:32.476325  9799 raft_consensus.cc:2243] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.477689  9799 raft_consensus.cc:2272] T 9824def13ff74f65931445e01ea9cb84 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.483289  9799 tablet_replica.cc:333] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
W20260709 12:26:32.484107 11645 consensus_peers.cc:597] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Couldn't send request to peer 7518bdeb78f24e67a530754ae48547eb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:32.490700  9799 raft_consensus.cc:2243] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.491545  9799 raft_consensus.cc:2272] T 6506ec2922c24d099538b52b0df81502 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:32.491950 11645 consensus_peers.cc:597] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Couldn't send request to peer 7518bdeb78f24e67a530754ae48547eb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:32.495138  9799 tablet_replica.cc:333] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
W20260709 12:26:32.495842 11098 consensus_peers.cc:597] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:32.496136  9799 raft_consensus.cc:2243] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 19 LEADER]: Raft consensus shutting down.
W20260709 12:26:32.512633 11644 consensus_peers.cc:597] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:32.515583 11645 consensus_peers.cc:597] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Couldn't send request to peer 7518bdeb78f24e67a530754ae48547eb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:32.497567  9799 raft_consensus.cc:2272] T a5d087871c7847629fca3c40460a08b1 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.520365  9799 tablet_replica.cc:333] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.521332  9799 raft_consensus.cc:2243] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.522796  9799 raft_consensus.cc:2272] T 65c91dadbee643c4bc2ef982cc40ffe8 P 7518bdeb78f24e67a530754ae48547eb [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.526189  9799 tablet_replica.cc:333] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.526983  9799 raft_consensus.cc:2243] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.527658  9799 raft_consensus.cc:2272] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:32.529455 11645 consensus_peers.cc:597] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Couldn't send request to peer 7518bdeb78f24e67a530754ae48547eb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:32.531204  9799 tablet_replica.cc:333] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.532106  9799 raft_consensus.cc:2243] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 15 LEADER]: Raft consensus shutting down.
W20260709 12:26:32.532752 11645 consensus_peers.cc:597] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Couldn't send request to peer 7518bdeb78f24e67a530754ae48547eb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:32.533207  9799 raft_consensus.cc:2272] T ceabf3208ccf4abbad90d81586377118 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.536051  9799 tablet_replica.cc:333] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.536922  9799 raft_consensus.cc:2243] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.537606  9799 raft_consensus.cc:2272] T 8390bc6d251348e398da3cb9bee4bd2c P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.541430  9799 tablet_replica.cc:333] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.542299  9799 raft_consensus.cc:2243] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.543586  9799 raft_consensus.cc:2272] T 839b2afaa86144938bdfb973011c3303 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.546435  9799 tablet_replica.cc:333] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.547245  9799 raft_consensus.cc:2243] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.548024  9799 raft_consensus.cc:2272] T 42f9fb63946447bdadbb789c9398031d P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.554788  9799 tablet_replica.cc:333] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
W20260709 12:26:32.555032 11645 consensus_peers.cc:597] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Couldn't send request to peer 7518bdeb78f24e67a530754ae48547eb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:32.555661  9799 raft_consensus.cc:2243] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.556620  9799 raft_consensus.cc:2272] T 46989f4f6130442698a2028fb5bcbf0e P 7518bdeb78f24e67a530754ae48547eb [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:32.583132 11645 consensus_peers.cc:597] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Couldn't send request to peer 7518bdeb78f24e67a530754ae48547eb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:32.590044 11644 consensus_peers.cc:597] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:32.593216 17888 raft_consensus.cc:493] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:32.593757 17888 raft_consensus.cc:515] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:32.596005 17888 leader_election.cc:290] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:26:32.590994 11645 consensus_peers.cc:597] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Couldn't send request to peer 7518bdeb78f24e67a530754ae48547eb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:32.613860 11643 leader_election.cc:336] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:32.617909 11645 consensus_peers.cc:597] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Couldn't send request to peer 7518bdeb78f24e67a530754ae48547eb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:32.618069 11644 leader_election.cc:336] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:32.626449 11644 leader_election.cc:304] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:32.628048  9799 tablet_replica.cc:333] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.631080 17888 raft_consensus.cc:2749] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:32.639088  9799 raft_consensus.cc:2243] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.642933  9799 raft_consensus.cc:2272] T ec4be143c296464e86202c1a42e3d3ee P 7518bdeb78f24e67a530754ae48547eb [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.649295  9799 tablet_replica.cc:333] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.657001  9799 raft_consensus.cc:2243] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:32.659303 11645 consensus_peers.cc:597] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Couldn't send request to peer 7518bdeb78f24e67a530754ae48547eb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:32.659844  9799 raft_consensus.cc:2272] T ed6bc26e6dfc446c9b989b8483864ae4 P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.662979  9799 tablet_replica.cc:333] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.663836  9799 raft_consensus.cc:2243] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.664799  9799 raft_consensus.cc:2272] T 5d049c89d78443e886fd95f8df54f02b P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.667973  9799 tablet_replica.cc:333] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.675266  9799 raft_consensus.cc:2243] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.677078  9799 raft_consensus.cc:2272] T 634832ddce4348f1bb6c7bbf1b9045f0 P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.679903  9799 tablet_replica.cc:333] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.681123  9799 raft_consensus.cc:2243] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.682035  9799 raft_consensus.cc:2272] T 1edc7e1c10ce4d21b4ad909d703ace3e P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.684643  9799 tablet_replica.cc:333] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.685514  9799 raft_consensus.cc:2243] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.686718  9799 raft_consensus.cc:2272] T 03bda770d3504576acc9bfb2923fb9ff P 7518bdeb78f24e67a530754ae48547eb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.691164  9799 tablet_replica.cc:333] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.691999  9799 raft_consensus.cc:2243] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.693315  9799 raft_consensus.cc:2272] T 2721401e0fa944aea90572c7ec29c134 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.699052  9799 tablet_replica.cc:333] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.699971  9799 raft_consensus.cc:2243] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:32.700889 11645 consensus_peers.cc:597] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Couldn't send request to peer 7518bdeb78f24e67a530754ae48547eb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:32.700875  9799 raft_consensus.cc:2272] T 1e22af520a9e4eb795f4a0e920b05a3b P 7518bdeb78f24e67a530754ae48547eb [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.704731  9799 tablet_replica.cc:333] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.705588  9799 raft_consensus.cc:2243] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.706458  9799 raft_consensus.cc:2272] T 494450549bab41b6a4c557c9d2afddc7 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.709233  9799 tablet_replica.cc:333] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.710001  9799 raft_consensus.cc:2243] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.710779  9799 raft_consensus.cc:2272] T cf134f8026dd4c7c8bbdf22ddca4edf2 P 7518bdeb78f24e67a530754ae48547eb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.713405  9799 tablet_replica.cc:333] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.714208  9799 raft_consensus.cc:2243] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.715412  9799 raft_consensus.cc:2272] T 8383ba7a20f343a2bf66fc93ad293a56 P 7518bdeb78f24e67a530754ae48547eb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.718298  9799 tablet_replica.cc:333] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.719172  9799 raft_consensus.cc:2243] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.719862  9799 raft_consensus.cc:2272] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:32.728636 11644 consensus_peers.cc:597] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:32.729782  9799 tablet_replica.cc:333] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.730800  9799 raft_consensus.cc:2243] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.731863  9799 raft_consensus.cc:2272] T 265677e547f5428e992bc91650ec60e2 P 7518bdeb78f24e67a530754ae48547eb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.748353  9799 tablet_replica.cc:333] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.749223  9799 raft_consensus.cc:2243] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.750560  9799 raft_consensus.cc:2272] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 7518bdeb78f24e67a530754ae48547eb [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:32.770355 11644 consensus_peers.cc:597] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:32.774391  9799 tablet_replica.cc:333] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.775744  9799 raft_consensus.cc:2243] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.776486  9799 raft_consensus.cc:2272] T 709d2903489748c8a8490194704bc3ca P 7518bdeb78f24e67a530754ae48547eb [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.779350  9799 tablet_replica.cc:333] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.780176  9799 raft_consensus.cc:2243] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.781198  9799 raft_consensus.cc:2272] T 1d0463b3e1c746218d71d6d8eb843dc8 P 7518bdeb78f24e67a530754ae48547eb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.784363  9799 tablet_replica.cc:333] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.785135  9799 raft_consensus.cc:2243] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.785946  9799 raft_consensus.cc:2272] T 6dff0ae92c5347b59bfed7b76061d189 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.788703  9799 tablet_replica.cc:333] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb: stopping tablet replica
I20260709 12:26:32.789487  9799 raft_consensus.cc:2243] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.790810  9799 raft_consensus.cc:2272] T 49ef051819cd4f229ac2b37858ee3db5 P 7518bdeb78f24e67a530754ae48547eb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.795818 17888 raft_consensus.cc:493] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:32.796434 17888 raft_consensus.cc:515] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:32.805119 17888 leader_election.cc:290] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:26:32.809996 11643 leader_election.cc:336] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:32.810961 11644 consensus_peers.cc:597] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:32.821826 11644 leader_election.cc:336] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:32.822432 11644 leader_election.cc:304] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:32.823642 17888 raft_consensus.cc:2749] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:32.853330 11644 consensus_peers.cc:597] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:32.949033 11644 consensus_peers.cc:597] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:33.015604 11643 consensus_peers.cc:597] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:33.099064 11644 consensus_peers.cc:597] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:33.135334 11643 consensus_peers.cc:597] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:33.137635 11644 consensus_peers.cc:597] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:33.141621 11644 consensus_peers.cc:597] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:33.145620 11644 consensus_peers.cc:597] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:33.159415 11644 consensus_peers.cc:597] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:33.163529 11644 consensus_peers.cc:597] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:33.242920 11643 consensus_peers.cc:597] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:33.283541 11643 consensus_peers.cc:597] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:26:33.300793 17893 raft_consensus.cc:493] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:33.301388 17893 raft_consensus.cc:515] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:33.303642 17893 leader_election.cc:290] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:26:33.308771 11644 leader_election.cc:336] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
W20260709 12:26:33.309564 11643 leader_election.cc:336] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:33.309974 11643 leader_election.cc:304] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:33.311342 17893 raft_consensus.cc:2749] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:33.316735 11644 consensus_peers.cc:597] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:33.361248 11643 consensus_peers.cc:597] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:33.398806 11643 consensus_peers.cc:597] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:33.473230 11644 consensus_peers.cc:597] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Couldn't send request to peer c979ef00e0ad4157b49ebbdc13ce7cd7. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:33.525312 17893 raft_consensus.cc:493] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:33.526010 17893 raft_consensus.cc:515] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:33.528434 17893 leader_election.cc:290] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:33.535338 17893 raft_consensus.cc:493] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:33.536016 17893 raft_consensus.cc:515] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:26:33.542032 11645 leader_election.cc:336] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Network error: Client connection negotiation failed: client connection to 127.9.145.195:42537: connect: Connection refused (error 111)
I20260709 12:26:33.554884 17892 raft_consensus.cc:493] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:33.555536 17892 raft_consensus.cc:515] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:33.558000 17892 leader_election.cc:290] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:26:33.565519 11643 leader_election.cc:336] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:33.566215 11643 leader_election.cc:336] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:33.567625 17893 leader_election.cc:290] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:26:33.568557 11644 leader_election.cc:336] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:33.570600 11644 leader_election.cc:304] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:33.578280 17893 raft_consensus.cc:2749] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:26:33.587184 11645 leader_election.cc:336] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Network error: Client connection negotiation failed: client connection to 127.9.145.195:42537: connect: Connection refused (error 111)
I20260709 12:26:33.590931 11645 leader_election.cc:304] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:26:33.592708 17892 raft_consensus.cc:493] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:33.593308 17892 raft_consensus.cc:515] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:33.595340 17892 leader_election.cc:290] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:26:33.603153 11643 leader_election.cc:336] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:33.604357 17893 raft_consensus.cc:2749] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:26:33.605978 11644 leader_election.cc:336] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:33.607383 11644 leader_election.cc:304] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:33.613301 17893 raft_consensus.cc:2749] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:33.631522 17892 raft_consensus.cc:493] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:33.632107 17892 raft_consensus.cc:515] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:33.634646 17888 raft_consensus.cc:493] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:33.635281 17888 raft_consensus.cc:515] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:33.637393 17888 leader_election.cc:290] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:33.639257 17892 leader_election.cc:290] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:26:33.658239 11645 leader_election.cc:336] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Network error: Client connection negotiation failed: client connection to 127.9.145.195:42537: connect: Connection refused (error 111)
I20260709 12:26:33.658878 11645 leader_election.cc:304] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
W20260709 12:26:33.923905 11645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:42537, user_credentials={real_user=slave}} blocked reactor thread for 265673us
I20260709 12:26:33.928462 17888 raft_consensus.cc:2749] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:33.930984 17895 raft_consensus.cc:493] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:33.937135 17895 raft_consensus.cc:515] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:33.939520 17895 leader_election.cc:290] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:33.931214 17892 raft_consensus.cc:493] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:33.940239 17892 raft_consensus.cc:515] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:33.942819 17892 leader_election.cc:290] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:33.950603 17893 raft_consensus.cc:493] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:33.951390 17893 raft_consensus.cc:515] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:33.954059 17893 leader_election.cc:290] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:26:33.956390 11643 consensus_peers.cc:597] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:26:33.965795 17898 raft_consensus.cc:493] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:33.993842 17898 raft_consensus.cc:515] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:33.996361 17898 leader_election.cc:290] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:33.980129 17892 raft_consensus.cc:493] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:33.997113 17892 raft_consensus.cc:515] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:33.999373 17892 leader_election.cc:290] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
I20260709 12:26:33.999881 17892 raft_consensus.cc:493] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:34.000350 17892 raft_consensus.cc:515] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:26:34.005098 11643 consensus_peers.cc:597] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:34.007668 11645 leader_election.cc:336] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Network error: Client connection negotiation failed: client connection to 127.9.145.195:42537: connect: Connection refused (error 111)
I20260709 12:26:33.983539 17896 raft_consensus.cc:493] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:34.003300 17892 leader_election.cc:290] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:26:33.986311 11644 leader_election.cc:336] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:34.013622 17896 raft_consensus.cc:515] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
W20260709 12:26:34.014205 11644 leader_election.cc:336] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:34.017845 11644 leader_election.cc:304] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:34.022955 17892 raft_consensus.cc:2749] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:34.025131 17896 leader_election.cc:290] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:26:34.025882 11645 leader_election.cc:336] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Network error: Client connection negotiation failed: client connection to 127.9.145.195:42537: connect: Connection refused (error 111)
W20260709 12:26:34.027002 11643 consensus_peers.cc:597] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:34.028507 11643 consensus_peers.cc:597] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:34.029573 11643 leader_election.cc:336] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:34.030200 11643 leader_election.cc:336] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:34.030632 11643 leader_election.cc:336] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:34.030887 17892 raft_consensus.cc:493] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:34.031464 17892 raft_consensus.cc:515] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:34.033527 17892 leader_election.cc:290] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
I20260709 12:26:34.028479 11645 leader_election.cc:304] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:26:34.031033 11643 leader_election.cc:336] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:34.036437 17898 raft_consensus.cc:2749] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:34.037568 11645 leader_election.cc:336] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Network error: Client connection negotiation failed: client connection to 127.9.145.195:42537: connect: Connection refused (error 111)
W20260709 12:26:34.038017 11645 leader_election.cc:336] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Network error: Client connection negotiation failed: client connection to 127.9.145.195:42537: connect: Connection refused (error 111)
W20260709 12:26:34.038726 11643 consensus_peers.cc:597] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:34.040220 11644 leader_election.cc:336] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:34.040717 11644 leader_election.cc:304] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:34.042382 17899 raft_consensus.cc:2749] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:26:34.045189 11644 leader_election.cc:336] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
W20260709 12:26:34.046193 11644 leader_election.cc:336] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:34.046628 11644 leader_election.cc:304] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
W20260709 12:26:34.046972 11643 leader_election.cc:336] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:34.047643 11644 leader_election.cc:336] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:34.048197 11644 leader_election.cc:304] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:34.048576 17892 raft_consensus.cc:2749] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:34.048988 17899 raft_consensus.cc:2749] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:26:34.048259 11643 consensus_peers.cc:597] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 -> Peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Couldn't send request to peer bc01179655564f29b83babe396377cbb. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:34.054880 11645 leader_election.cc:336] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Network error: Client connection negotiation failed: client connection to 127.9.145.195:42537: connect: Connection refused (error 111)
I20260709 12:26:34.055275 11645 leader_election.cc:304] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:26:34.055888 17892 raft_consensus.cc:2749] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:26:34.056093 11645 leader_election.cc:336] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Network error: Client connection negotiation failed: client connection to 127.9.145.195:42537: connect: Connection refused (error 111)
I20260709 12:26:34.056573 11645 leader_election.cc:304] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:26:34.057168 17892 raft_consensus.cc:2749] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:26:34.057494 11645 leader_election.cc:336] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Network error: Client connection negotiation failed: client connection to 127.9.145.195:42537: connect: Connection refused (error 111)
I20260709 12:26:34.057916 11645 leader_election.cc:304] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:34.058589 17892 raft_consensus.cc:2749] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:26:34.059827 11645 leader_election.cc:336] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Network error: Client connection negotiation failed: client connection to 127.9.145.195:42537: connect: Connection refused (error 111)
I20260709 12:26:34.061257 11645 leader_election.cc:304] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:26:34.064134 17892 raft_consensus.cc:2749] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:26:34.067755 11645 leader_election.cc:336] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Network error: Client connection negotiation failed: client connection to 127.9.145.195:42537: connect: Connection refused (error 111)
I20260709 12:26:34.068137 11645 leader_election.cc:304] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, bc01179655564f29b83babe396377cbb
I20260709 12:26:34.070909 17892 raft_consensus.cc:2749] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:34.108693  9799 tablet_server.cc:196] TabletServer@127.9.145.195:0 shutdown complete.
I20260709 12:26:34.124207 17892 raft_consensus.cc:493] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7518bdeb78f24e67a530754ae48547eb)
I20260709 12:26:34.124863 17892 raft_consensus.cc:515] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "7518bdeb78f24e67a530754ae48547eb" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42537 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:34.127247 17892 leader_election.cc:290] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483), 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537)
W20260709 12:26:34.132983 11644 leader_election.cc:336] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
W20260709 12:26:34.137147 11645 leader_election.cc:336] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 7518bdeb78f24e67a530754ae48547eb (127.9.145.195:42537): Network error: Client connection negotiation failed: client connection to 127.9.145.195:42537: connect: Connection refused (error 111)
I20260709 12:26:34.137719 11645 leader_election.cc:304] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: 7518bdeb78f24e67a530754ae48547eb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:34.138516 17892 raft_consensus.cc:2749] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:34.231671  9799 tablet_server.cc:179] TabletServer@127.9.145.196:0 shutting down...
I20260709 12:26:34.246904 17892 raft_consensus.cc:493] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c979ef00e0ad4157b49ebbdc13ce7cd7)
I20260709 12:26:34.247594 17892 raft_consensus.cc:515] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc01179655564f29b83babe396377cbb" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 46777 } } peers { permanent_uuid: "c979ef00e0ad4157b49ebbdc13ce7cd7" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 44483 } } peers { permanent_uuid: "0f3b1ccd8aa5412393aa7eb90f2bef95" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 42197 } attrs { promote: false } }
I20260709 12:26:34.249925 17892 leader_election.cc:290] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc01179655564f29b83babe396377cbb (127.9.145.193:46777), c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483)
W20260709 12:26:34.260906 11643 leader_election.cc:336] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc01179655564f29b83babe396377cbb (127.9.145.193:46777): Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
W20260709 12:26:34.262696 11644 leader_election.cc:336] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c979ef00e0ad4157b49ebbdc13ce7cd7 (127.9.145.194:44483): Network error: Client connection negotiation failed: client connection to 127.9.145.194:44483: connect: Connection refused (error 111)
I20260709 12:26:34.263155 11644 leader_election.cc:304] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3b1ccd8aa5412393aa7eb90f2bef95; no voters: bc01179655564f29b83babe396377cbb, c979ef00e0ad4157b49ebbdc13ce7cd7
I20260709 12:26:34.264510 17892 raft_consensus.cc:2749] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:34.292646  9799 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:34.293817  9799 tablet_replica.cc:333] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.294888  9799 raft_consensus.cc:2243] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.296325  9799 raft_consensus.cc:2272] T 9824def13ff74f65931445e01ea9cb84 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.299443  9799 tablet_replica.cc:333] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.300323  9799 raft_consensus.cc:2243] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.301842  9799 raft_consensus.cc:2272] T 5635e70df91d469ca24e987e2a28c27d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.305187  9799 tablet_replica.cc:333] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.306087  9799 raft_consensus.cc:2243] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.306946  9799 raft_consensus.cc:2272] T 8383ba7a20f343a2bf66fc93ad293a56 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.310123  9799 tablet_replica.cc:333] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.311033  9799 raft_consensus.cc:2243] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.311787  9799 raft_consensus.cc:2272] T 0bb240ba9bd84493aa3cda1c24e646f1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.314965  9799 tablet_replica.cc:333] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.315845  9799 raft_consensus.cc:2243] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.316763  9799 raft_consensus.cc:2272] T 227d10a1bcd84a0e9845113d5b0a2495 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.319979  9799 tablet_replica.cc:333] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.320959  9799 raft_consensus.cc:2243] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.321838  9799 raft_consensus.cc:2272] T f28a3d1504ca450d9efd93115b1164f9 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.325134  9799 tablet_replica.cc:333] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.326064  9799 raft_consensus.cc:2243] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.327347  9799 raft_consensus.cc:2272] T 6506ec2922c24d099538b52b0df81502 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.330652  9799 tablet_replica.cc:333] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.331722  9799 raft_consensus.cc:2243] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.333338  9799 raft_consensus.cc:2272] T 87a7b71cfb864c1b9ab4c85887ca32ad P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.336927  9799 tablet_replica.cc:333] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.337909  9799 raft_consensus.cc:2243] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.339389  9799 raft_consensus.cc:2272] T 1edc7e1c10ce4d21b4ad909d703ace3e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.342789  9799 tablet_replica.cc:333] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.343689  9799 raft_consensus.cc:2243] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.344935  9799 raft_consensus.cc:2272] T 03bda770d3504576acc9bfb2923fb9ff P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.347914  9799 tablet_replica.cc:333] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.348816  9799 raft_consensus.cc:2243] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.350138  9799 raft_consensus.cc:2272] T d3ee878370114c8d8434e02b9c0aa6be P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.353016  9799 tablet_replica.cc:333] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.353964  9799 raft_consensus.cc:2243] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.355249  9799 raft_consensus.cc:2272] T 6aa9f4fbf45b4a0a88651d571f7b49e4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.358161  9799 tablet_replica.cc:333] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.359138  9799 raft_consensus.cc:2243] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.360489  9799 raft_consensus.cc:2272] T c7865a5cff5849a2bd74dddc1bcdd8f3 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.363418  9799 tablet_replica.cc:333] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.364251  9799 raft_consensus.cc:2243] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.365468  9799 raft_consensus.cc:2272] T af28bcf443bc457bacfe081d037b6d9c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.368484  9799 tablet_replica.cc:333] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.369336  9799 raft_consensus.cc:2243] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.370214  9799 raft_consensus.cc:2272] T 839b2afaa86144938bdfb973011c3303 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.373549  9799 tablet_replica.cc:333] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.374475  9799 raft_consensus.cc:2243] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.375712  9799 raft_consensus.cc:2272] T 42f9fb63946447bdadbb789c9398031d P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.378924  9799 tablet_replica.cc:333] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.379776  9799 raft_consensus.cc:2243] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.380456  9799 raft_consensus.cc:2272] T c2dcd574d9d144ce853b29000889507e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.383445  9799 tablet_replica.cc:333] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.384249  9799 raft_consensus.cc:2243] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.385596  9799 raft_consensus.cc:2272] T d2205be6a7c94913a366d683de188a31 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.388710  9799 tablet_replica.cc:333] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.389604  9799 raft_consensus.cc:2243] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.390463  9799 raft_consensus.cc:2272] T 0a21734672b8441faae7b5d5d050d2b2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.393281  9799 tablet_replica.cc:333] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.394059  9799 raft_consensus.cc:2243] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.395284  9799 raft_consensus.cc:2272] T ec4be143c296464e86202c1a42e3d3ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.398007  9799 tablet_replica.cc:333] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.398844  9799 raft_consensus.cc:2243] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.400038  9799 raft_consensus.cc:2272] T 8390bc6d251348e398da3cb9bee4bd2c P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.402856  9799 tablet_replica.cc:333] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.403693  9799 raft_consensus.cc:2243] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.404307  9799 raft_consensus.cc:2272] T 634832ddce4348f1bb6c7bbf1b9045f0 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.407034  9799 tablet_replica.cc:333] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.407845  9799 raft_consensus.cc:2243] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.408870  9799 raft_consensus.cc:2272] T 820ab313402049dfa58d12167763953e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.411648  9799 tablet_replica.cc:333] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.412541  9799 raft_consensus.cc:2243] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.413208  9799 raft_consensus.cc:2272] T 2cdd07e6995141b68c257e6c93f15f2e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.416205  9799 tablet_replica.cc:333] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.418697  9799 raft_consensus.cc:2243] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.419245  9799 raft_consensus.cc:2272] T 6c233c491e1b4126b9d776bfd98023b6 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.421211  9799 tablet_replica.cc:333] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.421872  9799 raft_consensus.cc:2243] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.422446  9799 raft_consensus.cc:2272] T dabbb0c174364b1ea4126a4f3d5bb4c2 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.425087  9799 tablet_replica.cc:333] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.425681  9799 raft_consensus.cc:2243] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.426766  9799 raft_consensus.cc:2272] T 46989f4f6130442698a2028fb5bcbf0e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.429111  9799 tablet_replica.cc:333] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.429927  9799 raft_consensus.cc:2243] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.430625  9799 raft_consensus.cc:2272] T 6875ad729dd0416d88035fd642f6b3bd P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.433269  9799 tablet_replica.cc:333] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.433838  9799 raft_consensus.cc:2243] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.434314  9799 raft_consensus.cc:2272] T a5d087871c7847629fca3c40460a08b1 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.436239  9799 tablet_replica.cc:333] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.436803  9799 raft_consensus.cc:2243] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.437814  9799 raft_consensus.cc:2272] T a84c56f62e0a4a9990f4969bc324dd7e P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.441685  9799 tablet_replica.cc:333] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.442553  9799 raft_consensus.cc:2243] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.443904  9799 raft_consensus.cc:2272] T 6dff0ae92c5347b59bfed7b76061d189 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.446426  9799 tablet_replica.cc:333] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.447012  9799 raft_consensus.cc:2243] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.447834  9799 raft_consensus.cc:2272] T d10de3c352ba4d7c805da1ea559bfcb5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.449783  9799 tablet_replica.cc:333] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.450392  9799 raft_consensus.cc:2243] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.450872  9799 raft_consensus.cc:2272] T ad5b1fe8f9f246d791d03da03e5c44ee P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.452857  9799 tablet_replica.cc:333] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.453399  9799 raft_consensus.cc:2243] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.453842  9799 raft_consensus.cc:2272] T 2721401e0fa944aea90572c7ec29c134 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.455976  9799 tablet_replica.cc:333] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.456691  9799 raft_consensus.cc:2243] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.457250  9799 raft_consensus.cc:2272] T 702d64a1236147a784daa11e58563721 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.459672  9799 tablet_replica.cc:333] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.460224  9799 raft_consensus.cc:2243] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.460785  9799 raft_consensus.cc:2272] T 2d9fad3893d845fa9208a48c76eb609f P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.462863  9799 tablet_replica.cc:333] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.463418  9799 raft_consensus.cc:2243] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.463912  9799 raft_consensus.cc:2272] T 497ca545c71446259b5dc17afceaaf59 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.466588  9799 tablet_replica.cc:333] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.467378  9799 raft_consensus.cc:2243] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.468595  9799 raft_consensus.cc:2272] T 1d0463b3e1c746218d71d6d8eb843dc8 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.470877  9799 tablet_replica.cc:333] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.471545  9799 raft_consensus.cc:2243] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.472680  9799 raft_consensus.cc:2272] T c5ceb1aa25414d24b15ed1bff03f40c4 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.475288  9799 tablet_replica.cc:333] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.475914  9799 raft_consensus.cc:2243] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.476388  9799 raft_consensus.cc:2272] T 0bb096cdb35c45e785fda6900a7999f7 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.478705  9799 tablet_replica.cc:333] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.479270  9799 raft_consensus.cc:2243] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.480185  9799 raft_consensus.cc:2272] T 1e22af520a9e4eb795f4a0e920b05a3b P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.482326  9799 tablet_replica.cc:333] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.482829  9799 raft_consensus.cc:2243] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.483676  9799 raft_consensus.cc:2272] T cfc5f0c97d6e4662b2fe7ef12f7e7284 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.485850  9799 tablet_replica.cc:333] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.486409  9799 raft_consensus.cc:2243] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.487519  9799 raft_consensus.cc:2272] T e8083bc5cbd34d98a24be9a390262c19 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.489621  9799 tablet_replica.cc:333] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95: stopping tablet replica
I20260709 12:26:34.490240  9799 raft_consensus.cc:2243] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.491216  9799 raft_consensus.cc:2272] T 49ef051819cd4f229ac2b37858ee3db5 P 0f3b1ccd8aa5412393aa7eb90f2bef95 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:34.962060 11702 debug-util.cc:398] Leaking SignalData structure 0x7b08003074a0 after lost signal to thread 9802
W20260709 12:26:34.963106 11702 debug-util.cc:398] Leaking SignalData structure 0x7b08001063c0 after lost signal to thread 10916
W20260709 12:26:34.964336 11702 debug-util.cc:398] Leaking SignalData structure 0x7b08002635a0 after lost signal to thread 11705
W20260709 12:26:35.562654  9799 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 11702)
W20260709 12:26:35.759243 10913 debug-util.cc:398] Leaking SignalData structure 0x7b0800102b00 after lost signal to thread 9802
W20260709 12:26:35.760267 10913 debug-util.cc:398] Leaking SignalData structure 0x7b08003d5280 after lost signal to thread 10916
I20260709 12:26:35.991063  9799 tablet_server.cc:196] TabletServer@127.9.145.196:0 shutdown complete.
I20260709 12:26:36.080962  9799 master.cc:562] Master@127.9.145.254:35687 shutting down...
W20260709 12:26:37.212759 10866 catalog_manager.cc:4755] TS bc01179655564f29b83babe396377cbb (127.9.145.193:46777): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9824def13ff74f65931445e01ea9cb84: Network error: Client connection negotiation failed: client connection to 127.9.145.193:46777: connect: Connection refused (error 111)
I20260709 12:26:37.304713  9799 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.305377  9799 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.305706  9799 tablet_replica.cc:333] T 00000000000000000000000000000000 P 67a911ac695143c380a7065b971eb9b7: stopping tablet replica
I20260709 12:26:37.505900  9799 master.cc:584] Master@127.9.145.254:35687 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (217214 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:26:37.600334  9799 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.145.254:45005
I20260709 12:26:37.601449  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:37.607620 17902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:37.607769 17903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:37.608712 17905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:37.609018  9799 server_base.cc:1061] running on GCE node
I20260709 12:26:37.611896  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:37.612108  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:37.612270  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783599997612253 us; error 0 us; skew 500 ppm
I20260709 12:26:37.612815  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:37.615334  9799 webserver.cc:533] Webserver started at http://127.9.145.254:34957/ using document root <none> and password file <none>
I20260709 12:26:37.615850  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:37.616030  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:37.616299  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:37.617493  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599719482688-9799-0/minicluster-data/master-0-root/instance:
uuid: "03e98baed3d2465499fb533f47c7aecd"
format_stamp: "Formatted at 2026-07-09 12:26:37 on dist-test-slave-1sdq"
I20260709 12:26:37.622687  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 12:26:37.626236 17910 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:37.627022  9799 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:26:37.627327  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599719482688-9799-0/minicluster-data/master-0-root
uuid: "03e98baed3d2465499fb533f47c7aecd"
format_stamp: "Formatted at 2026-07-09 12:26:37 on dist-test-slave-1sdq"
I20260709 12:26:37.627632  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599719482688-9799-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599719482688-9799-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599719482688-9799-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:37.644052  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:37.645274  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:37.684855  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.254:45005
I20260709 12:26:37.684965 17961 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.254:45005 every 8 connection(s)
I20260709 12:26:37.688920 17962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:37.700182 17962 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03e98baed3d2465499fb533f47c7aecd: Bootstrap starting.
I20260709 12:26:37.705018 17962 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 03e98baed3d2465499fb533f47c7aecd: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:37.709491 17962 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03e98baed3d2465499fb533f47c7aecd: No bootstrap required, opened a new log
I20260709 12:26:37.711795 17962 raft_consensus.cc:359] T 00000000000000000000000000000000 P 03e98baed3d2465499fb533f47c7aecd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03e98baed3d2465499fb533f47c7aecd" member_type: VOTER }
I20260709 12:26:37.712208 17962 raft_consensus.cc:385] T 00000000000000000000000000000000 P 03e98baed3d2465499fb533f47c7aecd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:37.712394 17962 raft_consensus.cc:740] T 00000000000000000000000000000000 P 03e98baed3d2465499fb533f47c7aecd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e98baed3d2465499fb533f47c7aecd, State: Initialized, Role: FOLLOWER
I20260709 12:26:37.712927 17962 consensus_queue.cc:260] T 00000000000000000000000000000000 P 03e98baed3d2465499fb533f47c7aecd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03e98baed3d2465499fb533f47c7aecd" member_type: VOTER }
I20260709 12:26:37.713372 17962 raft_consensus.cc:399] T 00000000000000000000000000000000 P 03e98baed3d2465499fb533f47c7aecd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:26:37.713567 17962 raft_consensus.cc:493] T 00000000000000000000000000000000 P 03e98baed3d2465499fb533f47c7aecd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:26:37.713788 17962 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 03e98baed3d2465499fb533f47c7aecd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:37.718315 17962 raft_consensus.cc:515] T 00000000000000000000000000000000 P 03e98baed3d2465499fb533f47c7aecd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03e98baed3d2465499fb533f47c7aecd" member_type: VOTER }
I20260709 12:26:37.718864 17962 leader_election.cc:304] T 00000000000000000000000000000000 P 03e98baed3d2465499fb533f47c7aecd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 03e98baed3d2465499fb533f47c7aecd; no voters: 
I20260709 12:26:37.719976 17962 leader_election.cc:290] T 00000000000000000000000000000000 P 03e98baed3d2465499fb533f47c7aecd [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:26:37.720393 17965 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 03e98baed3d2465499fb533f47c7aecd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:37.721805 17965 raft_consensus.cc:697] T 00000000000000000000000000000000 P 03e98baed3d2465499fb533f47c7aecd [term 1 LEADER]: Becoming Leader. State: Replica: 03e98baed3d2465499fb533f47c7aecd, State: Running, Role: LEADER
I20260709 12:26:37.722533 17965 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03e98baed3d2465499fb533f47c7aecd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03e98baed3d2465499fb533f47c7aecd" member_type: VOTER }
I20260709 12:26:37.722986 17962 sys_catalog.cc:565] T 00000000000000000000000000000000 P 03e98baed3d2465499fb533f47c7aecd [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:26:37.727388 17967 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03e98baed3d2465499fb533f47c7aecd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03e98baed3d2465499fb533f47c7aecd. Latest consensus state: current_term: 1 leader_uuid: "03e98baed3d2465499fb533f47c7aecd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03e98baed3d2465499fb533f47c7aecd" member_type: VOTER } }
I20260709 12:26:37.727653 17966 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03e98baed3d2465499fb533f47c7aecd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "03e98baed3d2465499fb533f47c7aecd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03e98baed3d2465499fb533f47c7aecd" member_type: VOTER } }
I20260709 12:26:37.728291 17967 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03e98baed3d2465499fb533f47c7aecd [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:37.728426 17966 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03e98baed3d2465499fb533f47c7aecd [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:37.731546 17971 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:26:37.737141 17971 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:26:37.743804  9799 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:26:37.746236 17971 catalog_manager.cc:1383] Generated new cluster ID: 9a99a2f7b93745d482fc692a2a1cc3bc
I20260709 12:26:37.746491 17971 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:26:37.776010 17971 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:26:37.777321 17971 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:26:37.791512 17971 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 03e98baed3d2465499fb533f47c7aecd: Generated new TSK 0
I20260709 12:26:37.792109 17971 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:26:37.811216  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:37.817426 17983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:37.818447 17984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:37.820474 17986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:37.825789  9799 server_base.cc:1061] running on GCE node
I20260709 12:26:37.828097  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:37.828332  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:37.828536  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783599997828516 us; error 0 us; skew 500 ppm
I20260709 12:26:37.829157  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:37.831802  9799 webserver.cc:533] Webserver started at http://127.9.145.193:40915/ using document root <none> and password file <none>
I20260709 12:26:37.832317  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:37.832505  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:37.832778  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:37.833993  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599719482688-9799-0/minicluster-data/ts-0-root/instance:
uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
format_stamp: "Formatted at 2026-07-09 12:26:37 on dist-test-slave-1sdq"
I20260709 12:26:37.838779  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:26:37.842418 17991 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:37.843221  9799 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:26:37.843544  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599719482688-9799-0/minicluster-data/ts-0-root
uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
format_stamp: "Formatted at 2026-07-09 12:26:37 on dist-test-slave-1sdq"
I20260709 12:26:37.843868  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599719482688-9799-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599719482688-9799-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599719482688-9799-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:37.855741  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:37.857000  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:37.858493  9799 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:37.860879  9799 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:37.861111  9799 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:37.861353  9799 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:37.861526  9799 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:37.904073  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.193:36743
I20260709 12:26:37.904193 18053 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.193:36743 every 8 connection(s)
I20260709 12:26:37.909302  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:37.916791 18058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:37.917972 18059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:37.921051  9799 server_base.cc:1061] running on GCE node
W20260709 12:26:37.921249 18061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:37.923430  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:37.923691  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:37.923898  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783599997923880 us; error 0 us; skew 500 ppm
I20260709 12:26:37.924639  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:37.927009 18054 heartbeater.cc:344] Connected to a master server at 127.9.145.254:45005
I20260709 12:26:37.927413 18054 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:37.927685  9799 webserver.cc:533] Webserver started at http://127.9.145.194:35903/ using document root <none> and password file <none>
I20260709 12:26:37.928246  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:37.928247 18054 heartbeater.cc:507] Master 127.9.145.254:45005 requested a full tablet report, sending...
I20260709 12:26:37.928700  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:37.929066  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:37.930485  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599719482688-9799-0/minicluster-data/ts-1-root/instance:
uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
format_stamp: "Formatted at 2026-07-09 12:26:37 on dist-test-slave-1sdq"
I20260709 12:26:37.930907 17927 ts_manager.cc:194] Registered new tserver with Master: ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:37.932770 17927 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55738
I20260709 12:26:37.935601  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:26:37.939491 18066 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:37.940337  9799 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:26:37.940699  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599719482688-9799-0/minicluster-data/ts-1-root
uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
format_stamp: "Formatted at 2026-07-09 12:26:37 on dist-test-slave-1sdq"
I20260709 12:26:37.940990  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599719482688-9799-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599719482688-9799-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599719482688-9799-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:37.967684  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:37.968880  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:37.970440  9799 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:37.972750  9799 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:37.972949  9799 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:37.973189  9799 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:37.973335  9799 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:38.014799  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.194:45595
I20260709 12:26:38.014899 18128 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.194:45595 every 8 connection(s)
I20260709 12:26:38.019781  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:38.027134 18132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:38.027858 18133 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:38.032521  9799 server_base.cc:1061] running on GCE node
I20260709 12:26:38.033155 18129 heartbeater.cc:344] Connected to a master server at 127.9.145.254:45005
I20260709 12:26:38.033574 18129 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:38.034385 18129 heartbeater.cc:507] Master 127.9.145.254:45005 requested a full tablet report, sending...
W20260709 12:26:38.034526 18135 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:38.035619  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:38.035923  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:38.036130  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783599998036111 us; error 0 us; skew 500 ppm
I20260709 12:26:38.036551 17927 ts_manager.cc:194] Registered new tserver with Master: 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:38.036717  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:38.038408 17927 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55750
I20260709 12:26:38.040197  9799 webserver.cc:533] Webserver started at http://127.9.145.195:35381/ using document root <none> and password file <none>
I20260709 12:26:38.040786  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:38.040983  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:38.041231  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:38.042447  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599719482688-9799-0/minicluster-data/ts-2-root/instance:
uuid: "a08ea42cd3884210924a19c8f570486d"
format_stamp: "Formatted at 2026-07-09 12:26:38 on dist-test-slave-1sdq"
I20260709 12:26:38.047025  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:26:38.050765 18140 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:38.051615  9799 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:26:38.051942  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599719482688-9799-0/minicluster-data/ts-2-root
uuid: "a08ea42cd3884210924a19c8f570486d"
format_stamp: "Formatted at 2026-07-09 12:26:38 on dist-test-slave-1sdq"
I20260709 12:26:38.052245  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599719482688-9799-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599719482688-9799-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599719482688-9799-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:38.068773  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:38.070060  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:38.071668  9799 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:38.074043  9799 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:38.074330  9799 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:38.074573  9799 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:38.074735  9799 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:38.115985  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.195:43695
I20260709 12:26:38.116087 18202 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.195:43695 every 8 connection(s)
I20260709 12:26:38.120970  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:38.129076 18206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:38.132228 18207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:38.135897 18203 heartbeater.cc:344] Connected to a master server at 127.9.145.254:45005
I20260709 12:26:38.136431 18203 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:38.136613  9799 server_base.cc:1061] running on GCE node
I20260709 12:26:38.137523 18203 heartbeater.cc:507] Master 127.9.145.254:45005 requested a full tablet report, sending...
W20260709 12:26:38.137566 18209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:38.138751  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:38.139052  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:38.139281  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783599998139258 us; error 0 us; skew 500 ppm
I20260709 12:26:38.139942  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:38.139884 17927 ts_manager.cc:194] Registered new tserver with Master: a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:38.141680 17927 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55762
I20260709 12:26:38.143023  9799 webserver.cc:533] Webserver started at http://127.9.145.196:44673/ using document root <none> and password file <none>
I20260709 12:26:38.143642  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:38.143857  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:38.144114  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:38.145220  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599719482688-9799-0/minicluster-data/ts-3-root/instance:
uuid: "10c938681fc04e66968531267f39f16c"
format_stamp: "Formatted at 2026-07-09 12:26:38 on dist-test-slave-1sdq"
I20260709 12:26:38.150178  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:26:38.153895 18214 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:38.154867  9799 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:26:38.155206  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599719482688-9799-0/minicluster-data/ts-3-root
uuid: "10c938681fc04e66968531267f39f16c"
format_stamp: "Formatted at 2026-07-09 12:26:38 on dist-test-slave-1sdq"
I20260709 12:26:38.155498  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599719482688-9799-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599719482688-9799-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599719482688-9799-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:38.173995  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:38.175539  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:38.177140  9799 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:38.179783  9799 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:38.180017  9799 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:38.180302  9799 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:38.180460  9799 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:38.225317  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.196:37881
I20260709 12:26:38.225435 18276 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.196:37881 every 8 connection(s)
I20260709 12:26:38.241057 18277 heartbeater.cc:344] Connected to a master server at 127.9.145.254:45005
I20260709 12:26:38.241537 18277 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:38.242367 18277 heartbeater.cc:507] Master 127.9.145.254:45005 requested a full tablet report, sending...
I20260709 12:26:38.244760 17927 ts_manager.cc:194] Registered new tserver with Master: 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:38.245275  9799 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016685966s
I20260709 12:26:38.247601 17927 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55778
I20260709 12:26:38.273741 17927 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55794:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:26:38.602059 18242 tablet_service.cc:1511] Processing CreateTablet for tablet 91269edd7c074ad2bfced23e62cbe5fc (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:26:38.603812 18238 tablet_service.cc:1511] Processing CreateTablet for tablet a61bb69fcfd54ef88c37917a48d1cb30 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:26:38.604647 18242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91269edd7c074ad2bfced23e62cbe5fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.606932 18237 tablet_service.cc:1511] Processing CreateTablet for tablet e48eb1372ff4402498990d2abd8c6da2 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:26:38.607550 18241 tablet_service.cc:1511] Processing CreateTablet for tablet 10895331ca6e49d4aad97aec0e629dd7 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:26:38.608566 18238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a61bb69fcfd54ef88c37917a48d1cb30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.609272 18241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10895331ca6e49d4aad97aec0e629dd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.611515 18240 tablet_service.cc:1511] Processing CreateTablet for tablet e60fecc50c1d49c2963f342da1b3c2a6 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:26:38.613274 18240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e60fecc50c1d49c2963f342da1b3c2a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.615293 18094 tablet_service.cc:1511] Processing CreateTablet for tablet d8b351ffd4864761bb49da4eceac3566 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:26:38.622439 18090 tablet_service.cc:1511] Processing CreateTablet for tablet 5e88e93a00044d1482497fa864163047 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:26:38.624289 18090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e88e93a00044d1482497fa864163047. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.625090 18088 tablet_service.cc:1511] Processing CreateTablet for tablet d0fb4e45e6e54dbf8b96315fab6e5cb8 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:26:38.626763 18094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b351ffd4864761bb49da4eceac3566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.617411 18093 tablet_service.cc:1511] Processing CreateTablet for tablet 10895331ca6e49d4aad97aec0e629dd7 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:26:38.619282 18092 tablet_service.cc:1511] Processing CreateTablet for tablet e60fecc50c1d49c2963f342da1b3c2a6 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:26:38.619503 18089 tablet_service.cc:1511] Processing CreateTablet for tablet e48eb1372ff4402498990d2abd8c6da2 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:26:38.621577 18091 tablet_service.cc:1511] Processing CreateTablet for tablet c94eb437be5041e48122e923dc7cc760 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:26:38.632718 18088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0fb4e45e6e54dbf8b96315fab6e5cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.617524 18239 tablet_service.cc:1511] Processing CreateTablet for tablet 5e88e93a00044d1482497fa864163047 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:26:38.638674 18239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e88e93a00044d1482497fa864163047. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.642977 18237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e48eb1372ff4402498990d2abd8c6da2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.656603 18236 tablet_service.cc:1511] Processing CreateTablet for tablet 7adcc9c41a0d4ffe92d5aa05859d55f5 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:26:38.658231 18236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7adcc9c41a0d4ffe92d5aa05859d55f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.659876 18087 tablet_service.cc:1511] Processing CreateTablet for tablet 7adcc9c41a0d4ffe92d5aa05859d55f5 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:26:38.661394 18087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7adcc9c41a0d4ffe92d5aa05859d55f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.663455 18235 tablet_service.cc:1511] Processing CreateTablet for tablet 1660568f1208485fb6f74d572deee2d9 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:26:38.665053 18235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1660568f1208485fb6f74d572deee2d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.671494 18093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10895331ca6e49d4aad97aec0e629dd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.675375 18091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c94eb437be5041e48122e923dc7cc760. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.679325 18092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e60fecc50c1d49c2963f342da1b3c2a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.682257 18089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e48eb1372ff4402498990d2abd8c6da2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.692550 18086 tablet_service.cc:1511] Processing CreateTablet for tablet be25c969559444ae99d240c6f3f60df1 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:26:38.694521 18086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be25c969559444ae99d240c6f3f60df1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.695255 18234 tablet_service.cc:1511] Processing CreateTablet for tablet be25c969559444ae99d240c6f3f60df1 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:26:38.696789 18234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be25c969559444ae99d240c6f3f60df1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.721084 18168 tablet_service.cc:1511] Processing CreateTablet for tablet 91269edd7c074ad2bfced23e62cbe5fc (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:26:38.722927 18168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91269edd7c074ad2bfced23e62cbe5fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.726449 18085 tablet_service.cc:1511] Processing CreateTablet for tablet 629843ee608f4aff9e667570f73f9d6f (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:26:38.728089 18085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 629843ee608f4aff9e667570f73f9d6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.728118 18167 tablet_service.cc:1511] Processing CreateTablet for tablet d8b351ffd4864761bb49da4eceac3566 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:26:38.731770 18167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b351ffd4864761bb49da4eceac3566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.732201 18165 tablet_service.cc:1511] Processing CreateTablet for tablet c94eb437be5041e48122e923dc7cc760 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:26:38.733664 18165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c94eb437be5041e48122e923dc7cc760. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.730125 18166 tablet_service.cc:1511] Processing CreateTablet for tablet e60fecc50c1d49c2963f342da1b3c2a6 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:26:38.735589 18166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e60fecc50c1d49c2963f342da1b3c2a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.740315 18164 tablet_service.cc:1511] Processing CreateTablet for tablet a61bb69fcfd54ef88c37917a48d1cb30 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
W20260709 12:26:38.740419 17975 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:38.742031 18164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a61bb69fcfd54ef88c37917a48d1cb30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.752948 18237 tablet_service.cc:1511] Processing CreateTablet for tablet 5995ee175fed4e3e893b8efe2a7eb7d0 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:26:38.754788 18237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5995ee175fed4e3e893b8efe2a7eb7d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.780064 18089 tablet_service.cc:1511] Processing CreateTablet for tablet 5995ee175fed4e3e893b8efe2a7eb7d0 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:26:38.783102 18089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5995ee175fed4e3e893b8efe2a7eb7d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.785241 18235 tablet_service.cc:1511] Processing CreateTablet for tablet bb4d4ed1ab54477ca58913fad1bc93b1 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:26:38.795269 18298 tablet_bootstrap.cc:492] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:38.796196 18163 tablet_service.cc:1511] Processing CreateTablet for tablet e48eb1372ff4402498990d2abd8c6da2 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:26:38.796861 18161 tablet_service.cc:1511] Processing CreateTablet for tablet 1660568f1208485fb6f74d572deee2d9 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:26:38.797237 18162 tablet_service.cc:1511] Processing CreateTablet for tablet d0fb4e45e6e54dbf8b96315fab6e5cb8 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:26:38.798619 18161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1660568f1208485fb6f74d572deee2d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.799369 18160 tablet_service.cc:1511] Processing CreateTablet for tablet be25c969559444ae99d240c6f3f60df1 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:26:38.801077 18160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be25c969559444ae99d240c6f3f60df1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.802680 18162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0fb4e45e6e54dbf8b96315fab6e5cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.803457 18163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e48eb1372ff4402498990d2abd8c6da2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.806704 18235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb4d4ed1ab54477ca58913fad1bc93b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.810027 18298 tablet_bootstrap.cc:654] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:38.819039 18299 tablet_bootstrap.cc:492] T 5e88e93a00044d1482497fa864163047 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:38.822781 18241 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9471cf607248b0b7f9090046f63df4 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:26:38.824638 18241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9471cf607248b0b7f9090046f63df4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.828310 18159 tablet_service.cc:1511] Processing CreateTablet for tablet 629843ee608f4aff9e667570f73f9d6f (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:26:38.830685 18159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 629843ee608f4aff9e667570f73f9d6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.837554 18019 tablet_service.cc:1511] Processing CreateTablet for tablet 91269edd7c074ad2bfced23e62cbe5fc (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:26:38.839413 18019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91269edd7c074ad2bfced23e62cbe5fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.843256 18088 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9471cf607248b0b7f9090046f63df4 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:26:38.844849 18088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9471cf607248b0b7f9090046f63df4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.847034 18236 tablet_service.cc:1511] Processing CreateTablet for tablet a379e8a15db944b4a33a0c99f05dc6db (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:26:38.847424 18017 tablet_service.cc:1511] Processing CreateTablet for tablet 10895331ca6e49d4aad97aec0e629dd7 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:26:38.847182 18013 tablet_service.cc:1511] Processing CreateTablet for tablet d0fb4e45e6e54dbf8b96315fab6e5cb8 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:26:38.848891 18017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10895331ca6e49d4aad97aec0e629dd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.848608 18236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a379e8a15db944b4a33a0c99f05dc6db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.849696 18013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0fb4e45e6e54dbf8b96315fab6e5cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.851425 18016 tablet_service.cc:1511] Processing CreateTablet for tablet c94eb437be5041e48122e923dc7cc760 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:26:38.852905 18016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c94eb437be5041e48122e923dc7cc760. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.855463 18015 tablet_service.cc:1511] Processing CreateTablet for tablet 5e88e93a00044d1482497fa864163047 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:26:38.856961 18015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e88e93a00044d1482497fa864163047. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.859551 18014 tablet_service.cc:1511] Processing CreateTablet for tablet a61bb69fcfd54ef88c37917a48d1cb30 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:26:38.861173 18014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a61bb69fcfd54ef88c37917a48d1cb30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.864024 18012 tablet_service.cc:1511] Processing CreateTablet for tablet 7adcc9c41a0d4ffe92d5aa05859d55f5 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:26:38.865691 18012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7adcc9c41a0d4ffe92d5aa05859d55f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.843391 18018 tablet_service.cc:1511] Processing CreateTablet for tablet d8b351ffd4864761bb49da4eceac3566 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:26:38.869284 18018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b351ffd4864761bb49da4eceac3566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.869029 18010 tablet_service.cc:1511] Processing CreateTablet for tablet 629843ee608f4aff9e667570f73f9d6f (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:26:38.867471 18011 tablet_service.cc:1511] Processing CreateTablet for tablet 1660568f1208485fb6f74d572deee2d9 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:26:38.874047 18011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1660568f1208485fb6f74d572deee2d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.876376 18093 tablet_service.cc:1511] Processing CreateTablet for tablet a379e8a15db944b4a33a0c99f05dc6db (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:26:38.877519 18010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 629843ee608f4aff9e667570f73f9d6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.877839 18093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a379e8a15db944b4a33a0c99f05dc6db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.869629 18167 tablet_service.cc:1511] Processing CreateTablet for tablet bb4d4ed1ab54477ca58913fad1bc93b1 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:26:38.879832 18167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb4d4ed1ab54477ca58913fad1bc93b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.833813 18166 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9471cf607248b0b7f9090046f63df4 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:26:38.884490 18166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9471cf607248b0b7f9090046f63df4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.890455 18299 tablet_bootstrap.cc:654] T 5e88e93a00044d1482497fa864163047 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:38.911517 18298 tablet_bootstrap.cc:492] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:38.912137 18298 ts_tablet_manager.cc:1403] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.117s	user 0.006s	sys 0.007s
I20260709 12:26:38.911979 18159 tablet_service.cc:1511] Processing CreateTablet for tablet e735bb4b506c457f8dddf767573d025f (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:26:38.913437 18159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e735bb4b506c457f8dddf767573d025f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.915979 18298 raft_consensus.cc:359] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:38.917250 18298 raft_consensus.cc:385] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:38.917577 18298 raft_consensus.cc:740] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:38.923141 18094 tablet_service.cc:1511] Processing CreateTablet for tablet e735bb4b506c457f8dddf767573d025f (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:26:38.924610 18094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e735bb4b506c457f8dddf767573d025f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.936174 18054 heartbeater.cc:499] Master 127.9.145.254:45005 was elected leader, sending a full tablet report...
I20260709 12:26:38.961597 18298 consensus_queue.cc:260] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:38.962462 18300 tablet_bootstrap.cc:492] T 1660568f1208485fb6f74d572deee2d9 P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:38.975523 18165 tablet_service.cc:1511] Processing CreateTablet for tablet a019c53d9a9946c59ed8a1b201786adc (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:26:38.976994 18165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a019c53d9a9946c59ed8a1b201786adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.981063 18016 tablet_service.cc:1511] Processing CreateTablet for tablet 5995ee175fed4e3e893b8efe2a7eb7d0 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:26:38.986728 18016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5995ee175fed4e3e893b8efe2a7eb7d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.983880 18299 tablet_bootstrap.cc:492] T 5e88e93a00044d1482497fa864163047 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:38.990329 18299 ts_tablet_manager.cc:1403] T 5e88e93a00044d1482497fa864163047 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.172s	user 0.017s	sys 0.011s
I20260709 12:26:38.992445 18241 tablet_service.cc:1511] Processing CreateTablet for tablet a019c53d9a9946c59ed8a1b201786adc (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:26:38.993997 18241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a019c53d9a9946c59ed8a1b201786adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.998477 18017 tablet_service.cc:1511] Processing CreateTablet for tablet bb4d4ed1ab54477ca58913fad1bc93b1 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:26:38.999964 18017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb4d4ed1ab54477ca58913fad1bc93b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.027390 18014 tablet_service.cc:1511] Processing CreateTablet for tablet e735bb4b506c457f8dddf767573d025f (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:26:39.028793 18014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e735bb4b506c457f8dddf767573d025f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.060920 18129 heartbeater.cc:499] Master 127.9.145.254:45005 was elected leader, sending a full tablet report...
I20260709 12:26:39.061448 18277 heartbeater.cc:499] Master 127.9.145.254:45005 was elected leader, sending a full tablet report...
I20260709 12:26:39.061563 18299 raft_consensus.cc:359] T 5e88e93a00044d1482497fa864163047 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:39.084128 18299 raft_consensus.cc:385] T 5e88e93a00044d1482497fa864163047 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.084486 18299 raft_consensus.cc:740] T 5e88e93a00044d1482497fa864163047 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.085510 18299 consensus_queue.cc:260] T 5e88e93a00044d1482497fa864163047 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:39.084465 18013 tablet_service.cc:1511] Processing CreateTablet for tablet a379e8a15db944b4a33a0c99f05dc6db (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:26:39.088521 18013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a379e8a15db944b4a33a0c99f05dc6db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.129822 18303 tablet_bootstrap.cc:492] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:39.144644 18203 heartbeater.cc:499] Master 127.9.145.254:45005 was elected leader, sending a full tablet report...
I20260709 12:26:39.155017 18299 ts_tablet_manager.cc:1434] T 5e88e93a00044d1482497fa864163047 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.164s	user 0.012s	sys 0.010s
I20260709 12:26:39.156360 18299 tablet_bootstrap.cc:492] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
W20260709 12:26:39.161958 17912 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.9.145.193:36743, user_credentials={real_user=slave}} blocked reactor thread for 99628.8us
I20260709 12:26:39.164032 18300 tablet_bootstrap.cc:654] T 1660568f1208485fb6f74d572deee2d9 P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.155264 18298 ts_tablet_manager.cc:1434] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.243s	user 0.016s	sys 0.009s
I20260709 12:26:39.169782 18298 tablet_bootstrap.cc:492] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:39.171003 18304 raft_consensus.cc:493] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.171712 18304 raft_consensus.cc:515] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:39.177194 18304 leader_election.cc:290] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:39.199661 18093 tablet_service.cc:1511] Processing CreateTablet for tablet b667d19692ec4a3aaa8d0c45edf73db9 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:26:39.207203 18093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b667d19692ec4a3aaa8d0c45edf73db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.223500 18298 tablet_bootstrap.cc:654] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:39.230388 18278 tablet.cc:2406] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 10c938681fc04e66968531267f39f16c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:26:39.238893 18019 tablet_service.cc:1511] Processing CreateTablet for tablet a019c53d9a9946c59ed8a1b201786adc (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:26:39.240370 18019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a019c53d9a9946c59ed8a1b201786adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.248713 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adcc9c41a0d4ffe92d5aa05859d55f5" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:39.251225 18303 tablet_bootstrap.cc:654] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:39.251142 18216 leader_election.cc:343] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:39.261627 18168 tablet_service.cc:1511] Processing CreateTablet for tablet b667d19692ec4a3aaa8d0c45edf73db9 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:26:39.263259 18168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b667d19692ec4a3aaa8d0c45edf73db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.273465 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adcc9c41a0d4ffe92d5aa05859d55f5" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
W20260709 12:26:39.277700 18215 leader_election.cc:343] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:39.278329 18215 leader_election.cc:304] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c938681fc04e66968531267f39f16c; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:39.279311 18304 raft_consensus.cc:2749] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:39.282480 18236 tablet_service.cc:1511] Processing CreateTablet for tablet b667d19692ec4a3aaa8d0c45edf73db9 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:26:39.283986 18236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b667d19692ec4a3aaa8d0c45edf73db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.285490 18299 tablet_bootstrap.cc:654] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.288163 18010 tablet_service.cc:1511] Processing CreateTablet for tablet f17497d6870f4ff495e91f076239de59 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:26:39.289368 18010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f17497d6870f4ff495e91f076239de59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.291086 18305 raft_consensus.cc:493] T 5e88e93a00044d1482497fa864163047 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.291664 18305 raft_consensus.cc:515] T 5e88e93a00044d1482497fa864163047 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:39.309551 18305 leader_election.cc:290] T 5e88e93a00044d1482497fa864163047 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:39.315009 18303 tablet_bootstrap.cc:492] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:39.315663 18303 ts_tablet_manager.cc:1403] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.186s	user 0.019s	sys 0.000s
I20260709 12:26:39.316601 18300 tablet_bootstrap.cc:492] T 1660568f1208485fb6f74d572deee2d9 P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:39.316108 18017 tablet_service.cc:1511] Processing CreateTablet for tablet c697128b8d274c8790595b833d9b74eb (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:26:39.317174 18300 ts_tablet_manager.cc:1403] T 1660568f1208485fb6f74d572deee2d9 P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.355s	user 0.024s	sys 0.034s
I20260709 12:26:39.317833 18017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c697128b8d274c8790595b833d9b74eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.316108 18241 tablet_service.cc:1511] Processing CreateTablet for tablet c697128b8d274c8790595b833d9b74eb (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:26:39.322726 18241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c697128b8d274c8790595b833d9b74eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.328269 18166 tablet_service.cc:1511] Processing CreateTablet for tablet 90509aaa02f84d8a983c9f13d8155ded (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:26:39.329789 18166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90509aaa02f84d8a983c9f13d8155ded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.329511 18234 tablet_service.cc:1511] Processing CreateTablet for tablet 90509aaa02f84d8a983c9f13d8155ded (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:26:39.331065 18234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90509aaa02f84d8a983c9f13d8155ded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.331193 18167 tablet_service.cc:1511] Processing CreateTablet for tablet f17497d6870f4ff495e91f076239de59 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:26:39.335333 18300 raft_consensus.cc:359] T 1660568f1208485fb6f74d572deee2d9 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:39.336234 18300 raft_consensus.cc:385] T 1660568f1208485fb6f74d572deee2d9 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.336578 18300 raft_consensus.cc:740] T 1660568f1208485fb6f74d572deee2d9 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.339048 18300 consensus_queue.cc:260] T 1660568f1208485fb6f74d572deee2d9 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:39.345773 18167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f17497d6870f4ff495e91f076239de59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.359215 18303 raft_consensus.cc:359] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:39.360082 18303 raft_consensus.cc:385] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.360404 18303 raft_consensus.cc:740] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.361186 18303 consensus_queue.cc:260] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:39.374450 18019 tablet_service.cc:1511] Processing CreateTablet for tablet 90509aaa02f84d8a983c9f13d8155ded (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:26:39.375432 18299 tablet_bootstrap.cc:492] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:39.376089 18299 ts_tablet_manager.cc:1403] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.220s	user 0.016s	sys 0.007s
I20260709 12:26:39.378021 18235 tablet_service.cc:1511] Processing CreateTablet for tablet dc4b6b0d4466443f9c077e9a45bb3b89 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:26:39.376091 18019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90509aaa02f84d8a983c9f13d8155ded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.379009 18298 tablet_bootstrap.cc:492] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:39.379371 18235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc4b6b0d4466443f9c077e9a45bb3b89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.379653 18298 ts_tablet_manager.cc:1403] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.210s	user 0.016s	sys 0.002s
I20260709 12:26:39.382201 18299 raft_consensus.cc:359] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:39.403157 18298 raft_consensus.cc:359] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:39.404083 18298 raft_consensus.cc:385] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.404392 18298 raft_consensus.cc:740] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.405224 18298 consensus_queue.cc:260] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:39.394251 18299 raft_consensus.cc:385] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.410468 18093 tablet_service.cc:1511] Processing CreateTablet for tablet f17497d6870f4ff495e91f076239de59 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:26:39.411021 18094 tablet_service.cc:1511] Processing CreateTablet for tablet dc4b6b0d4466443f9c077e9a45bb3b89 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:26:39.411860 18093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f17497d6870f4ff495e91f076239de59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.412691 18094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc4b6b0d4466443f9c077e9a45bb3b89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.410279 18089 tablet_service.cc:1511] Processing CreateTablet for tablet c697128b8d274c8790595b833d9b74eb (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:26:39.416069 18089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c697128b8d274c8790595b833d9b74eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.418184 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e88e93a00044d1482497fa864163047" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:39.420226 18298 ts_tablet_manager.cc:1434] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.005s
I20260709 12:26:39.421545 18298 tablet_bootstrap.cc:492] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
W20260709 12:26:39.421826 18067 leader_election.cc:343] T 5e88e93a00044d1482497fa864163047 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10c938681fc04e66968531267f39f16c (127.9.145.196:37881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:39.425041 18300 ts_tablet_manager.cc:1434] T 1660568f1208485fb6f74d572deee2d9 P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.108s	user 0.017s	sys 0.021s
I20260709 12:26:39.432200 18298 tablet_bootstrap.cc:654] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.435917 18010 tablet_service.cc:1511] Processing CreateTablet for tablet dda5199333524768beef0903fe39e300 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:26:39.437516 18010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dda5199333524768beef0903fe39e300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.448199 18159 tablet_service.cc:1511] Processing CreateTablet for tablet dc4b6b0d4466443f9c077e9a45bb3b89 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:26:39.456851 18089 tablet_service.cc:1511] Processing CreateTablet for tablet dda5199333524768beef0903fe39e300 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:26:39.458468 18089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dda5199333524768beef0903fe39e300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.414366 18299 raft_consensus.cc:740] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.463256 18300 tablet_bootstrap.cc:492] T e60fecc50c1d49c2963f342da1b3c2a6 P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:39.466728 18299 consensus_queue.cc:260] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:39.468304 18159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc4b6b0d4466443f9c077e9a45bb3b89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.469309 18299 ts_tablet_manager.cc:1434] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.093s	user 0.005s	sys 0.000s
I20260709 12:26:39.471184 18303 ts_tablet_manager.cc:1434] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.155s	user 0.016s	sys 0.011s
I20260709 12:26:39.472373 18303 tablet_bootstrap.cc:492] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:39.473565 18300 tablet_bootstrap.cc:654] T e60fecc50c1d49c2963f342da1b3c2a6 P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.476303 18299 tablet_bootstrap.cc:492] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:39.482709 18165 tablet_service.cc:1511] Processing CreateTablet for tablet dda5199333524768beef0903fe39e300 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:26:39.483538 18299 tablet_bootstrap.cc:654] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.484242 18165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dda5199333524768beef0903fe39e300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.491281 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e88e93a00044d1482497fa864163047" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:39.493072 18303 tablet_bootstrap.cc:654] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:39.494444 18068 leader_election.cc:343] T 5e88e93a00044d1482497fa864163047 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:39.495105 18068 leader_election.cc:304] T 5e88e93a00044d1482497fa864163047 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:39.496408 18305 raft_consensus.cc:2749] T 5e88e93a00044d1482497fa864163047 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:39.513520 18241 tablet_service.cc:1511] Processing CreateTablet for tablet 01d2f53aff8a45a49cadf9fd72b75ee8 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:26:39.515748 18019 tablet_service.cc:1511] Processing CreateTablet for tablet 01d2f53aff8a45a49cadf9fd72b75ee8 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:26:39.516284 18241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d2f53aff8a45a49cadf9fd72b75ee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.517189 18019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d2f53aff8a45a49cadf9fd72b75ee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.525033 18300 tablet_bootstrap.cc:492] T e60fecc50c1d49c2963f342da1b3c2a6 P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:39.525678 18300 ts_tablet_manager.cc:1403] T e60fecc50c1d49c2963f342da1b3c2a6 P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.063s	user 0.008s	sys 0.015s
I20260709 12:26:39.529023 18300 raft_consensus.cc:359] T e60fecc50c1d49c2963f342da1b3c2a6 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:39.529790 18300 raft_consensus.cc:385] T e60fecc50c1d49c2963f342da1b3c2a6 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.530246 18300 raft_consensus.cc:740] T e60fecc50c1d49c2963f342da1b3c2a6 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.531213 18300 consensus_queue.cc:260] T e60fecc50c1d49c2963f342da1b3c2a6 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:39.532756 18093 tablet_service.cc:1511] Processing CreateTablet for tablet 01d2f53aff8a45a49cadf9fd72b75ee8 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:26:39.534317 18093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d2f53aff8a45a49cadf9fd72b75ee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.534729 18298 tablet_bootstrap.cc:492] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:39.538652 18298 ts_tablet_manager.cc:1403] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.117s	user 0.012s	sys 0.008s
I20260709 12:26:39.539588 18317 raft_consensus.cc:493] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.540508 18300 ts_tablet_manager.cc:1434] T e60fecc50c1d49c2963f342da1b3c2a6 P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:26:39.540174 18317 raft_consensus.cc:515] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:39.540943 18167 tablet_service.cc:1511] Processing CreateTablet for tablet f68e8047f5ff4aa0b631cbd912091d25 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:26:39.542543 18167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f68e8047f5ff4aa0b631cbd912091d25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.544370 18303 tablet_bootstrap.cc:492] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:39.544935 18303 ts_tablet_manager.cc:1403] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.073s	user 0.009s	sys 0.003s
I20260709 12:26:39.548723 18236 tablet_service.cc:1511] Processing CreateTablet for tablet f68e8047f5ff4aa0b631cbd912091d25 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:26:39.549641 18317 leader_election.cc:290] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:39.550259 18236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f68e8047f5ff4aa0b631cbd912091d25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.555738 18304 raft_consensus.cc:493] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.556363 18304 raft_consensus.cc:515] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:39.556931 18303 raft_consensus.cc:359] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:39.558082 18303 raft_consensus.cc:385] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.558687 18303 raft_consensus.cc:740] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.561897 18303 consensus_queue.cc:260] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:39.560845 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60fecc50c1d49c2963f342da1b3c2a6" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
W20260709 12:26:39.568148 18215 leader_election.cc:343] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:39.560209 18298 raft_consensus.cc:359] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:39.565598 18304 leader_election.cc:290] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:39.570125 18300 tablet_bootstrap.cc:492] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:39.570402 18298 raft_consensus.cc:385] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.563604 18299 tablet_bootstrap.cc:492] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:39.573691 18299 ts_tablet_manager.cc:1403] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.099s	user 0.030s	sys 0.006s
I20260709 12:26:39.574388 18298 raft_consensus.cc:740] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.578791 18298 consensus_queue.cc:260] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:39.587800 18303 ts_tablet_manager.cc:1434] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.000s
I20260709 12:26:39.589775 18303 tablet_bootstrap.cc:492] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:39.591583 18298 ts_tablet_manager.cc:1434] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 12:26:39.594493 18298 tablet_bootstrap.cc:492] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:39.605118 18316 raft_consensus.cc:493] T e60fecc50c1d49c2963f342da1b3c2a6 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.605818 18316 raft_consensus.cc:515] T e60fecc50c1d49c2963f342da1b3c2a6 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:39.608968 18316 leader_election.cc:290] T e60fecc50c1d49c2963f342da1b3c2a6 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:39.620673 18300 tablet_bootstrap.cc:654] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.631963 18010 tablet_service.cc:1511] Processing CreateTablet for tablet f68e8047f5ff4aa0b631cbd912091d25 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:26:39.633474 18010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f68e8047f5ff4aa0b631cbd912091d25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.641431 18298 tablet_bootstrap.cc:654] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.621851 18299 raft_consensus.cc:359] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:39.642859 18299 raft_consensus.cc:385] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.643221 18299 raft_consensus.cc:740] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.644131 18299 consensus_queue.cc:260] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:39.645694 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60fecc50c1d49c2963f342da1b3c2a6" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:39.646518 18178 raft_consensus.cc:2468] T e60fecc50c1d49c2963f342da1b3c2a6 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 0.
I20260709 12:26:39.648027 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0fb4e45e6e54dbf8b96315fab6e5cb8" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:39.648784 18104 raft_consensus.cc:2468] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 0.
I20260709 12:26:39.655968 17992 leader_election.cc:304] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:39.657004 18317 raft_consensus.cc:2804] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:39.656834 18167 tablet_service.cc:1511] Processing CreateTablet for tablet 07d9e11e303c4580a941ccc2943afdd5 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:26:39.657464 18317 raft_consensus.cc:493] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.660219 18218 leader_election.cc:304] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c
I20260709 12:26:39.661183 18304 raft_consensus.cc:2804] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:39.658967 18317 raft_consensus.cc:3060] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.661594 18304 raft_consensus.cc:493] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.662178 18304 raft_consensus.cc:3060] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.661501 18089 tablet_service.cc:1511] Processing CreateTablet for tablet 07d9e11e303c4580a941ccc2943afdd5 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:26:39.663484 18089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07d9e11e303c4580a941ccc2943afdd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.669858 18167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07d9e11e303c4580a941ccc2943afdd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.672758 18304 raft_consensus.cc:515] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:39.674134 18299 ts_tablet_manager.cc:1434] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.100s	user 0.011s	sys 0.002s
I20260709 12:26:39.675377 18299 tablet_bootstrap.cc:492] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:39.675715 18241 tablet_service.cc:1511] Processing CreateTablet for tablet 07d9e11e303c4580a941ccc2943afdd5 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:26:39.677151 18241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07d9e11e303c4580a941ccc2943afdd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.679026 18303 tablet_bootstrap.cc:654] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.679773 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0fb4e45e6e54dbf8b96315fab6e5cb8" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
W20260709 12:26:39.684500 17995 leader_election.cc:343] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:39.686447 18304 leader_election.cc:290] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Requested vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:39.686614 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60fecc50c1d49c2963f342da1b3c2a6" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:39.688390 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60fecc50c1d49c2963f342da1b3c2a6" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:39.689038 18178 raft_consensus.cc:3060] T e60fecc50c1d49c2963f342da1b3c2a6 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:39.689340 18215 leader_election.cc:343] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:39.672783 18317 raft_consensus.cc:515] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:39.696295 18300 tablet_bootstrap.cc:492] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:39.696432 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0fb4e45e6e54dbf8b96315fab6e5cb8" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:39.699556 18104 raft_consensus.cc:3060] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.702323 18094 tablet_service.cc:1511] Processing CreateTablet for tablet 049a535902f64c44bb4e1b9ecc92694c (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:26:39.702821 18165 tablet_service.cc:1511] Processing CreateTablet for tablet 049a535902f64c44bb4e1b9ecc92694c (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:26:39.703781 18094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049a535902f64c44bb4e1b9ecc92694c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.704087 18165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049a535902f64c44bb4e1b9ecc92694c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.704607 18317 leader_election.cc:290] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Requested vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:39.707278 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0fb4e45e6e54dbf8b96315fab6e5cb8" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
W20260709 12:26:39.709893 17995 leader_election.cc:343] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:39.714205 18299 tablet_bootstrap.cc:654] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.719172 18236 tablet_service.cc:1511] Processing CreateTablet for tablet 29e1b7b25f15438ba055b0ea299ada27 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:26:39.720718 18236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29e1b7b25f15438ba055b0ea299ada27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.724125 18017 tablet_service.cc:1511] Processing CreateTablet for tablet 29e1b7b25f15438ba055b0ea299ada27 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:26:39.725147 18178 raft_consensus.cc:2468] T e60fecc50c1d49c2963f342da1b3c2a6 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 1.
I20260709 12:26:39.700042 18300 ts_tablet_manager.cc:1403] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.130s	user 0.018s	sys 0.004s
I20260709 12:26:39.727921 18088 tablet_service.cc:1511] Processing CreateTablet for tablet 29e1b7b25f15438ba055b0ea299ada27 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:26:39.702390 18019 tablet_service.cc:1511] Processing CreateTablet for tablet 049a535902f64c44bb4e1b9ecc92694c (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:26:39.733934 18159 tablet_service.cc:1511] Processing CreateTablet for tablet ebb7b63685e841a2a975e727c46f1b64 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:26:39.735000 18316 raft_consensus.cc:493] T 1660568f1208485fb6f74d572deee2d9 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.735986 18104 raft_consensus.cc:2468] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 1.
I20260709 12:26:39.741240 18234 tablet_service.cc:1511] Processing CreateTablet for tablet ebb7b63685e841a2a975e727c46f1b64 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
W20260709 12:26:39.743842 17975 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:39.752701 18088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29e1b7b25f15438ba055b0ea299ada27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.753260 17992 leader_election.cc:304] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: a08ea42cd3884210924a19c8f570486d
I20260709 12:26:39.754213 18317 raft_consensus.cc:2804] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:39.753973 18316 raft_consensus.cc:515] T 1660568f1208485fb6f74d572deee2d9 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:39.756661 18316 leader_election.cc:290] T 1660568f1208485fb6f74d572deee2d9 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:39.758662 18085 tablet_service.cc:1511] Processing CreateTablet for tablet 81710104264d4f3fa7ecf1c48b2b48ca (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:26:39.759591 18218 leader_election.cc:304] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c
I20260709 12:26:39.758394 18159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebb7b63685e841a2a975e727c46f1b64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.760077 18085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81710104264d4f3fa7ecf1c48b2b48ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.759853 18017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29e1b7b25f15438ba055b0ea299ada27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.760528 18304 raft_consensus.cc:2804] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:39.753706 18234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebb7b63685e841a2a975e727c46f1b64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.758662 18010 tablet_service.cc:1511] Processing CreateTablet for tablet ebb7b63685e841a2a975e727c46f1b64 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:26:39.771013 18019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049a535902f64c44bb4e1b9ecc92694c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.788842 18168 tablet_service.cc:1511] Processing CreateTablet for tablet 81710104264d4f3fa7ecf1c48b2b48ca (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:26:39.789053 18300 raft_consensus.cc:359] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:39.790637 18168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81710104264d4f3fa7ecf1c48b2b48ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.789863 18300 raft_consensus.cc:385] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.795231 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1660568f1208485fb6f74d572deee2d9" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
W20260709 12:26:39.797060 18142 leader_election.cc:343] T 1660568f1208485fb6f74d572deee2d9 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:39.801975 18303 tablet_bootstrap.cc:492] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:39.802726 18303 ts_tablet_manager.cc:1403] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.213s	user 0.004s	sys 0.016s
I20260709 12:26:39.804106 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60fecc50c1d49c2963f342da1b3c2a6" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
W20260709 12:26:39.808681 18141 leader_election.cc:343] T e60fecc50c1d49c2963f342da1b3c2a6 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:39.809631 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60fecc50c1d49c2963f342da1b3c2a6" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:39.810228 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1660568f1208485fb6f74d572deee2d9" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
W20260709 12:26:39.811872 18141 leader_election.cc:343] T 1660568f1208485fb6f74d572deee2d9 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10c938681fc04e66968531267f39f16c (127.9.145.196:37881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:39.811709 18016 tablet_service.cc:1511] Processing CreateTablet for tablet 6cf8e5342a1141b5b3f0ee9ec643beec (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:26:39.812103 18241 tablet_service.cc:1511] Processing CreateTablet for tablet 81710104264d4f3fa7ecf1c48b2b48ca (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:26:39.812366 18141 leader_election.cc:304] T 1660568f1208485fb6f74d572deee2d9 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a08ea42cd3884210924a19c8f570486d; no voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:39.813207 18316 raft_consensus.cc:2749] T 1660568f1208485fb6f74d572deee2d9 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:39.813416 18241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81710104264d4f3fa7ecf1c48b2b48ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.794061 18300 raft_consensus.cc:740] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.820966 18010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebb7b63685e841a2a975e727c46f1b64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.805871 18304 raft_consensus.cc:697] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Becoming Leader. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:26:39.807282 18317 raft_consensus.cc:697] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 LEADER]: Becoming Leader. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Running, Role: LEADER
I20260709 12:26:39.830233 18013 tablet_service.cc:1511] Processing CreateTablet for tablet 9984112bc75a4e66b55655a1bdd99052 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:26:39.830233 18235 tablet_service.cc:1511] Processing CreateTablet for tablet 9984112bc75a4e66b55655a1bdd99052 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:26:39.834308 18235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9984112bc75a4e66b55655a1bdd99052. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.836685 18333 raft_consensus.cc:493] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.837334 18333 raft_consensus.cc:515] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:39.839038 18094 tablet_service.cc:1511] Processing CreateTablet for tablet 6cf8e5342a1141b5b3f0ee9ec643beec (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:26:39.839236 18299 tablet_bootstrap.cc:492] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:39.840663 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e88e93a00044d1482497fa864163047" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:39.840395 18303 raft_consensus.cc:359] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
W20260709 12:26:39.842361 18216 leader_election.cc:343] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:39.840898 18299 ts_tablet_manager.cc:1403] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.166s	user 0.021s	sys 0.014s
I20260709 12:26:39.850485 18304 consensus_queue.cc:237] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:39.840569 18094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cf8e5342a1141b5b3f0ee9ec643beec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.855819 18298 tablet_bootstrap.cc:492] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:39.856580 18298 ts_tablet_manager.cc:1403] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.262s	user 0.013s	sys 0.027s
I20260709 12:26:39.856036 18317 consensus_queue.cc:237] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:39.855021 18299 raft_consensus.cc:359] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:39.857800 18299 raft_consensus.cc:385] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.858878 18299 raft_consensus.cc:740] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.859838 18298 raft_consensus.cc:359] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:39.860704 18298 raft_consensus.cc:385] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.860265 18300 consensus_queue.cc:260] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:39.861021 18298 raft_consensus.cc:740] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.869731 18016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cf8e5342a1141b5b3f0ee9ec643beec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.859922 18303 raft_consensus.cc:385] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.870229 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e88e93a00044d1482497fa864163047" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:39.870563 18303 raft_consensus.cc:740] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.871167 18013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9984112bc75a4e66b55655a1bdd99052. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.861882 18298 consensus_queue.cc:260] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:39.871853 18303 consensus_queue.cc:260] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:39.871069 18104 raft_consensus.cc:2468] T 5e88e93a00044d1482497fa864163047 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 0.
I20260709 12:26:39.874542 18215 leader_election.cc:304] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:39.870647 18088 tablet_service.cc:1511] Processing CreateTablet for tablet 9984112bc75a4e66b55655a1bdd99052 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:26:39.876374 18088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9984112bc75a4e66b55655a1bdd99052. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.874790 18303 ts_tablet_manager.cc:1434] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.001s
I20260709 12:26:39.879383 18335 raft_consensus.cc:2804] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:39.879914 18298 ts_tablet_manager.cc:1434] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.002s
I20260709 12:26:39.861332 18299 consensus_queue.cc:260] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:39.887905 18299 ts_tablet_manager.cc:1434] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 12:26:39.879849 18335 raft_consensus.cc:493] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.888568 18335 raft_consensus.cc:3060] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.897719 18299 tablet_bootstrap.cc:492] T d8b351ffd4864761bb49da4eceac3566 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:39.898460 18305 raft_consensus.cc:493] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.899106 18305 raft_consensus.cc:515] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:39.882553 18298 tablet_bootstrap.cc:492] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:39.877609 18333 leader_election.cc:290] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:39.909253 18333 raft_consensus.cc:493] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.909761 18333 raft_consensus.cc:515] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:39.862797 18300 ts_tablet_manager.cc:1434] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.113s	user 0.004s	sys 0.003s
I20260709 12:26:39.913749 18303 tablet_bootstrap.cc:492] T a61bb69fcfd54ef88c37917a48d1cb30 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:39.867645 18167 tablet_service.cc:1511] Processing CreateTablet for tablet 6cf8e5342a1141b5b3f0ee9ec643beec (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:26:39.922287 18305 leader_election.cc:290] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:39.927635 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e48eb1372ff4402498990d2abd8c6da2" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
W20260709 12:26:39.930565 18218 leader_election.cc:343] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:39.931838 18167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cf8e5342a1141b5b3f0ee9ec643beec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.934957 18168 tablet_service.cc:1511] Processing CreateTablet for tablet 96957d639eed4a1395857a97a292f8ea (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:26:39.936359 18168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96957d639eed4a1395857a97a292f8ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.922191 18333 leader_election.cc:290] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:39.948992 18234 tablet_service.cc:1511] Processing CreateTablet for tablet 96957d639eed4a1395857a97a292f8ea (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:26:39.950500 18234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96957d639eed4a1395857a97a292f8ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.953189 18300 tablet_bootstrap.cc:492] T 629843ee608f4aff9e667570f73f9d6f P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:39.981433 18335 raft_consensus.cc:515] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:39.982645 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e48eb1372ff4402498990d2abd8c6da2" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
W20260709 12:26:39.989321 18070 leader_election.cc:343] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:39.989655 18335 leader_election.cc:290] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Requested vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:39.984194 18299 tablet_bootstrap.cc:654] T d8b351ffd4864761bb49da4eceac3566 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.992092 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e88e93a00044d1482497fa864163047" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:39.992342 17927 catalog_manager.cc:5697] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc reported cstate change: term changed from 0 to 1, leader changed from <none> to ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193). New cstate: current_term: 1 leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:39.993857 18216 leader_election.cc:343] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:39.991122 18215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:45595, user_credentials={real_user=slave}} blocked reactor thread for 116688us
I20260709 12:26:39.995293 18305 raft_consensus.cc:493] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.995838 18305 raft_consensus.cc:515] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:39.996529 18141 leader_election.cc:304] T e60fecc50c1d49c2963f342da1b3c2a6 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a08ea42cd3884210924a19c8f570486d; no voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c
I20260709 12:26:39.996690 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e48eb1372ff4402498990d2abd8c6da2" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:39.997433 18104 raft_consensus.cc:2468] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 0.
I20260709 12:26:39.997759 18316 raft_consensus.cc:2749] T e60fecc50c1d49c2963f342da1b3c2a6 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:39.997370 17925 catalog_manager.cc:5697] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c938681fc04e66968531267f39f16c (127.9.145.196). New cstate: current_term: 1 leader_uuid: "10c938681fc04e66968531267f39f16c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:39.998092 18305 leader_election.cc:290] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:39.999922 18016 tablet_service.cc:1511] Processing CreateTablet for tablet 96957d639eed4a1395857a97a292f8ea (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:26:40.000227 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adcc9c41a0d4ffe92d5aa05859d55f5" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:40.001295 18016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96957d639eed4a1395857a97a292f8ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.981263 18303 tablet_bootstrap.cc:654] T a61bb69fcfd54ef88c37917a48d1cb30 P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.984391 18317 raft_consensus.cc:493] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.010514 18317 raft_consensus.cc:515] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:40.011463 18159 tablet_service.cc:1511] Processing CreateTablet for tablet 223eb34bd9744014b3c011eebcb37f11 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
W20260709 12:26:40.002868 18068 leader_election.cc:343] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:40.008886 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e48eb1372ff4402498990d2abd8c6da2" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:40.009168 18215 leader_election.cc:304] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: a08ea42cd3884210924a19c8f570486d
I20260709 12:26:40.009696 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adcc9c41a0d4ffe92d5aa05859d55f5" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:40.002318 18298 tablet_bootstrap.cc:654] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:40.022220 18251 raft_consensus.cc:2468] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 0.
I20260709 12:26:40.013067 18317 leader_election.cc:290] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:40.014808 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94eb437be5041e48122e923dc7cc760" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:40.015280 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94eb437be5041e48122e923dc7cc760" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:40.007004 18094 tablet_service.cc:1511] Processing CreateTablet for tablet 223eb34bd9744014b3c011eebcb37f11 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:26:40.017524 18300 tablet_bootstrap.cc:654] T 629843ee608f4aff9e667570f73f9d6f P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:40.024461 18252 raft_consensus.cc:2468] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 0.
W20260709 12:26:40.035845 17995 leader_election.cc:343] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:40.036284 18088 tablet_service.cc:1511] Processing CreateTablet for tablet d52578a055b2452883b1a598a35ca322 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:26:40.037082 18013 tablet_service.cc:1511] Processing CreateTablet for tablet d52578a055b2452883b1a598a35ca322 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:26:40.040131 18337 raft_consensus.cc:2804] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:26:40.037606 17992 leader_election.cc:343] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:40.043100 18017 tablet_service.cc:1511] Processing CreateTablet for tablet f124d65e17c143b08d3428ef325ae9a5 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:26:40.043457 17992 leader_election.cc:304] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac42e2bcf9ac42448a84370269bc6ccc; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d
I20260709 12:26:40.043779 18094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 223eb34bd9744014b3c011eebcb37f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.044553 18017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f124d65e17c143b08d3428ef325ae9a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.045699 18088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d52578a055b2452883b1a598a35ca322. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.046607 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e88e93a00044d1482497fa864163047" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:40.047345 18103 raft_consensus.cc:3060] T 5e88e93a00044d1482497fa864163047 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:40.042657 18337 raft_consensus.cc:493] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:40.051811 18337 raft_consensus.cc:3060] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:40.052912 18241 tablet_service.cc:1511] Processing CreateTablet for tablet f124d65e17c143b08d3428ef325ae9a5 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
W20260709 12:26:40.053993 18215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:45595, user_credentials={real_user=slave}} blocked reactor thread for 44947us
I20260709 12:26:40.054893 18241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f124d65e17c143b08d3428ef325ae9a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.055644 18013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d52578a055b2452883b1a598a35ca322. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.056900 18067 leader_election.cc:304] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:40.058547 18067 leader_election.cc:304] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: a08ea42cd3884210924a19c8f570486d
I20260709 12:26:40.061307 18305 raft_consensus.cc:2804] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:40.061625 18317 raft_consensus.cc:2749] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:40.066526 18305 raft_consensus.cc:493] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:40.072111 18305 raft_consensus.cc:3060] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:40.073444 18165 tablet_service.cc:1511] Processing CreateTablet for tablet 7dbf7d84f5ff496e905988250445db74 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:26:40.076588 18299 tablet_bootstrap.cc:492] T d8b351ffd4864761bb49da4eceac3566 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:40.077201 18299 ts_tablet_manager.cc:1403] T d8b351ffd4864761bb49da4eceac3566 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.180s	user 0.015s	sys 0.003s
I20260709 12:26:40.077368 18235 tablet_service.cc:1511] Processing CreateTablet for tablet 7dbf7d84f5ff496e905988250445db74 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:26:40.078953 18235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dbf7d84f5ff496e905988250445db74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.080657 18299 raft_consensus.cc:359] T d8b351ffd4864761bb49da4eceac3566 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:40.081519 18299 raft_consensus.cc:385] T d8b351ffd4864761bb49da4eceac3566 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:40.081832 18299 raft_consensus.cc:740] T d8b351ffd4864761bb49da4eceac3566 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:40.069254 18159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 223eb34bd9744014b3c011eebcb37f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.085098 18103 raft_consensus.cc:2468] T 5e88e93a00044d1482497fa864163047 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 1.
I20260709 12:26:40.090070 18165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dbf7d84f5ff496e905988250445db74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.090024 18299 consensus_queue.cc:260] T d8b351ffd4864761bb49da4eceac3566 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:40.091678 18019 tablet_service.cc:1511] Processing CreateTablet for tablet 7dbf7d84f5ff496e905988250445db74 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:26:40.093161 18019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dbf7d84f5ff496e905988250445db74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.088487 18305 raft_consensus.cc:515] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
W20260709 12:26:40.103646 18067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:37881, user_credentials={real_user=slave}} blocked reactor thread for 45217.7us
I20260709 12:26:40.104136 18215 leader_election.cc:304] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:40.108045 18335 raft_consensus.cc:2804] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:40.108609 18335 raft_consensus.cc:697] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Becoming Leader. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:26:40.109442 18335 consensus_queue.cc:237] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:40.115685 18085 tablet_service.cc:1511] Processing CreateTablet for tablet f124d65e17c143b08d3428ef325ae9a5 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:26:40.063757 18167 tablet_service.cc:1511] Processing CreateTablet for tablet d52578a055b2452883b1a598a35ca322 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:26:40.116314 18337 raft_consensus.cc:515] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:40.117156 18085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f124d65e17c143b08d3428ef325ae9a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.118163 18093 tablet_service.cc:1511] Processing CreateTablet for tablet 57c55f2aea594f27bd7ce646464ea07c (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:26:40.119542 18093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c55f2aea594f27bd7ce646464ea07c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.120208 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e48eb1372ff4402498990d2abd8c6da2" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
W20260709 12:26:40.121865 18218 leader_election.cc:343] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:40.123759 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e48eb1372ff4402498990d2abd8c6da2" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:40.124467 18103 raft_consensus.cc:3060] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:40.125679 18305 leader_election.cc:290] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Requested vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:40.127420 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adcc9c41a0d4ffe92d5aa05859d55f5" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
W20260709 12:26:40.129160 18068 leader_election.cc:343] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:40.129803 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adcc9c41a0d4ffe92d5aa05859d55f5" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:40.130568 18252 raft_consensus.cc:3060] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:40.119510 18337 leader_election.cc:290] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Requested vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:40.134493 18168 tablet_service.cc:1511] Processing CreateTablet for tablet 57c55f2aea594f27bd7ce646464ea07c (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:26:40.142868 18103 raft_consensus.cc:2468] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 1.
I20260709 12:26:40.144390 18215 leader_election.cc:304] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: a08ea42cd3884210924a19c8f570486d
I20260709 12:26:40.145063 18300 tablet_bootstrap.cc:492] T 629843ee608f4aff9e667570f73f9d6f P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:40.145650 18300 ts_tablet_manager.cc:1403] T 629843ee608f4aff9e667570f73f9d6f P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.193s	user 0.016s	sys 0.006s
I20260709 12:26:40.146127 18337 raft_consensus.cc:2804] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:40.146366 18344 raft_consensus.cc:2764] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:26:40.147346 18337 raft_consensus.cc:697] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Becoming Leader. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:26:40.147718 18252 raft_consensus.cc:2468] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 1.
I20260709 12:26:40.148927 18300 raft_consensus.cc:359] T 629843ee608f4aff9e667570f73f9d6f P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:40.149222 18067 leader_election.cc:304] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:40.149749 18300 raft_consensus.cc:385] T 629843ee608f4aff9e667570f73f9d6f P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:40.159029 18298 tablet_bootstrap.cc:492] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:40.159680 18298 ts_tablet_manager.cc:1403] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.279s	user 0.029s	sys 0.017s
I20260709 12:26:40.161947 18013 tablet_service.cc:1511] Processing CreateTablet for tablet 440b2a57096e45188762ccb05301beec (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:26:40.162999 18317 raft_consensus.cc:493] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.163388 18013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 440b2a57096e45188762ccb05301beec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.164083 18166 tablet_service.cc:1511] Processing CreateTablet for tablet 440b2a57096e45188762ccb05301beec (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:26:40.164572 18298 raft_consensus.cc:359] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:40.163576 18317 raft_consensus.cc:515] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:40.167336 18234 tablet_service.cc:1511] Processing CreateTablet for tablet 57c55f2aea594f27bd7ce646464ea07c (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:26:40.150707 18236 tablet_service.cc:1511] Processing CreateTablet for tablet 223eb34bd9744014b3c011eebcb37f11 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:26:40.152632 18167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d52578a055b2452883b1a598a35ca322. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.170476 18234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c55f2aea594f27bd7ce646464ea07c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.171505 18089 tablet_service.cc:1511] Processing CreateTablet for tablet 440b2a57096e45188762ccb05301beec (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:26:40.172786 18236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 223eb34bd9744014b3c011eebcb37f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.173525 18303 tablet_bootstrap.cc:492] T a61bb69fcfd54ef88c37917a48d1cb30 P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:40.173826 18298 raft_consensus.cc:385] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:40.150691 18344 raft_consensus.cc:2804] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:40.169589 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10895331ca6e49d4aad97aec0e629dd7" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:40.179440 18166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 440b2a57096e45188762ccb05301beec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.172861 18089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 440b2a57096e45188762ccb05301beec. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:40.180817 17992 leader_election.cc:343] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:40.151783 18300 raft_consensus.cc:740] T 629843ee608f4aff9e667570f73f9d6f P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:40.182915 18300 consensus_queue.cc:260] T 629843ee608f4aff9e667570f73f9d6f P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:40.185334 18300 ts_tablet_manager.cc:1434] T 629843ee608f4aff9e667570f73f9d6f P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:26:40.167919 18317 leader_election.cc:290] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:40.179443 18303 ts_tablet_manager.cc:1403] T a61bb69fcfd54ef88c37917a48d1cb30 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.271s	user 0.017s	sys 0.002s
I20260709 12:26:40.186524 18344 raft_consensus.cc:697] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Becoming Leader. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Running, Role: LEADER
I20260709 12:26:40.187527 18344 consensus_queue.cc:237] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:40.177594 18298 raft_consensus.cc:740] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:40.191020 18298 consensus_queue.cc:260] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:40.193426 18298 ts_tablet_manager.cc:1434] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.001s
I20260709 12:26:40.195502 18168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c55f2aea594f27bd7ce646464ea07c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.152791 18337 consensus_queue.cc:237] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:40.178968 18299 ts_tablet_manager.cc:1434] T d8b351ffd4864761bb49da4eceac3566 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.101s	user 0.007s	sys 0.008s
I20260709 12:26:40.205276 18299 tablet_bootstrap.cc:492] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:40.205978 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10895331ca6e49d4aad97aec0e629dd7" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:40.207597 18298 tablet_bootstrap.cc:492] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
W20260709 12:26:40.208039 17992 leader_election.cc:343] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10c938681fc04e66968531267f39f16c (127.9.145.196:37881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:40.208549 17992 leader_election.cc:304] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac42e2bcf9ac42448a84370269bc6ccc; no voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c
I20260709 12:26:40.208442 18237 tablet_service.cc:1511] Processing CreateTablet for tablet cffccb3c736b4f0fa0789217fa65dc2c (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:26:40.211803 18317 raft_consensus.cc:2749] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:40.213701 18300 tablet_bootstrap.cc:492] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:40.213963 18237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cffccb3c736b4f0fa0789217fa65dc2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.215498 18019 tablet_service.cc:1511] Processing CreateTablet for tablet cffccb3c736b4f0fa0789217fa65dc2c (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:26:40.216882 18019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cffccb3c736b4f0fa0789217fa65dc2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.220033 18091 tablet_service.cc:1511] Processing CreateTablet for tablet cffccb3c736b4f0fa0789217fa65dc2c (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:26:40.220733 18303 raft_consensus.cc:359] T a61bb69fcfd54ef88c37917a48d1cb30 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:40.221493 18091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cffccb3c736b4f0fa0789217fa65dc2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.225157 18162 tablet_service.cc:1511] Processing CreateTablet for tablet 35683295be3042a4bc1839bda16f6f40 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:26:40.228087 18162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35683295be3042a4bc1839bda16f6f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.239140 18316 raft_consensus.cc:493] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.239773 18316 raft_consensus.cc:515] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:40.245388 18299 tablet_bootstrap.cc:654] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:40.247776 18316 leader_election.cc:290] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:40.247509 18016 tablet_service.cc:1511] Processing CreateTablet for tablet 35683295be3042a4bc1839bda16f6f40 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:26:40.248983 18016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35683295be3042a4bc1839bda16f6f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.249267 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b351ffd4864761bb49da4eceac3566" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:40.250128 18103 raft_consensus.cc:2468] T d8b351ffd4864761bb49da4eceac3566 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 0.
I20260709 12:26:40.251104 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b351ffd4864761bb49da4eceac3566" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:40.251547 18141 leader_election.cc:304] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 
W20260709 12:26:40.252913 18142 leader_election.cc:343] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:40.254508 18316 raft_consensus.cc:2804] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:40.255131 18316 raft_consensus.cc:493] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:40.255762 18316 raft_consensus.cc:3060] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:40.257618 18300 tablet_bootstrap.cc:654] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:40.258594 18241 tablet_service.cc:1511] Processing CreateTablet for tablet 35683295be3042a4bc1839bda16f6f40 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:26:40.260489 18241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35683295be3042a4bc1839bda16f6f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.267355 18298 tablet_bootstrap.cc:654] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:40.269441 18092 tablet_service.cc:1511] Processing CreateTablet for tablet cba48186789449ef9cae51c546ace419 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:26:40.271150 18092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cba48186789449ef9cae51c546ace419. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.277779 18160 tablet_service.cc:1511] Processing CreateTablet for tablet cba48186789449ef9cae51c546ace419 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:26:40.279501 18160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cba48186789449ef9cae51c546ace419. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.283285 18242 tablet_service.cc:1511] Processing CreateTablet for tablet cba48186789449ef9cae51c546ace419 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:26:40.284747 18242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cba48186789449ef9cae51c546ace419. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.221511 18303 raft_consensus.cc:385] T a61bb69fcfd54ef88c37917a48d1cb30 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:40.310253 18159 tablet_service.cc:1511] Processing CreateTablet for tablet 8d1315ba5fa54c50809825b3329d3510 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:26:40.311934 18159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d1315ba5fa54c50809825b3329d3510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.313555 18017 tablet_service.cc:1511] Processing CreateTablet for tablet 8d1315ba5fa54c50809825b3329d3510 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:26:40.315100 18017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d1315ba5fa54c50809825b3329d3510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.286455 18303 raft_consensus.cc:740] T a61bb69fcfd54ef88c37917a48d1cb30 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:40.330451 18238 tablet_service.cc:1511] Processing CreateTablet for tablet 740537a0f03c42caa8182d3b9f403859 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:26:40.332115 18238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 740537a0f03c42caa8182d3b9f403859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.337134 18010 tablet_service.cc:1511] Processing CreateTablet for tablet 740537a0f03c42caa8182d3b9f403859 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:26:40.338801 18010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 740537a0f03c42caa8182d3b9f403859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.339702 18167 tablet_service.cc:1511] Processing CreateTablet for tablet fa35871af5624c709008fe86090c0ad1 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:26:40.341123 18167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa35871af5624c709008fe86090c0ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.341411 18303 consensus_queue.cc:260] T a61bb69fcfd54ef88c37917a48d1cb30 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:40.352598 18086 tablet_service.cc:1511] Processing CreateTablet for tablet 8d1315ba5fa54c50809825b3329d3510 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:26:40.353609 18303 ts_tablet_manager.cc:1434] T a61bb69fcfd54ef88c37917a48d1cb30 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.167s	user 0.007s	sys 0.000s
I20260709 12:26:40.354151 18086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d1315ba5fa54c50809825b3329d3510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.354832 18303 tablet_bootstrap.cc:492] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
W20260709 12:26:40.360409 18215 consensus_peers.cc:597] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c -> Peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Couldn't send request to peer 3a269a9c95e0476d9e09c25b4b5aaa2c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:40.363297 18087 tablet_service.cc:1511] Processing CreateTablet for tablet 740537a0f03c42caa8182d3b9f403859 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:26:40.363075 17926 catalog_manager.cc:5697] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194). New cstate: current_term: 1 leader_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:40.364784 18087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 740537a0f03c42caa8182d3b9f403859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.371711 17927 catalog_manager.cc:5697] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c938681fc04e66968531267f39f16c (127.9.145.196). New cstate: current_term: 1 leader_uuid: "10c938681fc04e66968531267f39f16c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:40.374935 18241 tablet_service.cc:1511] Processing CreateTablet for tablet fa35871af5624c709008fe86090c0ad1 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:26:40.378736 18241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa35871af5624c709008fe86090c0ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.381850 18317 consensus_queue.cc:1048] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:40.386566 17927 catalog_manager.cc:5697] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c938681fc04e66968531267f39f16c (127.9.145.196). New cstate: current_term: 1 leader_uuid: "10c938681fc04e66968531267f39f16c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:40.392520 18337 consensus_queue.cc:1048] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:40.393323 18316 raft_consensus.cc:515] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:40.398085 18299 tablet_bootstrap.cc:492] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:40.398720 18299 ts_tablet_manager.cc:1403] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.194s	user 0.015s	sys 0.000s
I20260709 12:26:40.439406 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b351ffd4864761bb49da4eceac3566" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:40.402037 18299 raft_consensus.cc:359] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:40.432195 18337 raft_consensus.cc:493] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.438419 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b351ffd4864761bb49da4eceac3566" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:40.442726 18337 raft_consensus.cc:515] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
W20260709 12:26:40.443135 18142 leader_election.cc:343] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:40.443475 18104 raft_consensus.cc:3060] T d8b351ffd4864761bb49da4eceac3566 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:40.446043 18337 leader_election.cc:290] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:40.446197 18358 raft_consensus.cc:493] T 629843ee608f4aff9e667570f73f9d6f P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.437120 18316 leader_election.cc:290] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Requested vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:40.446779 18358 raft_consensus.cc:515] T 629843ee608f4aff9e667570f73f9d6f P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:40.447526 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61bb69fcfd54ef88c37917a48d1cb30" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:40.448300 18029 raft_consensus.cc:2468] T a61bb69fcfd54ef88c37917a48d1cb30 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 0.
I20260709 12:26:40.453979 18216 leader_election.cc:304] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:40.454258 18104 raft_consensus.cc:2468] T d8b351ffd4864761bb49da4eceac3566 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 1.
I20260709 12:26:40.455044 18337 raft_consensus.cc:2804] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:40.455438 18337 raft_consensus.cc:493] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:40.455545 18141 leader_election.cc:304] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:40.450479 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61bb69fcfd54ef88c37917a48d1cb30" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:40.450845 18299 raft_consensus.cc:385] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:40.456972 18299 raft_consensus.cc:740] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:40.427521 18298 tablet_bootstrap.cc:492] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:40.422712 18168 tablet_service.cc:1511] Processing CreateTablet for tablet 09661bcb87ec455e97022bc6febc4754 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:26:40.427475 18234 tablet_service.cc:1511] Processing CreateTablet for tablet 09661bcb87ec455e97022bc6febc4754 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:26:40.417519 18085 tablet_service.cc:1511] Processing CreateTablet for tablet 09661bcb87ec455e97022bc6febc4754 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:26:40.452245 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "629843ee608f4aff9e667570f73f9d6f" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:40.450749 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "629843ee608f4aff9e667570f73f9d6f" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:40.463644 18234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09661bcb87ec455e97022bc6febc4754. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:40.464378 18142 leader_election.cc:343] T 629843ee608f4aff9e667570f73f9d6f P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:40.465020 18141 leader_election.cc:343] T 629843ee608f4aff9e667570f73f9d6f P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:40.455848 18337 raft_consensus.cc:3060] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:40.413763 18013 tablet_service.cc:1511] Processing CreateTablet for tablet fa35871af5624c709008fe86090c0ad1 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:26:40.469026 18013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa35871af5624c709008fe86090c0ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.449136 18358 leader_election.cc:290] T 629843ee608f4aff9e667570f73f9d6f P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
W20260709 12:26:40.458595 18218 leader_election.cc:343] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:40.459470 18356 raft_consensus.cc:2804] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:40.470920 18356 raft_consensus.cc:697] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Becoming Leader. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Running, Role: LEADER
I20260709 12:26:40.471844 18356 consensus_queue.cc:237] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:40.472532 18303 tablet_bootstrap.cc:654] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:40.457993 18298 ts_tablet_manager.cc:1403] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.251s	user 0.030s	sys 0.014s
I20260709 12:26:40.474882 18168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09661bcb87ec455e97022bc6febc4754. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.477449 18298 raft_consensus.cc:359] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:40.465445 18141 leader_election.cc:304] T 629843ee608f4aff9e667570f73f9d6f P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a08ea42cd3884210924a19c8f570486d; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:40.466636 18085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09661bcb87ec455e97022bc6febc4754. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.481950 18316 raft_consensus.cc:2749] T 629843ee608f4aff9e667570f73f9d6f P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:40.484555 17995 consensus_peers.cc:597] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc -> Peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Couldn't send request to peer a08ea42cd3884210924a19c8f570486d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:40.458113 18299 consensus_queue.cc:260] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:40.487592 18088 tablet_service.cc:1511] Processing CreateTablet for tablet 2a3e4e4b25f84008b5cd603640f2252f (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:26:40.489056 18088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a3e4e4b25f84008b5cd603640f2252f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.460115 18019 tablet_service.cc:1511] Processing CreateTablet for tablet 2a3e4e4b25f84008b5cd603640f2252f (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:26:40.490989 18019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a3e4e4b25f84008b5cd603640f2252f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.491930 18299 ts_tablet_manager.cc:1434] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.093s	user 0.008s	sys 0.000s
I20260709 12:26:40.493263 18299 tablet_bootstrap.cc:492] T be25c969559444ae99d240c6f3f60df1 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:40.493861 18298 raft_consensus.cc:385] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:40.494313 18298 raft_consensus.cc:740] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:40.467536 18242 tablet_service.cc:1511] Processing CreateTablet for tablet 02af88afdc444f268f05df276bf720c0 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:26:40.503099 18242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02af88afdc444f268f05df276bf720c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.508265 18016 tablet_service.cc:1511] Processing CreateTablet for tablet 02af88afdc444f268f05df276bf720c0 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:26:40.509850 18016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02af88afdc444f268f05df276bf720c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.512198 18162 tablet_service.cc:1511] Processing CreateTablet for tablet e2114d69fe2c427599f225a7b0686dee (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:26:40.512488 18337 raft_consensus.cc:515] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:40.513665 18162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2114d69fe2c427599f225a7b0686dee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.497540 18298 consensus_queue.cc:260] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:40.516978 18091 tablet_service.cc:1511] Processing CreateTablet for tablet 02af88afdc444f268f05df276bf720c0 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:26:40.518440 18091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02af88afdc444f268f05df276bf720c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.519073 18298 ts_tablet_manager.cc:1434] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 12:26:40.520241 18298 tablet_bootstrap.cc:492] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:40.524667 18300 tablet_bootstrap.cc:492] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:40.525398 18300 ts_tablet_manager.cc:1403] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.312s	user 0.010s	sys 0.013s
I20260709 12:26:40.533656 18300 raft_consensus.cc:359] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:40.534510 18300 raft_consensus.cc:385] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:40.534852 18300 raft_consensus.cc:740] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:40.535516 18300 consensus_queue.cc:260] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:40.536758 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61bb69fcfd54ef88c37917a48d1cb30" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
W20260709 12:26:40.538239 18218 leader_election.cc:343] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:40.538390 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61bb69fcfd54ef88c37917a48d1cb30" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:40.539129 18028 raft_consensus.cc:3060] T a61bb69fcfd54ef88c37917a48d1cb30 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:40.540459 18333 consensus_queue.cc:1048] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:40.479239 18160 tablet_service.cc:1511] Processing CreateTablet for tablet 2a3e4e4b25f84008b5cd603640f2252f (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:26:40.549695 18337 leader_election.cc:290] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Requested vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:40.579181 18237 tablet_service.cc:1511] Processing CreateTablet for tablet e2114d69fe2c427599f225a7b0686dee (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:26:40.580808 18237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2114d69fe2c427599f225a7b0686dee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.568179 18299 tablet_bootstrap.cc:654] T be25c969559444ae99d240c6f3f60df1 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:40.587333 18141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:45595, user_credentials={real_user=slave}} blocked reactor thread for 122829us
I20260709 12:26:40.579257 18300 ts_tablet_manager.cc:1434] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.002s
I20260709 12:26:40.591831 18015 tablet_service.cc:1511] Processing CreateTablet for tablet e2114d69fe2c427599f225a7b0686dee (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:26:40.592417 18300 tablet_bootstrap.cc:492] T a61bb69fcfd54ef88c37917a48d1cb30 P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:40.597002 18160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a3e4e4b25f84008b5cd603640f2252f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.614840 18167 tablet_service.cc:1511] Processing CreateTablet for tablet 3463ec2e9f294668adae229e2814b1cf (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:26:40.614843 18238 tablet_service.cc:1511] Processing CreateTablet for tablet 3463ec2e9f294668adae229e2814b1cf (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:26:40.618788 18092 tablet_service.cc:1511] Processing CreateTablet for tablet 3463ec2e9f294668adae229e2814b1cf (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:26:40.619428 18238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3463ec2e9f294668adae229e2814b1cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.620146 18092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3463ec2e9f294668adae229e2814b1cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.622452 17927 catalog_manager.cc:5697] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d reported cstate change: term changed from 0 to 1, leader changed from <none> to a08ea42cd3884210924a19c8f570486d (127.9.145.195). New cstate: current_term: 1 leader_uuid: "a08ea42cd3884210924a19c8f570486d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:40.624538 18028 raft_consensus.cc:2468] T a61bb69fcfd54ef88c37917a48d1cb30 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 1.
I20260709 12:26:40.628181 18216 leader_election.cc:304] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: a08ea42cd3884210924a19c8f570486d
I20260709 12:26:40.629477 18335 raft_consensus.cc:2804] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:40.630003 18335 raft_consensus.cc:697] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Becoming Leader. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:26:40.630863 18335 consensus_queue.cc:237] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:40.623117 18337 raft_consensus.cc:493] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.633859 18337 raft_consensus.cc:515] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:40.636088 18337 leader_election.cc:290] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:40.638075 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91269edd7c074ad2bfced23e62cbe5fc" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:40.639794 18167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3463ec2e9f294668adae229e2814b1cf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:40.641506 18218 leader_election.cc:343] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:40.656392 18092 tablet_service.cc:1511] Processing CreateTablet for tablet ed8548d1e22c49f7a5341ec0e2f7b073 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:26:40.658066 18092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed8548d1e22c49f7a5341ec0e2f7b073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.648049 18015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2114d69fe2c427599f225a7b0686dee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.671778 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91269edd7c074ad2bfced23e62cbe5fc" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:40.675683 18159 tablet_service.cc:1511] Processing CreateTablet for tablet ed8548d1e22c49f7a5341ec0e2f7b073 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
W20260709 12:26:40.677114 18216 leader_election.cc:343] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:40.677700 18216 leader_election.cc:304] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c938681fc04e66968531267f39f16c; no voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:40.689702 18337 raft_consensus.cc:2749] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:40.690783 18159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed8548d1e22c49f7a5341ec0e2f7b073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.692003 18236 tablet_service.cc:1511] Processing CreateTablet for tablet 8447aa2b8d4547c0b737643187aa4bd0 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:26:40.694756 18019 tablet_service.cc:1511] Processing CreateTablet for tablet ed8548d1e22c49f7a5341ec0e2f7b073 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:26:40.697119 18019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed8548d1e22c49f7a5341ec0e2f7b073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.706229 18236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8447aa2b8d4547c0b737643187aa4bd0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:40.706933 18068 consensus_peers.cc:597] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:40.711100 18010 tablet_service.cc:1511] Processing CreateTablet for tablet 8447aa2b8d4547c0b737643187aa4bd0 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260709 12:26:40.711910 18216 consensus_peers.cc:597] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:40.712558 18010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8447aa2b8d4547c0b737643187aa4bd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.716354 18333 consensus_queue.cc:1048] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:40.722446 18303 tablet_bootstrap.cc:492] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:40.723069 18303 ts_tablet_manager.cc:1403] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.368s	user 0.023s	sys 0.018s
I20260709 12:26:40.734405 18303 raft_consensus.cc:359] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:40.735193 18303 raft_consensus.cc:385] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:40.735520 18303 raft_consensus.cc:740] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:40.737274 18303 consensus_queue.cc:260] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
W20260709 12:26:40.755719 18365 log.cc:927] Time spent T 5e88e93a00044d1482497fa864163047 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:26:40.757318 17975 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:40.735540 18298 tablet_bootstrap.cc:654] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:40.770860 18344 consensus_queue.cc:1048] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:40.773380 18086 tablet_service.cc:1511] Processing CreateTablet for tablet 8447aa2b8d4547c0b737643187aa4bd0 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:26:40.769102 17927 catalog_manager.cc:5697] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c938681fc04e66968531267f39f16c (127.9.145.196). New cstate: current_term: 1 leader_uuid: "10c938681fc04e66968531267f39f16c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:40.779100 18086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8447aa2b8d4547c0b737643187aa4bd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.782341 18299 tablet_bootstrap.cc:492] T be25c969559444ae99d240c6f3f60df1 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:40.789211 18162 tablet_service.cc:1511] Processing CreateTablet for tablet 8aa7d7ddefbe4ff394a232a4f45e5cd4 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:26:40.795814 18162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aa7d7ddefbe4ff394a232a4f45e5cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.797712 18300 tablet_bootstrap.cc:654] T a61bb69fcfd54ef88c37917a48d1cb30 P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:40.798133 18241 tablet_service.cc:1511] Processing CreateTablet for tablet 8aa7d7ddefbe4ff394a232a4f45e5cd4 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:26:40.799415 18241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aa7d7ddefbe4ff394a232a4f45e5cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.809270 18015 tablet_service.cc:1511] Processing CreateTablet for tablet 8aa7d7ddefbe4ff394a232a4f45e5cd4 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:26:40.810809 18015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aa7d7ddefbe4ff394a232a4f45e5cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.813737 18299 ts_tablet_manager.cc:1403] T be25c969559444ae99d240c6f3f60df1 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.321s	user 0.026s	sys 0.008s
W20260709 12:26:40.823087 18218 consensus_peers.cc:597] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c -> Peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Couldn't send request to peer a08ea42cd3884210924a19c8f570486d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:40.834738 18168 tablet_service.cc:1511] Processing CreateTablet for tablet 0d8b927123c04143a7b87fa8f129a9e7 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:26:40.852900 18299 raft_consensus.cc:359] T be25c969559444ae99d240c6f3f60df1 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:40.853672 18299 raft_consensus.cc:385] T be25c969559444ae99d240c6f3f60df1 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:40.854276 18168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d8b927123c04143a7b87fa8f129a9e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.855069 18303 ts_tablet_manager.cc:1434] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.132s	user 0.009s	sys 0.000s
I20260709 12:26:40.856302 18303 tablet_bootstrap.cc:492] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:40.833160 18234 tablet_service.cc:1511] Processing CreateTablet for tablet 0d8b927123c04143a7b87fa8f129a9e7 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:26:40.873744 18234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d8b927123c04143a7b87fa8f129a9e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.854017 18299 raft_consensus.cc:740] T be25c969559444ae99d240c6f3f60df1 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:40.874197 18016 tablet_service.cc:1511] Processing CreateTablet for tablet 11b3b0ee25aa435586a0fd8c3f186681 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:26:40.877207 18091 tablet_service.cc:1511] Processing CreateTablet for tablet 11b3b0ee25aa435586a0fd8c3f186681 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:26:40.872687 18303 tablet_bootstrap.cc:654] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:40.886747 18016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11b3b0ee25aa435586a0fd8c3f186681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.889892 18091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11b3b0ee25aa435586a0fd8c3f186681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.895908 18300 tablet_bootstrap.cc:492] T a61bb69fcfd54ef88c37917a48d1cb30 P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:40.896538 18300 ts_tablet_manager.cc:1403] T a61bb69fcfd54ef88c37917a48d1cb30 P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.304s	user 0.030s	sys 0.030s
I20260709 12:26:40.899622 18298 tablet_bootstrap.cc:492] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:40.900238 18298 ts_tablet_manager.cc:1403] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.380s	user 0.017s	sys 0.006s
I20260709 12:26:40.903756 18241 tablet_service.cc:1511] Processing CreateTablet for tablet bdc0b28c91d54918b8a914c137f9543f (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:26:40.905076 18241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdc0b28c91d54918b8a914c137f9543f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.907861 18300 raft_consensus.cc:359] T a61bb69fcfd54ef88c37917a48d1cb30 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:40.908735 18300 raft_consensus.cc:385] T a61bb69fcfd54ef88c37917a48d1cb30 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:40.904625 18298 raft_consensus.cc:359] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:40.909044 18300 raft_consensus.cc:740] T a61bb69fcfd54ef88c37917a48d1cb30 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:40.909612 18298 raft_consensus.cc:385] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:40.909987 18300 consensus_queue.cc:260] T a61bb69fcfd54ef88c37917a48d1cb30 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:40.910636 18159 tablet_service.cc:1511] Processing CreateTablet for tablet 11b3b0ee25aa435586a0fd8c3f186681 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:26:40.917256 18159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11b3b0ee25aa435586a0fd8c3f186681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.892373 18092 tablet_service.cc:1511] Processing CreateTablet for tablet 0d8b927123c04143a7b87fa8f129a9e7 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:26:40.914525 18298 raft_consensus.cc:740] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:40.922374 18298 consensus_queue.cc:260] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:40.924784 18298 ts_tablet_manager.cc:1434] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.002s
I20260709 12:26:40.915182 18299 consensus_queue.cc:260] T be25c969559444ae99d240c6f3f60df1 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:40.928784 18300 ts_tablet_manager.cc:1434] T a61bb69fcfd54ef88c37917a48d1cb30 P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.001s
I20260709 12:26:40.935123 18378 raft_consensus.cc:493] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.935791 18378 raft_consensus.cc:515] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:40.936214 18299 ts_tablet_manager.cc:1434] T be25c969559444ae99d240c6f3f60df1 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.086s	user 0.004s	sys 0.006s
I20260709 12:26:40.938876 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10895331ca6e49d4aad97aec0e629dd7" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:40.939841 18092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d8b927123c04143a7b87fa8f129a9e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.938836 18010 tablet_service.cc:1511] Processing CreateTablet for tablet bdc0b28c91d54918b8a914c137f9543f (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:26:40.941823 18010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdc0b28c91d54918b8a914c137f9543f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:40.942209 18067 leader_election.cc:343] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10c938681fc04e66968531267f39f16c (127.9.145.196:37881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:40.942878 18299 tablet_bootstrap.cc:492] T e60fecc50c1d49c2963f342da1b3c2a6 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:40.938925 18300 tablet_bootstrap.cc:492] T e48eb1372ff4402498990d2abd8c6da2 P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:40.956733 18162 tablet_service.cc:1511] Processing CreateTablet for tablet 2c660b0ce2084a1a9fcc17139d4addd5 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:26:40.960013 18162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c660b0ce2084a1a9fcc17139d4addd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.956875 18086 tablet_service.cc:1511] Processing CreateTablet for tablet bdc0b28c91d54918b8a914c137f9543f (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:26:40.963020 18086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdc0b28c91d54918b8a914c137f9543f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:40.957919 18142 consensus_peers.cc:597] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:40.965000 18333 raft_consensus.cc:493] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.965581 18333 raft_consensus.cc:515] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:40.967818 18333 leader_election.cc:290] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:40.969353 18378 leader_election.cc:290] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:40.971562 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1660568f1208485fb6f74d572deee2d9" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:40.972327 18178 raft_consensus.cc:2468] T 1660568f1208485fb6f74d572deee2d9 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 0.
I20260709 12:26:40.974252 18356 consensus_queue.cc:1048] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:40.974464 18218 leader_election.cc:304] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:40.975436 18337 raft_consensus.cc:2804] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:40.975823 18337 raft_consensus.cc:493] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:40.976143 18337 raft_consensus.cc:3060] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:40.980063 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1660568f1208485fb6f74d572deee2d9" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:40.981340 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10895331ca6e49d4aad97aec0e629dd7" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:40.981564 18019 tablet_service.cc:1511] Processing CreateTablet for tablet 2c660b0ce2084a1a9fcc17139d4addd5 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:26:40.982064 18029 raft_consensus.cc:2468] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 0.
I20260709 12:26:40.982738 18019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c660b0ce2084a1a9fcc17139d4addd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.985347 18241 tablet_service.cc:1511] Processing CreateTablet for tablet 2c660b0ce2084a1a9fcc17139d4addd5 (DEFAULT_TABLE table=test-workload [id=2c4cf120b01a4b6184b4ad8592d9460b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:26:40.965057 18300 tablet_bootstrap.cc:654] T e48eb1372ff4402498990d2abd8c6da2 P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:40.986500 18216 leader_election.cc:343] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:40.995213 18068 leader_election.cc:304] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 10c938681fc04e66968531267f39f16c
I20260709 12:26:40.997344 18241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c660b0ce2084a1a9fcc17139d4addd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.997629 18303 tablet_bootstrap.cc:492] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:40.991205 18299 tablet_bootstrap.cc:654] T e60fecc50c1d49c2963f342da1b3c2a6 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:40.998680 18303 ts_tablet_manager.cc:1403] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.143s	user 0.012s	sys 0.005s
I20260709 12:26:40.999908 18298 tablet_bootstrap.cc:492] T 10895331ca6e49d4aad97aec0e629dd7 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:40.998039 18376 raft_consensus.cc:2804] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:41.004731 18376 raft_consensus.cc:493] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.005136 18376 raft_consensus.cc:3060] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.005973 18303 raft_consensus.cc:359] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.006834 18303 raft_consensus.cc:385] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.007141 18303 raft_consensus.cc:740] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.001703 18337 raft_consensus.cc:515] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.008775 18303 consensus_queue.cc:260] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.028033 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1660568f1208485fb6f74d572deee2d9" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:41.028717 18178 raft_consensus.cc:3060] T 1660568f1208485fb6f74d572deee2d9 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.035238 18337 leader_election.cc:290] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Requested vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:41.035916 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1660568f1208485fb6f74d572deee2d9" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:41.037191 18029 raft_consensus.cc:3060] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.043594 18298 tablet_bootstrap.cc:654] T 10895331ca6e49d4aad97aec0e629dd7 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.044576 18356 raft_consensus.cc:493] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.045141 18356 raft_consensus.cc:515] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:41.047350 18356 leader_election.cc:290] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:41.049273 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94eb437be5041e48122e923dc7cc760" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:41.050026 18028 raft_consensus.cc:2468] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 0.
I20260709 12:26:41.051594 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94eb437be5041e48122e923dc7cc760" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:41.052192 18142 leader_election.cc:304] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:41.053328 18303 ts_tablet_manager.cc:1434] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.054s	user 0.003s	sys 0.004s
I20260709 12:26:41.054636 18303 tablet_bootstrap.cc:492] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:41.055423 18356 raft_consensus.cc:2804] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:41.055827 18356 raft_consensus.cc:493] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.056166 18356 raft_consensus.cc:3060] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.049980 18029 raft_consensus.cc:2468] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 1.
W20260709 12:26:41.058534 18141 leader_election.cc:343] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:41.064844 18216 leader_election.cc:304] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:41.065683 18300 tablet_bootstrap.cc:492] T e48eb1372ff4402498990d2abd8c6da2 P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:41.066290 18300 ts_tablet_manager.cc:1403] T e48eb1372ff4402498990d2abd8c6da2 P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.128s	user 0.014s	sys 0.002s
I20260709 12:26:41.069424 18300 raft_consensus.cc:359] T e48eb1372ff4402498990d2abd8c6da2 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:41.072860 18303 tablet_bootstrap.cc:654] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.071985 18337 raft_consensus.cc:2804] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:41.073186 18300 raft_consensus.cc:385] T e48eb1372ff4402498990d2abd8c6da2 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.073576 18300 raft_consensus.cc:740] T e48eb1372ff4402498990d2abd8c6da2 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.073913 18178 raft_consensus.cc:2468] T 1660568f1208485fb6f74d572deee2d9 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 1.
I20260709 12:26:41.075670 18300 consensus_queue.cc:260] T e48eb1372ff4402498990d2abd8c6da2 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:41.078173 18300 ts_tablet_manager.cc:1434] T e48eb1372ff4402498990d2abd8c6da2 P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:26:41.078946 18337 raft_consensus.cc:697] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Becoming Leader. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:26:41.080049 18337 consensus_queue.cc:237] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.080351 18376 raft_consensus.cc:515] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.082957 18300 tablet_bootstrap.cc:492] T be25c969559444ae99d240c6f3f60df1 P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:41.086676 18299 tablet_bootstrap.cc:492] T e60fecc50c1d49c2963f342da1b3c2a6 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:41.087262 18299 ts_tablet_manager.cc:1403] T e60fecc50c1d49c2963f342da1b3c2a6 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.145s	user 0.008s	sys 0.013s
I20260709 12:26:41.090615 18299 raft_consensus.cc:359] T e60fecc50c1d49c2963f342da1b3c2a6 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:41.091444 18299 raft_consensus.cc:385] T e60fecc50c1d49c2963f342da1b3c2a6 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.091828 18299 raft_consensus.cc:740] T e60fecc50c1d49c2963f342da1b3c2a6 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.091459 18300 tablet_bootstrap.cc:654] T be25c969559444ae99d240c6f3f60df1 P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.094419 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10895331ca6e49d4aad97aec0e629dd7" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
W20260709 12:26:41.096300 18067 leader_election.cc:343] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10c938681fc04e66968531267f39f16c (127.9.145.196:37881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:41.096992 18356 raft_consensus.cc:515] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:41.098599 18376 leader_election.cc:290] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Requested vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:41.099996 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10895331ca6e49d4aad97aec0e629dd7" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:41.100633 18029 raft_consensus.cc:3060] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.100721 18299 consensus_queue.cc:260] T e60fecc50c1d49c2963f342da1b3c2a6 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:41.103374 18299 ts_tablet_manager.cc:1434] T e60fecc50c1d49c2963f342da1b3c2a6 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:26:41.103993 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94eb437be5041e48122e923dc7cc760" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:41.104202 18356 leader_election.cc:290] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Requested vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:41.104662 18028 raft_consensus.cc:3060] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.107349 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94eb437be5041e48122e923dc7cc760" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
W20260709 12:26:41.108875 18141 leader_election.cc:343] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:41.109752 18303 tablet_bootstrap.cc:492] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:41.110419 18303 ts_tablet_manager.cc:1403] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.056s	user 0.016s	sys 0.000s
I20260709 12:26:41.111685 18029 raft_consensus.cc:2468] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 1.
I20260709 12:26:41.114192 18303 raft_consensus.cc:359] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.114816 18068 leader_election.cc:304] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 10c938681fc04e66968531267f39f16c
I20260709 12:26:41.115132 18303 raft_consensus.cc:385] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.115628 18303 raft_consensus.cc:740] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.116711 18300 tablet_bootstrap.cc:492] T be25c969559444ae99d240c6f3f60df1 P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:41.116614 18303 consensus_queue.cc:260] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.117249 18300 ts_tablet_manager.cc:1403] T be25c969559444ae99d240c6f3f60df1 P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.003s
I20260709 12:26:41.117393 18298 tablet_bootstrap.cc:492] T 10895331ca6e49d4aad97aec0e629dd7 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:41.117704 18376 raft_consensus.cc:2804] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:41.117913 18298 ts_tablet_manager.cc:1403] T 10895331ca6e49d4aad97aec0e629dd7 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.118s	user 0.018s	sys 0.015s
I20260709 12:26:41.120373 18300 raft_consensus.cc:359] T be25c969559444ae99d240c6f3f60df1 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:41.115799 17926 catalog_manager.cc:5697] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c938681fc04e66968531267f39f16c (127.9.145.196). New cstate: current_term: 1 leader_uuid: "10c938681fc04e66968531267f39f16c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:41.121289 18300 raft_consensus.cc:385] T be25c969559444ae99d240c6f3f60df1 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.121616 18300 raft_consensus.cc:740] T be25c969559444ae99d240c6f3f60df1 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.121712 18028 raft_consensus.cc:2468] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 1.
I20260709 12:26:41.123119 18300 consensus_queue.cc:260] T be25c969559444ae99d240c6f3f60df1 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:41.126309 18303 ts_tablet_manager.cc:1434] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:26:41.127506 18303 tablet_bootstrap.cc:492] T d8b351ffd4864761bb49da4eceac3566 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:41.104344 18299 tablet_bootstrap.cc:492] T c94eb437be5041e48122e923dc7cc760 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:41.123064 18142 leader_election.cc:304] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c
I20260709 12:26:41.131641 18356 raft_consensus.cc:2804] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:41.132210 18356 raft_consensus.cc:697] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Becoming Leader. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Running, Role: LEADER
I20260709 12:26:41.133065 18356 consensus_queue.cc:237] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:41.120627 18298 raft_consensus.cc:359] T 10895331ca6e49d4aad97aec0e629dd7 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.134660 18298 raft_consensus.cc:385] T 10895331ca6e49d4aad97aec0e629dd7 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.135115 18298 raft_consensus.cc:740] T 10895331ca6e49d4aad97aec0e629dd7 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.136238 18298 consensus_queue.cc:260] T 10895331ca6e49d4aad97aec0e629dd7 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.136770 18299 tablet_bootstrap.cc:654] T c94eb437be5041e48122e923dc7cc760 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.135123 18376 raft_consensus.cc:697] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Becoming Leader. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Running, Role: LEADER
I20260709 12:26:41.138332 18376 consensus_queue.cc:237] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.138759 18300 ts_tablet_manager.cc:1434] T be25c969559444ae99d240c6f3f60df1 P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:26:41.140730 18300 tablet_bootstrap.cc:492] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:41.145787 18303 tablet_bootstrap.cc:654] T d8b351ffd4864761bb49da4eceac3566 P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.148509 18317 raft_consensus.cc:493] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.149098 18317 raft_consensus.cc:515] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:41.151382 18317 leader_election.cc:290] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:41.151310 18298 ts_tablet_manager.cc:1434] T 10895331ca6e49d4aad97aec0e629dd7 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.001s
I20260709 12:26:41.152575 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adcc9c41a0d4ffe92d5aa05859d55f5" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:41.153913 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adcc9c41a0d4ffe92d5aa05859d55f5" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:41.156316 18300 tablet_bootstrap.cc:654] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.156105 17992 leader_election.cc:304] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac42e2bcf9ac42448a84370269bc6ccc; no voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c
I20260709 12:26:41.157770 18317 raft_consensus.cc:2749] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:41.161489 18298 tablet_bootstrap.cc:492] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:41.164417 18303 tablet_bootstrap.cc:492] T d8b351ffd4864761bb49da4eceac3566 P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:41.166273 18303 ts_tablet_manager.cc:1403] T d8b351ffd4864761bb49da4eceac3566 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.000s
I20260709 12:26:41.170266 17926 catalog_manager.cc:5697] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d reported cstate change: term changed from 0 to 1, leader changed from <none> to a08ea42cd3884210924a19c8f570486d (127.9.145.195). New cstate: current_term: 1 leader_uuid: "a08ea42cd3884210924a19c8f570486d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:41.172931 17927 catalog_manager.cc:5697] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194). New cstate: current_term: 1 leader_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:41.176031 18298 tablet_bootstrap.cc:654] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.176445 18303 raft_consensus.cc:359] T d8b351ffd4864761bb49da4eceac3566 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:41.177167 18303 raft_consensus.cc:385] T d8b351ffd4864761bb49da4eceac3566 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.177443 18303 raft_consensus.cc:740] T d8b351ffd4864761bb49da4eceac3566 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.177583 18337 consensus_queue.cc:1048] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:41.180932 18300 tablet_bootstrap.cc:492] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:41.181401 18300 ts_tablet_manager.cc:1403] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.004s
I20260709 12:26:41.181607 18303 consensus_queue.cc:260] T d8b351ffd4864761bb49da4eceac3566 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:41.184195 18300 raft_consensus.cc:359] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:41.184932 18300 raft_consensus.cc:385] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.185185 18300 raft_consensus.cc:740] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.185437 18303 ts_tablet_manager.cc:1434] T d8b351ffd4864761bb49da4eceac3566 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:26:41.186024 18300 consensus_queue.cc:260] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:41.188125 18303 tablet_bootstrap.cc:492] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:41.189208 18029 raft_consensus.cc:3060] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.193219 18299 tablet_bootstrap.cc:492] T c94eb437be5041e48122e923dc7cc760 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:41.193879 18299 ts_tablet_manager.cc:1403] T c94eb437be5041e48122e923dc7cc760 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.090s	user 0.008s	sys 0.018s
I20260709 12:26:41.188303 18300 ts_tablet_manager.cc:1434] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:41.197073 18299 raft_consensus.cc:359] T c94eb437be5041e48122e923dc7cc760 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:41.197515 18300 tablet_bootstrap.cc:492] T a019c53d9a9946c59ed8a1b201786adc P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:41.203533 18299 raft_consensus.cc:385] T c94eb437be5041e48122e923dc7cc760 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.203933 18299 raft_consensus.cc:740] T c94eb437be5041e48122e923dc7cc760 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.204633 18303 tablet_bootstrap.cc:654] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.208256 18299 consensus_queue.cc:260] T c94eb437be5041e48122e923dc7cc760 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:41.210830 18300 tablet_bootstrap.cc:654] T a019c53d9a9946c59ed8a1b201786adc P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.212411 18178 raft_consensus.cc:3060] T a61bb69fcfd54ef88c37917a48d1cb30 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.215075 18298 tablet_bootstrap.cc:492] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:41.215668 18298 ts_tablet_manager.cc:1403] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.004s
I20260709 12:26:41.218786 18298 raft_consensus.cc:359] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:41.219497 18299 ts_tablet_manager.cc:1434] T c94eb437be5041e48122e923dc7cc760 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.002s
I20260709 12:26:41.220695 18299 tablet_bootstrap.cc:492] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:41.222890 18376 raft_consensus.cc:493] T be25c969559444ae99d240c6f3f60df1 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.223464 18376 raft_consensus.cc:515] T be25c969559444ae99d240c6f3f60df1 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:41.225746 18376 leader_election.cc:290] T be25c969559444ae99d240c6f3f60df1 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:41.227238 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be25c969559444ae99d240c6f3f60df1" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:41.225126 18300 tablet_bootstrap.cc:492] T a019c53d9a9946c59ed8a1b201786adc P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:41.228483 18300 ts_tablet_manager.cc:1403] T a019c53d9a9946c59ed8a1b201786adc P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.000s
I20260709 12:26:41.231926 18303 tablet_bootstrap.cc:492] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:41.232614 18303 ts_tablet_manager.cc:1403] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.000s
I20260709 12:26:41.233553 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be25c969559444ae99d240c6f3f60df1" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:41.234334 18177 raft_consensus.cc:2468] T be25c969559444ae99d240c6f3f60df1 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 0.
I20260709 12:26:41.234948 18300 raft_consensus.cc:359] T a019c53d9a9946c59ed8a1b201786adc P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.235535 18303 raft_consensus.cc:359] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:41.236325 18303 raft_consensus.cc:385] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.236618 18303 raft_consensus.cc:740] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.237680 18300 raft_consensus.cc:385] T a019c53d9a9946c59ed8a1b201786adc P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.237418 18303 consensus_queue.cc:260] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:41.238000 18300 raft_consensus.cc:740] T a019c53d9a9946c59ed8a1b201786adc P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
W20260709 12:26:41.238778 18067 leader_election.cc:343] T be25c969559444ae99d240c6f3f60df1 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10c938681fc04e66968531267f39f16c (127.9.145.196:37881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:41.239826 18299 tablet_bootstrap.cc:654] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.240062 18300 consensus_queue.cc:260] T a019c53d9a9946c59ed8a1b201786adc P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.240415 18070 leader_election.cc:304] T be25c969559444ae99d240c6f3f60df1 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 10c938681fc04e66968531267f39f16c
I20260709 12:26:41.243366 18376 raft_consensus.cc:2804] T be25c969559444ae99d240c6f3f60df1 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:41.243757 18376 raft_consensus.cc:493] T be25c969559444ae99d240c6f3f60df1 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.244113 18376 raft_consensus.cc:3060] T be25c969559444ae99d240c6f3f60df1 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.219542 18298 raft_consensus.cc:385] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.259483 18298 raft_consensus.cc:740] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.260272 18298 consensus_queue.cc:260] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:41.249986 18337 consensus_queue.cc:1048] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:26:41.256783 18364 raft_consensus.cc:493] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.253446 18376 raft_consensus.cc:515] T be25c969559444ae99d240c6f3f60df1 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:41.263689 18364 raft_consensus.cc:515] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.265219 18376 leader_election.cc:290] T be25c969559444ae99d240c6f3f60df1 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Requested vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:41.249348 18300 ts_tablet_manager.cc:1434] T a019c53d9a9946c59ed8a1b201786adc P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:26:41.267001 18300 tablet_bootstrap.cc:492] T 91269edd7c074ad2bfced23e62cbe5fc P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:41.271355 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be25c969559444ae99d240c6f3f60df1" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:41.273146 18300 tablet_bootstrap.cc:654] T 91269edd7c074ad2bfced23e62cbe5fc P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.275528 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91269edd7c074ad2bfced23e62cbe5fc" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:41.276424 18252 raft_consensus.cc:2468] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 0.
I20260709 12:26:41.277421 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91269edd7c074ad2bfced23e62cbe5fc" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:41.276414 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be25c969559444ae99d240c6f3f60df1" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
W20260709 12:26:41.275436 18067 leader_election.cc:343] T be25c969559444ae99d240c6f3f60df1 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10c938681fc04e66968531267f39f16c (127.9.145.196:37881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:41.279248 17992 leader_election.cc:304] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:41.280645 18298 ts_tablet_manager.cc:1434] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.000s
W20260709 12:26:41.281020 17995 leader_election.cc:343] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:41.281461 18177 raft_consensus.cc:3060] T be25c969559444ae99d240c6f3f60df1 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.281736 18298 tablet_bootstrap.cc:492] T 2d9471cf607248b0b7f9090046f63df4 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:41.280422 18317 raft_consensus.cc:2804] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:41.286558 18317 raft_consensus.cc:493] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.286988 18317 raft_consensus.cc:3060] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.288892 18298 tablet_bootstrap.cc:654] T 2d9471cf607248b0b7f9090046f63df4 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.266083 18364 leader_election.cc:290] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:41.254647 18303 ts_tablet_manager.cc:1434] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 12:26:41.303633 18303 tablet_bootstrap.cc:492] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:41.297663 18317 raft_consensus.cc:515] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.322378 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91269edd7c074ad2bfced23e62cbe5fc" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:41.323171 18252 raft_consensus.cc:3060] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.332346 18252 raft_consensus.cc:2468] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 1.
I20260709 12:26:41.334020 17992 leader_election.cc:304] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:41.335175 18364 raft_consensus.cc:2804] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:41.338701 18177 raft_consensus.cc:2468] T be25c969559444ae99d240c6f3f60df1 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 1.
I20260709 12:26:41.343142 18070 leader_election.cc:304] T be25c969559444ae99d240c6f3f60df1 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 10c938681fc04e66968531267f39f16c
I20260709 12:26:41.344111 18376 raft_consensus.cc:2804] T be25c969559444ae99d240c6f3f60df1 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:41.344681 18376 raft_consensus.cc:697] T be25c969559444ae99d240c6f3f60df1 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Becoming Leader. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Running, Role: LEADER
I20260709 12:26:41.345592 18364 raft_consensus.cc:697] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc [term 1 LEADER]: Becoming Leader. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Running, Role: LEADER
I20260709 12:26:41.345597 18376 consensus_queue.cc:237] T be25c969559444ae99d240c6f3f60df1 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:41.346561 18299 tablet_bootstrap.cc:492] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:41.347114 18299 ts_tablet_manager.cc:1403] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.127s	user 0.033s	sys 0.053s
I20260709 12:26:41.349164 18317 leader_election.cc:290] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Requested vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:41.352629 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91269edd7c074ad2bfced23e62cbe5fc" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:41.352989 18300 tablet_bootstrap.cc:492] T 91269edd7c074ad2bfced23e62cbe5fc P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:41.353513 18300 ts_tablet_manager.cc:1403] T 91269edd7c074ad2bfced23e62cbe5fc P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.087s	user 0.015s	sys 0.006s
I20260709 12:26:41.355846 18337 raft_consensus.cc:493] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.356498 18337 raft_consensus.cc:515] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:41.358310 18300 raft_consensus.cc:359] T 91269edd7c074ad2bfced23e62cbe5fc P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.358835 18337 leader_election.cc:290] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:41.359093 18300 raft_consensus.cc:385] T 91269edd7c074ad2bfced23e62cbe5fc P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.359413 18300 raft_consensus.cc:740] T 91269edd7c074ad2bfced23e62cbe5fc P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.362970 18299 raft_consensus.cc:359] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:41.363238 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5995ee175fed4e3e893b8efe2a7eb7d0" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:41.363780 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5995ee175fed4e3e893b8efe2a7eb7d0" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:41.360123 18300 consensus_queue.cc:260] T 91269edd7c074ad2bfced23e62cbe5fc P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
W20260709 12:26:41.355734 17995 leader_election.cc:343] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:41.364883 18215 leader_election.cc:343] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:41.365592 18216 leader_election.cc:343] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:41.366068 18216 leader_election.cc:304] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c938681fc04e66968531267f39f16c; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:41.363790 18299 raft_consensus.cc:385] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.366894 18299 raft_consensus.cc:740] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.366953 18335 raft_consensus.cc:2749] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:41.366328 18300 ts_tablet_manager.cc:1434] T 91269edd7c074ad2bfced23e62cbe5fc P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.004s
I20260709 12:26:41.367702 18299 consensus_queue.cc:260] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:41.368451 18298 tablet_bootstrap.cc:492] T 2d9471cf607248b0b7f9090046f63df4 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:41.347091 18364 consensus_queue.cc:237] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.368969 18298 ts_tablet_manager.cc:1403] T 2d9471cf607248b0b7f9090046f63df4 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.087s	user 0.026s	sys 0.030s
I20260709 12:26:41.369899 18299 ts_tablet_manager.cc:1434] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.000s
I20260709 12:26:41.371110 18300 tablet_bootstrap.cc:492] T 2d9471cf607248b0b7f9090046f63df4 P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:41.371970 18298 raft_consensus.cc:359] T 2d9471cf607248b0b7f9090046f63df4 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:41.372552 18376 raft_consensus.cc:493] T c94eb437be5041e48122e923dc7cc760 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.372692 18298 raft_consensus.cc:385] T 2d9471cf607248b0b7f9090046f63df4 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.373306 18298 raft_consensus.cc:740] T 2d9471cf607248b0b7f9090046f63df4 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.373373 18376 raft_consensus.cc:515] T c94eb437be5041e48122e923dc7cc760 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:41.374604 18299 tablet_bootstrap.cc:492] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:41.374279 18298 consensus_queue.cc:260] T 2d9471cf607248b0b7f9090046f63df4 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:41.376552 18298 ts_tablet_manager.cc:1434] T 2d9471cf607248b0b7f9090046f63df4 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:41.377313 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94eb437be5041e48122e923dc7cc760" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:41.377671 18298 tablet_bootstrap.cc:492] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:41.378328 18027 raft_consensus.cc:2393] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in current term 1: Already voted for candidate a08ea42cd3884210924a19c8f570486d in this term.
I20260709 12:26:41.380512 18376 leader_election.cc:290] T c94eb437be5041e48122e923dc7cc760 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:41.380636 18303 tablet_bootstrap.cc:654] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.377223 18356 raft_consensus.cc:493] T a019c53d9a9946c59ed8a1b201786adc P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.381857 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94eb437be5041e48122e923dc7cc760" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:41.387576 18299 tablet_bootstrap.cc:654] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.387423 18356 raft_consensus.cc:515] T a019c53d9a9946c59ed8a1b201786adc P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.388706 18070 leader_election.cc:304] T c94eb437be5041e48122e923dc7cc760 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:41.389747 18377 raft_consensus.cc:3060] T c94eb437be5041e48122e923dc7cc760 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.390853 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019c53d9a9946c59ed8a1b201786adc" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:41.385200 18300 tablet_bootstrap.cc:654] T 2d9471cf607248b0b7f9090046f63df4 P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.385008 17927 catalog_manager.cc:5697] T be25c969559444ae99d240c6f3f60df1 P 3a269a9c95e0476d9e09c25b4b5aaa2c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194). New cstate: current_term: 1 leader_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:41.386539 18298 tablet_bootstrap.cc:654] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:41.392683 18141 leader_election.cc:343] T a019c53d9a9946c59ed8a1b201786adc P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10c938681fc04e66968531267f39f16c (127.9.145.196:37881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:41.404896 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019c53d9a9946c59ed8a1b201786adc" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
W20260709 12:26:41.406587 18142 leader_election.cc:343] T a019c53d9a9946c59ed8a1b201786adc P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:41.407095 18142 leader_election.cc:304] T a019c53d9a9946c59ed8a1b201786adc P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a08ea42cd3884210924a19c8f570486d; no voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:41.407961 18358 raft_consensus.cc:2749] T a019c53d9a9946c59ed8a1b201786adc P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:41.408896 18356 leader_election.cc:290] T a019c53d9a9946c59ed8a1b201786adc P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:41.410648 18377 raft_consensus.cc:2749] T c94eb437be5041e48122e923dc7cc760 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:41.420325 18298 tablet_bootstrap.cc:492] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:41.420977 18298 ts_tablet_manager.cc:1403] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.001s
I20260709 12:26:41.423828 18298 raft_consensus.cc:359] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.424269 18317 raft_consensus.cc:493] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.424567 18298 raft_consensus.cc:385] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.425005 18298 raft_consensus.cc:740] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.425880 18298 consensus_queue.cc:260] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.428973 18027 raft_consensus.cc:3060] T d8b351ffd4864761bb49da4eceac3566 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.434628 18298 ts_tablet_manager.cc:1434] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:26:41.435809 18298 tablet_bootstrap.cc:492] T be25c969559444ae99d240c6f3f60df1 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:41.441828 18178 raft_consensus.cc:3060] T e48eb1372ff4402498990d2abd8c6da2 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.443454 18303 tablet_bootstrap.cc:492] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:41.444097 18303 ts_tablet_manager.cc:1403] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.141s	user 0.010s	sys 0.003s
I20260709 12:26:41.446206 18317 raft_consensus.cc:515] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:41.453620 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e735bb4b506c457f8dddf767573d025f" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:41.454284 18317 leader_election.cc:290] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
W20260709 12:26:41.455291 17992 leader_election.cc:343] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:41.455555 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e735bb4b506c457f8dddf767573d025f" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
W20260709 12:26:41.457007 17995 leader_election.cc:343] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:41.451982 18303 raft_consensus.cc:359] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:41.457609 18303 raft_consensus.cc:385] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.457963 18303 raft_consensus.cc:740] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.458364 17995 leader_election.cc:304] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac42e2bcf9ac42448a84370269bc6ccc; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d
I20260709 12:26:41.459345 18317 raft_consensus.cc:2749] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:41.458930 18303 consensus_queue.cc:260] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:41.462384 18303 ts_tablet_manager.cc:1434] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:26:41.463442 18303 tablet_bootstrap.cc:492] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:41.463666 18300 tablet_bootstrap.cc:492] T 2d9471cf607248b0b7f9090046f63df4 P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:41.464249 18300 ts_tablet_manager.cc:1403] T 2d9471cf607248b0b7f9090046f63df4 P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.093s	user 0.016s	sys 0.025s
I20260709 12:26:41.467388 18300 raft_consensus.cc:359] T 2d9471cf607248b0b7f9090046f63df4 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:41.468541 18300 raft_consensus.cc:385] T 2d9471cf607248b0b7f9090046f63df4 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.468957 18300 raft_consensus.cc:740] T 2d9471cf607248b0b7f9090046f63df4 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.469920 18300 consensus_queue.cc:260] T 2d9471cf607248b0b7f9090046f63df4 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:41.472721 18298 tablet_bootstrap.cc:654] T be25c969559444ae99d240c6f3f60df1 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.473079 18300 ts_tablet_manager.cc:1434] T 2d9471cf607248b0b7f9090046f63df4 P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.001s
I20260709 12:26:41.473592 18299 tablet_bootstrap.cc:492] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:41.474135 18299 ts_tablet_manager.cc:1403] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.100s	user 0.041s	sys 0.026s
I20260709 12:26:41.474615 18300 tablet_bootstrap.cc:492] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:41.475934 18335 consensus_queue.cc:1048] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:41.477044 18299 raft_consensus.cc:359] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:41.479959 18299 raft_consensus.cc:385] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.480290 18299 raft_consensus.cc:740] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.481173 18299 consensus_queue.cc:260] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:41.483395 18299 ts_tablet_manager.cc:1434] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:26:41.477666 18303 tablet_bootstrap.cc:654] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.487552 18299 tablet_bootstrap.cc:492] T 2d9471cf607248b0b7f9090046f63df4 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:41.491611 18300 tablet_bootstrap.cc:654] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.493607 18299 tablet_bootstrap.cc:654] T 2d9471cf607248b0b7f9090046f63df4 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.497915 18303 tablet_bootstrap.cc:492] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:41.498657 18303 ts_tablet_manager.cc:1403] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.000s
I20260709 12:26:41.503773 18303 raft_consensus.cc:359] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:41.504854 18303 raft_consensus.cc:385] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.505252 18303 raft_consensus.cc:740] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.478674 17927 catalog_manager.cc:5697] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc reported cstate change: term changed from 0 to 1, leader changed from <none> to ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193). New cstate: current_term: 1 leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:41.506331 18303 consensus_queue.cc:260] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:41.509193 18303 ts_tablet_manager.cc:1434] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:26:41.512792 18303 tablet_bootstrap.cc:492] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:41.534780 18303 tablet_bootstrap.cc:654] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.537962 18335 raft_consensus.cc:493] T 10895331ca6e49d4aad97aec0e629dd7 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.539289 18335 raft_consensus.cc:515] T 10895331ca6e49d4aad97aec0e629dd7 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.543229 18335 leader_election.cc:290] T 10895331ca6e49d4aad97aec0e629dd7 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:41.547994 18298 tablet_bootstrap.cc:492] T be25c969559444ae99d240c6f3f60df1 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:41.548687 18298 ts_tablet_manager.cc:1403] T be25c969559444ae99d240c6f3f60df1 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.113s	user 0.018s	sys 0.021s
I20260709 12:26:41.548836 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10895331ca6e49d4aad97aec0e629dd7" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:41.549726 18027 raft_consensus.cc:2393] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c938681fc04e66968531267f39f16c in current term 1: Already voted for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in this term.
I20260709 12:26:41.551623 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10895331ca6e49d4aad97aec0e629dd7" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:41.554203 18356 raft_consensus.cc:493] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.554795 18356 raft_consensus.cc:515] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:41.556166 18216 leader_election.cc:304] T 10895331ca6e49d4aad97aec0e629dd7 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c938681fc04e66968531267f39f16c; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:41.556526 18252 raft_consensus.cc:3060] T 10895331ca6e49d4aad97aec0e629dd7 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.556978 18356 leader_election.cc:290] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:41.557649 18178 raft_consensus.cc:3060] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.560384 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0fb4e45e6e54dbf8b96315fab6e5cb8" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:41.563439 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0fb4e45e6e54dbf8b96315fab6e5cb8" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:41.565546 18142 leader_election.cc:304] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a08ea42cd3884210924a19c8f570486d; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:41.552165 18298 raft_consensus.cc:359] T be25c969559444ae99d240c6f3f60df1 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:41.574579 18298 raft_consensus.cc:385] T be25c969559444ae99d240c6f3f60df1 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.574992 18298 raft_consensus.cc:740] T be25c969559444ae99d240c6f3f60df1 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.575541 18335 consensus_queue.cc:1048] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:41.575850 18377 raft_consensus.cc:493] T e60fecc50c1d49c2963f342da1b3c2a6 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.575846 18298 consensus_queue.cc:260] T be25c969559444ae99d240c6f3f60df1 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:41.580641 18377 raft_consensus.cc:515] T e60fecc50c1d49c2963f342da1b3c2a6 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:41.586495 18300 tablet_bootstrap.cc:492] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:41.587133 18300 ts_tablet_manager.cc:1403] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.113s	user 0.018s	sys 0.014s
I20260709 12:26:41.587862 18377 leader_election.cc:290] T e60fecc50c1d49c2963f342da1b3c2a6 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:41.591135 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60fecc50c1d49c2963f342da1b3c2a6" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:41.591670 18299 tablet_bootstrap.cc:492] T 2d9471cf607248b0b7f9090046f63df4 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:41.592837 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60fecc50c1d49c2963f342da1b3c2a6" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:41.594163 18102 raft_consensus.cc:3060] T e60fecc50c1d49c2963f342da1b3c2a6 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.596974 18337 raft_consensus.cc:2749] T 10895331ca6e49d4aad97aec0e629dd7 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:41.597518 18298 ts_tablet_manager.cc:1434] T be25c969559444ae99d240c6f3f60df1 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.002s
I20260709 12:26:41.594602 18067 leader_election.cc:304] T e60fecc50c1d49c2963f342da1b3c2a6 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d
I20260709 12:26:41.599777 18303 tablet_bootstrap.cc:492] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:41.592234 18299 ts_tablet_manager.cc:1403] T 2d9471cf607248b0b7f9090046f63df4 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.105s	user 0.035s	sys 0.020s
I20260709 12:26:41.593830 18300 raft_consensus.cc:359] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.600901 18300 raft_consensus.cc:385] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.601200 18300 raft_consensus.cc:740] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.603394 18299 raft_consensus.cc:359] T 2d9471cf607248b0b7f9090046f63df4 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:41.604189 18299 raft_consensus.cc:385] T 2d9471cf607248b0b7f9090046f63df4 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.604465 18299 raft_consensus.cc:740] T 2d9471cf607248b0b7f9090046f63df4 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.605141 18299 consensus_queue.cc:260] T 2d9471cf607248b0b7f9090046f63df4 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:41.600363 18303 ts_tablet_manager.cc:1403] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.089s	user 0.027s	sys 0.016s
I20260709 12:26:41.606561 18298 tablet_bootstrap.cc:492] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:41.607721 18299 ts_tablet_manager.cc:1434] T 2d9471cf607248b0b7f9090046f63df4 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:26:41.607344 18300 consensus_queue.cc:260] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.604933 18356 consensus_queue.cc:1048] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:26:41.620661 18376 consensus_queue.cc:1048] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:41.624704 18299 tablet_bootstrap.cc:492] T e735bb4b506c457f8dddf767573d025f P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:41.627743 18303 raft_consensus.cc:359] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:41.628531 18303 raft_consensus.cc:385] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.628810 18303 raft_consensus.cc:740] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.630820 18303 consensus_queue.cc:260] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:41.638688 18303 ts_tablet_manager.cc:1434] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 12:26:41.640007 18303 tablet_bootstrap.cc:492] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:41.640693 18420 consensus_queue.cc:1048] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:41.643370 18300 ts_tablet_manager.cc:1434] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.056s	user 0.013s	sys 0.007s
I20260709 12:26:41.644675 18300 tablet_bootstrap.cc:492] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:41.654241 18358 raft_consensus.cc:2749] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:41.656838 18424 consensus_queue.cc:1048] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:41.659466 18299 tablet_bootstrap.cc:654] T e735bb4b506c457f8dddf767573d025f P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.661837 18298 tablet_bootstrap.cc:654] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.675004 18303 tablet_bootstrap.cc:654] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.678571 18421 raft_consensus.cc:493] T 2d9471cf607248b0b7f9090046f63df4 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.679190 18421 raft_consensus.cc:515] T 2d9471cf607248b0b7f9090046f63df4 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:41.682543 18421 leader_election.cc:290] T 2d9471cf607248b0b7f9090046f63df4 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:41.685174 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9471cf607248b0b7f9090046f63df4" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:41.686038 18178 raft_consensus.cc:2468] T 2d9471cf607248b0b7f9090046f63df4 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 0.
I20260709 12:26:41.688297 18218 leader_election.cc:304] T 2d9471cf607248b0b7f9090046f63df4 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:41.690387 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9471cf607248b0b7f9090046f63df4" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:41.691143 18104 raft_consensus.cc:2468] T 2d9471cf607248b0b7f9090046f63df4 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 0.
I20260709 12:26:41.692324 18333 raft_consensus.cc:2804] T 2d9471cf607248b0b7f9090046f63df4 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:41.692783 18333 raft_consensus.cc:493] T 2d9471cf607248b0b7f9090046f63df4 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.694330 18377 raft_consensus.cc:2749] T e60fecc50c1d49c2963f342da1b3c2a6 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:41.699424 18333 raft_consensus.cc:3060] T 2d9471cf607248b0b7f9090046f63df4 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.713779 18300 tablet_bootstrap.cc:654] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.758020 18252 raft_consensus.cc:3060] T be25c969559444ae99d240c6f3f60df1 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.758155 18333 raft_consensus.cc:515] T 2d9471cf607248b0b7f9090046f63df4 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:41.761471 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9471cf607248b0b7f9090046f63df4" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:41.762185 18102 raft_consensus.cc:3060] T 2d9471cf607248b0b7f9090046f63df4 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.771317 18303 tablet_bootstrap.cc:492] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:41.771800 18303 ts_tablet_manager.cc:1403] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.132s	user 0.008s	sys 0.009s
I20260709 12:26:41.774273 18333 leader_election.cc:290] T 2d9471cf607248b0b7f9090046f63df4 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Requested vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:41.775511 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9471cf607248b0b7f9090046f63df4" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:41.776299 18178 raft_consensus.cc:3060] T 2d9471cf607248b0b7f9090046f63df4 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.773448 18377 raft_consensus.cc:493] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.779577 18377 raft_consensus.cc:515] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:41.783649 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "629843ee608f4aff9e667570f73f9d6f" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:41.784153 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "629843ee608f4aff9e667570f73f9d6f" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:41.784399 18177 raft_consensus.cc:2468] T 629843ee608f4aff9e667570f73f9d6f P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 0.
I20260709 12:26:41.784865 18028 raft_consensus.cc:2468] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 0.
W20260709 12:26:41.785971 17975 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:41.785959 18070 leader_election.cc:304] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:41.786968 18376 raft_consensus.cc:2804] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:41.787241 18376 raft_consensus.cc:493] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.787271 18028 raft_consensus.cc:3060] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.787482 18376 raft_consensus.cc:3060] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.781872 18377 leader_election.cc:290] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:41.791421 18298 tablet_bootstrap.cc:492] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:41.791975 18298 ts_tablet_manager.cc:1403] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.188s	user 0.030s	sys 0.034s
I20260709 12:26:41.791704 18377 consensus_queue.cc:1048] T be25c969559444ae99d240c6f3f60df1 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:41.794994 18298 raft_consensus.cc:359] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.795710 18298 raft_consensus.cc:385] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.795990 18298 raft_consensus.cc:740] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.798242 18298 consensus_queue.cc:260] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.800328 18300 tablet_bootstrap.cc:492] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:41.800941 18300 ts_tablet_manager.cc:1403] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.157s	user 0.017s	sys 0.007s
I20260709 12:26:41.801440 18376 raft_consensus.cc:515] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:41.803867 18300 raft_consensus.cc:359] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:41.801802 18102 raft_consensus.cc:2468] T 2d9471cf607248b0b7f9090046f63df4 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 1.
I20260709 12:26:41.805830 18215 leader_election.cc:304] T 2d9471cf607248b0b7f9090046f63df4 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 
I20260709 12:26:41.806727 18423 raft_consensus.cc:493] T 91269edd7c074ad2bfced23e62cbe5fc P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.807185 18333 raft_consensus.cc:2804] T 2d9471cf607248b0b7f9090046f63df4 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:41.807250 18423 raft_consensus.cc:515] T 91269edd7c074ad2bfced23e62cbe5fc P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.807936 18299 tablet_bootstrap.cc:492] T e735bb4b506c457f8dddf767573d025f P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:41.808244 18333 raft_consensus.cc:697] T 2d9471cf607248b0b7f9090046f63df4 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Becoming Leader. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:26:41.808494 18299 ts_tablet_manager.cc:1403] T e735bb4b506c457f8dddf767573d025f P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.184s	user 0.016s	sys 0.028s
I20260709 12:26:41.809899 18423 leader_election.cc:290] T 91269edd7c074ad2bfced23e62cbe5fc P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:41.811440 18299 raft_consensus.cc:359] T e735bb4b506c457f8dddf767573d025f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:41.812208 18299 raft_consensus.cc:385] T e735bb4b506c457f8dddf767573d025f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.812573 18299 raft_consensus.cc:740] T e735bb4b506c457f8dddf767573d025f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.811636 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91269edd7c074ad2bfced23e62cbe5fc" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:41.813272 18298 ts_tablet_manager.cc:1434] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:26:41.813442 18251 raft_consensus.cc:2393] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a08ea42cd3884210924a19c8f570486d in current term 1: Already voted for candidate ac42e2bcf9ac42448a84370269bc6ccc in this term.
I20260709 12:26:41.813630 18299 consensus_queue.cc:260] T e735bb4b506c457f8dddf767573d025f P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:41.814532 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91269edd7c074ad2bfced23e62cbe5fc" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:41.809291 18333 consensus_queue.cc:237] T 2d9471cf607248b0b7f9090046f63df4 P 10c938681fc04e66968531267f39f16c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:41.815897 18299 ts_tablet_manager.cc:1434] T e735bb4b506c457f8dddf767573d025f P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:41.812137 18303 raft_consensus.cc:359] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:41.816886 18299 tablet_bootstrap.cc:492] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:41.817025 18303 raft_consensus.cc:385] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.817387 18303 raft_consensus.cc:740] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.817421 18142 leader_election.cc:304] T 91269edd7c074ad2bfced23e62cbe5fc P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a08ea42cd3884210924a19c8f570486d; no voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:41.818375 18303 consensus_queue.cc:260] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:41.818761 18423 raft_consensus.cc:3060] T 91269edd7c074ad2bfced23e62cbe5fc P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.804606 18300 raft_consensus.cc:385] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.825037 18300 raft_consensus.cc:740] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.827359 18423 raft_consensus.cc:2749] T 91269edd7c074ad2bfced23e62cbe5fc P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:41.830237 18298 tablet_bootstrap.cc:492] T a379e8a15db944b4a33a0c99f05dc6db P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:41.831359 18299 tablet_bootstrap.cc:654] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.803032 18178 raft_consensus.cc:2468] T 2d9471cf607248b0b7f9090046f63df4 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 1.
I20260709 12:26:41.834175 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "629843ee608f4aff9e667570f73f9d6f" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:41.834717 18303 ts_tablet_manager.cc:1434] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.063s	user 0.003s	sys 0.005s
I20260709 12:26:41.834887 18027 raft_consensus.cc:3060] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.825829 18300 consensus_queue.cc:260] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:41.837209 18300 ts_tablet_manager.cc:1434] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:26:41.838686 18303 tablet_bootstrap.cc:492] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:41.838858 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "629843ee608f4aff9e667570f73f9d6f" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:41.840296 18317 consensus_queue.cc:1048] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:41.845683 18300 tablet_bootstrap.cc:492] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:41.856781 18303 tablet_bootstrap.cc:654] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.844944 18376 leader_election.cc:290] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Requested vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:41.863248 18423 raft_consensus.cc:493] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.863642 18419 raft_consensus.cc:493] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.851569 18178 raft_consensus.cc:3060] T 629843ee608f4aff9e667570f73f9d6f P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.864765 18419 raft_consensus.cc:515] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.863907 18423 raft_consensus.cc:515] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.872298 18376 raft_consensus.cc:493] T e735bb4b506c457f8dddf767573d025f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.873046 18300 tablet_bootstrap.cc:654] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.872884 18376 raft_consensus.cc:515] T e735bb4b506c457f8dddf767573d025f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:41.864303 18027 raft_consensus.cc:2468] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 1.
I20260709 12:26:41.876812 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4d4ed1ab54477ca58913fad1bc93b1" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:41.877128 18068 leader_election.cc:304] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:41.878058 18377 raft_consensus.cc:2804] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:41.878568 18424 raft_consensus.cc:493] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.879136 18424 raft_consensus.cc:515] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:41.880887 18419 leader_election.cc:290] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:41.881464 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e735bb4b506c457f8dddf767573d025f" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:41.882329 18176 raft_consensus.cc:2468] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 0.
I20260709 12:26:41.878592 18377 raft_consensus.cc:697] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Becoming Leader. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Running, Role: LEADER
I20260709 12:26:41.883538 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e735bb4b506c457f8dddf767573d025f" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:41.883821 18377 consensus_queue.cc:237] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:41.884280 18103 raft_consensus.cc:2468] T e735bb4b506c457f8dddf767573d025f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 0.
I20260709 12:26:41.875679 18423 leader_election.cc:290] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
W20260709 12:26:41.886754 18142 leader_election.cc:343] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:41.879017 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4d4ed1ab54477ca58913fad1bc93b1" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:41.888163 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e735bb4b506c457f8dddf767573d025f" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:41.888885 18029 raft_consensus.cc:2468] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 0.
I20260709 12:26:41.887629 18070 leader_election.cc:304] T e735bb4b506c457f8dddf767573d025f P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:41.889593 18141 leader_election.cc:304] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:41.888495 18251 raft_consensus.cc:2468] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 0.
I20260709 12:26:41.889122 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4d4ed1ab54477ca58913fad1bc93b1" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:41.881537 18424 leader_election.cc:290] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:41.890262 18420 raft_consensus.cc:2804] T e735bb4b506c457f8dddf767573d025f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:41.892495 18420 raft_consensus.cc:493] T e735bb4b506c457f8dddf767573d025f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.892830 18420 raft_consensus.cc:3060] T e735bb4b506c457f8dddf767573d025f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.891741 18423 raft_consensus.cc:2804] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:41.894610 18423 raft_consensus.cc:493] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.895011 18423 raft_consensus.cc:3060] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.891806 18141 leader_election.cc:304] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d; no voters: ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:41.897032 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4d4ed1ab54477ca58913fad1bc93b1" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:41.897837 18176 raft_consensus.cc:2468] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 0.
W20260709 12:26:41.892012 18216 leader_election.cc:343] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:41.898921 18424 raft_consensus.cc:2804] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:41.899287 18218 leader_election.cc:304] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d; no voters: ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:41.900609 18419 raft_consensus.cc:2804] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:41.901036 18419 raft_consensus.cc:493] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.901451 18419 raft_consensus.cc:3060] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.903944 18333 raft_consensus.cc:493] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.899335 18424 raft_consensus.cc:493] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.904640 18333 raft_consensus.cc:515] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.907366 18333 leader_election.cc:290] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:41.904745 18424 raft_consensus.cc:3060] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.909746 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019c53d9a9946c59ed8a1b201786adc" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
W20260709 12:26:41.914350 18216 leader_election.cc:343] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:41.925665 18420 raft_consensus.cc:515] T e735bb4b506c457f8dddf767573d025f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:41.926719 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019c53d9a9946c59ed8a1b201786adc" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:41.927574 18176 raft_consensus.cc:2468] T a019c53d9a9946c59ed8a1b201786adc P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 0.
I20260709 12:26:41.929029 18218 leader_election.cc:304] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d; no voters: ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:41.936161 18299 tablet_bootstrap.cc:492] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:41.876008 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e735bb4b506c457f8dddf767573d025f" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:41.941231 18317 consensus_queue.cc:1048] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:41.920169 18376 leader_election.cc:290] T e735bb4b506c457f8dddf767573d025f P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:41.940023 18333 raft_consensus.cc:2804] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:41.946729 18299 ts_tablet_manager.cc:1403] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.130s	user 0.017s	sys 0.003s
I20260709 12:26:41.949220 18364 raft_consensus.cc:493] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.951223 18364 raft_consensus.cc:515] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:41.953742 18364 leader_election.cc:290] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:41.957767 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5995ee175fed4e3e893b8efe2a7eb7d0" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:41.957965 18333 raft_consensus.cc:493] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.960233 18178 raft_consensus.cc:2468] T 629843ee608f4aff9e667570f73f9d6f P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 1.
I20260709 12:26:41.961078 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e735bb4b506c457f8dddf767573d025f" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:41.939841 18420 leader_election.cc:290] T e735bb4b506c457f8dddf767573d025f P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Requested vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:41.963224 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5995ee175fed4e3e893b8efe2a7eb7d0" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:41.964608 18424 raft_consensus.cc:515] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.957667 18423 raft_consensus.cc:515] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:41.966579 18251 raft_consensus.cc:2468] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 0.
I20260709 12:26:41.970774 17992 leader_election.cc:304] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:41.946887 18028 raft_consensus.cc:2468] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 0.
I20260709 12:26:41.967049 18333 raft_consensus.cc:3060] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.971320 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e735bb4b506c457f8dddf767573d025f" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:41.972446 18027 raft_consensus.cc:3060] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.971372 18176 raft_consensus.cc:2393] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in current term 1: Already voted for candidate a08ea42cd3884210924a19c8f570486d in this term.
I20260709 12:26:41.977118 18364 raft_consensus.cc:2804] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:41.977708 18364 raft_consensus.cc:493] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.978152 18364 raft_consensus.cc:3060] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.980928 18027 raft_consensus.cc:2468] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 1.
I20260709 12:26:41.966065 18419 raft_consensus.cc:515] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.967110 18303 tablet_bootstrap.cc:492] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:41.986740 18303 ts_tablet_manager.cc:1403] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.149s	user 0.016s	sys 0.011s
I20260709 12:26:41.989029 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4d4ed1ab54477ca58913fad1bc93b1" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:41.982786 18298 tablet_bootstrap.cc:654] T a379e8a15db944b4a33a0c99f05dc6db P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.983134 18142 leader_election.cc:304] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:41.991132 18358 raft_consensus.cc:2804] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:41.991914 18358 raft_consensus.cc:697] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Becoming Leader. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Running, Role: LEADER
I20260709 12:26:41.995230 18358 consensus_queue.cc:237] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:41.990005 18303 raft_consensus.cc:359] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:42.004484 18303 raft_consensus.cc:385] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.004881 18303 raft_consensus.cc:740] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.005764 18303 consensus_queue.cc:260] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:41.993621 18333 raft_consensus.cc:515] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:42.019586 18303 ts_tablet_manager.cc:1434] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:26:42.023061 18303 tablet_bootstrap.cc:492] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:42.002040 18423 leader_election.cc:290] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Requested vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:42.032599 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4d4ed1ab54477ca58913fad1bc93b1" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:42.033265 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4d4ed1ab54477ca58913fad1bc93b1" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:42.033949 18028 raft_consensus.cc:3060] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.033604 18251 raft_consensus.cc:2393] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a08ea42cd3884210924a19c8f570486d in current term 1: Already voted for candidate 10c938681fc04e66968531267f39f16c in this term.
I20260709 12:26:42.035921 18176 raft_consensus.cc:2393] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c938681fc04e66968531267f39f16c in current term 1: Already voted for candidate a08ea42cd3884210924a19c8f570486d in this term.
I20260709 12:26:42.037465 18377 raft_consensus.cc:493] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.038050 18377 raft_consensus.cc:515] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:42.028481 18419 leader_election.cc:290] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Requested vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:42.040238 18377 leader_election.cc:290] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:42.040771 18377 consensus_queue.cc:1048] T be25c969559444ae99d240c6f3f60df1 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:42.033803 18299 raft_consensus.cc:359] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:42.050879 18299 raft_consensus.cc:385] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.051249 18299 raft_consensus.cc:740] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.052009 18299 consensus_queue.cc:260] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:42.052927 18103 raft_consensus.cc:2468] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 0.
I20260709 12:26:42.054541 18299 ts_tablet_manager.cc:1434] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.104s	user 0.007s	sys 0.000s
I20260709 12:26:42.055990 18303 tablet_bootstrap.cc:654] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.057580 18299 tablet_bootstrap.cc:492] T b667d19692ec4a3aaa8d0c45edf73db9 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:42.055893 18424 leader_election.cc:290] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Requested vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
W20260709 12:26:42.065253 18067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:37881, user_credentials={real_user=slave}} blocked reactor thread for 122737us
I20260709 12:26:42.069857 18028 raft_consensus.cc:2468] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 1.
I20260709 12:26:42.071655 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a379e8a15db944b4a33a0c99f05dc6db" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:42.075204 18142 leader_election.cc:304] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 10c938681fc04e66968531267f39f16c
W20260709 12:26:42.076303 18067 leader_election.cc:343] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10c938681fc04e66968531267f39f16c (127.9.145.196:37881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:42.078368 18423 raft_consensus.cc:2804] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:42.066119 17926 catalog_manager.cc:5697] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194). New cstate: current_term: 1 leader_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:42.076542 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e735bb4b506c457f8dddf767573d025f" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:42.059139 18364 raft_consensus.cc:515] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:42.090633 18423 raft_consensus.cc:697] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Becoming Leader. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Running, Role: LEADER
I20260709 12:26:42.105283 18333 leader_election.cc:290] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Requested vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:42.107276 18300 tablet_bootstrap.cc:492] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:42.107858 18300 ts_tablet_manager.cc:1403] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.262s	user 0.044s	sys 0.082s
I20260709 12:26:42.108213 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019c53d9a9946c59ed8a1b201786adc" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:42.108914 18175 raft_consensus.cc:3060] T a019c53d9a9946c59ed8a1b201786adc P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.117379 18103 raft_consensus.cc:2393] T e735bb4b506c457f8dddf767573d025f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a08ea42cd3884210924a19c8f570486d in current term 1: Already voted for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in this term.
I20260709 12:26:42.125701 18423 consensus_queue.cc:237] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:42.127107 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4d4ed1ab54477ca58913fad1bc93b1" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:42.128495 18028 raft_consensus.cc:2393] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c938681fc04e66968531267f39f16c in current term 1: Already voted for candidate a08ea42cd3884210924a19c8f570486d in this term.
I20260709 12:26:42.129760 18317 raft_consensus.cc:493] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.130017 18300 raft_consensus.cc:359] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:42.130772 18300 raft_consensus.cc:385] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.131160 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019c53d9a9946c59ed8a1b201786adc" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:42.132632 18364 leader_election.cc:290] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Requested vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:42.133376 18299 tablet_bootstrap.cc:654] T b667d19692ec4a3aaa8d0c45edf73db9 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.131059 18300 raft_consensus.cc:740] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.134289 18317 raft_consensus.cc:515] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:42.135390 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e735bb4b506c457f8dddf767573d025f" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:42.136334 18028 raft_consensus.cc:2393] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in current term 1: Already voted for candidate a08ea42cd3884210924a19c8f570486d in this term.
I20260709 12:26:42.136686 18317 leader_election.cc:290] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:42.137012 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a379e8a15db944b4a33a0c99f05dc6db" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:42.134249 18300 consensus_queue.cc:260] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:42.147269 18027 raft_consensus.cc:2468] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 0.
I20260709 12:26:42.150066 18216 leader_election.cc:304] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c938681fc04e66968531267f39f16c; no voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc
W20260709 12:26:42.151562 18216 leader_election.cc:343] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:42.152956 18337 raft_consensus.cc:2749] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:42.154501 18298 tablet_bootstrap.cc:492] T a379e8a15db944b4a33a0c99f05dc6db P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:42.155105 18298 ts_tablet_manager.cc:1403] T a379e8a15db944b4a33a0c99f05dc6db P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.325s	user 0.033s	sys 0.010s
I20260709 12:26:42.161461 18300 ts_tablet_manager.cc:1434] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.001s
I20260709 12:26:42.158043 18298 raft_consensus.cc:359] T a379e8a15db944b4a33a0c99f05dc6db P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:42.184712 18298 raft_consensus.cc:385] T a379e8a15db944b4a33a0c99f05dc6db P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.185106 18300 tablet_bootstrap.cc:492] T 90509aaa02f84d8a983c9f13d8155ded P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:42.185061 18298 raft_consensus.cc:740] T a379e8a15db944b4a33a0c99f05dc6db P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.186775 18298 consensus_queue.cc:260] T a379e8a15db944b4a33a0c99f05dc6db P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:42.171373 18356 raft_consensus.cc:493] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.205665 18299 tablet_bootstrap.cc:492] T b667d19692ec4a3aaa8d0c45edf73db9 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:42.194404 18298 ts_tablet_manager.cc:1434] T a379e8a15db944b4a33a0c99f05dc6db P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 12:26:42.167409 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a379e8a15db944b4a33a0c99f05dc6db" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:42.206560 18299 ts_tablet_manager.cc:1403] T b667d19692ec4a3aaa8d0c45edf73db9 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.151s	user 0.017s	sys 0.010s
I20260709 12:26:42.206809 18250 raft_consensus.cc:2468] T a379e8a15db944b4a33a0c99f05dc6db P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 0.
I20260709 12:26:42.165678 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a379e8a15db944b4a33a0c99f05dc6db" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:42.207876 18104 raft_consensus.cc:2468] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 0.
I20260709 12:26:42.172816 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5995ee175fed4e3e893b8efe2a7eb7d0" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:42.208981 18252 raft_consensus.cc:3060] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.165179 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5995ee175fed4e3e893b8efe2a7eb7d0" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:42.213572 18102 raft_consensus.cc:3060] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.217361 17992 leader_election.cc:304] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:42.201201 18068 leader_election.cc:304] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 10c938681fc04e66968531267f39f16c
I20260709 12:26:42.209777 18299 raft_consensus.cc:359] T b667d19692ec4a3aaa8d0c45edf73db9 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:42.218431 18299 raft_consensus.cc:385] T b667d19692ec4a3aaa8d0c45edf73db9 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.218779 18299 raft_consensus.cc:740] T b667d19692ec4a3aaa8d0c45edf73db9 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.219218 18068 leader_election.cc:304] T e735bb4b506c457f8dddf767573d025f P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:42.219578 18299 consensus_queue.cc:260] T b667d19692ec4a3aaa8d0c45edf73db9 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:42.220989 18445 raft_consensus.cc:2804] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:42.221392 18445 raft_consensus.cc:493] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.221438 18317 raft_consensus.cc:2804] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:42.222087 18317 raft_consensus.cc:493] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.222550 18317 raft_consensus.cc:3060] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.221794 18445 raft_consensus.cc:3060] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.227612 18356 raft_consensus.cc:515] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:42.230135 18356 leader_election.cc:290] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:42.230731 18299 ts_tablet_manager.cc:1434] T b667d19692ec4a3aaa8d0c45edf73db9 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:26:42.222266 18446 raft_consensus.cc:2749] T e735bb4b506c457f8dddf767573d025f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:42.232014 18299 tablet_bootstrap.cc:492] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:42.236372 18175 raft_consensus.cc:2468] T a019c53d9a9946c59ed8a1b201786adc P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 1.
I20260709 12:26:42.211198 18298 tablet_bootstrap.cc:492] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
W20260709 12:26:42.241161 18141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:45595, user_credentials={real_user=slave}} blocked reactor thread for 72318.2us
I20260709 12:26:42.241374 18317 raft_consensus.cc:515] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:42.242233 18303 tablet_bootstrap.cc:492] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:42.242839 18303 ts_tablet_manager.cc:1403] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.220s	user 0.036s	sys 0.023s
I20260709 12:26:42.243548 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b667d19692ec4a3aaa8d0c45edf73db9" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:42.243733 18317 leader_election.cc:290] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Requested vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:42.236783 18445 raft_consensus.cc:515] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:42.244364 18104 raft_consensus.cc:2468] T b667d19692ec4a3aaa8d0c45edf73db9 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 0.
W20260709 12:26:42.245214 17995 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:43695, user_credentials={real_user=slave}} blocked reactor thread for 112331us
I20260709 12:26:42.249200 17924 catalog_manager.cc:5697] T 2d9471cf607248b0b7f9090046f63df4 P 10c938681fc04e66968531267f39f16c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c938681fc04e66968531267f39f16c (127.9.145.196). New cstate: current_term: 1 leader_uuid: "10c938681fc04e66968531267f39f16c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:42.250880 18218 leader_election.cc:304] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d; no voters: ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:42.251911 18102 raft_consensus.cc:2468] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 1.
I20260709 12:26:42.252224 18337 raft_consensus.cc:2804] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:42.252846 18337 raft_consensus.cc:697] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Becoming Leader. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:26:42.215794 17925 catalog_manager.cc:5697] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d reported cstate change: term changed from 0 to 1, leader changed from <none> to a08ea42cd3884210924a19c8f570486d (127.9.145.195). New cstate: current_term: 1 leader_uuid: "a08ea42cd3884210924a19c8f570486d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:42.254462 18300 tablet_bootstrap.cc:654] T 90509aaa02f84d8a983c9f13d8155ded P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.244364 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b667d19692ec4a3aaa8d0c45edf73db9" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:42.255801 18299 tablet_bootstrap.cc:654] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.257248 17925 catalog_manager.cc:5697] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d reported cstate change: term changed from 0 to 1, leader changed from <none> to a08ea42cd3884210924a19c8f570486d (127.9.145.195). New cstate: current_term: 1 leader_uuid: "a08ea42cd3884210924a19c8f570486d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:42.258314 18445 leader_election.cc:290] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Requested vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:42.253756 18337 consensus_queue.cc:237] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:42.253216 18252 raft_consensus.cc:2468] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 1.
I20260709 12:26:42.261123 18303 raft_consensus.cc:359] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:42.262740 18303 raft_consensus.cc:385] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.263191 18303 raft_consensus.cc:740] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.264495 18303 consensus_queue.cc:260] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:42.265455 18298 tablet_bootstrap.cc:654] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.267098 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a379e8a15db944b4a33a0c99f05dc6db" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:42.269073 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a379e8a15db944b4a33a0c99f05dc6db" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:42.267956 18303 ts_tablet_manager.cc:1434] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:26:42.270824 18303 tablet_bootstrap.cc:492] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:42.272138 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a379e8a15db944b4a33a0c99f05dc6db" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:42.272967 18252 raft_consensus.cc:3060] T a379e8a15db944b4a33a0c99f05dc6db P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.270033 18028 raft_consensus.cc:2393] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in current term 1: Already voted for candidate ac42e2bcf9ac42448a84370269bc6ccc in this term.
I20260709 12:26:42.268054 18102 raft_consensus.cc:2393] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ac42e2bcf9ac42448a84370269bc6ccc in current term 1: Already voted for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in this term.
I20260709 12:26:42.276676 18141 leader_election.cc:304] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:42.277462 18303 tablet_bootstrap.cc:654] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:42.278048 18141 leader_election.cc:343] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10c938681fc04e66968531267f39f16c (127.9.145.196:37881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:42.279300 18424 raft_consensus.cc:2804] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:42.279814 18424 raft_consensus.cc:493] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.280860 18424 raft_consensus.cc:3060] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.281656 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a379e8a15db944b4a33a0c99f05dc6db" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:42.290431 17992 leader_election.cc:304] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:42.291652 18364 raft_consensus.cc:2804] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:42.292342 18364 raft_consensus.cc:697] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 LEADER]: Becoming Leader. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Running, Role: LEADER
I20260709 12:26:42.289556 18424 raft_consensus.cc:515] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:42.293406 18364 consensus_queue.cc:237] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:42.296685 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b667d19692ec4a3aaa8d0c45edf73db9" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:42.297484 18102 raft_consensus.cc:3060] T b667d19692ec4a3aaa8d0c45edf73db9 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.296483 17992 leader_election.cc:304] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac42e2bcf9ac42448a84370269bc6ccc; no voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c
I20260709 12:26:42.299038 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b667d19692ec4a3aaa8d0c45edf73db9" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:42.299958 18424 leader_election.cc:290] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Requested vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
W20260709 12:26:42.300694 18141 leader_election.cc:343] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10c938681fc04e66968531267f39f16c (127.9.145.196:37881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:42.301560 18455 raft_consensus.cc:2749] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:42.302881 18303 tablet_bootstrap.cc:492] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:42.303308 18303 ts_tablet_manager.cc:1403] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.001s
I20260709 12:26:42.305411 18303 raft_consensus.cc:359] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:42.305886 18303 raft_consensus.cc:385] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.309621 18303 raft_consensus.cc:740] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.305778 18102 raft_consensus.cc:2468] T b667d19692ec4a3aaa8d0c45edf73db9 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 1.
I20260709 12:26:42.311643 18299 tablet_bootstrap.cc:492] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:42.311555 18141 leader_election.cc:304] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 10c938681fc04e66968531267f39f16c
I20260709 12:26:42.312182 18299 ts_tablet_manager.cc:1403] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.018s
I20260709 12:26:42.311842 18445 consensus_queue.cc:1048] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:42.312939 18424 raft_consensus.cc:2804] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:42.313663 18424 raft_consensus.cc:697] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Becoming Leader. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Running, Role: LEADER
I20260709 12:26:42.314612 18424 consensus_queue.cc:237] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:42.316169 18299 raft_consensus.cc:359] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:42.318506 18252 raft_consensus.cc:2468] T a379e8a15db944b4a33a0c99f05dc6db P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 1.
I20260709 12:26:42.319239 18303 consensus_queue.cc:260] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:42.320070 18067 leader_election.cc:304] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:42.321398 18303 ts_tablet_manager.cc:1434] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 12:26:42.321688 18445 raft_consensus.cc:2804] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:42.322350 18445 raft_consensus.cc:697] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Becoming Leader. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Running, Role: LEADER
I20260709 12:26:42.322513 18303 tablet_bootstrap.cc:492] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:42.324944 18445 consensus_queue.cc:237] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:42.316888 18299 raft_consensus.cc:385] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.329667 18299 raft_consensus.cc:740] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.330587 18299 consensus_queue.cc:260] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:42.333041 18299 ts_tablet_manager.cc:1434] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:26:42.334129 18299 tablet_bootstrap.cc:492] T dc4b6b0d4466443f9c077e9a45bb3b89 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:42.336792 18298 tablet_bootstrap.cc:492] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:42.337424 18298 ts_tablet_manager.cc:1403] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.126s	user 0.009s	sys 0.006s
I20260709 12:26:42.340384 18299 tablet_bootstrap.cc:654] T dc4b6b0d4466443f9c077e9a45bb3b89 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.340977 18303 tablet_bootstrap.cc:654] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.340631 18298 raft_consensus.cc:359] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:42.341367 18298 raft_consensus.cc:385] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.341663 18298 raft_consensus.cc:740] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.345130 18300 tablet_bootstrap.cc:492] T 90509aaa02f84d8a983c9f13d8155ded P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:42.345745 18300 ts_tablet_manager.cc:1403] T 90509aaa02f84d8a983c9f13d8155ded P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.161s	user 0.007s	sys 0.004s
I20260709 12:26:42.348456 18377 consensus_queue.cc:1048] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:42.350301 18337 consensus_queue.cc:1048] T 2d9471cf607248b0b7f9090046f63df4 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:42.360859 18300 raft_consensus.cc:359] T 90509aaa02f84d8a983c9f13d8155ded P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:42.361254 18299 tablet_bootstrap.cc:492] T dc4b6b0d4466443f9c077e9a45bb3b89 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:42.361662 18300 raft_consensus.cc:385] T 90509aaa02f84d8a983c9f13d8155ded P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.361898 18299 ts_tablet_manager.cc:1403] T dc4b6b0d4466443f9c077e9a45bb3b89 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.004s
I20260709 12:26:42.367587 18303 tablet_bootstrap.cc:492] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:42.364677 18421 consensus_queue.cc:1048] T 2d9471cf607248b0b7f9090046f63df4 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:26:42.371537 18303 ts_tablet_manager.cc:1403] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.004s
I20260709 12:26:42.368578 17924 catalog_manager.cc:5697] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc reported cstate change: term changed from 0 to 1, leader changed from <none> to ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193). New cstate: current_term: 1 leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:42.374487 18303 raft_consensus.cc:359] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:42.375203 18303 raft_consensus.cc:385] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.375458 18303 raft_consensus.cc:740] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.376123 18303 consensus_queue.cc:260] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:42.364913 18299 raft_consensus.cc:359] T dc4b6b0d4466443f9c077e9a45bb3b89 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:42.377897 18299 raft_consensus.cc:385] T dc4b6b0d4466443f9c077e9a45bb3b89 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.378213 18299 raft_consensus.cc:740] T dc4b6b0d4466443f9c077e9a45bb3b89 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.378966 18299 consensus_queue.cc:260] T dc4b6b0d4466443f9c077e9a45bb3b89 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:42.362560 18298 consensus_queue.cc:260] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:42.383283 18298 ts_tablet_manager.cc:1434] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 12:26:42.395093 18298 tablet_bootstrap.cc:492] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:42.401269 18298 tablet_bootstrap.cc:654] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.361974 18300 raft_consensus.cc:740] T 90509aaa02f84d8a983c9f13d8155ded P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.402997 18300 consensus_queue.cc:260] T 90509aaa02f84d8a983c9f13d8155ded P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:42.404841 18300 ts_tablet_manager.cc:1434] T 90509aaa02f84d8a983c9f13d8155ded P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.001s
I20260709 12:26:42.405619 18300 tablet_bootstrap.cc:492] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:42.385318 18303 ts_tablet_manager.cc:1434] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:26:42.406672 18303 tablet_bootstrap.cc:492] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:42.390820 17923 catalog_manager.cc:5697] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c938681fc04e66968531267f39f16c (127.9.145.196). New cstate: current_term: 1 leader_uuid: "10c938681fc04e66968531267f39f16c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:42.413115 18303 tablet_bootstrap.cc:654] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.385692 18299 ts_tablet_manager.cc:1434] T dc4b6b0d4466443f9c077e9a45bb3b89 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:26:42.414996 18299 tablet_bootstrap.cc:492] T f17497d6870f4ff495e91f076239de59 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:42.419088 18300 tablet_bootstrap.cc:654] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.420907 18299 tablet_bootstrap.cc:654] T f17497d6870f4ff495e91f076239de59 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.422065 17926 catalog_manager.cc:5697] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194). New cstate: current_term: 1 leader_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:42.433708 18298 tablet_bootstrap.cc:492] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:42.434358 18298 ts_tablet_manager.cc:1403] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.001s
I20260709 12:26:42.436398 18299 tablet_bootstrap.cc:492] T f17497d6870f4ff495e91f076239de59 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:42.435992 17925 catalog_manager.cc:5697] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d reported cstate change: term changed from 0 to 1, leader changed from <none> to a08ea42cd3884210924a19c8f570486d (127.9.145.195). New cstate: current_term: 1 leader_uuid: "a08ea42cd3884210924a19c8f570486d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:42.436920 18299 ts_tablet_manager.cc:1403] T f17497d6870f4ff495e91f076239de59 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.000s
I20260709 12:26:42.437314 18298 raft_consensus.cc:359] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:42.438468 18298 raft_consensus.cc:385] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.438731 18298 raft_consensus.cc:740] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.439716 18299 raft_consensus.cc:359] T f17497d6870f4ff495e91f076239de59 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:42.439867 18298 consensus_queue.cc:260] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:42.440433 18299 raft_consensus.cc:385] T f17497d6870f4ff495e91f076239de59 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.440743 18299 raft_consensus.cc:740] T f17497d6870f4ff495e91f076239de59 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.441406 18299 consensus_queue.cc:260] T f17497d6870f4ff495e91f076239de59 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:42.442378 18298 ts_tablet_manager.cc:1434] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:26:42.443380 18298 tablet_bootstrap.cc:492] T c697128b8d274c8790595b833d9b74eb P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:42.439647 18300 tablet_bootstrap.cc:492] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:42.443766 18299 ts_tablet_manager.cc:1434] T f17497d6870f4ff495e91f076239de59 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:42.444316 18300 ts_tablet_manager.cc:1403] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.008s
I20260709 12:26:42.444895 18299 tablet_bootstrap.cc:492] T dda5199333524768beef0903fe39e300 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:42.447278 18300 raft_consensus.cc:359] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:42.447978 18300 raft_consensus.cc:385] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.448266 18300 raft_consensus.cc:740] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.448958 18300 consensus_queue.cc:260] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:42.449448 18298 tablet_bootstrap.cc:654] T c697128b8d274c8790595b833d9b74eb P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.451447 18300 ts_tablet_manager.cc:1434] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.005s
I20260709 12:26:42.452486 18300 tablet_bootstrap.cc:492] T dc4b6b0d4466443f9c077e9a45bb3b89 P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:42.458225 18337 raft_consensus.cc:493] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.458395 18300 tablet_bootstrap.cc:654] T dc4b6b0d4466443f9c077e9a45bb3b89 P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.458832 18337 raft_consensus.cc:515] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:42.461107 18337 leader_election.cc:290] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:42.462647 18303 tablet_bootstrap.cc:492] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:42.463392 18303 ts_tablet_manager.cc:1403] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.057s	user 0.006s	sys 0.007s
I20260709 12:26:42.464428 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4b6b0d4466443f9c077e9a45bb3b89" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:42.465113 18104 raft_consensus.cc:2468] T dc4b6b0d4466443f9c077e9a45bb3b89 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 0.
I20260709 12:26:42.466794 18303 raft_consensus.cc:359] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:42.467535 18303 raft_consensus.cc:385] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.467931 18303 raft_consensus.cc:740] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.468870 18424 consensus_queue.cc:1048] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:42.468998 18303 consensus_queue.cc:260] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:42.467582 18299 tablet_bootstrap.cc:654] T dda5199333524768beef0903fe39e300 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.471803 18303 ts_tablet_manager.cc:1434] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:42.471900 18215 leader_election.cc:304] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 
I20260709 12:26:42.463230 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4b6b0d4466443f9c077e9a45bb3b89" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:42.474455 18333 raft_consensus.cc:2804] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:42.474869 18333 raft_consensus.cc:493] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.475225 18333 raft_consensus.cc:3060] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:42.476179 18218 leader_election.cc:343] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:42.477152 18337 raft_consensus.cc:493] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.477660 18337 raft_consensus.cc:515] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:42.479110 18364 raft_consensus.cc:493] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.479625 18364 raft_consensus.cc:515] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:42.482599 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f17497d6870f4ff495e91f076239de59" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:42.482991 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f17497d6870f4ff495e91f076239de59" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:42.483672 18175 raft_consensus.cc:2468] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 0.
I20260709 12:26:42.485837 17995 leader_election.cc:304] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:42.486775 18455 raft_consensus.cc:2804] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:42.486989 18299 tablet_bootstrap.cc:492] T dda5199333524768beef0903fe39e300 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:42.487550 18102 raft_consensus.cc:2468] T f17497d6870f4ff495e91f076239de59 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 0.
I20260709 12:26:42.487722 18299 ts_tablet_manager.cc:1403] T dda5199333524768beef0903fe39e300 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.000s
I20260709 12:26:42.487205 18455 raft_consensus.cc:493] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.491101 18455 raft_consensus.cc:3060] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.492029 18337 leader_election.cc:290] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:42.486210 18364 leader_election.cc:290] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:42.491881 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90509aaa02f84d8a983c9f13d8155ded" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:42.493387 18175 raft_consensus.cc:2468] T 90509aaa02f84d8a983c9f13d8155ded P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 0.
I20260709 12:26:42.494038 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90509aaa02f84d8a983c9f13d8155ded" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:42.494725 18218 leader_election.cc:304] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:42.495666 18421 raft_consensus.cc:2804] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:42.496050 18421 raft_consensus.cc:493] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.496431 18421 raft_consensus.cc:3060] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.499225 18298 tablet_bootstrap.cc:492] T c697128b8d274c8790595b833d9b74eb P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:42.499825 18298 ts_tablet_manager.cc:1403] T c697128b8d274c8790595b833d9b74eb P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.004s
I20260709 12:26:42.490818 18299 raft_consensus.cc:359] T dda5199333524768beef0903fe39e300 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:42.494755 18027 raft_consensus.cc:2468] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 0.
I20260709 12:26:42.502537 18299 raft_consensus.cc:385] T dda5199333524768beef0903fe39e300 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.502772 18333 raft_consensus.cc:515] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:42.505112 18298 raft_consensus.cc:359] T c697128b8d274c8790595b833d9b74eb P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:42.505861 18298 raft_consensus.cc:385] T c697128b8d274c8790595b833d9b74eb P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.506179 18298 raft_consensus.cc:740] T c697128b8d274c8790595b833d9b74eb P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.506914 18298 consensus_queue.cc:260] T c697128b8d274c8790595b833d9b74eb P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:42.507619 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4b6b0d4466443f9c077e9a45bb3b89" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:42.507355 18421 raft_consensus.cc:515] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:42.508411 18102 raft_consensus.cc:3060] T dc4b6b0d4466443f9c077e9a45bb3b89 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.510958 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90509aaa02f84d8a983c9f13d8155ded" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:42.511555 18421 leader_election.cc:290] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Requested vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:42.501897 18455 raft_consensus.cc:515] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:42.515295 18298 ts_tablet_manager.cc:1434] T c697128b8d274c8790595b833d9b74eb P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:26:42.503024 18299 raft_consensus.cc:740] T dda5199333524768beef0903fe39e300 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.496062 18303 tablet_bootstrap.cc:492] T dda5199333524768beef0903fe39e300 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:42.511958 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90509aaa02f84d8a983c9f13d8155ded" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:42.516175 18027 raft_consensus.cc:3060] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.516378 18298 tablet_bootstrap.cc:492] T b667d19692ec4a3aaa8d0c45edf73db9 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:42.504269 18300 tablet_bootstrap.cc:492] T dc4b6b0d4466443f9c077e9a45bb3b89 P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:42.518476 18300 ts_tablet_manager.cc:1403] T dc4b6b0d4466443f9c077e9a45bb3b89 P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.066s	user 0.006s	sys 0.005s
I20260709 12:26:42.519770 18455 leader_election.cc:290] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Requested vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:42.520349 18299 consensus_queue.cc:260] T dda5199333524768beef0903fe39e300 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:42.522439 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f17497d6870f4ff495e91f076239de59" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:42.523146 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4b6b0d4466443f9c077e9a45bb3b89" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:42.511615 18175 raft_consensus.cc:3060] T 90509aaa02f84d8a983c9f13d8155ded P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.524917 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f17497d6870f4ff495e91f076239de59" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:42.525529 18177 raft_consensus.cc:3060] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.525628 18300 raft_consensus.cc:359] T dc4b6b0d4466443f9c077e9a45bb3b89 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:42.526368 18300 raft_consensus.cc:385] T dc4b6b0d4466443f9c077e9a45bb3b89 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.526643 18300 raft_consensus.cc:740] T dc4b6b0d4466443f9c077e9a45bb3b89 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.523083 18103 raft_consensus.cc:3060] T f17497d6870f4ff495e91f076239de59 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.523677 18455 raft_consensus.cc:493] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.528921 18455 raft_consensus.cc:515] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:42.531177 18299 ts_tablet_manager.cc:1434] T dda5199333524768beef0903fe39e300 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 12:26:42.531598 18298 tablet_bootstrap.cc:654] T b667d19692ec4a3aaa8d0c45edf73db9 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.531839 18303 tablet_bootstrap.cc:654] T dda5199333524768beef0903fe39e300 P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:42.531790 18218 leader_election.cc:343] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:42.534021 18455 leader_election.cc:290] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:42.527312 18300 consensus_queue.cc:260] T dc4b6b0d4466443f9c077e9a45bb3b89 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:42.534706 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c697128b8d274c8790595b833d9b74eb" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:42.535231 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c697128b8d274c8790595b833d9b74eb" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:42.535385 18252 raft_consensus.cc:2468] T c697128b8d274c8790595b833d9b74eb P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 0.
I20260709 12:26:42.536355 18424 raft_consensus.cc:493] T dc4b6b0d4466443f9c077e9a45bb3b89 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.536543 18300 ts_tablet_manager.cc:1434] T dc4b6b0d4466443f9c077e9a45bb3b89 P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:26:42.537016 18424 raft_consensus.cc:515] T dc4b6b0d4466443f9c077e9a45bb3b89 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:42.537670 18300 tablet_bootstrap.cc:492] T dda5199333524768beef0903fe39e300 P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:42.538412 18101 raft_consensus.cc:2468] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 0.
I20260709 12:26:42.541437 17992 leader_election.cc:304] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:42.544230 18455 raft_consensus.cc:2804] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:42.544701 18455 raft_consensus.cc:493] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.545086 18455 raft_consensus.cc:3060] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.544711 18300 tablet_bootstrap.cc:654] T dda5199333524768beef0903fe39e300 P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.550712 18364 raft_consensus.cc:493] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.551364 18364 raft_consensus.cc:515] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:42.554405 18364 leader_election.cc:290] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:42.555760 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019c53d9a9946c59ed8a1b201786adc" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:42.556699 18178 raft_consensus.cc:2393] T a019c53d9a9946c59ed8a1b201786adc P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac42e2bcf9ac42448a84370269bc6ccc in current term 1: Already voted for candidate 10c938681fc04e66968531267f39f16c in this term.
I20260709 12:26:42.557760 18299 tablet_bootstrap.cc:492] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:42.558290 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4b6b0d4466443f9c077e9a45bb3b89" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:42.558425 18424 leader_election.cc:290] T dc4b6b0d4466443f9c077e9a45bb3b89 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:42.561914 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4b6b0d4466443f9c077e9a45bb3b89" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:42.563004 18250 raft_consensus.cc:2393] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a08ea42cd3884210924a19c8f570486d in current term 1: Already voted for candidate 10c938681fc04e66968531267f39f16c in this term.
I20260709 12:26:42.564844 18027 raft_consensus.cc:2468] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 1.
I20260709 12:26:42.521938 18333 leader_election.cc:290] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Requested vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:42.570542 18298 tablet_bootstrap.cc:492] T b667d19692ec4a3aaa8d0c45edf73db9 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:42.571154 18298 ts_tablet_manager.cc:1403] T b667d19692ec4a3aaa8d0c45edf73db9 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.000s
I20260709 12:26:42.558768 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019c53d9a9946c59ed8a1b201786adc" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:42.566215 18177 raft_consensus.cc:2468] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 1.
I20260709 12:26:42.575776 17995 leader_election.cc:304] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:42.574054 18298 raft_consensus.cc:359] T b667d19692ec4a3aaa8d0c45edf73db9 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:42.565150 18141 leader_election.cc:304] T dc4b6b0d4466443f9c077e9a45bb3b89 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a08ea42cd3884210924a19c8f570486d; no voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c
I20260709 12:26:42.576088 18216 leader_election.cc:304] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:42.577405 18424 raft_consensus.cc:3060] T dc4b6b0d4466443f9c077e9a45bb3b89 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.579373 18455 raft_consensus.cc:515] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:42.587899 18424 raft_consensus.cc:2749] T dc4b6b0d4466443f9c077e9a45bb3b89 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:42.576702 18317 raft_consensus.cc:2804] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:42.584478 18299 tablet_bootstrap.cc:654] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.576859 17992 leader_election.cc:304] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac42e2bcf9ac42448a84370269bc6ccc; no voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d
I20260709 12:26:42.580940 18103 raft_consensus.cc:2468] T f17497d6870f4ff495e91f076239de59 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 1.
I20260709 12:26:42.611357 18317 raft_consensus.cc:697] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 LEADER]: Becoming Leader. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Running, Role: LEADER
I20260709 12:26:42.612573 18449 raft_consensus.cc:3060] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.612777 18317 consensus_queue.cc:237] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:42.576488 18298 raft_consensus.cc:385] T b667d19692ec4a3aaa8d0c45edf73db9 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.614904 18298 raft_consensus.cc:740] T b667d19692ec4a3aaa8d0c45edf73db9 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.610771 18102 raft_consensus.cc:2468] T dc4b6b0d4466443f9c077e9a45bb3b89 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 1.
I20260709 12:26:42.616631 18215 leader_election.cc:304] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: a08ea42cd3884210924a19c8f570486d
I20260709 12:26:42.617880 18421 raft_consensus.cc:2804] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:26:42.618816 18216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:36743, user_credentials={real_user=slave}} blocked reactor thread for 44602.6us
I20260709 12:26:42.619205 18337 raft_consensus.cc:2804] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:42.619737 18337 raft_consensus.cc:697] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Becoming Leader. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:26:42.620580 18337 consensus_queue.cc:237] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:42.622943 18300 tablet_bootstrap.cc:492] T dda5199333524768beef0903fe39e300 P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:42.623493 18300 ts_tablet_manager.cc:1403] T dda5199333524768beef0903fe39e300 P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.086s	user 0.011s	sys 0.000s
I20260709 12:26:42.623916 18421 raft_consensus.cc:697] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Becoming Leader. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:26:42.624327 18303 tablet_bootstrap.cc:492] T dda5199333524768beef0903fe39e300 P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:42.624833 18303 ts_tablet_manager.cc:1403] T dda5199333524768beef0903fe39e300 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.129s	user 0.011s	sys 0.022s
I20260709 12:26:42.625085 18421 consensus_queue.cc:237] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:42.626356 18300 raft_consensus.cc:359] T dda5199333524768beef0903fe39e300 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:42.627148 18300 raft_consensus.cc:385] T dda5199333524768beef0903fe39e300 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.627417 18300 raft_consensus.cc:740] T dda5199333524768beef0903fe39e300 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.620954 18175 raft_consensus.cc:2468] T 90509aaa02f84d8a983c9f13d8155ded P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 1.
I20260709 12:26:42.628118 18300 consensus_queue.cc:260] T dda5199333524768beef0903fe39e300 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:42.581691 18455 leader_election.cc:290] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Requested vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
W20260709 12:26:42.630239 17992 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.196:37881, user_credentials={real_user=slave}} blocked reactor thread for 53480.7us
I20260709 12:26:42.631316 18300 ts_tablet_manager.cc:1434] T dda5199333524768beef0903fe39e300 P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:26:42.631984 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c697128b8d274c8790595b833d9b74eb" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:42.632198 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c697128b8d274c8790595b833d9b74eb" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:42.632647 18252 raft_consensus.cc:3060] T c697128b8d274c8790595b833d9b74eb P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.632748 18102 raft_consensus.cc:3060] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.636987 18449 raft_consensus.cc:2749] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:42.638290 18303 raft_consensus.cc:359] T dda5199333524768beef0903fe39e300 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:42.639122 18303 raft_consensus.cc:385] T dda5199333524768beef0903fe39e300 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.639393 18303 raft_consensus.cc:740] T dda5199333524768beef0903fe39e300 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.640100 18303 consensus_queue.cc:260] T dda5199333524768beef0903fe39e300 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:42.641705 18300 tablet_bootstrap.cc:492] T f68e8047f5ff4aa0b631cbd912091d25 P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:42.642982 18303 ts_tablet_manager.cc:1434] T dda5199333524768beef0903fe39e300 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:26:42.645222 18252 raft_consensus.cc:2468] T c697128b8d274c8790595b833d9b74eb P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 1.
I20260709 12:26:42.615770 18298 consensus_queue.cc:260] T b667d19692ec4a3aaa8d0c45edf73db9 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:42.646668 18424 consensus_queue.cc:1048] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:42.646591 18303 tablet_bootstrap.cc:492] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:42.652908 18298 ts_tablet_manager.cc:1434] T b667d19692ec4a3aaa8d0c45edf73db9 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.081s	user 0.010s	sys 0.002s
I20260709 12:26:42.654358 18298 tablet_bootstrap.cc:492] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:42.656541 18300 tablet_bootstrap.cc:654] T f68e8047f5ff4aa0b631cbd912091d25 P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.656327 18102 raft_consensus.cc:2468] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 1.
I20260709 12:26:42.663470 17992 leader_election.cc:304] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:42.668105 17925 catalog_manager.cc:5697] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c938681fc04e66968531267f39f16c (127.9.145.196). New cstate: current_term: 1 leader_uuid: "10c938681fc04e66968531267f39f16c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:42.669071 18424 consensus_queue.cc:1048] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:42.668895 18299 tablet_bootstrap.cc:492] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:42.669590 17926 catalog_manager.cc:5697] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc reported cstate change: term changed from 0 to 1, leader changed from <none> to ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193). New cstate: current_term: 1 leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:42.670770 18299 ts_tablet_manager.cc:1403] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.113s	user 0.018s	sys 0.001s
I20260709 12:26:42.671324 18317 raft_consensus.cc:2804] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:42.671865 18317 raft_consensus.cc:697] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc [term 1 LEADER]: Becoming Leader. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Running, Role: LEADER
I20260709 12:26:42.672731 18317 consensus_queue.cc:237] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:42.673674 18299 raft_consensus.cc:359] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:42.674397 18299 raft_consensus.cc:385] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.674698 18299 raft_consensus.cc:740] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.675208 18303 tablet_bootstrap.cc:654] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.669299 18420 raft_consensus.cc:493] T dda5199333524768beef0903fe39e300 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.686388 18420 raft_consensus.cc:515] T dda5199333524768beef0903fe39e300 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:42.690084 18420 leader_election.cc:290] T dda5199333524768beef0903fe39e300 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:42.693890 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda5199333524768beef0903fe39e300" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:42.694690 18177 raft_consensus.cc:2468] T dda5199333524768beef0903fe39e300 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 0.
I20260709 12:26:42.695767 18250 raft_consensus.cc:3060] T b667d19692ec4a3aaa8d0c45edf73db9 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.698207 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda5199333524768beef0903fe39e300" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:42.698891 18070 leader_election.cc:304] T dda5199333524768beef0903fe39e300 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:42.698977 18029 raft_consensus.cc:2468] T dda5199333524768beef0903fe39e300 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 0.
I20260709 12:26:42.690531 18299 consensus_queue.cc:260] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:42.699602 18298 tablet_bootstrap.cc:654] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.706907 18299 ts_tablet_manager.cc:1434] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 12:26:42.707851 18299 tablet_bootstrap.cc:492] T 07d9e11e303c4580a941ccc2943afdd5 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:42.702910 18445 raft_consensus.cc:2804] T dda5199333524768beef0903fe39e300 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:42.708787 18445 raft_consensus.cc:493] T dda5199333524768beef0903fe39e300 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.709187 18445 raft_consensus.cc:3060] T dda5199333524768beef0903fe39e300 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.718706 18421 consensus_queue.cc:1048] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:42.723179 17925 catalog_manager.cc:5697] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c938681fc04e66968531267f39f16c (127.9.145.196). New cstate: current_term: 1 leader_uuid: "10c938681fc04e66968531267f39f16c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:42.729470 18421 consensus_queue.cc:1048] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:42.736630 18423 consensus_queue.cc:1048] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:42.754333 18303 tablet_bootstrap.cc:492] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:42.754949 18303 ts_tablet_manager.cc:1403] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.109s	user 0.016s	sys 0.001s
I20260709 12:26:42.766203 18424 consensus_queue.cc:1048] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:42.768280 18377 consensus_queue.cc:1048] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:42.776343 18445 raft_consensus.cc:515] T dda5199333524768beef0903fe39e300 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:42.783696 18300 tablet_bootstrap.cc:492] T f68e8047f5ff4aa0b631cbd912091d25 P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:42.784407 18300 ts_tablet_manager.cc:1403] T f68e8047f5ff4aa0b631cbd912091d25 P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.146s	user 0.019s	sys 0.019s
I20260709 12:26:42.790058 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda5199333524768beef0903fe39e300" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:42.789909 18445 leader_election.cc:290] T dda5199333524768beef0903fe39e300 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Requested vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:42.790833 18027 raft_consensus.cc:3060] T dda5199333524768beef0903fe39e300 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.829560 18298 tablet_bootstrap.cc:492] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:42.830525 18298 ts_tablet_manager.cc:1403] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.177s	user 0.031s	sys 0.027s
I20260709 12:26:42.828621 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda5199333524768beef0903fe39e300" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:42.836985 18177 raft_consensus.cc:3060] T dda5199333524768beef0903fe39e300 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.823465 18424 consensus_queue.cc:1048] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:26:42.850682 18300 raft_consensus.cc:359] T f68e8047f5ff4aa0b631cbd912091d25 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:42.851588 18300 raft_consensus.cc:385] T f68e8047f5ff4aa0b631cbd912091d25 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.851922 18300 raft_consensus.cc:740] T f68e8047f5ff4aa0b631cbd912091d25 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.848295 18446 consensus_queue.cc:1048] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:26:42.858656 18300 consensus_queue.cc:260] T f68e8047f5ff4aa0b631cbd912091d25 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:42.864010 18303 raft_consensus.cc:359] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:42.864907 18303 raft_consensus.cc:385] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.865202 18303 raft_consensus.cc:740] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.867758 18303 consensus_queue.cc:260] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:42.871068 18300 ts_tablet_manager.cc:1434] T f68e8047f5ff4aa0b631cbd912091d25 P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.002s
I20260709 12:26:42.873544 18300 tablet_bootstrap.cc:492] T 07d9e11e303c4580a941ccc2943afdd5 P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:42.876057 18303 ts_tablet_manager.cc:1434] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.121s	user 0.007s	sys 0.001s
I20260709 12:26:42.877013 18303 tablet_bootstrap.cc:492] T f68e8047f5ff4aa0b631cbd912091d25 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:42.888827 18177 raft_consensus.cc:2468] T dda5199333524768beef0903fe39e300 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 1.
I20260709 12:26:42.890343 18070 leader_election.cc:304] T dda5199333524768beef0903fe39e300 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:42.890687 18299 tablet_bootstrap.cc:654] T 07d9e11e303c4580a941ccc2943afdd5 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.891295 18445 raft_consensus.cc:2804] T dda5199333524768beef0903fe39e300 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:42.891973 18445 raft_consensus.cc:697] T dda5199333524768beef0903fe39e300 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Becoming Leader. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Running, Role: LEADER
I20260709 12:26:42.893852 18445 consensus_queue.cc:237] T dda5199333524768beef0903fe39e300 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:42.902870 18298 raft_consensus.cc:359] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:42.874706 18317 consensus_queue.cc:1048] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:26:42.906586 18027 raft_consensus.cc:2468] T dda5199333524768beef0903fe39e300 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 1.
I20260709 12:26:42.903687 18298 raft_consensus.cc:385] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.915050 18298 raft_consensus.cc:740] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.926290 18303 tablet_bootstrap.cc:654] T f68e8047f5ff4aa0b631cbd912091d25 P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.942849 18492 consensus_queue.cc:1048] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:26:42.943375 17975 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:42.950311 18492 raft_consensus.cc:493] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.950908 18492 raft_consensus.cc:515] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:42.953480 18492 leader_election.cc:290] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:42.939960 18298 consensus_queue.cc:260] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:42.956049 18298 ts_tablet_manager.cc:1434] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.124s	user 0.007s	sys 0.000s
I20260709 12:26:42.957129 18298 tablet_bootstrap.cc:492] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:42.960039 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d2f53aff8a45a49cadf9fd72b75ee8" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:42.960908 18104 raft_consensus.cc:2468] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 0.
I20260709 12:26:42.962414 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d2f53aff8a45a49cadf9fd72b75ee8" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:42.963151 18252 raft_consensus.cc:2468] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 0.
I20260709 12:26:42.963972 18300 tablet_bootstrap.cc:654] T 07d9e11e303c4580a941ccc2943afdd5 P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.965500 17992 leader_election.cc:304] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:42.966806 18317 raft_consensus.cc:2804] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:42.967253 18317 raft_consensus.cc:493] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.953358 17923 catalog_manager.cc:5697] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc reported cstate change: term changed from 0 to 1, leader changed from <none> to ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193). New cstate: current_term: 1 leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:42.967603 18317 raft_consensus.cc:3060] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.973388 18424 raft_consensus.cc:493] T f68e8047f5ff4aa0b631cbd912091d25 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.974067 18424 raft_consensus.cc:515] T f68e8047f5ff4aa0b631cbd912091d25 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:42.976704 18424 leader_election.cc:290] T f68e8047f5ff4aa0b631cbd912091d25 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:42.978036 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68e8047f5ff4aa0b631cbd912091d25" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:42.978658 18317 raft_consensus.cc:515] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:42.979499 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68e8047f5ff4aa0b631cbd912091d25" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
W20260709 12:26:42.979768 18142 leader_election.cc:343] T f68e8047f5ff4aa0b631cbd912091d25 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:42.981335 18141 leader_election.cc:343] T f68e8047f5ff4aa0b631cbd912091d25 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10c938681fc04e66968531267f39f16c (127.9.145.196:37881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:42.981860 18141 leader_election.cc:304] T f68e8047f5ff4aa0b631cbd912091d25 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a08ea42cd3884210924a19c8f570486d; no voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:42.984238 18423 raft_consensus.cc:2749] T f68e8047f5ff4aa0b631cbd912091d25 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:42.987262 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d2f53aff8a45a49cadf9fd72b75ee8" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:42.987993 18252 raft_consensus.cc:3060] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.002393 18303 tablet_bootstrap.cc:492] T f68e8047f5ff4aa0b631cbd912091d25 P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:43.003049 18252 raft_consensus.cc:2468] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 1.
I20260709 12:26:43.003016 18303 ts_tablet_manager.cc:1403] T f68e8047f5ff4aa0b631cbd912091d25 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.126s	user 0.014s	sys 0.000s
I20260709 12:26:43.006667 18303 raft_consensus.cc:359] T f68e8047f5ff4aa0b631cbd912091d25 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:43.007376 18303 raft_consensus.cc:385] T f68e8047f5ff4aa0b631cbd912091d25 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.007665 18303 raft_consensus.cc:740] T f68e8047f5ff4aa0b631cbd912091d25 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.008337 18303 consensus_queue.cc:260] T f68e8047f5ff4aa0b631cbd912091d25 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:43.010632 18317 leader_election.cc:290] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Requested vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:43.016219 18299 tablet_bootstrap.cc:492] T 07d9e11e303c4580a941ccc2943afdd5 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:43.016726 18299 ts_tablet_manager.cc:1403] T 07d9e11e303c4580a941ccc2943afdd5 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.309s	user 0.012s	sys 0.020s
I20260709 12:26:43.018385 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d2f53aff8a45a49cadf9fd72b75ee8" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:43.018802 18298 tablet_bootstrap.cc:654] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.019091 18103 raft_consensus.cc:3060] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.021093 18299 raft_consensus.cc:359] T 07d9e11e303c4580a941ccc2943afdd5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:43.021849 18299 raft_consensus.cc:385] T 07d9e11e303c4580a941ccc2943afdd5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.022131 18299 raft_consensus.cc:740] T 07d9e11e303c4580a941ccc2943afdd5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.022272 17926 catalog_manager.cc:5697] T dda5199333524768beef0903fe39e300 P 3a269a9c95e0476d9e09c25b4b5aaa2c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194). New cstate: current_term: 1 leader_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:43.024089 18303 ts_tablet_manager.cc:1434] T f68e8047f5ff4aa0b631cbd912091d25 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 12:26:43.025290 18303 tablet_bootstrap.cc:492] T 049a535902f64c44bb4e1b9ecc92694c P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:43.026834 18103 raft_consensus.cc:2468] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 1.
I20260709 12:26:43.028414 18299 consensus_queue.cc:260] T 07d9e11e303c4580a941ccc2943afdd5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:43.030174 18299 ts_tablet_manager.cc:1434] T 07d9e11e303c4580a941ccc2943afdd5 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:26:43.031188 18299 tablet_bootstrap.cc:492] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:43.037290 18299 tablet_bootstrap.cc:654] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.040560 18303 tablet_bootstrap.cc:654] T 049a535902f64c44bb4e1b9ecc92694c P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.042754 17992 leader_election.cc:304] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:43.046005 18455 raft_consensus.cc:2804] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:43.046594 18455 raft_consensus.cc:697] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 LEADER]: Becoming Leader. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Running, Role: LEADER
I20260709 12:26:43.047492 18455 consensus_queue.cc:237] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:43.022269 18300 tablet_bootstrap.cc:492] T 07d9e11e303c4580a941ccc2943afdd5 P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:43.052372 18300 ts_tablet_manager.cc:1403] T 07d9e11e303c4580a941ccc2943afdd5 P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.181s	user 0.002s	sys 0.010s
I20260709 12:26:43.056747 18364 consensus_queue.cc:1048] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:43.058703 18299 tablet_bootstrap.cc:492] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:43.059763 18299 ts_tablet_manager.cc:1403] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.003s
I20260709 12:26:43.072772 18303 tablet_bootstrap.cc:492] T 049a535902f64c44bb4e1b9ecc92694c P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:43.121176 18446 raft_consensus.cc:493] T 07d9e11e303c4580a941ccc2943afdd5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.121891 18446 raft_consensus.cc:515] T 07d9e11e303c4580a941ccc2943afdd5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:43.123134 18303 ts_tablet_manager.cc:1403] T 049a535902f64c44bb4e1b9ecc92694c P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.098s	user 0.015s	sys 0.002s
I20260709 12:26:43.124291 18446 leader_election.cc:290] T 07d9e11e303c4580a941ccc2943afdd5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:43.126377 18298 tablet_bootstrap.cc:492] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:43.126931 18298 ts_tablet_manager.cc:1403] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.170s	user 0.012s	sys 0.004s
I20260709 12:26:43.130446 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d9e11e303c4580a941ccc2943afdd5" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:43.130841 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d9e11e303c4580a941ccc2943afdd5" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
W20260709 12:26:43.132483 18067 leader_election.cc:343] T 07d9e11e303c4580a941ccc2943afdd5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10c938681fc04e66968531267f39f16c (127.9.145.196:37881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.132516 18299 raft_consensus.cc:359] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:43.134793 18299 raft_consensus.cc:385] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.135190 18299 raft_consensus.cc:740] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
W20260709 12:26:43.135284 18070 leader_election.cc:343] T 07d9e11e303c4580a941ccc2943afdd5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.135824 18070 leader_election.cc:304] T 07d9e11e303c4580a941ccc2943afdd5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d
I20260709 12:26:43.136618 18299 consensus_queue.cc:260] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:43.136998 18377 raft_consensus.cc:2749] T 07d9e11e303c4580a941ccc2943afdd5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:43.136829 18300 raft_consensus.cc:359] T 07d9e11e303c4580a941ccc2943afdd5 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:43.138696 18300 raft_consensus.cc:385] T 07d9e11e303c4580a941ccc2943afdd5 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.138981 18300 raft_consensus.cc:740] T 07d9e11e303c4580a941ccc2943afdd5 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.139200 18299 ts_tablet_manager.cc:1434] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.079s	user 0.001s	sys 0.025s
I20260709 12:26:43.139712 18300 consensus_queue.cc:260] T 07d9e11e303c4580a941ccc2943afdd5 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:43.140213 18299 tablet_bootstrap.cc:492] T 81710104264d4f3fa7ecf1c48b2b48ca P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:43.145349 18303 raft_consensus.cc:359] T 049a535902f64c44bb4e1b9ecc92694c P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:43.145658 18317 consensus_queue.cc:1048] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:43.146234 18303 raft_consensus.cc:385] T 049a535902f64c44bb4e1b9ecc92694c P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.146623 18303 raft_consensus.cc:740] T 049a535902f64c44bb4e1b9ecc92694c P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.147324 18298 raft_consensus.cc:359] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:43.151660 18300 ts_tablet_manager.cc:1434] T 07d9e11e303c4580a941ccc2943afdd5 P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.099s	user 0.006s	sys 0.005s
I20260709 12:26:43.147343 18303 consensus_queue.cc:260] T 049a535902f64c44bb4e1b9ecc92694c P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:43.155200 18299 tablet_bootstrap.cc:654] T 81710104264d4f3fa7ecf1c48b2b48ca P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.152858 18298 raft_consensus.cc:385] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.157303 18298 raft_consensus.cc:740] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.158315 18303 ts_tablet_manager.cc:1434] T 049a535902f64c44bb4e1b9ecc92694c P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.001s
I20260709 12:26:43.158373 18298 consensus_queue.cc:260] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:43.165577 18298 ts_tablet_manager.cc:1434] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.003s
I20260709 12:26:43.166716 18298 tablet_bootstrap.cc:492] T 07d9e11e303c4580a941ccc2943afdd5 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:43.172978 18298 tablet_bootstrap.cc:654] T 07d9e11e303c4580a941ccc2943afdd5 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.156852 18300 tablet_bootstrap.cc:492] T 049a535902f64c44bb4e1b9ecc92694c P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:43.177481 18449 consensus_queue.cc:1048] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:43.180991 18300 tablet_bootstrap.cc:654] T 049a535902f64c44bb4e1b9ecc92694c P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.159497 18303 tablet_bootstrap.cc:492] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:43.191242 18502 consensus_queue.cc:1048] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:43.199008 18445 raft_consensus.cc:493] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.199681 18445 raft_consensus.cc:515] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:43.206601 18298 tablet_bootstrap.cc:492] T 07d9e11e303c4580a941ccc2943afdd5 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:43.206744 18502 raft_consensus.cc:493] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.205988 18445 leader_election.cc:290] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:43.207309 18502 raft_consensus.cc:515] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:43.209266 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049a535902f64c44bb4e1b9ecc92694c" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:43.209748 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049a535902f64c44bb4e1b9ecc92694c" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:43.209985 18027 raft_consensus.cc:2468] T 049a535902f64c44bb4e1b9ecc92694c P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 0.
I20260709 12:26:43.211541 18502 leader_election.cc:290] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:43.207280 18298 ts_tablet_manager.cc:1403] T 07d9e11e303c4580a941ccc2943afdd5 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.007s
W20260709 12:26:43.213040 18070 leader_election.cc:343] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.214289 18337 consensus_queue.cc:1048] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:43.215160 18333 consensus_queue.cc:1048] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:43.215828 18298 raft_consensus.cc:359] T 07d9e11e303c4580a941ccc2943afdd5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:43.216614 18298 raft_consensus.cc:385] T 07d9e11e303c4580a941ccc2943afdd5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.216894 18298 raft_consensus.cc:740] T 07d9e11e303c4580a941ccc2943afdd5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.217643 18298 consensus_queue.cc:260] T 07d9e11e303c4580a941ccc2943afdd5 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:43.214514 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68e8047f5ff4aa0b631cbd912091d25" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:43.219086 18175 raft_consensus.cc:2468] T f68e8047f5ff4aa0b631cbd912091d25 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 0.
I20260709 12:26:43.220628 18218 leader_election.cc:304] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:43.226052 18068 leader_election.cc:304] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: a08ea42cd3884210924a19c8f570486d
I20260709 12:26:43.226497 18502 raft_consensus.cc:2804] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:43.226956 18502 raft_consensus.cc:493] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.227291 18502 raft_consensus.cc:3060] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.191232 18303 tablet_bootstrap.cc:654] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.228042 18298 ts_tablet_manager.cc:1434] T 07d9e11e303c4580a941ccc2943afdd5 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:26:43.229153 18298 tablet_bootstrap.cc:492] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:43.229059 18445 raft_consensus.cc:2804] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:43.229647 18445 raft_consensus.cc:493] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.230027 18445 raft_consensus.cc:3060] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.235515 18299 tablet_bootstrap.cc:492] T 81710104264d4f3fa7ecf1c48b2b48ca P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:43.236121 18299 ts_tablet_manager.cc:1403] T 81710104264d4f3fa7ecf1c48b2b48ca P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.096s	user 0.014s	sys 0.034s
I20260709 12:26:43.237591 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68e8047f5ff4aa0b631cbd912091d25" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:43.238464 18027 raft_consensus.cc:2468] T f68e8047f5ff4aa0b631cbd912091d25 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 0.
I20260709 12:26:43.241287 18518 consensus_queue.cc:1048] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:43.243712 18298 tablet_bootstrap.cc:654] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.245481 18419 consensus_queue.cc:1048] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:43.254609 18299 raft_consensus.cc:359] T 81710104264d4f3fa7ecf1c48b2b48ca P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:43.255895 18299 raft_consensus.cc:385] T 81710104264d4f3fa7ecf1c48b2b48ca P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.256193 18299 raft_consensus.cc:740] T 81710104264d4f3fa7ecf1c48b2b48ca P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.259057 18299 consensus_queue.cc:260] T 81710104264d4f3fa7ecf1c48b2b48ca P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:43.264225 18299 ts_tablet_manager.cc:1434] T 81710104264d4f3fa7ecf1c48b2b48ca P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.003s
I20260709 12:26:43.279961 18300 tablet_bootstrap.cc:492] T 049a535902f64c44bb4e1b9ecc92694c P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:43.280774 18300 ts_tablet_manager.cc:1403] T 049a535902f64c44bb4e1b9ecc92694c P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.124s	user 0.023s	sys 0.015s
I20260709 12:26:43.279633 18420 raft_consensus.cc:493] T 81710104264d4f3fa7ecf1c48b2b48ca P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.298400 18420 raft_consensus.cc:515] T 81710104264d4f3fa7ecf1c48b2b48ca P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:43.300740 18420 leader_election.cc:290] T 81710104264d4f3fa7ecf1c48b2b48ca P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:43.282748 18502 raft_consensus.cc:515] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:43.301694 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81710104264d4f3fa7ecf1c48b2b48ca" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:43.302867 18502 leader_election.cc:290] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Requested vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:43.303503 18502 raft_consensus.cc:493] T 07d9e11e303c4580a941ccc2943afdd5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.303965 18502 raft_consensus.cc:515] T 07d9e11e303c4580a941ccc2943afdd5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:43.307446 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68e8047f5ff4aa0b631cbd912091d25" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:43.308120 18029 raft_consensus.cc:3060] T f68e8047f5ff4aa0b631cbd912091d25 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.308964 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d9e11e303c4580a941ccc2943afdd5" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:43.309839 18174 raft_consensus.cc:2468] T 07d9e11e303c4580a941ccc2943afdd5 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 0.
I20260709 12:26:43.305861 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81710104264d4f3fa7ecf1c48b2b48ca" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
W20260709 12:26:43.312644 18067 leader_election.cc:343] T 81710104264d4f3fa7ecf1c48b2b48ca P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10c938681fc04e66968531267f39f16c (127.9.145.196:37881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.314312 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d9e11e303c4580a941ccc2943afdd5" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:43.315196 18102 raft_consensus.cc:2468] T 07d9e11e303c4580a941ccc2943afdd5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 0.
I20260709 12:26:43.290345 18300 raft_consensus.cc:359] T 049a535902f64c44bb4e1b9ecc92694c P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:43.316622 18300 raft_consensus.cc:385] T 049a535902f64c44bb4e1b9ecc92694c P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.316953 18300 raft_consensus.cc:740] T 049a535902f64c44bb4e1b9ecc92694c P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.317912 18300 consensus_queue.cc:260] T 049a535902f64c44bb4e1b9ecc92694c P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:43.319800 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68e8047f5ff4aa0b631cbd912091d25" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:43.321442 18176 raft_consensus.cc:3060] T f68e8047f5ff4aa0b631cbd912091d25 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.324069 18298 tablet_bootstrap.cc:492] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:43.324646 18298 ts_tablet_manager.cc:1403] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.096s	user 0.027s	sys 0.006s
I20260709 12:26:43.321331 18300 ts_tablet_manager.cc:1434] T 049a535902f64c44bb4e1b9ecc92694c P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 12:26:43.326165 18300 tablet_bootstrap.cc:492] T 81710104264d4f3fa7ecf1c48b2b48ca P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:43.318832 18215 leader_election.cc:304] T 07d9e11e303c4580a941ccc2943afdd5 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 
W20260709 12:26:43.317695 18070 leader_election.cc:343] T 81710104264d4f3fa7ecf1c48b2b48ca P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.319764 18502 leader_election.cc:290] T 07d9e11e303c4580a941ccc2943afdd5 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:43.324638 17926 catalog_manager.cc:5697] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc reported cstate change: term changed from 0 to 1, leader changed from <none> to ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193). New cstate: current_term: 1 leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:43.331159 18298 raft_consensus.cc:359] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:43.335883 18298 raft_consensus.cc:385] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.336244 18298 raft_consensus.cc:740] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.338658 18299 tablet_bootstrap.cc:492] T 29e1b7b25f15438ba055b0ea299ada27 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:43.342607 18337 raft_consensus.cc:2804] T 07d9e11e303c4580a941ccc2943afdd5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:43.343107 18337 raft_consensus.cc:493] T 07d9e11e303c4580a941ccc2943afdd5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.343451 18337 raft_consensus.cc:3060] T 07d9e11e303c4580a941ccc2943afdd5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.347342 18298 consensus_queue.cc:260] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:43.349622 18298 ts_tablet_manager.cc:1434] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 12:26:43.283237 18445 raft_consensus.cc:515] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:43.355490 18299 tablet_bootstrap.cc:654] T 29e1b7b25f15438ba055b0ea299ada27 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.356137 18445 leader_election.cc:290] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Requested vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:43.337530 18070 leader_election.cc:304] T 81710104264d4f3fa7ecf1c48b2b48ca P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d
I20260709 12:26:43.357906 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049a535902f64c44bb4e1b9ecc92694c" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:43.358700 18028 raft_consensus.cc:3060] T 049a535902f64c44bb4e1b9ecc92694c P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.356901 18303 tablet_bootstrap.cc:492] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:43.359995 18303 ts_tablet_manager.cc:1403] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.201s	user 0.009s	sys 0.007s
I20260709 12:26:43.361958 18298 tablet_bootstrap.cc:492] T 9984112bc75a4e66b55655a1bdd99052 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:43.363175 18303 raft_consensus.cc:359] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:43.384810 18303 raft_consensus.cc:385] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.385025 18303 raft_consensus.cc:740] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
W20260709 12:26:43.370563 18070 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:43695, user_credentials={real_user=slave}} blocked reactor thread for 52923.7us
I20260709 12:26:43.370728 18377 raft_consensus.cc:2749] T 81710104264d4f3fa7ecf1c48b2b48ca P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:43.386163 18303 consensus_queue.cc:260] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:43.391950 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049a535902f64c44bb4e1b9ecc92694c" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:43.379287 18028 raft_consensus.cc:2468] T 049a535902f64c44bb4e1b9ecc92694c P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 1.
I20260709 12:26:43.393361 18029 raft_consensus.cc:2468] T f68e8047f5ff4aa0b631cbd912091d25 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 1.
I20260709 12:26:43.398779 18303 ts_tablet_manager.cc:1434] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 12:26:43.393157 18178 raft_consensus.cc:3060] T 049a535902f64c44bb4e1b9ecc92694c P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.404632 18300 tablet_bootstrap.cc:654] T 81710104264d4f3fa7ecf1c48b2b48ca P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.356926 18445 consensus_queue.cc:1048] T dda5199333524768beef0903fe39e300 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 12:26:43.407474 18303 tablet_bootstrap.cc:492] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:43.421176 18216 leader_election.cc:304] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:43.422292 18419 raft_consensus.cc:2804] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:43.422921 18419 raft_consensus.cc:697] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Becoming Leader. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:26:43.423844 18419 consensus_queue.cc:237] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:43.425881 18298 tablet_bootstrap.cc:654] T 9984112bc75a4e66b55655a1bdd99052 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.413717 18176 raft_consensus.cc:2468] T f68e8047f5ff4aa0b631cbd912091d25 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 1.
I20260709 12:26:43.418941 18068 leader_election.cc:304] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:43.432401 18377 raft_consensus.cc:2804] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:43.433035 18377 raft_consensus.cc:697] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Becoming Leader. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Running, Role: LEADER
I20260709 12:26:43.433962 18377 consensus_queue.cc:237] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:43.439337 18303 tablet_bootstrap.cc:654] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.416149 18337 raft_consensus.cc:515] T 07d9e11e303c4580a941ccc2943afdd5 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:43.452005 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d9e11e303c4580a941ccc2943afdd5" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:43.452802 18103 raft_consensus.cc:3060] T 07d9e11e303c4580a941ccc2943afdd5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.457269 18299 tablet_bootstrap.cc:492] T 29e1b7b25f15438ba055b0ea299ada27 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:43.458745 18298 tablet_bootstrap.cc:492] T 9984112bc75a4e66b55655a1bdd99052 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:43.459590 18298 ts_tablet_manager.cc:1403] T 9984112bc75a4e66b55655a1bdd99052 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.100s	user 0.009s	sys 0.005s
I20260709 12:26:43.457973 18299 ts_tablet_manager.cc:1403] T 29e1b7b25f15438ba055b0ea299ada27 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.120s	user 0.014s	sys 0.007s
I20260709 12:26:43.462917 18492 raft_consensus.cc:493] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.463536 18492 raft_consensus.cc:515] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:43.464484 18298 raft_consensus.cc:359] T 9984112bc75a4e66b55655a1bdd99052 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:43.465796 18492 leader_election.cc:290] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:43.467865 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e1b7b25f15438ba055b0ea299ada27" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:43.468729 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d9e11e303c4580a941ccc2943afdd5" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:43.468045 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e1b7b25f15438ba055b0ea299ada27" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:43.469383 18176 raft_consensus.cc:3060] T 07d9e11e303c4580a941ccc2943afdd5 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.470057 18298 raft_consensus.cc:385] T 9984112bc75a4e66b55655a1bdd99052 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.470534 18298 raft_consensus.cc:740] T 9984112bc75a4e66b55655a1bdd99052 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
W20260709 12:26:43.470719 17992 leader_election.cc:343] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10c938681fc04e66968531267f39f16c (127.9.145.196:37881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.471390 18298 consensus_queue.cc:260] T 9984112bc75a4e66b55655a1bdd99052 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:43.466821 18299 raft_consensus.cc:359] T 29e1b7b25f15438ba055b0ea299ada27 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:43.472689 18299 raft_consensus.cc:385] T 29e1b7b25f15438ba055b0ea299ada27 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.473156 18299 raft_consensus.cc:740] T 29e1b7b25f15438ba055b0ea299ada27 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.473980 18299 consensus_queue.cc:260] T 29e1b7b25f15438ba055b0ea299ada27 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:43.476814 18104 raft_consensus.cc:2468] T 29e1b7b25f15438ba055b0ea299ada27 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 0.
I20260709 12:26:43.479486 18420 consensus_queue.cc:1048] T dda5199333524768beef0903fe39e300 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:43.482672 18299 ts_tablet_manager.cc:1434] T 29e1b7b25f15438ba055b0ea299ada27 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:26:43.476253 18298 ts_tablet_manager.cc:1434] T 9984112bc75a4e66b55655a1bdd99052 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:26:43.484863 18298 tablet_bootstrap.cc:492] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:43.485400 17992 leader_election.cc:304] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 10c938681fc04e66968531267f39f16c
I20260709 12:26:43.486646 18492 raft_consensus.cc:2804] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:43.487057 18492 raft_consensus.cc:493] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.487402 18492 raft_consensus.cc:3060] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.491787 18298 tablet_bootstrap.cc:654] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.487222 18299 tablet_bootstrap.cc:492] T 6cf8e5342a1141b5b3f0ee9ec643beec P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:43.498503 18299 tablet_bootstrap.cc:654] T 6cf8e5342a1141b5b3f0ee9ec643beec P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.496678 18492 raft_consensus.cc:515] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:43.504882 18337 leader_election.cc:290] T 07d9e11e303c4580a941ccc2943afdd5 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Requested vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:43.506635 18492 leader_election.cc:290] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Requested vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:43.507616 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e1b7b25f15438ba055b0ea299ada27" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:43.507956 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e1b7b25f15438ba055b0ea299ada27" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:43.509353 18103 raft_consensus.cc:2468] T 07d9e11e303c4580a941ccc2943afdd5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 1.
W20260709 12:26:43.509622 17992 leader_election.cc:343] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10c938681fc04e66968531267f39f16c (127.9.145.196:37881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.509822 18102 raft_consensus.cc:3060] T 29e1b7b25f15438ba055b0ea299ada27 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.500609 18176 raft_consensus.cc:2468] T 07d9e11e303c4580a941ccc2943afdd5 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 1.
I20260709 12:26:43.511538 18215 leader_election.cc:304] T 07d9e11e303c4580a941ccc2943afdd5 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 
I20260709 12:26:43.515092 18337 raft_consensus.cc:2804] T 07d9e11e303c4580a941ccc2943afdd5 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:43.515632 18337 raft_consensus.cc:697] T 07d9e11e303c4580a941ccc2943afdd5 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Becoming Leader. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:26:43.516414 18298 tablet_bootstrap.cc:492] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:43.517131 18298 ts_tablet_manager.cc:1403] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.000s
I20260709 12:26:43.516559 18337 consensus_queue.cc:237] T 07d9e11e303c4580a941ccc2943afdd5 P 10c938681fc04e66968531267f39f16c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:43.506556 17925 catalog_manager.cc:5697] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194). New cstate: current_term: 1 leader_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:43.520828 18298 raft_consensus.cc:359] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:43.521664 18298 raft_consensus.cc:385] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.521965 18298 raft_consensus.cc:740] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.522783 18298 consensus_queue.cc:260] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:43.526264 18299 tablet_bootstrap.cc:492] T 6cf8e5342a1141b5b3f0ee9ec643beec P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:43.526841 18299 ts_tablet_manager.cc:1403] T 6cf8e5342a1141b5b3f0ee9ec643beec P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.001s
I20260709 12:26:43.529395 18303 tablet_bootstrap.cc:492] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:43.530223 18102 raft_consensus.cc:2468] T 29e1b7b25f15438ba055b0ea299ada27 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 1.
I20260709 12:26:43.531682 18299 raft_consensus.cc:359] T 6cf8e5342a1141b5b3f0ee9ec643beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:43.532446 18299 raft_consensus.cc:385] T 6cf8e5342a1141b5b3f0ee9ec643beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.532743 18299 raft_consensus.cc:740] T 6cf8e5342a1141b5b3f0ee9ec643beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.531119 18303 ts_tablet_manager.cc:1403] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.124s	user 0.017s	sys 0.020s
I20260709 12:26:43.534052 17992 leader_election.cc:304] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 10c938681fc04e66968531267f39f16c
I20260709 12:26:43.536417 18492 raft_consensus.cc:2804] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:43.537016 18492 raft_consensus.cc:697] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 LEADER]: Becoming Leader. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Running, Role: LEADER
I20260709 12:26:43.536936 18299 consensus_queue.cc:260] T 6cf8e5342a1141b5b3f0ee9ec643beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:43.538002 18492 consensus_queue.cc:237] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:43.539641 18299 ts_tablet_manager.cc:1434] T 6cf8e5342a1141b5b3f0ee9ec643beec P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:26:43.531124 18298 ts_tablet_manager.cc:1434] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:26:43.541422 18298 tablet_bootstrap.cc:492] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:43.507573 18178 raft_consensus.cc:2468] T 049a535902f64c44bb4e1b9ecc92694c P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 1.
I20260709 12:26:43.536319 18303 raft_consensus.cc:359] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:43.547587 18303 raft_consensus.cc:385] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.547920 18303 raft_consensus.cc:740] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.548775 18303 consensus_queue.cc:260] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:43.550495 18299 tablet_bootstrap.cc:492] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:43.550758 18300 tablet_bootstrap.cc:492] T 81710104264d4f3fa7ecf1c48b2b48ca P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:43.551277 18300 ts_tablet_manager.cc:1403] T 81710104264d4f3fa7ecf1c48b2b48ca P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.225s	user 0.010s	sys 0.006s
I20260709 12:26:43.554188 18300 raft_consensus.cc:359] T 81710104264d4f3fa7ecf1c48b2b48ca P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:43.554929 18300 raft_consensus.cc:385] T 81710104264d4f3fa7ecf1c48b2b48ca P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.555217 18300 raft_consensus.cc:740] T 81710104264d4f3fa7ecf1c48b2b48ca P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.555856 18300 consensus_queue.cc:260] T 81710104264d4f3fa7ecf1c48b2b48ca P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:43.556442 18299 tablet_bootstrap.cc:654] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.558176 18300 ts_tablet_manager.cc:1434] T 81710104264d4f3fa7ecf1c48b2b48ca P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:43.554221 17923 catalog_manager.cc:5697] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c938681fc04e66968531267f39f16c (127.9.145.196). New cstate: current_term: 1 leader_uuid: "10c938681fc04e66968531267f39f16c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:43.562208 18303 ts_tablet_manager.cc:1434] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:26:43.563414 18303 tablet_bootstrap.cc:492] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:43.564575 18364 consensus_queue.cc:1048] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:43.568797 18419 raft_consensus.cc:493] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.569522 18303 tablet_bootstrap.cc:654] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.570554 18298 tablet_bootstrap.cc:654] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.573398 17927 catalog_manager.cc:5697] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc reported cstate change: term changed from 0 to 1, leader changed from <none> to ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193). New cstate: current_term: 1 leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:43.580310 18423 raft_consensus.cc:493] T 81710104264d4f3fa7ecf1c48b2b48ca P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.580896 18423 raft_consensus.cc:515] T 81710104264d4f3fa7ecf1c48b2b48ca P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:43.574688 18419 raft_consensus.cc:515] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:43.588565 18300 tablet_bootstrap.cc:492] T ebb7b63685e841a2a975e727c46f1b64 P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:43.595925 18300 tablet_bootstrap.cc:654] T ebb7b63685e841a2a975e727c46f1b64 P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.601302 18298 tablet_bootstrap.cc:492] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:43.601330 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81710104264d4f3fa7ecf1c48b2b48ca" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:43.601923 18298 ts_tablet_manager.cc:1403] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.061s	user 0.013s	sys 0.007s
I20260709 12:26:43.602226 18103 raft_consensus.cc:2468] T 81710104264d4f3fa7ecf1c48b2b48ca P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 0.
I20260709 12:26:43.602664 18419 leader_election.cc:290] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:43.603554 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81710104264d4f3fa7ecf1c48b2b48ca" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:43.604282 18176 raft_consensus.cc:2468] T 81710104264d4f3fa7ecf1c48b2b48ca P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 0.
I20260709 12:26:43.604974 18215 leader_election.cc:304] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 
I20260709 12:26:43.604879 18298 raft_consensus.cc:359] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:43.605749 18298 raft_consensus.cc:385] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.606242 18337 raft_consensus.cc:2804] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:43.606670 18337 raft_consensus.cc:493] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.606995 18337 raft_consensus.cc:3060] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.608148 18299 tablet_bootstrap.cc:492] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:43.609452 18299 ts_tablet_manager.cc:1403] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.006s
I20260709 12:26:43.609920 18423 leader_election.cc:290] T 81710104264d4f3fa7ecf1c48b2b48ca P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:43.606048 18298 raft_consensus.cc:740] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.611083 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81710104264d4f3fa7ecf1c48b2b48ca" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:43.611773 18104 raft_consensus.cc:2468] T 81710104264d4f3fa7ecf1c48b2b48ca P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 0.
I20260709 12:26:43.613219 18299 raft_consensus.cc:359] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:43.614040 18299 raft_consensus.cc:385] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.614327 18299 raft_consensus.cc:740] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.615033 18299 consensus_queue.cc:260] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:43.616626 18298 consensus_queue.cc:260] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:43.617957 18141 leader_election.cc:304] T 81710104264d4f3fa7ecf1c48b2b48ca P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:43.619710 18300 tablet_bootstrap.cc:492] T ebb7b63685e841a2a975e727c46f1b64 P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:43.620276 18300 ts_tablet_manager.cc:1403] T ebb7b63685e841a2a975e727c46f1b64 P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.000s
I20260709 12:26:43.620785 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81710104264d4f3fa7ecf1c48b2b48ca" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:43.609313 18492 consensus_queue.cc:1048] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:26:43.620148 18358 raft_consensus.cc:2804] T 81710104264d4f3fa7ecf1c48b2b48ca P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:43.622520 18358 raft_consensus.cc:493] T 81710104264d4f3fa7ecf1c48b2b48ca P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.622887 18358 raft_consensus.cc:3060] T 81710104264d4f3fa7ecf1c48b2b48ca P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.623847 18337 raft_consensus.cc:515] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:43.625198 18252 raft_consensus.cc:2393] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a08ea42cd3884210924a19c8f570486d in current term 1: Already voted for candidate 10c938681fc04e66968531267f39f16c in this term.
I20260709 12:26:43.628232 18300 raft_consensus.cc:359] T ebb7b63685e841a2a975e727c46f1b64 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:43.628726 18337 leader_election.cc:290] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Requested vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:43.628909 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81710104264d4f3fa7ecf1c48b2b48ca" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:43.629873 18300 raft_consensus.cc:385] T ebb7b63685e841a2a975e727c46f1b64 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.630260 18300 raft_consensus.cc:740] T ebb7b63685e841a2a975e727c46f1b64 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.631577 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81710104264d4f3fa7ecf1c48b2b48ca" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:43.632223 18102 raft_consensus.cc:3060] T 81710104264d4f3fa7ecf1c48b2b48ca P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.632788 18298 ts_tablet_manager.cc:1434] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:26:43.631032 18300 consensus_queue.cc:260] T ebb7b63685e841a2a975e727c46f1b64 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:43.633821 18298 tablet_bootstrap.cc:492] T 96957d639eed4a1395857a97a292f8ea P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:43.635619 18300 ts_tablet_manager.cc:1434] T ebb7b63685e841a2a975e727c46f1b64 P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:26:43.641728 18102 raft_consensus.cc:2468] T 81710104264d4f3fa7ecf1c48b2b48ca P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 1.
I20260709 12:26:43.643350 18300 tablet_bootstrap.cc:492] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:43.644336 18215 leader_election.cc:304] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 
I20260709 12:26:43.645126 18337 raft_consensus.cc:2804] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:43.645637 18337 raft_consensus.cc:697] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Becoming Leader. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:26:43.647279 18299 ts_tablet_manager.cc:1434] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:26:43.646533 18337 consensus_queue.cc:237] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:43.648447 18299 tablet_bootstrap.cc:492] T 440b2a57096e45188762ccb05301beec P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:43.650259 18300 tablet_bootstrap.cc:654] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.655519 18419 raft_consensus.cc:493] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.656126 18419 raft_consensus.cc:515] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:43.658515 18419 leader_election.cc:290] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:43.661367 18298 tablet_bootstrap.cc:654] T 96957d639eed4a1395857a97a292f8ea P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.662236 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb7b63685e841a2a975e727c46f1b64" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:43.663041 18178 raft_consensus.cc:2468] T ebb7b63685e841a2a975e727c46f1b64 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 0.
I20260709 12:26:43.666025 18218 leader_election.cc:304] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:43.668094 18333 raft_consensus.cc:2804] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:43.668532 18333 raft_consensus.cc:493] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.668862 18333 raft_consensus.cc:3060] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.669184 18299 tablet_bootstrap.cc:654] T 440b2a57096e45188762ccb05301beec P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.671826 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb7b63685e841a2a975e727c46f1b64" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:43.674531 18303 tablet_bootstrap.cc:492] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:43.675140 18303 ts_tablet_manager.cc:1403] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.112s	user 0.007s	sys 0.011s
W20260709 12:26:43.675485 18216 leader_election.cc:343] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.661078 18358 raft_consensus.cc:515] T 81710104264d4f3fa7ecf1c48b2b48ca P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:43.678139 18303 raft_consensus.cc:359] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:43.679009 18303 raft_consensus.cc:385] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.679138 18175 raft_consensus.cc:2393] T 81710104264d4f3fa7ecf1c48b2b48ca P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c938681fc04e66968531267f39f16c in current term 1: Already voted for candidate a08ea42cd3884210924a19c8f570486d in this term.
I20260709 12:26:43.679327 18303 raft_consensus.cc:740] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.680258 18303 consensus_queue.cc:260] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:43.682592 18298 tablet_bootstrap.cc:492] T 96957d639eed4a1395857a97a292f8ea P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:43.683164 18298 ts_tablet_manager.cc:1403] T 96957d639eed4a1395857a97a292f8ea P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.002s
I20260709 12:26:43.686012 18298 raft_consensus.cc:359] T 96957d639eed4a1395857a97a292f8ea P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:43.686885 18298 raft_consensus.cc:385] T 96957d639eed4a1395857a97a292f8ea P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.687186 18298 raft_consensus.cc:740] T 96957d639eed4a1395857a97a292f8ea P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.690003 18299 tablet_bootstrap.cc:492] T 440b2a57096e45188762ccb05301beec P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:43.690634 18299 ts_tablet_manager.cc:1403] T 440b2a57096e45188762ccb05301beec P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.004s
I20260709 12:26:43.693424 18299 raft_consensus.cc:359] T 440b2a57096e45188762ccb05301beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:43.693892 18333 raft_consensus.cc:515] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:43.694365 18298 consensus_queue.cc:260] T 96957d639eed4a1395857a97a292f8ea P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:43.696964 18298 ts_tablet_manager.cc:1434] T 96957d639eed4a1395857a97a292f8ea P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:26:43.697300 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb7b63685e841a2a975e727c46f1b64" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:43.698222 18299 raft_consensus.cc:385] T 440b2a57096e45188762ccb05301beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.697988 18178 raft_consensus.cc:3060] T ebb7b63685e841a2a975e727c46f1b64 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.697818 18303 ts_tablet_manager.cc:1434] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.002s
I20260709 12:26:43.700814 18303 tablet_bootstrap.cc:492] T ebb7b63685e841a2a975e727c46f1b64 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:43.700944 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb7b63685e841a2a975e727c46f1b64" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
W20260709 12:26:43.702637 18216 leader_election.cc:343] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.704152 18358 leader_election.cc:290] T 81710104264d4f3fa7ecf1c48b2b48ca P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Requested vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:43.704831 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81710104264d4f3fa7ecf1c48b2b48ca" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:43.703707 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81710104264d4f3fa7ecf1c48b2b48ca" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:43.710848 18300 tablet_bootstrap.cc:492] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:43.711405 18102 raft_consensus.cc:2393] T 81710104264d4f3fa7ecf1c48b2b48ca P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a08ea42cd3884210924a19c8f570486d in current term 1: Already voted for candidate 10c938681fc04e66968531267f39f16c in this term.
I20260709 12:26:43.711475 18300 ts_tablet_manager.cc:1403] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.019s
I20260709 12:26:43.718631 18299 raft_consensus.cc:740] T 440b2a57096e45188762ccb05301beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.698132 18298 tablet_bootstrap.cc:492] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:43.759209 18300 raft_consensus.cc:359] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:43.759985 18300 raft_consensus.cc:385] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.759637 18299 consensus_queue.cc:260] T 440b2a57096e45188762ccb05301beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:43.760282 18300 raft_consensus.cc:740] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.761039 18300 consensus_queue.cc:260] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:43.763293 18300 ts_tablet_manager.cc:1434] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:43.760452 17923 catalog_manager.cc:5697] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c938681fc04e66968531267f39f16c (127.9.145.196). New cstate: current_term: 1 leader_uuid: "10c938681fc04e66968531267f39f16c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:43.764644 18300 tablet_bootstrap.cc:492] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:43.764773 18298 tablet_bootstrap.cc:654] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.765060 17923 catalog_manager.cc:5697] T 07d9e11e303c4580a941ccc2943afdd5 P 10c938681fc04e66968531267f39f16c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c938681fc04e66968531267f39f16c (127.9.145.196). New cstate: current_term: 1 leader_uuid: "10c938681fc04e66968531267f39f16c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:43.771211 18300 tablet_bootstrap.cc:654] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.771347 18377 raft_consensus.cc:493] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.771894 18377 raft_consensus.cc:515] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:43.774086 18377 leader_election.cc:290] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:43.778441 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9984112bc75a4e66b55655a1bdd99052" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:43.779290 18252 raft_consensus.cc:2468] T 9984112bc75a4e66b55655a1bdd99052 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 0.
I20260709 12:26:43.780710 18067 leader_election.cc:304] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 
I20260709 12:26:43.782318 18377 raft_consensus.cc:2804] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:43.782832 18377 raft_consensus.cc:493] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.783252 18377 raft_consensus.cc:3060] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.783947 18299 ts_tablet_manager.cc:1434] T 440b2a57096e45188762ccb05301beec P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.093s	user 0.004s	sys 0.002s
I20260709 12:26:43.785234 18299 tablet_bootstrap.cc:492] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:43.787652 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9984112bc75a4e66b55655a1bdd99052" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:43.788509 18029 raft_consensus.cc:2468] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 0.
I20260709 12:26:43.741663 18178 raft_consensus.cc:2468] T ebb7b63685e841a2a975e727c46f1b64 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 1.
I20260709 12:26:43.714263 18364 raft_consensus.cc:493] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.794262 18364 raft_consensus.cc:515] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:43.794816 18218 leader_election.cc:304] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d; no voters: ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:43.796020 18337 raft_consensus.cc:2804] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:43.796557 18364 leader_election.cc:290] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:43.796576 18337 raft_consensus.cc:697] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Becoming Leader. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:26:43.747231 18141 leader_election.cc:304] T 81710104264d4f3fa7ecf1c48b2b48ca P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a08ea42cd3884210924a19c8f570486d; no voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c
I20260709 12:26:43.798694 18423 raft_consensus.cc:2749] T 81710104264d4f3fa7ecf1c48b2b48ca P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:26:43.798854 18141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:45595, user_credentials={real_user=slave}} blocked reactor thread for 51753.1us
I20260709 12:26:43.752341 18333 leader_election.cc:290] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Requested vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:43.741952 18303 tablet_bootstrap.cc:654] T ebb7b63685e841a2a975e727c46f1b64 P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.802835 18337 consensus_queue.cc:237] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:43.803481 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf8e5342a1141b5b3f0ee9ec643beec" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:43.804333 18104 raft_consensus.cc:2468] T 6cf8e5342a1141b5b3f0ee9ec643beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 0.
I20260709 12:26:43.793352 18377 raft_consensus.cc:515] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:43.805586 17992 leader_election.cc:304] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:43.802592 18299 tablet_bootstrap.cc:654] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.807003 18455 raft_consensus.cc:2804] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:43.807440 18455 raft_consensus.cc:493] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.807559 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9984112bc75a4e66b55655a1bdd99052" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:43.808254 18252 raft_consensus.cc:3060] T 9984112bc75a4e66b55655a1bdd99052 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.808708 18300 tablet_bootstrap.cc:492] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:43.809257 18300 ts_tablet_manager.cc:1403] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.021s
I20260709 12:26:43.811123 18298 tablet_bootstrap.cc:492] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:43.811652 18298 ts_tablet_manager.cc:1403] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.114s	user 0.011s	sys 0.000s
I20260709 12:26:43.812201 18300 raft_consensus.cc:359] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:43.812915 18300 raft_consensus.cc:385] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.813185 18300 raft_consensus.cc:740] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.814482 18455 raft_consensus.cc:3060] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.818668 18303 tablet_bootstrap.cc:492] T ebb7b63685e841a2a975e727c46f1b64 P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:43.818917 18377 leader_election.cc:290] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Requested vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:43.819346 18252 raft_consensus.cc:2468] T 9984112bc75a4e66b55655a1bdd99052 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 1.
I20260709 12:26:43.820010 18298 raft_consensus.cc:359] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:43.820745 18298 raft_consensus.cc:385] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.820756 18067 leader_election.cc:304] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 
I20260709 12:26:43.821177 18298 raft_consensus.cc:740] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.819236 18303 ts_tablet_manager.cc:1403] T ebb7b63685e841a2a975e727c46f1b64 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.119s	user 0.020s	sys 0.001s
I20260709 12:26:43.821851 18420 raft_consensus.cc:2804] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:43.818197 18300 consensus_queue.cc:260] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:43.822961 18445 consensus_queue.cc:1048] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:26:43.822052 18298 consensus_queue.cc:260] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:43.826238 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf8e5342a1141b5b3f0ee9ec643beec" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:43.826982 18178 raft_consensus.cc:2468] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 0.
I20260709 12:26:43.822614 18420 raft_consensus.cc:697] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Becoming Leader. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Running, Role: LEADER
I20260709 12:26:43.828553 18298 ts_tablet_manager.cc:1434] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:26:43.828176 18420 consensus_queue.cc:237] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:43.829818 18298 tablet_bootstrap.cc:492] T 7dbf7d84f5ff496e905988250445db74 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:43.825327 18303 raft_consensus.cc:359] T ebb7b63685e841a2a975e727c46f1b64 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:43.833184 18303 raft_consensus.cc:385] T ebb7b63685e841a2a975e727c46f1b64 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.833470 18303 raft_consensus.cc:740] T ebb7b63685e841a2a975e727c46f1b64 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.834892 18303 consensus_queue.cc:260] T ebb7b63685e841a2a975e727c46f1b64 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:43.835387 18358 raft_consensus.cc:493] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.835852 18358 raft_consensus.cc:515] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:43.836896 18299 tablet_bootstrap.cc:492] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:43.837667 18299 ts_tablet_manager.cc:1403] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.014s
I20260709 12:26:43.839067 18303 ts_tablet_manager.cc:1434] T ebb7b63685e841a2a975e727c46f1b64 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:26:43.836948 18300 ts_tablet_manager.cc:1434] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.002s
I20260709 12:26:43.840139 18303 tablet_bootstrap.cc:492] T f124d65e17c143b08d3428ef325ae9a5 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:43.840605 18300 tablet_bootstrap.cc:492] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:43.841133 18358 leader_election.cc:290] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:43.844502 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96957d639eed4a1395857a97a292f8ea" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:43.845400 18252 raft_consensus.cc:2468] T 96957d639eed4a1395857a97a292f8ea P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 0.
I20260709 12:26:43.849860 18298 tablet_bootstrap.cc:654] T 7dbf7d84f5ff496e905988250445db74 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.847116 18300 tablet_bootstrap.cc:654] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.844954 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96957d639eed4a1395857a97a292f8ea" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:43.851261 18141 leader_election.cc:304] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:43.852172 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9984112bc75a4e66b55655a1bdd99052" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:43.852864 18028 raft_consensus.cc:3060] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.852487 18358 raft_consensus.cc:2804] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:26:43.853098 18142 leader_election.cc:343] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.849519 18420 raft_consensus.cc:493] T 440b2a57096e45188762ccb05301beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.855178 18420 raft_consensus.cc:515] T 440b2a57096e45188762ccb05301beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:43.857434 18420 leader_election.cc:290] T 440b2a57096e45188762ccb05301beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:43.858777 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440b2a57096e45188762ccb05301beec" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
W20260709 12:26:43.860411 18070 leader_election.cc:343] T 440b2a57096e45188762ccb05301beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.863531 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440b2a57096e45188762ccb05301beec" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:43.846447 18303 tablet_bootstrap.cc:654] T f124d65e17c143b08d3428ef325ae9a5 P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.865911 18299 raft_consensus.cc:359] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:43.866781 18299 raft_consensus.cc:385] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.867087 18299 raft_consensus.cc:740] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.853515 18358 raft_consensus.cc:493] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.848616 18455 raft_consensus.cc:515] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:43.870601 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf8e5342a1141b5b3f0ee9ec643beec" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:43.870944 18455 leader_election.cc:290] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Requested vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:43.871367 18104 raft_consensus.cc:3060] T 6cf8e5342a1141b5b3f0ee9ec643beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.872422 18299 consensus_queue.cc:260] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:43.875427 18299 ts_tablet_manager.cc:1434] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 12:26:43.877209 18299 tablet_bootstrap.cc:492] T f124d65e17c143b08d3428ef325ae9a5 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:43.878907 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf8e5342a1141b5b3f0ee9ec643beec" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:43.879606 18178 raft_consensus.cc:3060] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.881091 18104 raft_consensus.cc:2468] T 6cf8e5342a1141b5b3f0ee9ec643beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 1.
I20260709 12:26:43.882390 17992 leader_election.cc:304] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:43.883406 18455 raft_consensus.cc:2804] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:43.867654 18358 raft_consensus.cc:3060] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.883975 18455 raft_consensus.cc:697] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc [term 1 LEADER]: Becoming Leader. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Running, Role: LEADER
I20260709 12:26:43.884940 18455 consensus_queue.cc:237] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:43.888159 18298 tablet_bootstrap.cc:492] T 7dbf7d84f5ff496e905988250445db74 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:43.888757 18298 ts_tablet_manager.cc:1403] T 7dbf7d84f5ff496e905988250445db74 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.059s	user 0.020s	sys 0.000s
I20260709 12:26:43.890537 18299 tablet_bootstrap.cc:654] T f124d65e17c143b08d3428ef325ae9a5 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.894948 18298 raft_consensus.cc:359] T 7dbf7d84f5ff496e905988250445db74 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:43.895812 18298 raft_consensus.cc:385] T 7dbf7d84f5ff496e905988250445db74 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.896029 18178 raft_consensus.cc:2468] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 1.
I20260709 12:26:43.896117 18298 raft_consensus.cc:740] T 7dbf7d84f5ff496e905988250445db74 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.900000 18298 consensus_queue.cc:260] T 7dbf7d84f5ff496e905988250445db74 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:43.902276 18298 ts_tablet_manager.cc:1434] T 7dbf7d84f5ff496e905988250445db74 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:26:43.903330 18298 tablet_bootstrap.cc:492] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
W20260709 12:26:43.905055 18068 leader_election.cc:343] T 440b2a57096e45188762ccb05301beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.905653 18068 leader_election.cc:304] T 440b2a57096e45188762ccb05301beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:43.906469 18420 raft_consensus.cc:2749] T 440b2a57096e45188762ccb05301beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:43.908301 18300 tablet_bootstrap.cc:492] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:43.908833 18300 ts_tablet_manager.cc:1403] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.010s
I20260709 12:26:43.909253 18298 tablet_bootstrap.cc:654] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.883497 18028 raft_consensus.cc:2468] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 1.
I20260709 12:26:43.917398 17923 catalog_manager.cc:5697] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc reported cstate change: term changed from 0 to 1, leader changed from <none> to ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193). New cstate: current_term: 1 leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:43.917735 18300 raft_consensus.cc:359] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:43.922214 18298 tablet_bootstrap.cc:492] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:43.922623 18300 raft_consensus.cc:385] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.922912 18298 ts_tablet_manager.cc:1403] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 12:26:43.922976 18300 raft_consensus.cc:740] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.925212 18419 consensus_queue.cc:1048] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:43.925863 18300 consensus_queue.cc:260] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:43.928099 18300 ts_tablet_manager.cc:1434] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:26:43.929131 18300 tablet_bootstrap.cc:492] T 223eb34bd9744014b3c011eebcb37f11 P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:43.930974 18298 raft_consensus.cc:359] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:43.931653 18298 raft_consensus.cc:385] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.931900 18298 raft_consensus.cc:740] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.932583 18298 consensus_queue.cc:260] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:43.937378 18300 tablet_bootstrap.cc:654] T 223eb34bd9744014b3c011eebcb37f11 P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.938848 17927 catalog_manager.cc:5697] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c938681fc04e66968531267f39f16c (127.9.145.196). New cstate: current_term: 1 leader_uuid: "10c938681fc04e66968531267f39f16c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:43.943465 17926 catalog_manager.cc:5697] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194). New cstate: current_term: 1 leader_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:43.947228 18333 consensus_queue.cc:1048] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:43.949361 18358 raft_consensus.cc:515] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:43.950196 18300 tablet_bootstrap.cc:492] T 223eb34bd9744014b3c011eebcb37f11 P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:43.950825 18300 ts_tablet_manager.cc:1403] T 223eb34bd9744014b3c011eebcb37f11 P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.006s
I20260709 12:26:43.953553 18300 raft_consensus.cc:359] T 223eb34bd9744014b3c011eebcb37f11 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:43.954257 18300 raft_consensus.cc:385] T 223eb34bd9744014b3c011eebcb37f11 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.954535 18300 raft_consensus.cc:740] T 223eb34bd9744014b3c011eebcb37f11 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.955161 18300 consensus_queue.cc:260] T 223eb34bd9744014b3c011eebcb37f11 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:43.959262 18300 ts_tablet_manager.cc:1434] T 223eb34bd9744014b3c011eebcb37f11 P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:43.960403 18423 raft_consensus.cc:493] T 223eb34bd9744014b3c011eebcb37f11 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.960996 18423 raft_consensus.cc:515] T 223eb34bd9744014b3c011eebcb37f11 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:43.961659 18298 ts_tablet_manager.cc:1434] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 12:26:43.962769 18298 tablet_bootstrap.cc:492] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:43.963195 18423 leader_election.cc:290] T 223eb34bd9744014b3c011eebcb37f11 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:43.967747 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "223eb34bd9744014b3c011eebcb37f11" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:43.968314 18377 consensus_queue.cc:1048] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:43.969435 18358 leader_election.cc:290] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Requested vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
W20260709 12:26:43.969726 18141 leader_election.cc:343] T 223eb34bd9744014b3c011eebcb37f11 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10c938681fc04e66968531267f39f16c (127.9.145.196:37881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.971127 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96957d639eed4a1395857a97a292f8ea" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:43.971810 18252 raft_consensus.cc:3060] T 96957d639eed4a1395857a97a292f8ea P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.974898 18298 tablet_bootstrap.cc:654] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.975224 18502 consensus_queue.cc:1048] T 07d9e11e303c4580a941ccc2943afdd5 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:43.981995 18252 raft_consensus.cc:2468] T 96957d639eed4a1395857a97a292f8ea P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 1.
I20260709 12:26:43.982826 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "223eb34bd9744014b3c011eebcb37f11" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
W20260709 12:26:43.984632 18141 leader_election.cc:343] T 223eb34bd9744014b3c011eebcb37f11 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.985080 18141 leader_election.cc:304] T 223eb34bd9744014b3c011eebcb37f11 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a08ea42cd3884210924a19c8f570486d; no voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c
I20260709 12:26:43.986801 18358 raft_consensus.cc:2749] T 223eb34bd9744014b3c011eebcb37f11 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:43.983319 18300 tablet_bootstrap.cc:492] T 7dbf7d84f5ff496e905988250445db74 P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:43.985412 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96957d639eed4a1395857a97a292f8ea" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:44.002420 18141 leader_election.cc:304] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:44.003281 18358 raft_consensus.cc:2804] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:44.003778 18358 raft_consensus.cc:697] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Becoming Leader. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Running, Role: LEADER
I20260709 12:26:44.004642 18358 consensus_queue.cc:237] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:44.005671 18300 tablet_bootstrap.cc:654] T 7dbf7d84f5ff496e905988250445db74 P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:44.008880 18142 leader_election.cc:343] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.011693 18364 consensus_queue.cc:1048] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:44.028060 18333 consensus_queue.cc:1048] T 07d9e11e303c4580a941ccc2943afdd5 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:44.033118 18303 tablet_bootstrap.cc:492] T f124d65e17c143b08d3428ef325ae9a5 P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:44.033720 18303 ts_tablet_manager.cc:1403] T f124d65e17c143b08d3428ef325ae9a5 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.194s	user 0.010s	sys 0.000s
I20260709 12:26:44.036639 18303 raft_consensus.cc:359] T f124d65e17c143b08d3428ef325ae9a5 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:44.037370 18303 raft_consensus.cc:385] T f124d65e17c143b08d3428ef325ae9a5 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.037758 18303 raft_consensus.cc:740] T f124d65e17c143b08d3428ef325ae9a5 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.038635 18303 consensus_queue.cc:260] T f124d65e17c143b08d3428ef325ae9a5 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:44.041531 18303 ts_tablet_manager.cc:1434] T f124d65e17c143b08d3428ef325ae9a5 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:44.042778 18303 tablet_bootstrap.cc:492] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:44.045351 18298 tablet_bootstrap.cc:492] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:44.045979 18298 ts_tablet_manager.cc:1403] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.083s	user 0.014s	sys 0.010s
I20260709 12:26:44.047622 18333 raft_consensus.cc:493] T 7dbf7d84f5ff496e905988250445db74 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.048187 18333 raft_consensus.cc:515] T 7dbf7d84f5ff496e905988250445db74 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:44.048880 18298 raft_consensus.cc:359] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:44.049623 18298 raft_consensus.cc:385] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.051473 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dbf7d84f5ff496e905988250445db74" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:44.052778 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dbf7d84f5ff496e905988250445db74" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
W20260709 12:26:44.053040 18218 leader_election.cc:343] T 7dbf7d84f5ff496e905988250445db74 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.051529 18333 leader_election.cc:290] T 7dbf7d84f5ff496e905988250445db74 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
W20260709 12:26:44.054275 18216 leader_election.cc:343] T 7dbf7d84f5ff496e905988250445db74 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.054780 18216 leader_election.cc:304] T 7dbf7d84f5ff496e905988250445db74 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c938681fc04e66968531267f39f16c; no voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:44.049898 18298 raft_consensus.cc:740] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.056234 18333 raft_consensus.cc:2749] T 7dbf7d84f5ff496e905988250445db74 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:44.056388 18298 consensus_queue.cc:260] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:44.061793 18252 raft_consensus.cc:3060] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.063126 18298 ts_tablet_manager.cc:1434] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:26:44.064257 18298 tablet_bootstrap.cc:492] T cba48186789449ef9cae51c546ace419 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:44.065235 18299 tablet_bootstrap.cc:492] T f124d65e17c143b08d3428ef325ae9a5 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:44.066030 18299 ts_tablet_manager.cc:1403] T f124d65e17c143b08d3428ef325ae9a5 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.189s	user 0.011s	sys 0.000s
I20260709 12:26:44.069240 18299 raft_consensus.cc:359] T f124d65e17c143b08d3428ef325ae9a5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:44.070611 18298 tablet_bootstrap.cc:654] T cba48186789449ef9cae51c546ace419 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.086552 18337 raft_consensus.cc:493] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.087188 18337 raft_consensus.cc:515] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:44.089305 18337 leader_election.cc:290] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:44.094805 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e1b7b25f15438ba055b0ea299ada27" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:44.100382 18364 consensus_queue.cc:1048] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:44.102239 17926 catalog_manager.cc:5697] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d reported cstate change: term changed from 0 to 1, leader changed from <none> to a08ea42cd3884210924a19c8f570486d (127.9.145.195). New cstate: current_term: 1 leader_uuid: "a08ea42cd3884210924a19c8f570486d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:44.070039 18299 raft_consensus.cc:385] T f124d65e17c143b08d3428ef325ae9a5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.108601 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e1b7b25f15438ba055b0ea299ada27" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:44.108872 18299 raft_consensus.cc:740] T f124d65e17c143b08d3428ef325ae9a5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.111130 18299 consensus_queue.cc:260] T f124d65e17c143b08d3428ef325ae9a5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:44.113651 18299 ts_tablet_manager.cc:1434] T f124d65e17c143b08d3428ef325ae9a5 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 12:26:44.119645 18299 tablet_bootstrap.cc:492] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:44.125769 18299 tablet_bootstrap.cc:654] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.118220 18303 tablet_bootstrap.cc:654] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.134555 18300 tablet_bootstrap.cc:492] T 7dbf7d84f5ff496e905988250445db74 P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:44.135102 18300 ts_tablet_manager.cc:1403] T 7dbf7d84f5ff496e905988250445db74 P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.175s	user 0.063s	sys 0.025s
I20260709 12:26:44.147802 18300 raft_consensus.cc:359] T 7dbf7d84f5ff496e905988250445db74 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:44.148631 18300 raft_consensus.cc:385] T 7dbf7d84f5ff496e905988250445db74 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.148903 18300 raft_consensus.cc:740] T 7dbf7d84f5ff496e905988250445db74 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.150382 18215 leader_election.cc:304] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c938681fc04e66968531267f39f16c; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:44.149613 18300 consensus_queue.cc:260] T 7dbf7d84f5ff496e905988250445db74 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:44.156893 18446 raft_consensus.cc:493] T f124d65e17c143b08d3428ef325ae9a5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.157512 18446 raft_consensus.cc:515] T f124d65e17c143b08d3428ef325ae9a5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:44.164307 18298 tablet_bootstrap.cc:492] T cba48186789449ef9cae51c546ace419 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:44.164884 18298 ts_tablet_manager.cc:1403] T cba48186789449ef9cae51c546ace419 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.101s	user 0.016s	sys 0.043s
I20260709 12:26:44.158334 18300 ts_tablet_manager.cc:1434] T 7dbf7d84f5ff496e905988250445db74 P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:26:44.159003 18333 raft_consensus.cc:2749] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:44.167742 18298 raft_consensus.cc:359] T cba48186789449ef9cae51c546ace419 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:44.168478 18298 raft_consensus.cc:385] T cba48186789449ef9cae51c546ace419 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.168776 18298 raft_consensus.cc:740] T cba48186789449ef9cae51c546ace419 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.169414 18300 tablet_bootstrap.cc:492] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:44.172320 18419 consensus_queue.cc:1048] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:44.169602 18298 consensus_queue.cc:260] T cba48186789449ef9cae51c546ace419 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:44.181496 18299 tablet_bootstrap.cc:492] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:44.182017 18299 ts_tablet_manager.cc:1403] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.005s
I20260709 12:26:44.187315 18303 tablet_bootstrap.cc:492] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:44.187934 18303 ts_tablet_manager.cc:1403] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.145s	user 0.007s	sys 0.017s
I20260709 12:26:44.189826 18298 ts_tablet_manager.cc:1434] T cba48186789449ef9cae51c546ace419 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 12:26:44.190991 18298 tablet_bootstrap.cc:492] T fa35871af5624c709008fe86090c0ad1 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:44.186896 18446 leader_election.cc:290] T f124d65e17c143b08d3428ef325ae9a5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:44.201675 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f124d65e17c143b08d3428ef325ae9a5" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:44.199648 18419 raft_consensus.cc:493] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.203918 18419 raft_consensus.cc:515] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:44.204201 18299 raft_consensus.cc:359] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:44.205044 18299 raft_consensus.cc:385] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.205372 18299 raft_consensus.cc:740] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.206045 18299 consensus_queue.cc:260] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:44.207252 18250 raft_consensus.cc:2468] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 0.
I20260709 12:26:44.207736 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f124d65e17c143b08d3428ef325ae9a5" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:44.208477 18027 raft_consensus.cc:2468] T f124d65e17c143b08d3428ef325ae9a5 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 0.
I20260709 12:26:44.208643 18299 ts_tablet_manager.cc:1434] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 12:26:44.209749 18299 tablet_bootstrap.cc:492] T d52578a055b2452883b1a598a35ca322 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:44.209961 18419 leader_election.cc:290] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:44.210464 18216 leader_election.cc:304] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:44.211421 18502 raft_consensus.cc:2804] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:44.211862 18502 raft_consensus.cc:493] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.212206 18502 raft_consensus.cc:3060] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.215891 18299 tablet_bootstrap.cc:654] T d52578a055b2452883b1a598a35ca322 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.211277 18419 raft_consensus.cc:493] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.219597 18419 raft_consensus.cc:515] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:44.219972 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f124d65e17c143b08d3428ef325ae9a5" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:44.220876 18027 raft_consensus.cc:2468] T f124d65e17c143b08d3428ef325ae9a5 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 0.
I20260709 12:26:44.224582 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35683295be3042a4bc1839bda16f6f40" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
W20260709 12:26:44.226187 18218 leader_election.cc:343] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.227006 18337 raft_consensus.cc:493] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.227082 18303 raft_consensus.cc:359] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:44.227571 18337 raft_consensus.cc:515] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:44.229413 18067 leader_election.cc:304] T f124d65e17c143b08d3428ef325ae9a5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 
I20260709 12:26:44.230554 18446 raft_consensus.cc:2804] T f124d65e17c143b08d3428ef325ae9a5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:44.230968 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c55f2aea594f27bd7ce646464ea07c" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:44.230994 18446 raft_consensus.cc:493] T f124d65e17c143b08d3428ef325ae9a5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.232437 18446 raft_consensus.cc:3060] T f124d65e17c143b08d3428ef325ae9a5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.237921 18300 tablet_bootstrap.cc:654] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:44.238700 18218 leader_election.cc:343] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.242033 18333 consensus_queue.cc:1048] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:44.242781 18502 raft_consensus.cc:515] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:44.245826 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f124d65e17c143b08d3428ef325ae9a5" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:44.246503 18029 raft_consensus.cc:3060] T f124d65e17c143b08d3428ef325ae9a5 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.229461 18337 leader_election.cc:290] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:44.252493 18419 leader_election.cc:290] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:44.255437 18445 consensus_queue.cc:1048] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:44.257182 18446 raft_consensus.cc:515] T f124d65e17c143b08d3428ef325ae9a5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:44.262290 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35683295be3042a4bc1839bda16f6f40" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:44.262735 18502 leader_election.cc:290] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Requested vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
W20260709 12:26:44.267782 18216 leader_election.cc:343] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.269973 18298 tablet_bootstrap.cc:654] T fa35871af5624c709008fe86090c0ad1 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:44.300571 17975 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:44.227916 18303 raft_consensus.cc:385] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.269522 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f124d65e17c143b08d3428ef325ae9a5" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:44.301319 18303 raft_consensus.cc:740] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.301779 18101 raft_consensus.cc:2393] T f124d65e17c143b08d3428ef325ae9a5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c938681fc04e66968531267f39f16c in current term 1: Already voted for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in this term.
I20260709 12:26:44.302281 18303 consensus_queue.cc:260] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:44.268642 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c55f2aea594f27bd7ce646464ea07c" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:44.270148 18216 leader_election.cc:304] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c938681fc04e66968531267f39f16c; no voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:44.268143 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f124d65e17c143b08d3428ef325ae9a5" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:44.305572 18303 ts_tablet_manager.cc:1434] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.117s	user 0.007s	sys 0.000s
I20260709 12:26:44.305917 18103 raft_consensus.cc:2393] T f124d65e17c143b08d3428ef325ae9a5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c938681fc04e66968531267f39f16c in current term 1: Already voted for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in this term.
I20260709 12:26:44.306751 18333 raft_consensus.cc:2749] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:44.275619 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f124d65e17c143b08d3428ef325ae9a5" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:44.306682 18303 tablet_bootstrap.cc:492] T 96957d639eed4a1395857a97a292f8ea P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:44.271431 18446 leader_election.cc:290] T f124d65e17c143b08d3428ef325ae9a5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Requested vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:44.283316 18377 raft_consensus.cc:493] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.308398 18377 raft_consensus.cc:515] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:44.276798 18455 raft_consensus.cc:493] T ebb7b63685e841a2a975e727c46f1b64 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.310518 18377 leader_election.cc:290] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:44.310421 18455 raft_consensus.cc:515] T ebb7b63685e841a2a975e727c46f1b64 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:44.311622 18102 raft_consensus.cc:2468] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 0.
I20260709 12:26:44.312951 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c55f2aea594f27bd7ce646464ea07c" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:44.287701 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f124d65e17c143b08d3428ef325ae9a5" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:44.286574 18419 consensus_queue.cc:1048] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:44.313995 18303 tablet_bootstrap.cc:654] T 96957d639eed4a1395857a97a292f8ea P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.313871 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c55f2aea594f27bd7ce646464ea07c" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:44.294276 18445 consensus_queue.cc:1048] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:44.315570 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb7b63685e841a2a975e727c46f1b64" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:44.313674 18026 raft_consensus.cc:3060] T ebb7b63685e841a2a975e727c46f1b64 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:44.317695 18070 leader_election.cc:343] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.314169 18250 raft_consensus.cc:2393] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in current term 1: Already voted for candidate 10c938681fc04e66968531267f39f16c in this term.
I20260709 12:26:44.312844 18455 leader_election.cc:290] T ebb7b63685e841a2a975e727c46f1b64 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:44.313633 18252 raft_consensus.cc:2468] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 0.
I20260709 12:26:44.324101 18067 leader_election.cc:304] T f124d65e17c143b08d3428ef325ae9a5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:44.324944 18215 leader_election.cc:304] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: a08ea42cd3884210924a19c8f570486d
I20260709 12:26:44.325138 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb7b63685e841a2a975e727c46f1b64" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:44.325421 18445 raft_consensus.cc:2749] T f124d65e17c143b08d3428ef325ae9a5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:44.326081 18419 raft_consensus.cc:2804] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:44.326525 18419 raft_consensus.cc:493] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.326867 18419 raft_consensus.cc:3060] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.300861 18299 tablet_bootstrap.cc:492] T d52578a055b2452883b1a598a35ca322 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:44.327906 18299 ts_tablet_manager.cc:1403] T d52578a055b2452883b1a598a35ca322 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.118s	user 0.047s	sys 0.020s
I20260709 12:26:44.326953 17995 leader_election.cc:304] T ebb7b63685e841a2a975e727c46f1b64 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac42e2bcf9ac42448a84370269bc6ccc; no voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d
I20260709 12:26:44.325192 18067 leader_election.cc:304] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: a08ea42cd3884210924a19c8f570486d
I20260709 12:26:44.297881 18029 raft_consensus.cc:2468] T f124d65e17c143b08d3428ef325ae9a5 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 1.
I20260709 12:26:44.332670 18445 raft_consensus.cc:2804] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:44.333122 18445 raft_consensus.cc:493] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.333529 18445 raft_consensus.cc:3060] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.331854 18299 raft_consensus.cc:359] T d52578a055b2452883b1a598a35ca322 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:44.334043 18299 raft_consensus.cc:385] T d52578a055b2452883b1a598a35ca322 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.334370 18299 raft_consensus.cc:740] T d52578a055b2452883b1a598a35ca322 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.335117 18299 consensus_queue.cc:260] T d52578a055b2452883b1a598a35ca322 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:44.337733 18299 ts_tablet_manager.cc:1434] T d52578a055b2452883b1a598a35ca322 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:26:44.338819 18299 tablet_bootstrap.cc:492] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:44.333156 18298 tablet_bootstrap.cc:492] T fa35871af5624c709008fe86090c0ad1 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:44.343479 18298 ts_tablet_manager.cc:1403] T fa35871af5624c709008fe86090c0ad1 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.153s	user 0.008s	sys 0.002s
I20260709 12:26:44.295570 18300 tablet_bootstrap.cc:492] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:44.345906 18455 raft_consensus.cc:2749] T ebb7b63685e841a2a975e727c46f1b64 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:44.346514 18300 ts_tablet_manager.cc:1403] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.178s	user 0.012s	sys 0.000s
I20260709 12:26:44.349491 18300 raft_consensus.cc:359] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:44.355876 18303 tablet_bootstrap.cc:492] T 96957d639eed4a1395857a97a292f8ea P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:44.373395 18303 ts_tablet_manager.cc:1403] T 96957d639eed4a1395857a97a292f8ea P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.010s
I20260709 12:26:44.356320 18299 tablet_bootstrap.cc:654] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.377666 18303 raft_consensus.cc:359] T 96957d639eed4a1395857a97a292f8ea P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:44.378427 18303 raft_consensus.cc:385] T 96957d639eed4a1395857a97a292f8ea P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.378718 18303 raft_consensus.cc:740] T 96957d639eed4a1395857a97a292f8ea P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.379362 18300 raft_consensus.cc:385] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.379688 18300 raft_consensus.cc:740] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.380445 18300 consensus_queue.cc:260] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:44.382521 18568 raft_consensus.cc:493] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.383106 18568 raft_consensus.cc:515] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:44.383291 18445 raft_consensus.cc:515] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:44.387413 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52578a055b2452883b1a598a35ca322" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:44.389771 18026 raft_consensus.cc:2468] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 0.
I20260709 12:26:44.357615 18419 raft_consensus.cc:515] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:44.350732 18298 raft_consensus.cc:359] T fa35871af5624c709008fe86090c0ad1 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:44.360517 18216 leader_election.cc:304] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c
I20260709 12:26:44.390666 18298 raft_consensus.cc:385] T fa35871af5624c709008fe86090c0ad1 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.391010 18298 raft_consensus.cc:740] T fa35871af5624c709008fe86090c0ad1 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.391744 18298 consensus_queue.cc:260] T fa35871af5624c709008fe86090c0ad1 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:44.392530 18337 raft_consensus.cc:2804] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:44.392779 18445 leader_election.cc:290] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Requested vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:44.382627 18300 ts_tablet_manager.cc:1434] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.003s
I20260709 12:26:44.395740 18300 tablet_bootstrap.cc:492] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:44.391129 18303 consensus_queue.cc:260] T 96957d639eed4a1395857a97a292f8ea P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:44.396409 18419 leader_election.cc:290] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Requested vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:44.397960 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c55f2aea594f27bd7ce646464ea07c" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:44.398496 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c55f2aea594f27bd7ce646464ea07c" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:44.399394 18250 raft_consensus.cc:2393] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in current term 1: Already voted for candidate 10c938681fc04e66968531267f39f16c in this term.
W20260709 12:26:44.399510 18218 leader_election.cc:343] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.400750 18303 ts_tablet_manager.cc:1434] T 96957d639eed4a1395857a97a292f8ea P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:26:44.395785 18333 consensus_queue.cc:1048] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:26:44.403800 18446 raft_consensus.cc:493] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.404182 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c55f2aea594f27bd7ce646464ea07c" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:44.404429 18446 raft_consensus.cc:515] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:44.400954 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c55f2aea594f27bd7ce646464ea07c" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
W20260709 12:26:44.405943 18070 leader_election.cc:343] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.406461 18070 leader_election.cc:304] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d
I20260709 12:26:44.387668 18568 leader_election.cc:290] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:44.407948 18446 leader_election.cc:290] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:44.408761 18303 tablet_bootstrap.cc:492] T 7dbf7d84f5ff496e905988250445db74 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:44.406627 18103 raft_consensus.cc:2393] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c938681fc04e66968531267f39f16c in current term 1: Already voted for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in this term.
I20260709 12:26:44.410367 18518 consensus_queue.cc:1048] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:44.410692 18420 raft_consensus.cc:2749] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:44.411746 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "223eb34bd9744014b3c011eebcb37f11" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:44.407967 18300 tablet_bootstrap.cc:654] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.415617 18142 leader_election.cc:304] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:44.420331 18358 raft_consensus.cc:2804] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:44.420804 18358 raft_consensus.cc:493] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.421123 18358 raft_consensus.cc:3060] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.426486 18299 tablet_bootstrap.cc:492] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:44.426798 18303 tablet_bootstrap.cc:654] T 7dbf7d84f5ff496e905988250445db74 P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.387578 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52578a055b2452883b1a598a35ca322" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:44.430714 18102 raft_consensus.cc:2468] T d52578a055b2452883b1a598a35ca322 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 0.
I20260709 12:26:44.430904 18299 ts_tablet_manager.cc:1403] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.092s	user 0.010s	sys 0.002s
I20260709 12:26:44.435631 18215 leader_election.cc:304] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c938681fc04e66968531267f39f16c; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d
I20260709 12:26:44.435837 18518 consensus_queue.cc:1048] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:44.436514 18067 leader_election.cc:343] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10c938681fc04e66968531267f39f16c (127.9.145.196:37881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.438228 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "223eb34bd9744014b3c011eebcb37f11" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:44.438711 18333 raft_consensus.cc:2749] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:44.439191 18178 raft_consensus.cc:2468] T 223eb34bd9744014b3c011eebcb37f11 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 0.
I20260709 12:26:44.443637 18299 raft_consensus.cc:359] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:44.444506 18299 raft_consensus.cc:385] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.444795 18299 raft_consensus.cc:740] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.452184 18299 consensus_queue.cc:260] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:44.465401 18070 leader_election.cc:304] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 10c938681fc04e66968531267f39f16c
I20260709 12:26:44.467806 18377 raft_consensus.cc:2804] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:44.468252 18377 raft_consensus.cc:493] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.468600 18377 raft_consensus.cc:3060] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.470732 18518 raft_consensus.cc:493] T 96957d639eed4a1395857a97a292f8ea P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.471292 18518 raft_consensus.cc:515] T 96957d639eed4a1395857a97a292f8ea P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:44.473503 18518 leader_election.cc:290] T 96957d639eed4a1395857a97a292f8ea P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:44.475587 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96957d639eed4a1395857a97a292f8ea" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:44.476425 18252 raft_consensus.cc:2393] T 96957d639eed4a1395857a97a292f8ea P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac42e2bcf9ac42448a84370269bc6ccc in current term 1: Already voted for candidate a08ea42cd3884210924a19c8f570486d in this term.
I20260709 12:26:44.480733 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96957d639eed4a1395857a97a292f8ea" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:44.483578 18026 raft_consensus.cc:3060] T 96957d639eed4a1395857a97a292f8ea P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.483665 17995 leader_election.cc:304] T 96957d639eed4a1395857a97a292f8ea P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac42e2bcf9ac42448a84370269bc6ccc; no voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d
I20260709 12:26:44.485347 18502 raft_consensus.cc:493] T fa35871af5624c709008fe86090c0ad1 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.486860 18502 raft_consensus.cc:515] T fa35871af5624c709008fe86090c0ad1 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:44.492693 18358 raft_consensus.cc:515] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:44.495765 18337 raft_consensus.cc:697] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Becoming Leader. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:26:44.498934 18337 consensus_queue.cc:237] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:44.501441 18299 ts_tablet_manager.cc:1434] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.000s
I20260709 12:26:44.502905 18299 tablet_bootstrap.cc:492] T cba48186789449ef9cae51c546ace419 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:44.507426 18298 ts_tablet_manager.cc:1434] T fa35871af5624c709008fe86090c0ad1 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.164s	user 0.021s	sys 0.047s
I20260709 12:26:44.510484 18298 tablet_bootstrap.cc:492] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:44.511709 18518 raft_consensus.cc:2749] T 96957d639eed4a1395857a97a292f8ea P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:44.529191 18358 leader_election.cc:290] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Requested vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:44.535318 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52578a055b2452883b1a598a35ca322" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:44.506407 18568 consensus_queue.cc:1048] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 12:26:44.536926 18423 consensus_queue.cc:1048] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:44.543956 18303 tablet_bootstrap.cc:492] T 7dbf7d84f5ff496e905988250445db74 P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:44.544641 18303 ts_tablet_manager.cc:1403] T 7dbf7d84f5ff496e905988250445db74 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.136s	user 0.013s	sys 0.003s
I20260709 12:26:44.546705 18377 raft_consensus.cc:515] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:44.553651 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "223eb34bd9744014b3c011eebcb37f11" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:44.561996 18103 raft_consensus.cc:3060] T d52578a055b2452883b1a598a35ca322 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.577409 18303 raft_consensus.cc:359] T 7dbf7d84f5ff496e905988250445db74 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:44.579325 18303 raft_consensus.cc:385] T 7dbf7d84f5ff496e905988250445db74 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.579689 18303 raft_consensus.cc:740] T 7dbf7d84f5ff496e905988250445db74 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.556646 18377 leader_election.cc:290] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Requested vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:44.582437 18303 consensus_queue.cc:260] T 7dbf7d84f5ff496e905988250445db74 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:44.570753 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "223eb34bd9744014b3c011eebcb37f11" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:44.584611 18568 raft_consensus.cc:493] T 7dbf7d84f5ff496e905988250445db74 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.589285 18568 raft_consensus.cc:515] T 7dbf7d84f5ff496e905988250445db74 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:44.590350 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52578a055b2452883b1a598a35ca322" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:44.591042 18026 raft_consensus.cc:3060] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.594374 18502 leader_election.cc:290] T fa35871af5624c709008fe86090c0ad1 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
W20260709 12:26:44.574039 18067 leader_election.cc:343] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10c938681fc04e66968531267f39f16c (127.9.145.196:37881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.601154 18303 ts_tablet_manager.cc:1434] T 7dbf7d84f5ff496e905988250445db74 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.056s	user 0.010s	sys 0.000s
I20260709 12:26:44.602051 18303 tablet_bootstrap.cc:492] T 440b2a57096e45188762ccb05301beec P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:44.600183 18176 raft_consensus.cc:3060] T 223eb34bd9744014b3c011eebcb37f11 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.614207 17926 catalog_manager.cc:5697] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c938681fc04e66968531267f39f16c (127.9.145.196). New cstate: current_term: 1 leader_uuid: "10c938681fc04e66968531267f39f16c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:44.611047 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa35871af5624c709008fe86090c0ad1" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:44.622746 18300 tablet_bootstrap.cc:492] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:44.623255 18300 ts_tablet_manager.cc:1403] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.228s	user 0.030s	sys 0.017s
I20260709 12:26:44.628999 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dbf7d84f5ff496e905988250445db74" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:44.629797 18250 raft_consensus.cc:2468] T 7dbf7d84f5ff496e905988250445db74 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 0.
I20260709 12:26:44.635355 18300 raft_consensus.cc:359] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:44.638265 18300 raft_consensus.cc:385] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.638615 18300 raft_consensus.cc:740] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.639452 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa35871af5624c709008fe86090c0ad1" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
W20260709 12:26:44.633138 18216 leader_election.cc:343] T fa35871af5624c709008fe86090c0ad1 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.644111 18298 tablet_bootstrap.cc:654] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:44.659157 18218 leader_election.cc:343] T fa35871af5624c709008fe86090c0ad1 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.659739 18218 leader_election.cc:304] T fa35871af5624c709008fe86090c0ad1 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c938681fc04e66968531267f39f16c; no voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:44.661283 18502 raft_consensus.cc:2749] T fa35871af5624c709008fe86090c0ad1 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:44.662573 18141 leader_election.cc:304] T 7dbf7d84f5ff496e905988250445db74 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:44.650296 18568 leader_election.cc:290] T 7dbf7d84f5ff496e905988250445db74 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:44.668226 18300 consensus_queue.cc:260] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:44.671053 18423 raft_consensus.cc:2804] T 7dbf7d84f5ff496e905988250445db74 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:44.671556 18423 raft_consensus.cc:493] T 7dbf7d84f5ff496e905988250445db74 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.671980 18423 raft_consensus.cc:3060] T 7dbf7d84f5ff496e905988250445db74 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.672509 18026 raft_consensus.cc:2468] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 1.
I20260709 12:26:44.673527 18337 raft_consensus.cc:493] T cba48186789449ef9cae51c546ace419 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.678083 18300 ts_tablet_manager.cc:1434] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.000s
I20260709 12:26:44.675647 18337 raft_consensus.cc:515] T cba48186789449ef9cae51c546ace419 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:44.692902 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba48186789449ef9cae51c546ace419" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
W20260709 12:26:44.694588 18215 leader_election.cc:343] T cba48186789449ef9cae51c546ace419 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.695524 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dbf7d84f5ff496e905988250445db74" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:44.698511 18026 raft_consensus.cc:2468] T 7dbf7d84f5ff496e905988250445db74 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 0.
I20260709 12:26:44.702593 18303 tablet_bootstrap.cc:654] T 440b2a57096e45188762ccb05301beec P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.702661 18358 raft_consensus.cc:493] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.703384 18358 raft_consensus.cc:515] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:44.705708 18358 leader_election.cc:290] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:44.707427 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440b2a57096e45188762ccb05301beec" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:44.708168 18102 raft_consensus.cc:2468] T 440b2a57096e45188762ccb05301beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 0.
I20260709 12:26:44.709774 18337 leader_election.cc:290] T cba48186789449ef9cae51c546ace419 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:44.702847 18299 tablet_bootstrap.cc:654] T cba48186789449ef9cae51c546ace419 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.712123 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba48186789449ef9cae51c546ace419" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
W20260709 12:26:44.713904 18218 leader_election.cc:343] T cba48186789449ef9cae51c546ace419 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.714536 18218 leader_election.cc:304] T cba48186789449ef9cae51c546ace419 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c938681fc04e66968531267f39f16c; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d
I20260709 12:26:44.716328 18591 raft_consensus.cc:2749] T cba48186789449ef9cae51c546ace419 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:44.716872 18445 raft_consensus.cc:493] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.717550 18445 raft_consensus.cc:515] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:44.730619 18300 tablet_bootstrap.cc:492] T 57c55f2aea594f27bd7ce646464ea07c P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:44.733685 18445 leader_election.cc:290] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:44.737426 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cffccb3c736b4f0fa0789217fa65dc2c" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:44.738425 18141 leader_election.cc:304] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:44.738986 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cffccb3c736b4f0fa0789217fa65dc2c" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
W20260709 12:26:44.739143 18068 leader_election.cc:343] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.739933 18601 raft_consensus.cc:2804] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:44.740379 18601 raft_consensus.cc:493] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.740726 18601 raft_consensus.cc:3060] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:44.745890 18067 leader_election.cc:343] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10c938681fc04e66968531267f39f16c (127.9.145.196:37881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.746539 18067 leader_election.cc:304] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:44.748126 18446 raft_consensus.cc:2749] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:44.749423 18300 tablet_bootstrap.cc:654] T 57c55f2aea594f27bd7ce646464ea07c P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.750281 18103 raft_consensus.cc:2468] T d52578a055b2452883b1a598a35ca322 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 1.
I20260709 12:26:44.750555 18601 raft_consensus.cc:515] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:44.751827 18141 leader_election.cc:304] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:44.753877 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440b2a57096e45188762ccb05301beec" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:44.756959 18423 raft_consensus.cc:515] T 7dbf7d84f5ff496e905988250445db74 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:44.759524 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440b2a57096e45188762ccb05301beec" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:44.759837 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dbf7d84f5ff496e905988250445db74" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:44.760316 18103 raft_consensus.cc:3060] T 440b2a57096e45188762ccb05301beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.760507 18250 raft_consensus.cc:3060] T 7dbf7d84f5ff496e905988250445db74 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.752818 18358 raft_consensus.cc:2804] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:44.769346 18298 tablet_bootstrap.cc:492] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:44.770685 18298 ts_tablet_manager.cc:1403] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.262s	user 0.017s	sys 0.009s
I20260709 12:26:44.748328 18176 raft_consensus.cc:2468] T 223eb34bd9744014b3c011eebcb37f11 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 1.
I20260709 12:26:44.764726 18601 leader_election.cc:290] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Requested vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
W20260709 12:26:44.774704 18142 leader_election.cc:343] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.774739 18070 leader_election.cc:304] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 10c938681fc04e66968531267f39f16c
I20260709 12:26:44.776315 18358 raft_consensus.cc:697] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Becoming Leader. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Running, Role: LEADER
I20260709 12:26:44.776660 18446 raft_consensus.cc:2804] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:44.777331 18446 raft_consensus.cc:697] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Becoming Leader. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Running, Role: LEADER
I20260709 12:26:44.778434 18446 consensus_queue.cc:237] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:44.777453 18358 consensus_queue.cc:237] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:44.783296 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440b2a57096e45188762ccb05301beec" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:44.787571 18423 leader_election.cc:290] T 7dbf7d84f5ff496e905988250445db74 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Requested vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
W20260709 12:26:44.788796 18142 leader_election.cc:343] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.793181 18250 raft_consensus.cc:2468] T 7dbf7d84f5ff496e905988250445db74 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 1.
I20260709 12:26:44.795264 18298 raft_consensus.cc:359] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:44.797111 18298 raft_consensus.cc:385] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.797477 18298 raft_consensus.cc:740] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.798388 18298 consensus_queue.cc:260] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:44.797366 18141 leader_election.cc:304] T 7dbf7d84f5ff496e905988250445db74 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:44.806742 18298 ts_tablet_manager.cc:1434] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.004s
I20260709 12:26:44.808686 18298 tablet_bootstrap.cc:492] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:44.808821 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dbf7d84f5ff496e905988250445db74" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:44.812325 18027 raft_consensus.cc:3060] T 7dbf7d84f5ff496e905988250445db74 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.814926 18103 raft_consensus.cc:2468] T 440b2a57096e45188762ccb05301beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 1.
I20260709 12:26:44.807778 18568 raft_consensus.cc:2804] T 7dbf7d84f5ff496e905988250445db74 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:44.816134 18568 raft_consensus.cc:697] T 7dbf7d84f5ff496e905988250445db74 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Becoming Leader. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Running, Role: LEADER
I20260709 12:26:44.816352 18141 leader_election.cc:304] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:44.824399 18423 raft_consensus.cc:2804] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:44.825073 18423 raft_consensus.cc:697] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Becoming Leader. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Running, Role: LEADER
I20260709 12:26:44.826020 18423 consensus_queue.cc:237] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:44.826923 18303 tablet_bootstrap.cc:492] T 440b2a57096e45188762ccb05301beec P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:44.827493 18303 ts_tablet_manager.cc:1403] T 440b2a57096e45188762ccb05301beec P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.226s	user 0.018s	sys 0.014s
I20260709 12:26:44.830427 18027 raft_consensus.cc:2468] T 7dbf7d84f5ff496e905988250445db74 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 1.
I20260709 12:26:44.825063 18568 consensus_queue.cc:237] T 7dbf7d84f5ff496e905988250445db74 P a08ea42cd3884210924a19c8f570486d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:44.832038 18303 raft_consensus.cc:359] T 440b2a57096e45188762ccb05301beec P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:44.832754 18303 raft_consensus.cc:385] T 440b2a57096e45188762ccb05301beec P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.832975 18303 raft_consensus.cc:740] T 440b2a57096e45188762ccb05301beec P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.833600 18303 consensus_queue.cc:260] T 440b2a57096e45188762ccb05301beec P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:44.836690 18303 ts_tablet_manager.cc:1434] T 440b2a57096e45188762ccb05301beec P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:26:44.837862 18303 tablet_bootstrap.cc:492] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:44.842386 18298 tablet_bootstrap.cc:654] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.858788 18303 tablet_bootstrap.cc:654] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.865638 18300 tablet_bootstrap.cc:492] T 57c55f2aea594f27bd7ce646464ea07c P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:44.866235 18300 ts_tablet_manager.cc:1403] T 57c55f2aea594f27bd7ce646464ea07c P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.136s	user 0.016s	sys 0.013s
I20260709 12:26:44.874831 18299 tablet_bootstrap.cc:492] T cba48186789449ef9cae51c546ace419 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:44.875464 18299 ts_tablet_manager.cc:1403] T cba48186789449ef9cae51c546ace419 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.373s	user 0.048s	sys 0.017s
I20260709 12:26:44.878376 18299 raft_consensus.cc:359] T cba48186789449ef9cae51c546ace419 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:44.879108 18299 raft_consensus.cc:385] T cba48186789449ef9cae51c546ace419 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.879397 18299 raft_consensus.cc:740] T cba48186789449ef9cae51c546ace419 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.880066 18299 consensus_queue.cc:260] T cba48186789449ef9cae51c546ace419 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:44.881659 18300 raft_consensus.cc:359] T 57c55f2aea594f27bd7ce646464ea07c P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:44.882431 18300 raft_consensus.cc:385] T 57c55f2aea594f27bd7ce646464ea07c P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.882712 18300 raft_consensus.cc:740] T 57c55f2aea594f27bd7ce646464ea07c P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.880954 17924 catalog_manager.cc:5697] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d reported cstate change: term changed from 0 to 1, leader changed from <none> to a08ea42cd3884210924a19c8f570486d (127.9.145.195). New cstate: current_term: 1 leader_uuid: "a08ea42cd3884210924a19c8f570486d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:44.883428 18300 consensus_queue.cc:260] T 57c55f2aea594f27bd7ce646464ea07c P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:44.868642 17927 catalog_manager.cc:5697] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194). New cstate: current_term: 1 leader_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:44.887892 18300 ts_tablet_manager.cc:1434] T 57c55f2aea594f27bd7ce646464ea07c P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:26:44.889029 18300 tablet_bootstrap.cc:492] T cba48186789449ef9cae51c546ace419 P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:44.898579 18299 ts_tablet_manager.cc:1434] T cba48186789449ef9cae51c546ace419 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 12:26:44.899150 18303 tablet_bootstrap.cc:492] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:44.899775 18299 tablet_bootstrap.cc:492] T 3463ec2e9f294668adae229e2814b1cf P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:44.899784 18303 ts_tablet_manager.cc:1403] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.062s	user 0.008s	sys 0.011s
I20260709 12:26:44.907936 18300 tablet_bootstrap.cc:654] T cba48186789449ef9cae51c546ace419 P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.911785 18299 tablet_bootstrap.cc:654] T 3463ec2e9f294668adae229e2814b1cf P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.911558 18303 raft_consensus.cc:359] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:44.912542 18303 raft_consensus.cc:385] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.912927 18303 raft_consensus.cc:740] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.915059 18303 consensus_queue.cc:260] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:44.919725 18303 ts_tablet_manager.cc:1434] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:26:44.921123 18303 tablet_bootstrap.cc:492] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:44.926038 18300 tablet_bootstrap.cc:492] T cba48186789449ef9cae51c546ace419 P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:44.926690 18300 ts_tablet_manager.cc:1403] T cba48186789449ef9cae51c546ace419 P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.002s
I20260709 12:26:44.929193 18303 tablet_bootstrap.cc:654] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.930085 18300 raft_consensus.cc:359] T cba48186789449ef9cae51c546ace419 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:44.930953 18300 raft_consensus.cc:385] T cba48186789449ef9cae51c546ace419 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.931231 18300 raft_consensus.cc:740] T cba48186789449ef9cae51c546ace419 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.934082 18299 tablet_bootstrap.cc:492] T 3463ec2e9f294668adae229e2814b1cf P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:44.934823 18299 ts_tablet_manager.cc:1403] T 3463ec2e9f294668adae229e2814b1cf P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.004s
I20260709 12:26:44.932279 18300 consensus_queue.cc:260] T cba48186789449ef9cae51c546ace419 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:44.940641 18300 ts_tablet_manager.cc:1434] T cba48186789449ef9cae51c546ace419 P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:26:44.941838 18300 tablet_bootstrap.cc:492] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:44.942976 18303 tablet_bootstrap.cc:492] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:44.943113 18299 raft_consensus.cc:359] T 3463ec2e9f294668adae229e2814b1cf P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:44.943761 18303 ts_tablet_manager.cc:1403] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.006s
I20260709 12:26:44.943954 18299 raft_consensus.cc:385] T 3463ec2e9f294668adae229e2814b1cf P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.944317 18299 raft_consensus.cc:740] T 3463ec2e9f294668adae229e2814b1cf P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.945093 18299 consensus_queue.cc:260] T 3463ec2e9f294668adae229e2814b1cf P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:44.947582 18303 raft_consensus.cc:359] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:44.948472 18303 raft_consensus.cc:385] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.948829 18303 raft_consensus.cc:740] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.949653 18303 consensus_queue.cc:260] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:44.951135 18299 ts_tablet_manager.cc:1434] T 3463ec2e9f294668adae229e2814b1cf P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 12:26:44.952237 18299 tablet_bootstrap.cc:492] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:44.952873 18303 ts_tablet_manager.cc:1434] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:26:44.955790 18300 tablet_bootstrap.cc:654] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.956281 18303 tablet_bootstrap.cc:492] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:44.962878 18299 tablet_bootstrap.cc:654] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.963330 18303 tablet_bootstrap.cc:654] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.970654 18337 consensus_queue.cc:1048] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:44.974350 18423 raft_consensus.cc:493] T cba48186789449ef9cae51c546ace419 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.979663 18298 tablet_bootstrap.cc:492] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:44.980383 18298 ts_tablet_manager.cc:1403] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.173s	user 0.011s	sys 0.013s
I20260709 12:26:44.983845 18298 raft_consensus.cc:359] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:44.984735 18298 raft_consensus.cc:385] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.986145 18299 tablet_bootstrap.cc:492] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:44.986936 18299 ts_tablet_manager.cc:1403] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.000s
I20260709 12:26:44.985045 18298 raft_consensus.cc:740] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.993969 18298 consensus_queue.cc:260] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:44.975080 18423 raft_consensus.cc:515] T cba48186789449ef9cae51c546ace419 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:45.015699 18300 tablet_bootstrap.cc:492] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:45.016336 18300 ts_tablet_manager.cc:1403] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.003s
I20260709 12:26:45.017601 18423 leader_election.cc:290] T cba48186789449ef9cae51c546ace419 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:45.019403 18300 raft_consensus.cc:359] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:45.020128 18300 raft_consensus.cc:385] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.020383 18300 raft_consensus.cc:740] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.021035 18300 consensus_queue.cc:260] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:45.026070 18299 raft_consensus.cc:359] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:45.026885 18299 raft_consensus.cc:385] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.027176 18299 raft_consensus.cc:740] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.028582 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba48186789449ef9cae51c546ace419" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:45.029335 18250 raft_consensus.cc:2468] T cba48186789449ef9cae51c546ace419 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 0.
I20260709 12:26:45.031155 18141 leader_election.cc:304] T cba48186789449ef9cae51c546ace419 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:45.032193 18568 raft_consensus.cc:2804] T cba48186789449ef9cae51c546ace419 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.032622 18568 raft_consensus.cc:493] T cba48186789449ef9cae51c546ace419 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.032955 18568 raft_consensus.cc:3060] T cba48186789449ef9cae51c546ace419 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.040961 18568 raft_consensus.cc:515] T cba48186789449ef9cae51c546ace419 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:45.031189 18300 ts_tablet_manager.cc:1434] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 12:26:45.041893 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba48186789449ef9cae51c546ace419" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:45.043792 18102 raft_consensus.cc:2468] T cba48186789449ef9cae51c546ace419 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 0.
I20260709 12:26:45.044378 18568 leader_election.cc:290] T cba48186789449ef9cae51c546ace419 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Requested vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:45.044960 18299 consensus_queue.cc:260] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:45.047636 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba48186789449ef9cae51c546ace419" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:45.048830 18252 raft_consensus.cc:3060] T cba48186789449ef9cae51c546ace419 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.054868 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba48186789449ef9cae51c546ace419" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:45.055866 18102 raft_consensus.cc:3060] T cba48186789449ef9cae51c546ace419 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.054998 18298 ts_tablet_manager.cc:1434] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.074s	user 0.010s	sys 0.000s
I20260709 12:26:45.057623 18298 tablet_bootstrap.cc:492] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:45.060534 18252 raft_consensus.cc:2468] T cba48186789449ef9cae51c546ace419 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 1.
I20260709 12:26:45.061415 18300 tablet_bootstrap.cc:492] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:45.067878 18299 ts_tablet_manager.cc:1434] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.000s
I20260709 12:26:45.069167 18299 tablet_bootstrap.cc:492] T 740537a0f03c42caa8182d3b9f403859 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:45.069033 18141 leader_election.cc:304] T cba48186789449ef9cae51c546ace419 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:45.070506 18601 raft_consensus.cc:2804] T cba48186789449ef9cae51c546ace419 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:45.071002 18601 raft_consensus.cc:697] T cba48186789449ef9cae51c546ace419 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Becoming Leader. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Running, Role: LEADER
I20260709 12:26:45.071834 18601 consensus_queue.cc:237] T cba48186789449ef9cae51c546ace419 P a08ea42cd3884210924a19c8f570486d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:45.075111 18303 tablet_bootstrap.cc:492] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:45.075836 18299 tablet_bootstrap.cc:654] T 740537a0f03c42caa8182d3b9f403859 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.079366 18303 ts_tablet_manager.cc:1403] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.124s	user 0.024s	sys 0.032s
I20260709 12:26:45.080593 17926 catalog_manager.cc:5697] T 7dbf7d84f5ff496e905988250445db74 P a08ea42cd3884210924a19c8f570486d reported cstate change: term changed from 0 to 1, leader changed from <none> to a08ea42cd3884210924a19c8f570486d (127.9.145.195). New cstate: current_term: 1 leader_uuid: "a08ea42cd3884210924a19c8f570486d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:45.090770 17926 catalog_manager.cc:5697] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d reported cstate change: term changed from 0 to 1, leader changed from <none> to a08ea42cd3884210924a19c8f570486d (127.9.145.195). New cstate: current_term: 1 leader_uuid: "a08ea42cd3884210924a19c8f570486d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:45.104282 18298 tablet_bootstrap.cc:654] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.107751 18419 consensus_queue.cc:1048] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:45.117542 18300 tablet_bootstrap.cc:654] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.154040 18601 raft_consensus.cc:493] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.154850 18601 raft_consensus.cc:515] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:45.159479 18455 raft_consensus.cc:493] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.160140 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35683295be3042a4bc1839bda16f6f40" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:45.161052 18250 raft_consensus.cc:2468] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 0.
I20260709 12:26:45.160140 18455 raft_consensus.cc:515] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:45.165462 18455 leader_election.cc:290] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:45.167491 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35683295be3042a4bc1839bda16f6f40" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:45.168473 18175 raft_consensus.cc:2468] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 0.
I20260709 12:26:45.171145 18455 raft_consensus.cc:493] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.171804 18455 raft_consensus.cc:515] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:45.174081 18455 leader_election.cc:290] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:45.175463 18141 leader_election.cc:304] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:45.171667 18303 raft_consensus.cc:359] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:45.178787 18303 raft_consensus.cc:385] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.177703 18423 raft_consensus.cc:2804] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.178838 17995 leader_election.cc:304] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:45.179977 18303 raft_consensus.cc:740] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.181008 18303 consensus_queue.cc:260] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:45.177802 18102 raft_consensus.cc:2468] T cba48186789449ef9cae51c546ace419 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 1.
I20260709 12:26:45.193056 18299 tablet_bootstrap.cc:492] T 740537a0f03c42caa8182d3b9f403859 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:45.194305 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cffccb3c736b4f0fa0789217fa65dc2c" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:45.210139 18299 ts_tablet_manager.cc:1403] T 740537a0f03c42caa8182d3b9f403859 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.141s	user 0.031s	sys 0.045s
I20260709 12:26:45.210392 18252 raft_consensus.cc:2468] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 0.
I20260709 12:26:45.190842 18303 ts_tablet_manager.cc:1434] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.111s	user 0.008s	sys 0.000s
I20260709 12:26:45.182545 18423 raft_consensus.cc:493] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.212594 18303 tablet_bootstrap.cc:492] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:45.191630 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35683295be3042a4bc1839bda16f6f40" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:45.213394 18423 raft_consensus.cc:3060] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.214003 18250 raft_consensus.cc:2468] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 0.
I20260709 12:26:45.221916 18298 tablet_bootstrap.cc:492] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:45.222616 18298 ts_tablet_manager.cc:1403] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.165s	user 0.008s	sys 0.009s
I20260709 12:26:45.223804 18601 leader_election.cc:290] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:45.186013 18455 raft_consensus.cc:2804] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.224714 18455 raft_consensus.cc:493] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.224926 18419 raft_consensus.cc:493] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.223842 17992 leader_election.cc:304] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:45.225106 18455 raft_consensus.cc:3060] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.229233 17924 catalog_manager.cc:5697] T cba48186789449ef9cae51c546ace419 P a08ea42cd3884210924a19c8f570486d reported cstate change: term changed from 0 to 1, leader changed from <none> to a08ea42cd3884210924a19c8f570486d (127.9.145.195). New cstate: current_term: 1 leader_uuid: "a08ea42cd3884210924a19c8f570486d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:45.228266 18364 raft_consensus.cc:2804] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.232312 18364 raft_consensus.cc:493] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.232685 18364 raft_consensus.cc:3060] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.237372 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35683295be3042a4bc1839bda16f6f40" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:45.241587 18300 tablet_bootstrap.cc:492] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:45.192252 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cffccb3c736b4f0fa0789217fa65dc2c" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:45.242238 18300 ts_tablet_manager.cc:1403] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.183s	user 0.012s	sys 0.003s
I20260709 12:26:45.234055 18298 raft_consensus.cc:359] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:45.244123 18298 raft_consensus.cc:385] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.244621 18298 raft_consensus.cc:740] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.243994 18299 raft_consensus.cc:359] T 740537a0f03c42caa8182d3b9f403859 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:45.245328 18299 raft_consensus.cc:385] T 740537a0f03c42caa8182d3b9f403859 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.246814 18601 consensus_queue.cc:1048] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:45.250788 18298 consensus_queue.cc:260] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:45.253361 18029 raft_consensus.cc:3060] T 440b2a57096e45188762ccb05301beec P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.254829 18298 ts_tablet_manager.cc:1434] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:26:45.255901 18298 tablet_bootstrap.cc:492] T 09661bcb87ec455e97022bc6febc4754 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:45.245855 18299 raft_consensus.cc:740] T 740537a0f03c42caa8182d3b9f403859 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
W20260709 12:26:45.258416 18067 consensus_peers.cc:597] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c -> Peer 10c938681fc04e66968531267f39f16c (127.9.145.196:37881): Couldn't send request to peer 10c938681fc04e66968531267f39f16c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:45.258215 18299 consensus_queue.cc:260] T 740537a0f03c42caa8182d3b9f403859 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:45.228410 18419 raft_consensus.cc:515] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:45.265344 18299 ts_tablet_manager.cc:1434] T 740537a0f03c42caa8182d3b9f403859 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.000s
I20260709 12:26:45.266463 18299 tablet_bootstrap.cc:492] T 09661bcb87ec455e97022bc6febc4754 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:45.265897 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "740537a0f03c42caa8182d3b9f403859" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:45.266644 18423 raft_consensus.cc:515] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
W20260709 12:26:45.268790 18216 leader_election.cc:343] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.270644 18455 raft_consensus.cc:515] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:45.256889 18300 raft_consensus.cc:359] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:45.270409 18364 raft_consensus.cc:515] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:45.271864 18027 raft_consensus.cc:2393] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a08ea42cd3884210924a19c8f570486d in current term 1: Already voted for candidate ac42e2bcf9ac42448a84370269bc6ccc in this term.
I20260709 12:26:45.271832 18300 raft_consensus.cc:385] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.272467 18300 raft_consensus.cc:740] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.269767 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35683295be3042a4bc1839bda16f6f40" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:45.273408 18250 raft_consensus.cc:3060] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.272948 18101 raft_consensus.cc:2468] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 0.
I20260709 12:26:45.275807 18300 consensus_queue.cc:260] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:45.280829 18377 raft_consensus.cc:493] T 3463ec2e9f294668adae229e2814b1cf P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.281486 18377 raft_consensus.cc:515] T 3463ec2e9f294668adae229e2814b1cf P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:45.283309 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "740537a0f03c42caa8182d3b9f403859" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:45.283690 18377 leader_election.cc:290] T 3463ec2e9f294668adae229e2814b1cf P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:45.285862 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3463ec2e9f294668adae229e2814b1cf" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:45.288007 18303 tablet_bootstrap.cc:654] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.288798 18102 raft_consensus.cc:2468] T 740537a0f03c42caa8182d3b9f403859 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 0.
I20260709 12:26:45.298594 18300 ts_tablet_manager.cc:1434] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.000s
I20260709 12:26:45.299823 18300 tablet_bootstrap.cc:492] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:45.306525 18298 tablet_bootstrap.cc:654] T 09661bcb87ec455e97022bc6febc4754 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.313344 18299 tablet_bootstrap.cc:654] T 09661bcb87ec455e97022bc6febc4754 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.281024 18419 leader_election.cc:290] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:45.315953 18300 tablet_bootstrap.cc:654] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:45.307179 18070 leader_election.cc:343] T 3463ec2e9f294668adae229e2814b1cf P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.335842 18601 consensus_queue.cc:1048] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:45.338639 18601 consensus_queue.cc:1048] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:45.302541 18215 leader_election.cc:304] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:45.342487 18601 raft_consensus.cc:493] T 57c55f2aea594f27bd7ce646464ea07c P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.344633 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3463ec2e9f294668adae229e2814b1cf" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:45.346670 18601 raft_consensus.cc:515] T 57c55f2aea594f27bd7ce646464ea07c P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:45.348877 18601 leader_election.cc:290] T 57c55f2aea594f27bd7ce646464ea07c P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
W20260709 12:26:45.350505 18067 leader_election.cc:343] T 3463ec2e9f294668adae229e2814b1cf P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10c938681fc04e66968531267f39f16c (127.9.145.196:37881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.350685 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c55f2aea594f27bd7ce646464ea07c" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:45.351286 18067 leader_election.cc:304] T 3463ec2e9f294668adae229e2814b1cf P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d
I20260709 12:26:45.351845 18104 raft_consensus.cc:2393] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a08ea42cd3884210924a19c8f570486d in current term 1: Already voted for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in this term.
I20260709 12:26:45.352154 18446 raft_consensus.cc:2749] T 3463ec2e9f294668adae229e2814b1cf P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.352922 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c55f2aea594f27bd7ce646464ea07c" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:45.353716 18252 raft_consensus.cc:2393] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a08ea42cd3884210924a19c8f570486d in current term 1: Already voted for candidate 10c938681fc04e66968531267f39f16c in this term.
I20260709 12:26:45.356796 18141 leader_election.cc:304] T 57c55f2aea594f27bd7ce646464ea07c P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a08ea42cd3884210924a19c8f570486d; no voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c
I20260709 12:26:45.357790 18358 raft_consensus.cc:3060] T 57c55f2aea594f27bd7ce646464ea07c P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.362768 18364 leader_election.cc:290] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Requested vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:45.366374 18419 raft_consensus.cc:2804] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.366932 18419 raft_consensus.cc:493] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.367298 18419 raft_consensus.cc:3060] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.369472 18358 raft_consensus.cc:2749] T 57c55f2aea594f27bd7ce646464ea07c P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.370875 18606 consensus_queue.cc:1048] T 7dbf7d84f5ff496e905988250445db74 P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:45.380995 18446 consensus_queue.cc:1048] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:26:45.321053 18423 leader_election.cc:290] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Requested vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:45.394649 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35683295be3042a4bc1839bda16f6f40" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:45.395641 18176 raft_consensus.cc:2393] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ac42e2bcf9ac42448a84370269bc6ccc in current term 1: Already voted for candidate a08ea42cd3884210924a19c8f570486d in this term.
I20260709 12:26:45.406046 18446 raft_consensus.cc:493] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.419407 18599 raft_consensus.cc:493] T 440b2a57096e45188762ccb05301beec P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.420192 18599 raft_consensus.cc:515] T 440b2a57096e45188762ccb05301beec P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:45.425598 18423 raft_consensus.cc:493] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.426385 18423 raft_consensus.cc:515] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:45.476555 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cffccb3c736b4f0fa0789217fa65dc2c" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:45.477348 18103 raft_consensus.cc:3060] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.465585 18632 raft_consensus.cc:493] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.478731 18423 leader_election.cc:290] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:45.478986 18632 raft_consensus.cc:515] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:45.471894 18455 leader_election.cc:290] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Requested vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:45.499142 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cffccb3c736b4f0fa0789217fa65dc2c" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:45.455179 18446 raft_consensus.cc:515] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:45.490016 18250 raft_consensus.cc:2468] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 1.
I20260709 12:26:45.501605 18251 raft_consensus.cc:3060] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.517939 18606 raft_consensus.cc:493] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.517077 18103 raft_consensus.cc:2468] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 1.
I20260709 12:26:45.520489 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35683295be3042a4bc1839bda16f6f40" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:45.525298 18599 leader_election.cc:290] T 440b2a57096e45188762ccb05301beec P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:45.533687 18419 raft_consensus.cc:515] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:45.538121 18632 leader_election.cc:290] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:45.539455 18419 leader_election.cc:290] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Requested vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:45.542621 18028 raft_consensus.cc:2393] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a08ea42cd3884210924a19c8f570486d in current term 1: Already voted for candidate ac42e2bcf9ac42448a84370269bc6ccc in this term.
I20260709 12:26:45.535063 18606 raft_consensus.cc:515] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:45.543517 18249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35683295be3042a4bc1839bda16f6f40" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:45.544489 18249 raft_consensus.cc:2393] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ac42e2bcf9ac42448a84370269bc6ccc in current term 1: Already voted for candidate a08ea42cd3884210924a19c8f570486d in this term.
I20260709 12:26:45.569622 18299 tablet_bootstrap.cc:492] T 09661bcb87ec455e97022bc6febc4754 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:45.569852 18300 tablet_bootstrap.cc:492] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:45.570403 18300 ts_tablet_manager.cc:1403] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.271s	user 0.020s	sys 0.009s
I20260709 12:26:45.570695 18299 ts_tablet_manager.cc:1403] T 09661bcb87ec455e97022bc6febc4754 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.304s	user 0.012s	sys 0.011s
I20260709 12:26:45.571733 18298 tablet_bootstrap.cc:492] T 09661bcb87ec455e97022bc6febc4754 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:45.572356 18298 ts_tablet_manager.cc:1403] T 09661bcb87ec455e97022bc6febc4754 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.317s	user 0.017s	sys 0.005s
I20260709 12:26:45.573402 18300 raft_consensus.cc:359] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:45.577416 18337 raft_consensus.cc:493] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.579648 18141 leader_election.cc:304] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:45.580700 18249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa35871af5624c709008fe86090c0ad1" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:45.581956 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "740537a0f03c42caa8182d3b9f403859" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:45.582772 18299 raft_consensus.cc:359] T 09661bcb87ec455e97022bc6febc4754 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:45.597121 18299 raft_consensus.cc:385] T 09661bcb87ec455e97022bc6febc4754 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.584729 18300 raft_consensus.cc:385] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.597401 18298 raft_consensus.cc:359] T 09661bcb87ec455e97022bc6febc4754 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:45.598002 18300 raft_consensus.cc:740] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.598384 18298 raft_consensus.cc:385] T 09661bcb87ec455e97022bc6febc4754 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.598738 18298 raft_consensus.cc:740] T 09661bcb87ec455e97022bc6febc4754 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
W20260709 12:26:45.586308 17992 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:45595, user_credentials={real_user=slave}} blocked reactor thread for 96205us
I20260709 12:26:45.546089 18606 leader_election.cc:290] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:45.584127 18337 raft_consensus.cc:515] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:45.592542 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa35871af5624c709008fe86090c0ad1" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:45.599519 18098 raft_consensus.cc:3060] T 740537a0f03c42caa8182d3b9f403859 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.599754 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440b2a57096e45188762ccb05301beec" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:45.600556 18358 raft_consensus.cc:2804] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:45.597525 18299 raft_consensus.cc:740] T 09661bcb87ec455e97022bc6febc4754 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.598915 18300 consensus_queue.cc:260] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:45.608644 18299 consensus_queue.cc:260] T 09661bcb87ec455e97022bc6febc4754 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:45.612542 18303 tablet_bootstrap.cc:492] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:45.613263 18303 ts_tablet_manager.cc:1403] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.401s	user 0.015s	sys 0.007s
I20260709 12:26:45.600519 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1315ba5fa54c50809825b3329d3510" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:45.616519 18298 consensus_queue.cc:260] T 09661bcb87ec455e97022bc6febc4754 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:45.617126 18299 ts_tablet_manager.cc:1434] T 09661bcb87ec455e97022bc6febc4754 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 12:26:45.617806 18337 leader_election.cc:290] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:45.620523 18300 ts_tablet_manager.cc:1434] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 12:26:45.621462 18300 tablet_bootstrap.cc:492] T 09661bcb87ec455e97022bc6febc4754 P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:45.623988 17992 leader_election.cc:304] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:45.605855 18249 raft_consensus.cc:2468] T fa35871af5624c709008fe86090c0ad1 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 0.
I20260709 12:26:45.616281 18358 raft_consensus.cc:697] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Becoming Leader. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Running, Role: LEADER
I20260709 12:26:45.647903 18641 raft_consensus.cc:2804] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:45.648479 18641 raft_consensus.cc:697] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [term 1 LEADER]: Becoming Leader. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Running, Role: LEADER
I20260709 12:26:45.649412 18641 consensus_queue.cc:237] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:45.623587 18029 raft_consensus.cc:2468] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 0.
I20260709 12:26:45.654136 18446 leader_election.cc:290] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:45.652343 18420 raft_consensus.cc:493] T 09661bcb87ec455e97022bc6febc4754 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.655064 18420 raft_consensus.cc:515] T 09661bcb87ec455e97022bc6febc4754 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:45.657307 18303 raft_consensus.cc:359] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:45.659322 18303 raft_consensus.cc:385] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.659683 18303 raft_consensus.cc:740] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.660543 18303 consensus_queue.cc:260] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:45.661887 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1315ba5fa54c50809825b3329d3510" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:45.625901 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1315ba5fa54c50809825b3329d3510" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
W20260709 12:26:45.670141 17992 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:45595, user_credentials={real_user=slave}} blocked reactor thread for 46261.5us
I20260709 12:26:45.670650 18298 ts_tablet_manager.cc:1434] T 09661bcb87ec455e97022bc6febc4754 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.098s	user 0.009s	sys 0.000s
I20260709 12:26:45.672124 18298 tablet_bootstrap.cc:492] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:45.672951 18303 ts_tablet_manager.cc:1434] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.002s
I20260709 12:26:45.657310 18420 leader_election.cc:290] T 09661bcb87ec455e97022bc6febc4754 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:45.680811 18358 consensus_queue.cc:237] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:45.698596 18298 tablet_bootstrap.cc:654] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.683848 18025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3e4e4b25f84008b5cd603640f2252f" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:45.684299 18303 tablet_bootstrap.cc:492] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:45.688062 17992 leader_election.cc:304] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac42e2bcf9ac42448a84370269bc6ccc; no voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d
I20260709 12:26:45.686359 18299 tablet_bootstrap.cc:492] T 8d1315ba5fa54c50809825b3329d3510 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:45.676841 18176 raft_consensus.cc:2468] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 0.
W20260709 12:26:45.669245 18142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:36743, user_credentials={real_user=slave}} blocked reactor thread for 59159.8us
I20260709 12:26:45.712563 18251 raft_consensus.cc:2468] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 1.
I20260709 12:26:45.714334 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440b2a57096e45188762ccb05301beec" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:45.719210 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1315ba5fa54c50809825b3329d3510" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
W20260709 12:26:45.739449 17975 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:45.752014 18300 tablet_bootstrap.cc:654] T 09661bcb87ec455e97022bc6febc4754 P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.754684 18423 consensus_queue.cc:1048] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:45.755471 18651 raft_consensus.cc:2749] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.756270 18649 raft_consensus.cc:493] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.756836 18649 raft_consensus.cc:515] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:45.759078 18649 leader_election.cc:290] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:45.759436 18098 raft_consensus.cc:2468] T 740537a0f03c42caa8182d3b9f403859 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 1.
I20260709 12:26:45.759660 18606 consensus_queue.cc:1048] T 7dbf7d84f5ff496e905988250445db74 P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:45.746631 18215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:45595, user_credentials={real_user=slave}} blocked reactor thread for 84209.5us
W20260709 12:26:45.765251 18141 leader_election.cc:343] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:45.776846 18142 leader_election.cc:343] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.778137 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "223eb34bd9744014b3c011eebcb37f11" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:45.778456 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09661bcb87ec455e97022bc6febc4754" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:45.779731 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3e4e4b25f84008b5cd603640f2252f" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:45.781239 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "740537a0f03c42caa8182d3b9f403859" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:45.781922 18027 raft_consensus.cc:3060] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:45.787241 18070 leader_election.cc:343] T 09661bcb87ec455e97022bc6febc4754 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.781741 18648 consensus_queue.cc:1048] T cba48186789449ef9cae51c546ace419 P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:45.788775 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3463ec2e9f294668adae229e2814b1cf" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:45.789544 18098 raft_consensus.cc:2468] T 3463ec2e9f294668adae229e2814b1cf P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 0.
W20260709 12:26:45.796144 18653 log.cc:927] Time spent T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc: Append to log took a long time: real 0.091s	user 0.001s	sys 0.001s
W20260709 12:26:45.796273 18070 leader_election.cc:343] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.801308 18299 tablet_bootstrap.cc:654] T 8d1315ba5fa54c50809825b3329d3510 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:45.809265 17992 leader_election.cc:343] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.810576 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "223eb34bd9744014b3c011eebcb37f11" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:45.813206 17924 catalog_manager.cc:5697] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc reported cstate change: term changed from 0 to 1, leader changed from <none> to ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193). New cstate: current_term: 1 leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:45.816424 18068 leader_election.cc:343] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.816968 18068 leader_election.cc:304] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:45.817696 18420 raft_consensus.cc:2749] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.818236 18142 leader_election.cc:304] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c
I20260709 12:26:45.809480 18303 tablet_bootstrap.cc:654] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.823501 18298 tablet_bootstrap.cc:492] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:45.824133 18298 ts_tablet_manager.cc:1403] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.152s	user 0.011s	sys 0.011s
I20260709 12:26:45.827215 18298 raft_consensus.cc:359] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:45.831564 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09661bcb87ec455e97022bc6febc4754" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:45.832149 18027 raft_consensus.cc:2468] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 1.
I20260709 12:26:45.832309 18252 raft_consensus.cc:2468] T 09661bcb87ec455e97022bc6febc4754 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 0.
I20260709 12:26:45.833787 18249 raft_consensus.cc:3060] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.844254 18216 leader_election.cc:304] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:45.847764 18655 raft_consensus.cc:2804] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:45.845815 18300 tablet_bootstrap.cc:492] T 09661bcb87ec455e97022bc6febc4754 P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:45.848414 18655 raft_consensus.cc:697] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Becoming Leader. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:26:45.848734 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3463ec2e9f294668adae229e2814b1cf" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:45.849007 18300 ts_tablet_manager.cc:1403] T 09661bcb87ec455e97022bc6febc4754 P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.228s	user 0.012s	sys 0.006s
I20260709 12:26:45.849795 18655 consensus_queue.cc:237] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:45.827937 18298 raft_consensus.cc:385] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.851294 18298 raft_consensus.cc:740] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.852402 18298 consensus_queue.cc:260] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:45.854029 18215 leader_election.cc:304] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c938681fc04e66968531267f39f16c; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d
W20260709 12:26:45.862493 18142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:36743, user_credentials={real_user=slave}} blocked reactor thread for 84726.3us
I20260709 12:26:45.854710 18298 ts_tablet_manager.cc:1434] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 12:26:45.863786 18606 raft_consensus.cc:2804] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.864262 18606 raft_consensus.cc:493] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.864630 18606 raft_consensus.cc:3060] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.864826 18300 raft_consensus.cc:359] T 09661bcb87ec455e97022bc6febc4754 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:45.865587 18300 raft_consensus.cc:385] T 09661bcb87ec455e97022bc6febc4754 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.868073 17995 leader_election.cc:304] T 440b2a57096e45188762ccb05301beec P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac42e2bcf9ac42448a84370269bc6ccc; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d
I20260709 12:26:45.869546 17995 leader_election.cc:304] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c
I20260709 12:26:45.865860 18300 raft_consensus.cc:740] T 09661bcb87ec455e97022bc6febc4754 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.870545 18641 raft_consensus.cc:2749] T 440b2a57096e45188762ccb05301beec P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:45.871450 18300 consensus_queue.cc:260] T 09661bcb87ec455e97022bc6febc4754 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:45.872097 18641 raft_consensus.cc:2804] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.872545 18641 raft_consensus.cc:493] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.872884 18641 raft_consensus.cc:3060] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.874137 18300 ts_tablet_manager.cc:1434] T 09661bcb87ec455e97022bc6febc4754 P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:26:45.875298 18300 tablet_bootstrap.cc:492] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:45.875767 18067 leader_election.cc:304] T 09661bcb87ec455e97022bc6febc4754 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: a08ea42cd3884210924a19c8f570486d
I20260709 12:26:45.877318 18420 raft_consensus.cc:2804] T 09661bcb87ec455e97022bc6febc4754 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.877789 18420 raft_consensus.cc:493] T 09661bcb87ec455e97022bc6febc4754 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.878194 18420 raft_consensus.cc:3060] T 09661bcb87ec455e97022bc6febc4754 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.890187 18420 raft_consensus.cc:515] T 09661bcb87ec455e97022bc6febc4754 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:45.864977 18298 tablet_bootstrap.cc:492] T 3463ec2e9f294668adae229e2814b1cf P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:45.893497 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09661bcb87ec455e97022bc6febc4754" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:45.906591 18174 raft_consensus.cc:3060] T 09661bcb87ec455e97022bc6febc4754 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.892592 18641 raft_consensus.cc:515] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:45.910593 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1315ba5fa54c50809825b3329d3510" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
W20260709 12:26:45.912457 17992 leader_election.cc:343] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.915946 18300 tablet_bootstrap.cc:654] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.921217 18174 raft_consensus.cc:2468] T 09661bcb87ec455e97022bc6febc4754 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 1.
W20260709 12:26:45.921502 18218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:43695, user_credentials={real_user=slave}} blocked reactor thread for 111609us
I20260709 12:26:45.923456 18606 raft_consensus.cc:515] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:45.942147 18606 leader_election.cc:290] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Requested vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:45.932567 18141 leader_election.cc:304] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d; no voters: ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:45.934542 18070 leader_election.cc:304] T 09661bcb87ec455e97022bc6febc4754 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:45.946376 18420 leader_election.cc:290] T 09661bcb87ec455e97022bc6febc4754 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Requested vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:45.939052 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09661bcb87ec455e97022bc6febc4754" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:45.947235 18645 raft_consensus.cc:2804] T 09661bcb87ec455e97022bc6febc4754 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:45.947760 18358 raft_consensus.cc:2804] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.947926 18645 raft_consensus.cc:697] T 09661bcb87ec455e97022bc6febc4754 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Becoming Leader. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Running, Role: LEADER
I20260709 12:26:45.947235 18252 raft_consensus.cc:3060] T 09661bcb87ec455e97022bc6febc4754 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.948684 18141 leader_election.cc:304] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:45.949569 18648 raft_consensus.cc:2804] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.948246 18358 raft_consensus.cc:493] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.949927 18648 raft_consensus.cc:493] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.949899 18303 tablet_bootstrap.cc:492] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:45.950788 18648 raft_consensus.cc:3060] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.951442 18303 ts_tablet_manager.cc:1403] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.268s	user 0.035s	sys 0.070s
I20260709 12:26:45.953068 18645 consensus_queue.cc:237] T 09661bcb87ec455e97022bc6febc4754 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:45.954381 18303 raft_consensus.cc:359] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:45.955154 18303 raft_consensus.cc:385] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.955456 18303 raft_consensus.cc:740] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.950691 18358 raft_consensus.cc:3060] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.961277 18252 raft_consensus.cc:2468] T 09661bcb87ec455e97022bc6febc4754 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 1.
I20260709 12:26:45.962730 18648 raft_consensus.cc:515] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:45.964257 18303 consensus_queue.cc:260] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:45.963105 18358 raft_consensus.cc:515] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:45.953018 17926 catalog_manager.cc:5697] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d reported cstate change: term changed from 0 to 1, leader changed from <none> to a08ea42cd3884210924a19c8f570486d (127.9.145.195). New cstate: current_term: 1 leader_uuid: "a08ea42cd3884210924a19c8f570486d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:45.967738 18652 raft_consensus.cc:2749] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.968950 18303 ts_tablet_manager.cc:1434] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.002s
I20260709 12:26:45.970616 18303 tablet_bootstrap.cc:492] T fa35871af5624c709008fe86090c0ad1 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:45.969331 18358 leader_election.cc:290] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Requested vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:45.975693 18299 tablet_bootstrap.cc:492] T 8d1315ba5fa54c50809825b3329d3510 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:45.976291 18299 ts_tablet_manager.cc:1403] T 8d1315ba5fa54c50809825b3329d3510 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.298s	user 0.010s	sys 0.014s
I20260709 12:26:45.977144 18303 tablet_bootstrap.cc:654] T fa35871af5624c709008fe86090c0ad1 P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.983078 18641 leader_election.cc:290] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Requested vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:45.990653 18303 tablet_bootstrap.cc:492] T fa35871af5624c709008fe86090c0ad1 P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:45.991328 18303 ts_tablet_manager.cc:1403] T fa35871af5624c709008fe86090c0ad1 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.021s	user 0.003s	sys 0.015s
I20260709 12:26:45.992156 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1315ba5fa54c50809825b3329d3510" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:45.993162 18028 raft_consensus.cc:2393] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a08ea42cd3884210924a19c8f570486d in current term 1: Already voted for candidate ac42e2bcf9ac42448a84370269bc6ccc in this term.
I20260709 12:26:45.994505 18303 raft_consensus.cc:359] T fa35871af5624c709008fe86090c0ad1 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:45.995306 18303 raft_consensus.cc:385] T fa35871af5624c709008fe86090c0ad1 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.995635 18303 raft_consensus.cc:740] T fa35871af5624c709008fe86090c0ad1 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.996207 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa35871af5624c709008fe86090c0ad1" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:45.996531 18303 consensus_queue.cc:260] T fa35871af5624c709008fe86090c0ad1 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:45.997493 18027 raft_consensus.cc:3060] T fa35871af5624c709008fe86090c0ad1 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.998703 18303 ts_tablet_manager.cc:1434] T fa35871af5624c709008fe86090c0ad1 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:45.999951 18303 tablet_bootstrap.cc:492] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:46.006779 18303 tablet_bootstrap.cc:654] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.006844 18299 raft_consensus.cc:359] T 8d1315ba5fa54c50809825b3329d3510 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:46.017288 18299 raft_consensus.cc:385] T 8d1315ba5fa54c50809825b3329d3510 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.017599 18299 raft_consensus.cc:740] T 8d1315ba5fa54c50809825b3329d3510 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.007181 18027 raft_consensus.cc:2468] T fa35871af5624c709008fe86090c0ad1 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 1.
I20260709 12:26:45.998899 18298 tablet_bootstrap.cc:654] T 3463ec2e9f294668adae229e2814b1cf P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.021088 18303 tablet_bootstrap.cc:492] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:46.021658 18303 ts_tablet_manager.cc:1403] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.003s
I20260709 12:26:46.024437 18303 raft_consensus.cc:359] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:46.025128 18303 raft_consensus.cc:385] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.025403 18303 raft_consensus.cc:740] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.025467 18299 consensus_queue.cc:260] T 8d1315ba5fa54c50809825b3329d3510 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:46.027697 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1315ba5fa54c50809825b3329d3510" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:46.028466 18102 raft_consensus.cc:3060] T 8d1315ba5fa54c50809825b3329d3510 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.028724 18303 consensus_queue.cc:260] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:46.030335 18299 ts_tablet_manager.cc:1434] T 8d1315ba5fa54c50809825b3329d3510 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.054s	user 0.009s	sys 0.000s
I20260709 12:26:46.031356 18299 tablet_bootstrap.cc:492] T 02af88afdc444f268f05df276bf720c0 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:46.032148 18303 ts_tablet_manager.cc:1434] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:26:46.033169 18303 tablet_bootstrap.cc:492] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:46.034650 17927 catalog_manager.cc:5697] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c938681fc04e66968531267f39f16c (127.9.145.196). New cstate: current_term: 1 leader_uuid: "10c938681fc04e66968531267f39f16c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.041122 18303 tablet_bootstrap.cc:654] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.042279 18298 tablet_bootstrap.cc:492] T 3463ec2e9f294668adae229e2814b1cf P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:46.047981 18298 ts_tablet_manager.cc:1403] T 3463ec2e9f294668adae229e2814b1cf P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.178s	user 0.008s	sys 0.004s
I20260709 12:26:46.052418 18298 raft_consensus.cc:359] T 3463ec2e9f294668adae229e2814b1cf P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:46.053174 18298 raft_consensus.cc:385] T 3463ec2e9f294668adae229e2814b1cf P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.053453 18298 raft_consensus.cc:740] T 3463ec2e9f294668adae229e2814b1cf P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.055799 18303 tablet_bootstrap.cc:492] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:46.056384 18303 ts_tablet_manager.cc:1403] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.004s
I20260709 12:26:46.059350 18303 raft_consensus.cc:359] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:46.060500 18303 raft_consensus.cc:385] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.060824 18303 raft_consensus.cc:740] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.061784 18303 consensus_queue.cc:260] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:46.061962 18298 consensus_queue.cc:260] T 3463ec2e9f294668adae229e2814b1cf P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:46.063562 18299 tablet_bootstrap.cc:654] T 02af88afdc444f268f05df276bf720c0 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.064512 18303 ts_tablet_manager.cc:1434] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:46.065605 18303 tablet_bootstrap.cc:492] T 02af88afdc444f268f05df276bf720c0 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:46.070660 18298 ts_tablet_manager.cc:1434] T 3463ec2e9f294668adae229e2814b1cf P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:26:46.071770 18298 tablet_bootstrap.cc:492] T e2114d69fe2c427599f225a7b0686dee P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:46.072012 18303 tablet_bootstrap.cc:654] T 02af88afdc444f268f05df276bf720c0 P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.072655 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1315ba5fa54c50809825b3329d3510" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:46.073609 18176 raft_consensus.cc:2393] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ac42e2bcf9ac42448a84370269bc6ccc in current term 1: Already voted for candidate a08ea42cd3884210924a19c8f570486d in this term.
I20260709 12:26:46.077679 18102 raft_consensus.cc:2468] T 8d1315ba5fa54c50809825b3329d3510 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 1.
I20260709 12:26:46.060719 18648 leader_election.cc:290] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Requested vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:46.102902 18249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa35871af5624c709008fe86090c0ad1" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:46.103775 18249 raft_consensus.cc:3060] T fa35871af5624c709008fe86090c0ad1 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:46.109004 18141 leader_election.cc:343] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10c938681fc04e66968531267f39f16c (127.9.145.196:37881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.120033 18299 tablet_bootstrap.cc:492] T 02af88afdc444f268f05df276bf720c0 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:46.120641 18299 ts_tablet_manager.cc:1403] T 02af88afdc444f268f05df276bf720c0 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.089s	user 0.006s	sys 0.010s
I20260709 12:26:46.122483 18423 consensus_queue.cc:1048] T cba48186789449ef9cae51c546ace419 P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:46.124543 18142 leader_election.cc:304] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:46.122781 17995 leader_election.cc:304] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac42e2bcf9ac42448a84370269bc6ccc; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d
I20260709 12:26:46.125391 18648 raft_consensus.cc:2804] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:46.125919 18648 raft_consensus.cc:697] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Becoming Leader. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Running, Role: LEADER
I20260709 12:26:46.126035 18299 raft_consensus.cc:359] T 02af88afdc444f268f05df276bf720c0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:46.126789 18299 raft_consensus.cc:385] T 02af88afdc444f268f05df276bf720c0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.126814 18648 consensus_queue.cc:237] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:46.127058 18299 raft_consensus.cc:740] T 02af88afdc444f268f05df276bf720c0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.131613 18364 raft_consensus.cc:2749] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:46.134735 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3463ec2e9f294668adae229e2814b1cf" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:46.135488 18102 raft_consensus.cc:3060] T 3463ec2e9f294668adae229e2814b1cf P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.129429 18299 consensus_queue.cc:260] T 02af88afdc444f268f05df276bf720c0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:46.143082 18299 ts_tablet_manager.cc:1434] T 02af88afdc444f268f05df276bf720c0 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.001s
I20260709 12:26:46.144618 18299 tablet_bootstrap.cc:492] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:46.146052 18249 raft_consensus.cc:2468] T fa35871af5624c709008fe86090c0ad1 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 1.
I20260709 12:26:46.155043 18102 raft_consensus.cc:2468] T 3463ec2e9f294668adae229e2814b1cf P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 1.
I20260709 12:26:46.166440 18337 raft_consensus.cc:493] T 3463ec2e9f294668adae229e2814b1cf P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.166970 18337 raft_consensus.cc:515] T 3463ec2e9f294668adae229e2814b1cf P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:46.155732 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3463ec2e9f294668adae229e2814b1cf" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:46.157279 18651 consensus_queue.cc:1048] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:26:46.176123 18300 tablet_bootstrap.cc:492] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:46.176738 18300 ts_tablet_manager.cc:1403] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.302s	user 0.033s	sys 0.042s
I20260709 12:26:46.177711 18303 tablet_bootstrap.cc:492] T 02af88afdc444f268f05df276bf720c0 P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:46.178216 18303 ts_tablet_manager.cc:1403] T 02af88afdc444f268f05df276bf720c0 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.113s	user 0.024s	sys 0.006s
I20260709 12:26:46.178787 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3463ec2e9f294668adae229e2814b1cf" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:46.179584 18102 raft_consensus.cc:2393] T 3463ec2e9f294668adae229e2814b1cf P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c938681fc04e66968531267f39f16c in current term 1: Already voted for candidate a08ea42cd3884210924a19c8f570486d in this term.
I20260709 12:26:46.170708 18250 raft_consensus.cc:3060] T 3463ec2e9f294668adae229e2814b1cf P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.182569 18300 raft_consensus.cc:359] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:46.183342 18300 raft_consensus.cc:385] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.183507 18303 raft_consensus.cc:359] T 02af88afdc444f268f05df276bf720c0 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:46.184288 18303 raft_consensus.cc:385] T 02af88afdc444f268f05df276bf720c0 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.184580 18303 raft_consensus.cc:740] T 02af88afdc444f268f05df276bf720c0 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.166028 18606 consensus_queue.cc:1048] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:26:46.191246 18337 leader_election.cc:290] T 3463ec2e9f294668adae229e2814b1cf P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:46.183629 18300 raft_consensus.cc:740] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.190527 18303 consensus_queue.cc:260] T 02af88afdc444f268f05df276bf720c0 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:46.199640 18303 ts_tablet_manager.cc:1434] T 02af88afdc444f268f05df276bf720c0 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.003s
I20260709 12:26:46.200704 18303 tablet_bootstrap.cc:492] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:46.204953 18420 raft_consensus.cc:493] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.190420 18651 consensus_queue.cc:1048] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:26:46.206660 18303 tablet_bootstrap.cc:654] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.206705 18420 raft_consensus.cc:515] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:46.213079 18364 raft_consensus.cc:493] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.213498 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3463ec2e9f294668adae229e2814b1cf" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:46.213716 18364 raft_consensus.cc:515] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:46.214362 18174 raft_consensus.cc:2393] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c938681fc04e66968531267f39f16c in current term 1: Already voted for candidate a08ea42cd3884210924a19c8f570486d in this term.
I20260709 12:26:46.215870 18364 leader_election.cc:290] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:46.218532 17926 catalog_manager.cc:5697] T 09661bcb87ec455e97022bc6febc4754 P 3a269a9c95e0476d9e09c25b4b5aaa2c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194). New cstate: current_term: 1 leader_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.219936 18420 leader_election.cc:290] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:46.213340 18249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c55f2aea594f27bd7ce646464ea07c" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:46.221297 18249 raft_consensus.cc:2468] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 1.
I20260709 12:26:46.221704 18651 raft_consensus.cc:493] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.224078 18651 raft_consensus.cc:515] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:46.223047 18067 leader_election.cc:304] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 
I20260709 12:26:46.239107 18298 tablet_bootstrap.cc:654] T e2114d69fe2c427599f225a7b0686dee P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.222734 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed8548d1e22c49f7a5341ec0e2f7b073" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:46.228593 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c55f2aea594f27bd7ce646464ea07c" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:46.241585 18299 tablet_bootstrap.cc:654] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.244134 18174 raft_consensus.cc:2468] T 57c55f2aea594f27bd7ce646464ea07c P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 1.
I20260709 12:26:46.229523 18300 consensus_queue.cc:260] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:46.233394 18250 raft_consensus.cc:2468] T 3463ec2e9f294668adae229e2814b1cf P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 1.
I20260709 12:26:46.236968 18141 leader_election.cc:304] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:46.246917 18141 leader_election.cc:304] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:46.247267 18300 ts_tablet_manager.cc:1434] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.000s
I20260709 12:26:46.247184 17923 catalog_manager.cc:5697] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d reported cstate change: term changed from 0 to 1, leader changed from <none> to a08ea42cd3884210924a19c8f570486d (127.9.145.195). New cstate: current_term: 1 leader_uuid: "a08ea42cd3884210924a19c8f570486d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.248418 18300 tablet_bootstrap.cc:492] T ed8548d1e22c49f7a5341ec0e2f7b073 P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:46.248740 18606 raft_consensus.cc:2804] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:46.249276 18606 raft_consensus.cc:697] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Becoming Leader. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Running, Role: LEADER
I20260709 12:26:46.250174 18606 consensus_queue.cc:237] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:46.252072 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed8548d1e22c49f7a5341ec0e2f7b073" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:46.223201 18218 leader_election.cc:304] T 3463ec2e9f294668adae229e2814b1cf P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c938681fc04e66968531267f39f16c; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d
W20260709 12:26:46.240864 17992 leader_election.cc:343] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.241431 18420 raft_consensus.cc:2804] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:46.271437 18337 raft_consensus.cc:2749] T 3463ec2e9f294668adae229e2814b1cf P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:46.261883 18651 leader_election.cc:290] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:46.264003 18420 raft_consensus.cc:493] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.273736 18648 raft_consensus.cc:2804] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:26:46.274334 17995 leader_election.cc:343] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.285284 18420 raft_consensus.cc:3060] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:46.284274 18218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:43695, user_credentials={real_user=slave}} blocked reactor thread for 61187.8us
I20260709 12:26:46.301070 18300 tablet_bootstrap.cc:654] T ed8548d1e22c49f7a5341ec0e2f7b073 P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.294318 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3e4e4b25f84008b5cd603640f2252f" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:46.290767 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3e4e4b25f84008b5cd603640f2252f" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:46.290934 18648 raft_consensus.cc:697] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Becoming Leader. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Running, Role: LEADER
I20260709 12:26:46.308604 18101 raft_consensus.cc:2468] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 0.
I20260709 12:26:46.308997 18648 consensus_queue.cc:237] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:46.313051 17992 leader_election.cc:304] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:46.291755 17995 leader_election.cc:304] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac42e2bcf9ac42448a84370269bc6ccc; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d
I20260709 12:26:46.314146 18337 raft_consensus.cc:493] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.314788 18337 raft_consensus.cc:515] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:46.328475 18303 tablet_bootstrap.cc:492] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:46.329193 18303 ts_tablet_manager.cc:1403] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.129s	user 0.010s	sys 0.023s
I20260709 12:26:46.332412 18303 raft_consensus.cc:359] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:46.333216 18303 raft_consensus.cc:385] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.333487 18303 raft_consensus.cc:740] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.334583 18303 consensus_queue.cc:260] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:46.325070 18641 raft_consensus.cc:2804] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.364306 18298 tablet_bootstrap.cc:492] T e2114d69fe2c427599f225a7b0686dee P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:46.365126 18298 ts_tablet_manager.cc:1403] T e2114d69fe2c427599f225a7b0686dee P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.294s	user 0.011s	sys 0.013s
W20260709 12:26:46.364413 18681 log.cc:927] Time spent T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:26:46.384606 18298 raft_consensus.cc:359] T e2114d69fe2c427599f225a7b0686dee P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:46.390823 18298 raft_consensus.cc:385] T e2114d69fe2c427599f225a7b0686dee P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.391187 18298 raft_consensus.cc:740] T e2114d69fe2c427599f225a7b0686dee P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.391880 18298 consensus_queue.cc:260] T e2114d69fe2c427599f225a7b0686dee P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:46.394148 18298 ts_tablet_manager.cc:1434] T e2114d69fe2c427599f225a7b0686dee P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 12:26:46.368180 18685 raft_consensus.cc:493] T 02af88afdc444f268f05df276bf720c0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.395169 18298 tablet_bootstrap.cc:492] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:46.361900 18651 raft_consensus.cc:2749] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:46.396559 18651 raft_consensus.cc:493] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.397028 18651 raft_consensus.cc:515] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:46.385519 18337 leader_election.cc:290] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:46.398161 18568 consensus_queue.cc:1048] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:46.356015 18641 raft_consensus.cc:493] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.399163 18651 leader_election.cc:290] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:46.399278 18641 raft_consensus.cc:3060] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.413975 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02af88afdc444f268f05df276bf720c0" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:46.414444 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02af88afdc444f268f05df276bf720c0" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:46.415151 18029 raft_consensus.cc:2468] T 02af88afdc444f268f05df276bf720c0 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 0.
I20260709 12:26:46.395241 18685 raft_consensus.cc:515] T 02af88afdc444f268f05df276bf720c0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:46.425711 18685 leader_election.cc:290] T 02af88afdc444f268f05df276bf720c0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:46.427572 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2114d69fe2c427599f225a7b0686dee" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:46.433012 18248 raft_consensus.cc:2468] T e2114d69fe2c427599f225a7b0686dee P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 0.
I20260709 12:26:46.433756 18101 raft_consensus.cc:2468] T 02af88afdc444f268f05df276bf720c0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 0.
I20260709 12:26:46.437311 18215 leader_election.cc:304] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 
I20260709 12:26:46.432430 18298 tablet_bootstrap.cc:654] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.438495 18641 raft_consensus.cc:515] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:46.441160 18641 leader_election.cc:290] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Requested vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:46.442431 18652 raft_consensus.cc:2804] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.446480 18303 ts_tablet_manager.cc:1434] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.117s	user 0.012s	sys 0.032s
I20260709 12:26:46.434271 18420 raft_consensus.cc:515] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:46.450402 18303 tablet_bootstrap.cc:492] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:46.443074 18652 raft_consensus.cc:493] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.458752 18652 raft_consensus.cc:3060] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.460379 18420 leader_election.cc:290] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 election: Requested vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:46.464217 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c55f2aea594f27bd7ce646464ea07c" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:46.464923 18174 raft_consensus.cc:3060] T 57c55f2aea594f27bd7ce646464ea07c P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:46.451628 17992 leader_election.cc:304] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:46.457859 18300 tablet_bootstrap.cc:492] T ed8548d1e22c49f7a5341ec0e2f7b073 P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:46.467600 18300 ts_tablet_manager.cc:1403] T ed8548d1e22c49f7a5341ec0e2f7b073 P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.219s	user 0.024s	sys 0.020s
I20260709 12:26:46.471812 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3e4e4b25f84008b5cd603640f2252f" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:46.471927 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02af88afdc444f268f05df276bf720c0" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:46.472564 18101 raft_consensus.cc:3060] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.472719 18024 raft_consensus.cc:2468] T 02af88afdc444f268f05df276bf720c0 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 0.
I20260709 12:26:46.475618 18068 leader_election.cc:304] T 02af88afdc444f268f05df276bf720c0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:46.478084 18303 tablet_bootstrap.cc:654] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.479813 18333 consensus_queue.cc:1048] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:46.470023 18692 raft_consensus.cc:2804] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.483757 18692 raft_consensus.cc:493] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.484153 18692 raft_consensus.cc:3060] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.490048 18420 raft_consensus.cc:2804] T 02af88afdc444f268f05df276bf720c0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.490629 18420 raft_consensus.cc:493] T 02af88afdc444f268f05df276bf720c0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.491343 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02af88afdc444f268f05df276bf720c0" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:46.490473 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c55f2aea594f27bd7ce646464ea07c" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:46.500300 18251 raft_consensus.cc:3060] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:46.503345 18689 raft_consensus.cc:493] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.504038 18689 raft_consensus.cc:515] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:46.506448 18299 tablet_bootstrap.cc:492] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:46.507084 18299 ts_tablet_manager.cc:1403] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.363s	user 0.024s	sys 0.007s
I20260709 12:26:46.497731 18420 raft_consensus.cc:3060] T 02af88afdc444f268f05df276bf720c0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.508440 18251 raft_consensus.cc:2468] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 2.
I20260709 12:26:46.515092 18337 consensus_queue.cc:1048] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:46.515635 18299 raft_consensus.cc:359] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:46.516373 18299 raft_consensus.cc:385] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.516669 18299 raft_consensus.cc:740] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.517145 18645 consensus_queue.cc:1048] T 09661bcb87ec455e97022bc6febc4754 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:46.527834 18652 raft_consensus.cc:515] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:46.530659 18252 raft_consensus.cc:2393] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in current term 1: Already voted for candidate 10c938681fc04e66968531267f39f16c in this term.
I20260709 12:26:46.508447 18300 raft_consensus.cc:359] T ed8548d1e22c49f7a5341ec0e2f7b073 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:46.531967 18300 raft_consensus.cc:385] T ed8548d1e22c49f7a5341ec0e2f7b073 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.532639 18300 raft_consensus.cc:740] T ed8548d1e22c49f7a5341ec0e2f7b073 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.521726 18299 consensus_queue.cc:260] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:46.544793 18300 consensus_queue.cc:260] T ed8548d1e22c49f7a5341ec0e2f7b073 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:46.548014 18299 ts_tablet_manager.cc:1434] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.002s
I20260709 12:26:46.549170 18299 tablet_bootstrap.cc:492] T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:46.577304 18420 raft_consensus.cc:515] T 02af88afdc444f268f05df276bf720c0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:46.577591 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02af88afdc444f268f05df276bf720c0" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:46.579276 18029 raft_consensus.cc:3060] T 02af88afdc444f268f05df276bf720c0 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.579721 18300 ts_tablet_manager.cc:1434] T ed8548d1e22c49f7a5341ec0e2f7b073 P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.112s	user 0.014s	sys 0.000s
I20260709 12:26:46.580535 18420 leader_election.cc:290] T 02af88afdc444f268f05df276bf720c0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Requested vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:46.580765 18652 leader_election.cc:290] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Requested vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:46.581144 18694 raft_consensus.cc:493] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.581682 18694 raft_consensus.cc:515] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:46.591701 18692 raft_consensus.cc:515] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:46.596606 18174 raft_consensus.cc:2468] T 57c55f2aea594f27bd7ce646464ea07c P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 2.
I20260709 12:26:46.597628 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2114d69fe2c427599f225a7b0686dee" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:46.597645 18689 leader_election.cc:290] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
W20260709 12:26:46.582049 17995 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:43695, user_credentials={real_user=slave}} blocked reactor thread for 308998us
W20260709 12:26:46.601397 17995 leader_election.cc:343] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.602984 18101 raft_consensus.cc:2468] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 1.
I20260709 12:26:46.602694 17927 catalog_manager.cc:5697] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d reported cstate change: term changed from 0 to 1, leader changed from <none> to a08ea42cd3884210924a19c8f570486d (127.9.145.195). New cstate: current_term: 1 leader_uuid: "a08ea42cd3884210924a19c8f570486d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:46.604430 17927 catalog_manager.cc:5697] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d reported cstate change: term changed from 0 to 1, leader changed from <none> to a08ea42cd3884210924a19c8f570486d (127.9.145.195). New cstate: current_term: 1 leader_uuid: "a08ea42cd3884210924a19c8f570486d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.607051 18171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2114d69fe2c427599f225a7b0686dee" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:46.594018 18692 leader_election.cc:290] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Requested vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:46.603518 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2114d69fe2c427599f225a7b0686dee" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:46.608532 18171 raft_consensus.cc:3060] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.598542 18026 raft_consensus.cc:2393] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a08ea42cd3884210924a19c8f570486d in current term 1: Already voted for candidate ac42e2bcf9ac42448a84370269bc6ccc in this term.
I20260709 12:26:46.605384 18173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3e4e4b25f84008b5cd603640f2252f" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:46.608171 18299 tablet_bootstrap.cc:654] T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.620025 18029 raft_consensus.cc:2468] T 02af88afdc444f268f05df276bf720c0 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 1.
I20260709 12:26:46.580775 18300 tablet_bootstrap.cc:492] T 2a3e4e4b25f84008b5cd603640f2252f P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:46.583611 18694 leader_election.cc:290] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:46.635069 18070 leader_election.cc:304] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:46.635886 18298 tablet_bootstrap.cc:492] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:46.636492 18298 ts_tablet_manager.cc:1403] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.242s	user 0.037s	sys 0.032s
I20260709 12:26:46.636653 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447aa2b8d4547c0b737643187aa4bd0" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:46.637670 18446 raft_consensus.cc:2804] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:46.638260 18446 raft_consensus.cc:697] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 LEADER]: Becoming Leader. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Running, Role: LEADER
I20260709 12:26:46.639274 18298 raft_consensus.cc:359] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:46.641286 18298 raft_consensus.cc:385] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.641623 18298 raft_consensus.cc:740] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.642530 18298 consensus_queue.cc:260] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:46.644937 18298 ts_tablet_manager.cc:1434] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
W20260709 12:26:46.652144 17995 leader_election.cc:343] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.652624 18216 leader_election.cc:304] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:46.655640 17992 leader_election.cc:304] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: a08ea42cd3884210924a19c8f570486d
I20260709 12:26:46.655897 18652 raft_consensus.cc:2804] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:46.656492 18652 raft_consensus.cc:697] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Becoming Leader. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:26:46.657140 18691 raft_consensus.cc:2804] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:46.657755 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02af88afdc444f268f05df276bf720c0" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:46.657709 18691 raft_consensus.cc:697] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 LEADER]: Becoming Leader. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Running, Role: LEADER
I20260709 12:26:46.656180 18446 consensus_queue.cc:237] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:46.658583 18102 raft_consensus.cc:2393] T 02af88afdc444f268f05df276bf720c0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c938681fc04e66968531267f39f16c in current term 1: Already voted for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in this term.
I20260709 12:26:46.658914 18691 consensus_queue.cc:237] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:46.673501 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02af88afdc444f268f05df276bf720c0" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:46.673853 18298 tablet_bootstrap.cc:492] T 8447aa2b8d4547c0b737643187aa4bd0 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:46.674481 18029 raft_consensus.cc:2393] T 02af88afdc444f268f05df276bf720c0 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in current term 1: Already voted for candidate 10c938681fc04e66968531267f39f16c in this term.
I20260709 12:26:46.637917 18171 raft_consensus.cc:2468] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 1.
I20260709 12:26:46.672561 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2114d69fe2c427599f225a7b0686dee" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:46.684640 18251 raft_consensus.cc:2468] T e2114d69fe2c427599f225a7b0686dee P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 0.
I20260709 12:26:46.686657 18249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2114d69fe2c427599f225a7b0686dee" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:46.687369 18249 raft_consensus.cc:3060] T e2114d69fe2c427599f225a7b0686dee P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.689275 18141 leader_election.cc:304] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d; no voters: ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:46.690569 18606 raft_consensus.cc:2764] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260709 12:26:46.691607 17992 leader_election.cc:343] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10c938681fc04e66968531267f39f16c (127.9.145.196:37881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.658042 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447aa2b8d4547c0b737643187aa4bd0" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:46.734011 18303 tablet_bootstrap.cc:492] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:46.734782 18303 ts_tablet_manager.cc:1403] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.287s	user 0.022s	sys 0.015s
I20260709 12:26:46.735677 18698 raft_consensus.cc:493] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.736258 18698 raft_consensus.cc:515] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:46.657331 18652 consensus_queue.cc:237] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
W20260709 12:26:46.741818 18345 log.cc:927] Time spent T 00000000000000000000000000000000 P 03e98baed3d2465499fb533f47c7aecd: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:26:46.745004 18687 consensus_queue.cc:1048] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:26:46.750766 17992 leader_election.cc:343] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.751327 17992 leader_election.cc:304] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac42e2bcf9ac42448a84370269bc6ccc; no voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c
I20260709 12:26:46.753708 18364 raft_consensus.cc:2749] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:46.741681 18300 tablet_bootstrap.cc:654] T 2a3e4e4b25f84008b5cd603640f2252f P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.737699 17995 leader_election.cc:304] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:46.795953 18698 leader_election.cc:290] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
W20260709 12:26:46.782778 17995 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:43695, user_credentials={real_user=slave}} blocked reactor thread for 45162.7us
I20260709 12:26:46.801295 18249 raft_consensus.cc:2468] T e2114d69fe2c427599f225a7b0686dee P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 1.
I20260709 12:26:46.806815 18303 raft_consensus.cc:359] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:46.812683 18299 tablet_bootstrap.cc:492] T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:46.813596 18299 ts_tablet_manager.cc:1403] T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.265s	user 0.055s	sys 0.017s
I20260709 12:26:46.784348 18691 raft_consensus.cc:2804] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:46.814584 18691 raft_consensus.cc:697] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc [term 1 LEADER]: Becoming Leader. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Running, Role: LEADER
I20260709 12:26:46.816334 18691 consensus_queue.cc:237] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:46.817214 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02af88afdc444f268f05df276bf720c0" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:46.818293 18303 raft_consensus.cc:385] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.813536 18298 tablet_bootstrap.cc:654] T 8447aa2b8d4547c0b737643187aa4bd0 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:46.796159 17975 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:46.821607 18299 raft_consensus.cc:359] T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:46.827682 18299 raft_consensus.cc:385] T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.821864 18303 raft_consensus.cc:740] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.828024 18299 raft_consensus.cc:740] T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.831351 18299 consensus_queue.cc:260] T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:46.786495 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed8548d1e22c49f7a5341ec0e2f7b073" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:46.829070 18303 consensus_queue.cc:260] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
W20260709 12:26:46.793711 18070 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.195:43695, user_credentials={real_user=slave}} blocked reactor thread for 158719us
I20260709 12:26:46.844748 18067 leader_election.cc:304] T 02af88afdc444f268f05df276bf720c0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:46.833244 18568 consensus_queue.cc:1048] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:26:46.841898 18026 raft_consensus.cc:2468] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 0.
I20260709 12:26:46.858381 18171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed8548d1e22c49f7a5341ec0e2f7b073" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:46.859251 18171 raft_consensus.cc:2468] T ed8548d1e22c49f7a5341ec0e2f7b073 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 0.
I20260709 12:26:46.859335 18068 leader_election.cc:304] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:46.859823 18303 ts_tablet_manager.cc:1434] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.125s	user 0.007s	sys 0.000s
I20260709 12:26:46.860303 18685 raft_consensus.cc:2804] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.860728 18685 raft_consensus.cc:493] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.860853 18303 tablet_bootstrap.cc:492] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:46.854656 18299 ts_tablet_manager.cc:1434] T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 12:26:46.866847 18299 tablet_bootstrap.cc:492] T 11b3b0ee25aa435586a0fd8c3f186681 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:46.876976 18698 consensus_queue.cc:1048] T 09661bcb87ec455e97022bc6febc4754 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:26:46.840729 18216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:36743, user_credentials={real_user=slave}} blocked reactor thread for 43896.6us
I20260709 12:26:46.864840 18685 raft_consensus.cc:3060] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:46.857229 18218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:43695, user_credentials={real_user=slave}} blocked reactor thread for 49677.4us
I20260709 12:26:46.854511 18689 consensus_queue.cc:1048] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:26:46.903610 18300 tablet_bootstrap.cc:492] T 2a3e4e4b25f84008b5cd603640f2252f P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:46.904263 18300 ts_tablet_manager.cc:1403] T 2a3e4e4b25f84008b5cd603640f2252f P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.324s	user 0.026s	sys 0.032s
I20260709 12:26:46.870396 18606 consensus_queue.cc:1048] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 12:26:46.907768 18300 raft_consensus.cc:359] T 2a3e4e4b25f84008b5cd603640f2252f P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:46.908134 18687 consensus_queue.cc:1048] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:46.910637 18300 raft_consensus.cc:385] T 2a3e4e4b25f84008b5cd603640f2252f P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.912093 18300 raft_consensus.cc:740] T 2a3e4e4b25f84008b5cd603640f2252f P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.863845 18446 raft_consensus.cc:2749] T 02af88afdc444f268f05df276bf720c0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:46.921005 17924 catalog_manager.cc:5697] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc reported cstate change: term changed from 0 to 1, leader changed from <none> to ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193). New cstate: current_term: 1 leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:46.930960 18067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:37881, user_credentials={real_user=slave}} blocked reactor thread for 62715.8us
I20260709 12:26:46.909880 18649 consensus_queue.cc:1048] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 12:26:46.943894 18300 consensus_queue.cc:260] T 2a3e4e4b25f84008b5cd603640f2252f P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:46.953668 18299 tablet_bootstrap.cc:654] T 11b3b0ee25aa435586a0fd8c3f186681 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.983001 18300 ts_tablet_manager.cc:1434] T 2a3e4e4b25f84008b5cd603640f2252f P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.078s	user 0.008s	sys 0.000s
I20260709 12:26:46.987625 18300 tablet_bootstrap.cc:492] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:47.036088 18606 raft_consensus.cc:493] T 2a3e4e4b25f84008b5cd603640f2252f P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.036226 18300 tablet_bootstrap.cc:654] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.037058 18606 raft_consensus.cc:515] T 2a3e4e4b25f84008b5cd603640f2252f P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:47.042136 18298 tablet_bootstrap.cc:492] T 8447aa2b8d4547c0b737643187aa4bd0 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:47.042687 18298 ts_tablet_manager.cc:1403] T 8447aa2b8d4547c0b737643187aa4bd0 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.369s	user 0.017s	sys 0.015s
I20260709 12:26:47.043229 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3e4e4b25f84008b5cd603640f2252f" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:47.044123 18098 raft_consensus.cc:2393] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a08ea42cd3884210924a19c8f570486d in current term 1: Already voted for candidate ac42e2bcf9ac42448a84370269bc6ccc in this term.
I20260709 12:26:47.045619 18606 leader_election.cc:290] T 2a3e4e4b25f84008b5cd603640f2252f P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:47.042456 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3e4e4b25f84008b5cd603640f2252f" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:47.023305 17926 catalog_manager.cc:5697] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c reported cstate change: term changed from 0 to 2, leader changed from <none> to 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194). New cstate: current_term: 2 leader_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:47.059299 18303 tablet_bootstrap.cc:654] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.066135 18142 leader_election.cc:304] T 2a3e4e4b25f84008b5cd603640f2252f P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a08ea42cd3884210924a19c8f570486d; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:47.080710 18298 raft_consensus.cc:359] T 8447aa2b8d4547c0b737643187aa4bd0 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:47.084430 18298 raft_consensus.cc:385] T 8447aa2b8d4547c0b737643187aa4bd0 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.084800 18298 raft_consensus.cc:740] T 8447aa2b8d4547c0b737643187aa4bd0 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.076115 18568 raft_consensus.cc:3060] T 2a3e4e4b25f84008b5cd603640f2252f P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.108430 18591 raft_consensus.cc:493] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.109057 18591 raft_consensus.cc:515] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:47.137607 18591 leader_election.cc:290] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:47.121703 17924 catalog_manager.cc:5697] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc reported cstate change: term changed from 0 to 1, leader changed from <none> to ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193). New cstate: current_term: 1 leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:47.137697 18171 raft_consensus.cc:1275] T 57c55f2aea594f27bd7ce646464ea07c P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Refusing update from remote peer 3a269a9c95e0476d9e09c25b4b5aaa2c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:26:47.140128 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa7d7ddefbe4ff394a232a4f45e5cd4" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
W20260709 12:26:47.142235 18218 leader_election.cc:343] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.143410 18298 consensus_queue.cc:260] T 8447aa2b8d4547c0b737643187aa4bd0 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:47.145344 18298 ts_tablet_manager.cc:1434] T 8447aa2b8d4547c0b737643187aa4bd0 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.102s	user 0.006s	sys 0.000s
I20260709 12:26:47.173967 18298 tablet_bootstrap.cc:492] T bdc0b28c91d54918b8a914c137f9543f P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:47.148197 18645 consensus_queue.cc:1048] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:47.148299 18025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa7d7ddefbe4ff394a232a4f45e5cd4" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:47.178735 18025 raft_consensus.cc:2468] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 0.
I20260709 12:26:47.162608 18685 raft_consensus.cc:515] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:47.179935 17926 catalog_manager.cc:5697] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c938681fc04e66968531267f39f16c (127.9.145.196). New cstate: current_term: 1 leader_uuid: "10c938681fc04e66968531267f39f16c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:47.182847 18171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed8548d1e22c49f7a5341ec0e2f7b073" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:47.183539 18171 raft_consensus.cc:3060] T ed8548d1e22c49f7a5341ec0e2f7b073 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.184619 18216 leader_election.cc:304] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: a08ea42cd3884210924a19c8f570486d
I20260709 12:26:47.185595 18591 raft_consensus.cc:2804] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:47.189801 18685 leader_election.cc:290] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Requested vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:47.191697 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed8548d1e22c49f7a5341ec0e2f7b073" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:47.185958 18591 raft_consensus.cc:493] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.194368 18024 raft_consensus.cc:3060] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.196744 18171 raft_consensus.cc:2468] T ed8548d1e22c49f7a5341ec0e2f7b073 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 1.
I20260709 12:26:47.194330 18591 raft_consensus.cc:3060] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.200138 18070 leader_election.cc:304] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:47.203644 18685 raft_consensus.cc:2804] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:47.204303 18685 raft_consensus.cc:697] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Becoming Leader. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Running, Role: LEADER
I20260709 12:26:47.210985 18685 consensus_queue.cc:237] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:47.218544 18024 raft_consensus.cc:2468] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 1.
I20260709 12:26:47.201624 18568 raft_consensus.cc:2749] T 2a3e4e4b25f84008b5cd603640f2252f P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:47.223234 18591 raft_consensus.cc:515] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:47.229986 18337 consensus_queue.cc:1048] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:47.236590 18446 raft_consensus.cc:493] T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.324534 18298 tablet_bootstrap.cc:654] T bdc0b28c91d54918b8a914c137f9543f P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.294562 18446 raft_consensus.cc:515] T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:47.405278 18299 tablet_bootstrap.cc:492] T 11b3b0ee25aa435586a0fd8c3f186681 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:47.330667 18691 consensus_queue.cc:1048] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.049s
I20260709 12:26:47.405929 18299 ts_tablet_manager.cc:1403] T 11b3b0ee25aa435586a0fd8c3f186681 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.539s	user 0.023s	sys 0.039s
I20260709 12:26:47.422044 18300 tablet_bootstrap.cc:492] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:47.422654 18300 ts_tablet_manager.cc:1403] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.439s	user 0.035s	sys 0.049s
I20260709 12:26:47.424026 18303 tablet_bootstrap.cc:492] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:47.424611 18303 ts_tablet_manager.cc:1403] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.564s	user 0.028s	sys 0.019s
I20260709 12:26:47.413884 18641 consensus_queue.cc:1048] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:26:47.446511 18299 raft_consensus.cc:359] T 11b3b0ee25aa435586a0fd8c3f186681 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:47.447350 18299 raft_consensus.cc:385] T 11b3b0ee25aa435586a0fd8c3f186681 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.447618 18299 raft_consensus.cc:740] T 11b3b0ee25aa435586a0fd8c3f186681 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.448400 18299 consensus_queue.cc:260] T 11b3b0ee25aa435586a0fd8c3f186681 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:47.450579 18303 raft_consensus.cc:359] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:47.451495 18303 raft_consensus.cc:385] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.451782 18303 raft_consensus.cc:740] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.454545 18303 consensus_queue.cc:260] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:47.447721 18707 consensus_queue.cc:1048] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:26:47.460201 18591 leader_election.cc:290] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Requested vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:47.460959 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447aa2b8d4547c0b737643187aa4bd0" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:47.461654 18029 raft_consensus.cc:2468] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 0.
I20260709 12:26:47.463322 18303 ts_tablet_manager.cc:1434] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 12:26:47.457644 18446 leader_election.cc:290] T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:47.464272 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa7d7ddefbe4ff394a232a4f45e5cd4" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:47.468408 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa7d7ddefbe4ff394a232a4f45e5cd4" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:47.469108 18029 raft_consensus.cc:3060] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.482937 18068 leader_election.cc:304] T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:47.484035 18698 raft_consensus.cc:2804] T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:47.484431 18698 raft_consensus.cc:493] T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.484777 18698 raft_consensus.cc:3060] T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.464411 18303 tablet_bootstrap.cc:492] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:47.494303 18641 consensus_queue.cc:1048] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:26:47.503667 18218 leader_election.cc:343] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.529026 18299 ts_tablet_manager.cc:1434] T 11b3b0ee25aa435586a0fd8c3f186681 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.122s	user 0.007s	sys 0.000s
I20260709 12:26:47.532253 18300 raft_consensus.cc:359] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:47.533324 18300 raft_consensus.cc:385] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.533685 18300 raft_consensus.cc:740] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.535333 18029 raft_consensus.cc:2468] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 1.
W20260709 12:26:47.541260 18141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:45595, user_credentials={real_user=slave}} blocked reactor thread for 53736.7us
I20260709 12:26:47.544943 18300 consensus_queue.cc:260] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:47.553615 18299 tablet_bootstrap.cc:492] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:47.566455 18337 raft_consensus.cc:493] T 8447aa2b8d4547c0b737643187aa4bd0 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.567122 18337 raft_consensus.cc:515] T 8447aa2b8d4547c0b737643187aa4bd0 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:47.600692 18333 consensus_queue.cc:1048] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:47.601188 18216 leader_election.cc:304] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: a08ea42cd3884210924a19c8f570486d
I20260709 12:26:47.611151 18337 leader_election.cc:290] T 8447aa2b8d4547c0b737643187aa4bd0 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
W20260709 12:26:47.663344 18215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:45595, user_credentials={real_user=slave}} blocked reactor thread for 57121.2us
W20260709 12:26:47.676728 18216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:36743, user_credentials={real_user=slave}} blocked reactor thread for 75612us
I20260709 12:26:47.672345 18591 raft_consensus.cc:2804] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:47.677652 18591 raft_consensus.cc:697] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Becoming Leader. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:26:47.678669 18591 consensus_queue.cc:237] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:47.680210 18300 ts_tablet_manager.cc:1434] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.257s	user 0.007s	sys 0.007s
W20260709 12:26:47.682349 18141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:37881, user_credentials={real_user=slave}} blocked reactor thread for 86588.1us
W20260709 12:26:47.644068 18070 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:43695, user_credentials={real_user=slave}} blocked reactor thread for 48183.6us
I20260709 12:26:47.709693 18300 tablet_bootstrap.cc:492] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:47.713666 18298 tablet_bootstrap.cc:492] T bdc0b28c91d54918b8a914c137f9543f P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:47.714438 18298 ts_tablet_manager.cc:1403] T bdc0b28c91d54918b8a914c137f9543f P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.541s	user 0.006s	sys 0.014s
I20260709 12:26:47.746961 18420 raft_consensus.cc:493] T 11b3b0ee25aa435586a0fd8c3f186681 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.749820 18420 raft_consensus.cc:515] T 11b3b0ee25aa435586a0fd8c3f186681 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
W20260709 12:26:47.752480 18215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:45595, user_credentials={real_user=slave}} blocked reactor thread for 88288.1us
I20260709 12:26:47.751989 18420 leader_election.cc:290] T 11b3b0ee25aa435586a0fd8c3f186681 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:47.755101 18299 tablet_bootstrap.cc:654] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.768353 18303 tablet_bootstrap.cc:654] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.853674 18298 raft_consensus.cc:359] T bdc0b28c91d54918b8a914c137f9543f P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:47.854584 18298 raft_consensus.cc:385] T bdc0b28c91d54918b8a914c137f9543f P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.854889 18298 raft_consensus.cc:740] T bdc0b28c91d54918b8a914c137f9543f P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.777016 18698 raft_consensus.cc:515] T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:47.862640 18298 consensus_queue.cc:260] T bdc0b28c91d54918b8a914c137f9543f P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
W20260709 12:26:47.867354 18215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:45595, user_credentials={real_user=slave}} blocked reactor thread for 114182us
I20260709 12:26:47.908022 18606 raft_consensus.cc:493] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.908674 18606 raft_consensus.cc:515] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:47.929327 18300 tablet_bootstrap.cc:654] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:47.931706 17992 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:45595, user_credentials={real_user=slave}} blocked reactor thread for 149454us
I20260709 12:26:47.933549 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447aa2b8d4547c0b737643187aa4bd0" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:47.934295 18027 raft_consensus.cc:2468] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 0.
W20260709 12:26:47.951467 18215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:45595, user_credentials={real_user=slave}} blocked reactor thread for 50635.4us
I20260709 12:26:47.966965 18298 ts_tablet_manager.cc:1434] T bdc0b28c91d54918b8a914c137f9543f P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.252s	user 0.011s	sys 0.001s
I20260709 12:26:47.968184 18298 tablet_bootstrap.cc:492] T 0d8b927123c04143a7b87fa8f129a9e7 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:47.965240 18742 raft_consensus.cc:493] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.993307 18685 consensus_queue.cc:1048] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:26:48.002362 18747 log.cc:927] Time spent T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:26:48.008659 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447aa2b8d4547c0b737643187aa4bd0" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:48.009759 18098 raft_consensus.cc:2393] T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c938681fc04e66968531267f39f16c in current term 1: Already voted for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in this term.
I20260709 12:26:47.987989 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11b3b0ee25aa435586a0fd8c3f186681" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:47.999576 18446 consensus_queue.cc:1048] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 12:26:47.990325 18247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447aa2b8d4547c0b737643187aa4bd0" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:48.027174 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11b3b0ee25aa435586a0fd8c3f186681" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:48.026326 18251 raft_consensus.cc:1275] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Refusing update from remote peer 3a269a9c95e0476d9e09c25b4b5aaa2c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:26:47.988873 18742 raft_consensus.cc:515] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
W20260709 12:26:48.044365 18068 leader_election.cc:343] T 11b3b0ee25aa435586a0fd8c3f186681 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.059316 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447aa2b8d4547c0b737643187aa4bd0" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:48.034277 18247 raft_consensus.cc:2468] T 8447aa2b8d4547c0b737643187aa4bd0 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 0.
I20260709 12:26:48.064711 18698 leader_election.cc:290] T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Requested vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:48.067134 18606 leader_election.cc:290] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:48.090601 18247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa7d7ddefbe4ff394a232a4f45e5cd4" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:48.107045 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447aa2b8d4547c0b737643187aa4bd0" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:48.107735 18029 raft_consensus.cc:3060] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:48.098269 18070 leader_election.cc:343] T 11b3b0ee25aa435586a0fd8c3f186681 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.110234 18070 leader_election.cc:304] T 11b3b0ee25aa435586a0fd8c3f186681 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:48.113430 18742 leader_election.cc:290] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:48.114799 18298 tablet_bootstrap.cc:654] T 0d8b927123c04143a7b87fa8f129a9e7 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:48.086175 17995 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:43695, user_credentials={real_user=slave}} blocked reactor thread for 109281us
I20260709 12:26:48.125361 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa7d7ddefbe4ff394a232a4f45e5cd4" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:48.144124 18024 raft_consensus.cc:2393] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a08ea42cd3884210924a19c8f570486d in current term 1: Already voted for candidate 10c938681fc04e66968531267f39f16c in this term.
I20260709 12:26:48.122575 18698 raft_consensus.cc:2749] T 11b3b0ee25aa435586a0fd8c3f186681 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:48.143882 18247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b28c91d54918b8a914c137f9543f" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:48.145433 18247 raft_consensus.cc:2468] T bdc0b28c91d54918b8a914c137f9543f P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 0.
I20260709 12:26:48.146693 18300 tablet_bootstrap.cc:492] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:48.147264 18300 ts_tablet_manager.cc:1403] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.465s	user 0.014s	sys 0.013s
I20260709 12:26:48.129827 18216 leader_election.cc:304] T 8447aa2b8d4547c0b737643187aa4bd0 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c
I20260709 12:26:48.127537 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b28c91d54918b8a914c137f9543f" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:48.150221 18655 raft_consensus.cc:2804] T 8447aa2b8d4547c0b737643187aa4bd0 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.150635 18655 raft_consensus.cc:493] T 8447aa2b8d4547c0b737643187aa4bd0 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.150983 18655 raft_consensus.cc:3060] T 8447aa2b8d4547c0b737643187aa4bd0 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.163540 18029 raft_consensus.cc:2468] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 1.
I20260709 12:26:48.167111 18300 raft_consensus.cc:359] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:48.172412 18300 raft_consensus.cc:385] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.173377 18303 tablet_bootstrap.cc:492] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:48.173998 18303 ts_tablet_manager.cc:1403] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.710s	user 0.013s	sys 0.025s
W20260709 12:26:48.174543 18142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:36743, user_credentials={real_user=slave}} blocked reactor thread for 93954.6us
I20260709 12:26:48.172748 18300 raft_consensus.cc:740] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.186921 17992 leader_election.cc:304] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:48.189531 18300 consensus_queue.cc:260] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:48.194306 18364 raft_consensus.cc:2804] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.194900 18364 raft_consensus.cc:493] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.195257 18364 raft_consensus.cc:3060] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.187688 18645 consensus_queue.cc:1048] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:26:48.214435 18303 raft_consensus.cc:359] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:48.215302 18303 raft_consensus.cc:385] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.215935 18303 raft_consensus.cc:740] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.216210 18299 tablet_bootstrap.cc:492] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:48.216727 18299 ts_tablet_manager.cc:1403] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.663s	user 0.036s	sys 0.027s
I20260709 12:26:48.217550 18303 consensus_queue.cc:260] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:48.227561 18303 ts_tablet_manager.cc:1434] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.053s	user 0.004s	sys 0.002s
I20260709 12:26:48.228612 18303 tablet_bootstrap.cc:492] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:48.233312 18300 ts_tablet_manager.cc:1434] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.086s	user 0.003s	sys 0.006s
W20260709 12:26:48.235697 17992 leader_election.cc:343] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.240141 18300 tablet_bootstrap.cc:492] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:48.239959 18068 leader_election.cc:304] T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 10c938681fc04e66968531267f39f16c
I20260709 12:26:48.291438 18713 raft_consensus.cc:2804] T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:48.292037 18713 raft_consensus.cc:697] T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Becoming Leader. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Running, Role: LEADER
I20260709 12:26:48.292903 18713 consensus_queue.cc:237] T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:48.293507 18364 raft_consensus.cc:515] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:48.306777 18247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b28c91d54918b8a914c137f9543f" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:48.307694 18247 raft_consensus.cc:3060] T bdc0b28c91d54918b8a914c137f9543f P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:48.308765 18141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.196:37881, user_credentials={real_user=slave}} blocked reactor thread for 226197us
I20260709 12:26:48.301316 18364 leader_election.cc:290] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Requested vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:48.314920 18709 raft_consensus.cc:493] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3a269a9c95e0476d9e09c25b4b5aaa2c)
I20260709 12:26:48.315712 18709 raft_consensus.cc:515] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:48.323282 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b28c91d54918b8a914c137f9543f" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:48.326831 18299 raft_consensus.cc:359] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:48.327746 18299 raft_consensus.cc:385] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.328058 18299 raft_consensus.cc:740] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.328948 18299 consensus_queue.cc:260] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:48.337873 18299 ts_tablet_manager.cc:1434] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.121s	user 0.007s	sys 0.000s
I20260709 12:26:48.338996 18299 tablet_bootstrap.cc:492] T 0d8b927123c04143a7b87fa8f129a9e7 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Bootstrap starting.
I20260709 12:26:48.348982 18141 leader_election.cc:304] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a08ea42cd3884210924a19c8f570486d; no voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:48.350409 18709 leader_election.cc:290] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:48.350291 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adcc9c41a0d4ffe92d5aa05859d55f5" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:48.352332 18100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adcc9c41a0d4ffe92d5aa05859d55f5" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:48.355674 18745 raft_consensus.cc:3060] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.361013 18303 tablet_bootstrap.cc:654] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.360636 18216 leader_election.cc:304] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c938681fc04e66968531267f39f16c; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:48.369390 18337 raft_consensus.cc:2749] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:48.378778 18247 raft_consensus.cc:2468] T bdc0b28c91d54918b8a914c137f9543f P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 1.
I20260709 12:26:48.386123 17992 leader_election.cc:304] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:48.359896 18655 raft_consensus.cc:515] T 8447aa2b8d4547c0b737643187aa4bd0 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:48.410311 18364 raft_consensus.cc:2804] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:48.421818 18749 consensus_queue.cc:1048] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:26:48.429381 18364 raft_consensus.cc:697] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 LEADER]: Becoming Leader. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Running, Role: LEADER
I20260709 12:26:48.430467 18364 consensus_queue.cc:237] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:48.440629 18745 raft_consensus.cc:2749] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:48.442582 18099 raft_consensus.cc:3060] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:48.440721 17975 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:48.452786 18748 raft_consensus.cc:493] T 09661bcb87ec455e97022bc6febc4754 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3a269a9c95e0476d9e09c25b4b5aaa2c)
I20260709 12:26:48.453424 18748 raft_consensus.cc:515] T 09661bcb87ec455e97022bc6febc4754 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
W20260709 12:26:48.454609 18768 log.cc:927] Time spent T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:26:48.457333 18655 leader_election.cc:290] T 8447aa2b8d4547c0b737643187aa4bd0 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Requested vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:48.460517 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447aa2b8d4547c0b737643187aa4bd0" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:48.460968 18100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09661bcb87ec455e97022bc6febc4754" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:48.463977 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447aa2b8d4547c0b737643187aa4bd0" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:48.464805 18026 raft_consensus.cc:2393] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c938681fc04e66968531267f39f16c in current term 1: Already voted for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in this term.
I20260709 12:26:48.471166 18215 leader_election.cc:304] T 8447aa2b8d4547c0b737643187aa4bd0 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c938681fc04e66968531267f39f16c; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:48.480346 18300 tablet_bootstrap.cc:654] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.480620 18298 tablet_bootstrap.cc:492] T 0d8b927123c04143a7b87fa8f129a9e7 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:48.486197 18591 raft_consensus.cc:2749] T 8447aa2b8d4547c0b737643187aa4bd0 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:48.486200 18298 ts_tablet_manager.cc:1403] T 0d8b927123c04143a7b87fa8f129a9e7 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.518s	user 0.015s	sys 0.012s
I20260709 12:26:48.501530 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09661bcb87ec455e97022bc6febc4754" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:48.512871 18748 leader_election.cc:290] T 09661bcb87ec455e97022bc6febc4754 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:48.523972 18218 leader_election.cc:304] T 09661bcb87ec455e97022bc6febc4754 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c938681fc04e66968531267f39f16c; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d
I20260709 12:26:48.520581 18655 consensus_queue.cc:1048] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:26:48.534495 18299 tablet_bootstrap.cc:654] T 0d8b927123c04143a7b87fa8f129a9e7 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.520408 18651 raft_consensus.cc:493] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.537979 18651 raft_consensus.cc:515] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:48.540369 18651 leader_election.cc:290] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:48.541471 18171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c660b0ce2084a1a9fcc17139d4addd5" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
W20260709 12:26:48.539707 18778 log.cc:927] Time spent T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc: Append to log took a long time: real 0.088s	user 0.000s	sys 0.002s
I20260709 12:26:48.543401 18591 raft_consensus.cc:2749] T 09661bcb87ec455e97022bc6febc4754 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:48.547451 18757 raft_consensus.cc:493] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.548072 18757 raft_consensus.cc:515] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:48.551359 18757 leader_election.cc:290] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
W20260709 12:26:48.552325 17995 leader_election.cc:343] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:48.553097 18775 log.cc:927] Time spent T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:26:48.555868 18244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c660b0ce2084a1a9fcc17139d4addd5" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:48.556106 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8b927123c04143a7b87fa8f129a9e7" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
W20260709 12:26:48.564607 18141 leader_election.cc:343] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:48.566064 17992 leader_election.cc:343] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10c938681fc04e66968531267f39f16c (127.9.145.196:37881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.572561 17992 leader_election.cc:304] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac42e2bcf9ac42448a84370269bc6ccc; no voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d
I20260709 12:26:48.580152 18298 raft_consensus.cc:359] T 0d8b927123c04143a7b87fa8f129a9e7 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:48.581044 18298 raft_consensus.cc:385] T 0d8b927123c04143a7b87fa8f129a9e7 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.581347 18298 raft_consensus.cc:740] T 0d8b927123c04143a7b87fa8f129a9e7 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.576013 18691 raft_consensus.cc:2749] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:48.590291 18298 consensus_queue.cc:260] T 0d8b927123c04143a7b87fa8f129a9e7 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:48.609272 18303 tablet_bootstrap.cc:492] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc: No bootstrap required, opened a new log
I20260709 12:26:48.609875 18303 ts_tablet_manager.cc:1403] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.382s	user 0.012s	sys 0.032s
I20260709 12:26:48.619009 18298 ts_tablet_manager.cc:1434] T 0d8b927123c04143a7b87fa8f129a9e7 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.124s	user 0.007s	sys 0.000s
I20260709 12:26:48.593317 18099 raft_consensus.cc:2468] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 1.
I20260709 12:26:48.623930 18303 raft_consensus.cc:359] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:48.625047 18303 raft_consensus.cc:385] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.625492 18303 raft_consensus.cc:740] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.626809 18303 consensus_queue.cc:260] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:48.634953 18300 tablet_bootstrap.cc:492] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:48.635592 18300 ts_tablet_manager.cc:1403] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.401s	user 0.016s	sys 0.008s
I20260709 12:26:48.637969 18299 tablet_bootstrap.cc:492] T 0d8b927123c04143a7b87fa8f129a9e7 P 3a269a9c95e0476d9e09c25b4b5aaa2c: No bootstrap required, opened a new log
I20260709 12:26:48.638448 18299 ts_tablet_manager.cc:1403] T 0d8b927123c04143a7b87fa8f129a9e7 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent bootstrapping tablet: real 0.300s	user 0.008s	sys 0.004s
I20260709 12:26:48.638604 18300 raft_consensus.cc:359] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:48.639361 18300 raft_consensus.cc:385] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.639637 18300 raft_consensus.cc:740] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.640323 18300 consensus_queue.cc:260] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:48.640589 18299 raft_consensus.cc:359] T 0d8b927123c04143a7b87fa8f129a9e7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:48.641394 18299 raft_consensus.cc:385] T 0d8b927123c04143a7b87fa8f129a9e7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.641727 18299 raft_consensus.cc:740] T 0d8b927123c04143a7b87fa8f129a9e7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.641952 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8b927123c04143a7b87fa8f129a9e7" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:48.642704 18251 raft_consensus.cc:2468] T 0d8b927123c04143a7b87fa8f129a9e7 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 0.
I20260709 12:26:48.642910 18300 ts_tablet_manager.cc:1434] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:48.643167 18303 ts_tablet_manager.cc:1434] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:26:48.643877 18300 tablet_bootstrap.cc:492] T 2c660b0ce2084a1a9fcc17139d4addd5 P a08ea42cd3884210924a19c8f570486d: Bootstrap starting.
I20260709 12:26:48.644176 18298 tablet_bootstrap.cc:492] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c: Bootstrap starting.
I20260709 12:26:48.644217 18299 consensus_queue.cc:260] T 0d8b927123c04143a7b87fa8f129a9e7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:48.648487 18299 ts_tablet_manager.cc:1434] T 0d8b927123c04143a7b87fa8f129a9e7 P 3a269a9c95e0476d9e09c25b4b5aaa2c: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.001s
I20260709 12:26:48.650470 18300 tablet_bootstrap.cc:654] T 2c660b0ce2084a1a9fcc17139d4addd5 P a08ea42cd3884210924a19c8f570486d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.651108 18298 tablet_bootstrap.cc:654] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.770503 18757 raft_consensus.cc:493] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.772209 18757 raft_consensus.cc:515] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:48.775034 18141 leader_election.cc:304] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c
I20260709 12:26:48.775827 18757 leader_election.cc:290] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:48.776786 18754 raft_consensus.cc:2804] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.777407 18754 raft_consensus.cc:493] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.777849 18754 raft_consensus.cc:3060] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.787206 18298 tablet_bootstrap.cc:492] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c: No bootstrap required, opened a new log
I20260709 12:26:48.794378 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11b3b0ee25aa435586a0fd8c3f186681" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:48.795881 18026 raft_consensus.cc:2468] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 0.
I20260709 12:26:48.799372 18298 ts_tablet_manager.cc:1403] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c: Time spent bootstrapping tablet: real 0.155s	user 0.012s	sys 0.001s
I20260709 12:26:48.800544 18142 leader_election.cc:304] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:26:48.801664 18776 raft_consensus.cc:2804] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.802139 18776 raft_consensus.cc:493] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.802675 18776 raft_consensus.cc:3060] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.804572 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11b3b0ee25aa435586a0fd8c3f186681" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:48.805598 18104 raft_consensus.cc:2468] T 11b3b0ee25aa435586a0fd8c3f186681 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 0.
I20260709 12:26:48.794668 18754 raft_consensus.cc:515] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
W20260709 12:26:48.811317 17992 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:45595, user_credentials={real_user=slave}} blocked reactor thread for 67881.2us
I20260709 12:26:48.833272 17923 catalog_manager.cc:5697] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c938681fc04e66968531267f39f16c (127.9.145.196). New cstate: current_term: 1 leader_uuid: "10c938681fc04e66968531267f39f16c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.842715 18713 raft_consensus.cc:493] T 0d8b927123c04143a7b87fa8f129a9e7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.849618 18713 raft_consensus.cc:515] T 0d8b927123c04143a7b87fa8f129a9e7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:48.852313 18713 leader_election.cc:290] T 0d8b927123c04143a7b87fa8f129a9e7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
W20260709 12:26:48.857191 18216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:36743, user_credentials={real_user=slave}} blocked reactor thread for 99473.1us
I20260709 12:26:48.857550 18300 tablet_bootstrap.cc:492] T 2c660b0ce2084a1a9fcc17139d4addd5 P a08ea42cd3884210924a19c8f570486d: No bootstrap required, opened a new log
I20260709 12:26:48.858789 18298 raft_consensus.cc:359] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:48.859691 18298 raft_consensus.cc:385] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.860040 18298 raft_consensus.cc:740] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.860879 18298 consensus_queue.cc:260] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:48.879196 18173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8b927123c04143a7b87fa8f129a9e7" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:48.888226 18298 ts_tablet_manager.cc:1434] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c: Time spent starting tablet: real 0.088s	user 0.007s	sys 0.002s
I20260709 12:26:48.888664 18173 raft_consensus.cc:2393] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in current term 1: Already voted for candidate a08ea42cd3884210924a19c8f570486d in this term.
I20260709 12:26:48.885005 18713 consensus_queue.cc:1048] T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:26:48.895294 18754 leader_election.cc:290] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Requested vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:26:48.900952 18744 consensus_queue.cc:1048] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:48.903399 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8b927123c04143a7b87fa8f129a9e7" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:48.904923 18250 raft_consensus.cc:2468] T 0d8b927123c04143a7b87fa8f129a9e7 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 0.
I20260709 12:26:48.909885 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8b927123c04143a7b87fa8f129a9e7" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:48.912096 18101 raft_consensus.cc:3060] T 0d8b927123c04143a7b87fa8f129a9e7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.884833 18776 raft_consensus.cc:515] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:48.921538 18713 consensus_queue.cc:1048] T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:48.923313 18300 ts_tablet_manager.cc:1403] T 2c660b0ce2084a1a9fcc17139d4addd5 P a08ea42cd3884210924a19c8f570486d: Time spent bootstrapping tablet: real 0.280s	user 0.008s	sys 0.007s
I20260709 12:26:48.926565 18067 leader_election.cc:304] T 0d8b927123c04143a7b87fa8f129a9e7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: a08ea42cd3884210924a19c8f570486d
I20260709 12:26:48.945631 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8b927123c04143a7b87fa8f129a9e7" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:48.946483 18251 raft_consensus.cc:3060] T 0d8b927123c04143a7b87fa8f129a9e7 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.960321 18300 raft_consensus.cc:359] T 2c660b0ce2084a1a9fcc17139d4addd5 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:48.961440 18300 raft_consensus.cc:385] T 2c660b0ce2084a1a9fcc17139d4addd5 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.961772 18300 raft_consensus.cc:740] T 2c660b0ce2084a1a9fcc17139d4addd5 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.963707 18776 leader_election.cc:290] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Requested vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:48.964977 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11b3b0ee25aa435586a0fd8c3f186681" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:48.970408 18100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11b3b0ee25aa435586a0fd8c3f186681" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:48.971736 18100 raft_consensus.cc:3060] T 11b3b0ee25aa435586a0fd8c3f186681 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.976248 18101 raft_consensus.cc:2468] T 0d8b927123c04143a7b87fa8f129a9e7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 1.
I20260709 12:26:48.976894 18713 raft_consensus.cc:2764] T 0d8b927123c04143a7b87fa8f129a9e7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:26:48.980011 18026 raft_consensus.cc:3060] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.994376 18141 leader_election.cc:304] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:48.996261 18776 raft_consensus.cc:2804] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:48.997779 18776 raft_consensus.cc:697] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Becoming Leader. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Running, Role: LEADER
I20260709 12:26:48.999275 18251 raft_consensus.cc:2468] T 0d8b927123c04143a7b87fa8f129a9e7 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 1.
I20260709 12:26:49.005947 18300 consensus_queue.cc:260] T 2c660b0ce2084a1a9fcc17139d4addd5 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:49.007189 18364 consensus_queue.cc:1048] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:26:49.008291 18300 ts_tablet_manager.cc:1434] T 2c660b0ce2084a1a9fcc17139d4addd5 P a08ea42cd3884210924a19c8f570486d: Time spent starting tablet: real 0.084s	user 0.007s	sys 0.000s
I20260709 12:26:49.017253 18776 consensus_queue.cc:237] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:26:49.017369 18100 raft_consensus.cc:2468] T 11b3b0ee25aa435586a0fd8c3f186681 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 1.
I20260709 12:26:49.035535 18141 leader_election.cc:304] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:49.039712 18741 raft_consensus.cc:2804] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:49.040453 18741 raft_consensus.cc:697] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Becoming Leader. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Running, Role: LEADER
I20260709 12:26:49.041611 18741 consensus_queue.cc:237] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:49.050086 18026 raft_consensus.cc:2468] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 1.
I20260709 12:26:49.100951 17927 catalog_manager.cc:5697] T ed8548d1e22c49f7a5341ec0e2f7b073 P a08ea42cd3884210924a19c8f570486d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194). New cstate: current_term: 1 leader_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } }
I20260709 12:26:49.134725 17924 catalog_manager.cc:5697] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc reported cstate change: term changed from 0 to 1, leader changed from <none> to ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193). New cstate: current_term: 1 leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:49.158309 18709 raft_consensus.cc:493] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.158859 18709 raft_consensus.cc:515] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:49.160130 17927 catalog_manager.cc:5697] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d reported cstate change: term changed from 0 to 1, leader changed from <none> to a08ea42cd3884210924a19c8f570486d (127.9.145.195). New cstate: current_term: 1 leader_uuid: "a08ea42cd3884210924a19c8f570486d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:49.161962 17927 catalog_manager.cc:5697] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d reported cstate change: term changed from 0 to 1, leader changed from <none> to a08ea42cd3884210924a19c8f570486d (127.9.145.195). New cstate: current_term: 1 leader_uuid: "a08ea42cd3884210924a19c8f570486d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:49.170725 18709 leader_election.cc:290] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:49.174939 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c660b0ce2084a1a9fcc17139d4addd5" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:49.175740 18174 raft_consensus.cc:2468] T 2c660b0ce2084a1a9fcc17139d4addd5 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 0.
I20260709 12:26:49.178608 18218 leader_election.cc:304] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:49.180956 18743 raft_consensus.cc:2804] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:49.181382 18743 raft_consensus.cc:493] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.181751 18743 raft_consensus.cc:3060] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.185643 17924 catalog_manager.cc:5697] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194). New cstate: current_term: 1 leader_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } }
I20260709 12:26:49.191315 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c660b0ce2084a1a9fcc17139d4addd5" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:49.192155 18026 raft_consensus.cc:2468] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 0.
I20260709 12:26:49.202036 18743 raft_consensus.cc:515] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:49.208182 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c660b0ce2084a1a9fcc17139d4addd5" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:49.208838 18174 raft_consensus.cc:3060] T 2c660b0ce2084a1a9fcc17139d4addd5 P a08ea42cd3884210924a19c8f570486d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.210088 18743 leader_election.cc:290] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Requested vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:49.211570 18025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c660b0ce2084a1a9fcc17139d4addd5" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:49.212301 18025 raft_consensus.cc:3060] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.218917 18174 raft_consensus.cc:2468] T 2c660b0ce2084a1a9fcc17139d4addd5 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 1.
I20260709 12:26:49.220407 18218 leader_election.cc:304] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:49.221560 18743 raft_consensus.cc:2804] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:49.222182 18743 raft_consensus.cc:697] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Becoming Leader. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:26:49.223088 18743 consensus_queue.cc:237] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:49.227144 18025 raft_consensus.cc:2468] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 1.
I20260709 12:26:49.244267 17923 catalog_manager.cc:5697] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c938681fc04e66968531267f39f16c (127.9.145.196). New cstate: current_term: 1 leader_uuid: "10c938681fc04e66968531267f39f16c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:49.472900 18754 consensus_queue.cc:1048] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:49.473904 18741 consensus_queue.cc:1048] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:49.533562 18568 consensus_queue.cc:1048] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:49.549006 18754 consensus_queue.cc:1048] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:49.617275 18709 consensus_queue.cc:1048] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:49.630118 18709 consensus_queue.cc:1048] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:51.086350  9799 tablet_server.cc:179] TabletServer@127.9.145.193:0 shutting down...
W20260709 12:26:51.092988 18216 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 232 similar messages]
W20260709 12:26:51.098248 18216 consensus_peers.cc:597] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:51.122677 18216 consensus_peers.cc:597] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:51.128541  9799 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:51.130640  9799 tablet_replica.cc:333] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.131735  9799 raft_consensus.cc:2243] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.132330  9799 raft_consensus.cc:2272] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.135203  9799 tablet_replica.cc:333] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.136092  9799 raft_consensus.cc:2243] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:51.136871  9799 raft_consensus.cc:2272] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.139143  9799 tablet_replica.cc:333] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
W20260709 12:26:51.139384 18068 consensus_peers.cc:597] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:51.140002  9799 raft_consensus.cc:2243] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.140620  9799 raft_consensus.cc:2272] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:51.141209 18216 consensus_peers.cc:597] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:51.143332  9799 tablet_replica.cc:333] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.144387  9799 raft_consensus.cc:2243] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.145004  9799 raft_consensus.cc:2272] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.148118  9799 tablet_replica.cc:333] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.149055  9799 raft_consensus.cc:2243] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:51.150295  9799 raft_consensus.cc:2272] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.153575  9799 tablet_replica.cc:333] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.154476  9799 raft_consensus.cc:2243] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.155077  9799 raft_consensus.cc:2272] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.158221  9799 tablet_replica.cc:333] T 96957d639eed4a1395857a97a292f8ea P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.159070  9799 raft_consensus.cc:2243] T 96957d639eed4a1395857a97a292f8ea P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.159708  9799 raft_consensus.cc:2272] T 96957d639eed4a1395857a97a292f8ea P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.162848  9799 tablet_replica.cc:333] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.163751  9799 raft_consensus.cc:2243] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:51.173877 18068 consensus_peers.cc:597] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:51.173977 18142 consensus_peers.cc:597] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:51.174332  9799 raft_consensus.cc:2272] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:51.174800 18068 consensus_peers.cc:597] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:51.178335 18142 consensus_peers.cc:597] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:51.182672  9799 tablet_replica.cc:333] T f124d65e17c143b08d3428ef325ae9a5 P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.183609  9799 raft_consensus.cc:2243] T f124d65e17c143b08d3428ef325ae9a5 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.184187  9799 raft_consensus.cc:2272] T f124d65e17c143b08d3428ef325ae9a5 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.187186  9799 tablet_replica.cc:333] T ebb7b63685e841a2a975e727c46f1b64 P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.188007  9799 raft_consensus.cc:2243] T ebb7b63685e841a2a975e727c46f1b64 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.188544  9799 raft_consensus.cc:2272] T ebb7b63685e841a2a975e727c46f1b64 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.190897  9799 tablet_replica.cc:333] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.191694  9799 raft_consensus.cc:2243] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:51.192875  9799 raft_consensus.cc:2272] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.196096  9799 tablet_replica.cc:333] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.197031  9799 raft_consensus.cc:2243] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:51.198186  9799 raft_consensus.cc:2272] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.201085  9799 tablet_replica.cc:333] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.201855  9799 raft_consensus.cc:2243] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.202553  9799 raft_consensus.cc:2272] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:51.204806 18068 consensus_peers.cc:597] T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:51.205678  9799 tablet_replica.cc:333] T 049a535902f64c44bb4e1b9ecc92694c P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.206516  9799 raft_consensus.cc:2243] T 049a535902f64c44bb4e1b9ecc92694c P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.207023  9799 raft_consensus.cc:2272] T 049a535902f64c44bb4e1b9ecc92694c P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.210299  9799 tablet_replica.cc:333] T 02af88afdc444f268f05df276bf720c0 P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.211179  9799 raft_consensus.cc:2243] T 02af88afdc444f268f05df276bf720c0 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:51.211377 18216 consensus_peers.cc:597] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:51.211689  9799 raft_consensus.cc:2272] T 02af88afdc444f268f05df276bf720c0 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.214188  9799 tablet_replica.cc:333] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.214911  9799 raft_consensus.cc:2243] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.215438  9799 raft_consensus.cc:2272] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.217517  9799 tablet_replica.cc:333] T f68e8047f5ff4aa0b631cbd912091d25 P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.218411  9799 raft_consensus.cc:2243] T f68e8047f5ff4aa0b631cbd912091d25 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.219040  9799 raft_consensus.cc:2272] T f68e8047f5ff4aa0b631cbd912091d25 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.221992  9799 tablet_replica.cc:333] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.222906  9799 raft_consensus.cc:2243] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.223418  9799 raft_consensus.cc:2272] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.226145  9799 tablet_replica.cc:333] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
W20260709 12:26:51.226307 18216 consensus_peers.cc:597] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:51.226924  9799 raft_consensus.cc:2243] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.227486  9799 raft_consensus.cc:2272] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.229894  9799 tablet_replica.cc:333] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.230593  9799 raft_consensus.cc:2243] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.231055  9799 raft_consensus.cc:2272] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.233603  9799 tablet_replica.cc:333] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.234459  9799 raft_consensus.cc:2243] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:51.235472  9799 raft_consensus.cc:2272] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.238224  9799 tablet_replica.cc:333] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.238844  9799 raft_consensus.cc:2243] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.239355  9799 raft_consensus.cc:2272] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:51.240990 18142 consensus_peers.cc:597] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:51.241993  9799 tablet_replica.cc:333] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.242924  9799 raft_consensus.cc:2243] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.243479  9799 raft_consensus.cc:2272] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:51.243659 18216 consensus_peers.cc:597] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:51.246279  9799 tablet_replica.cc:333] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
W20260709 12:26:51.247006 18068 consensus_peers.cc:597] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:51.247143  9799 raft_consensus.cc:2243] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:51.248366  9799 raft_consensus.cc:2272] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.251151  9799 tablet_replica.cc:333] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.251768  9799 raft_consensus.cc:2243] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.252406  9799 raft_consensus.cc:2272] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.255381  9799 tablet_replica.cc:333] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.256248  9799 raft_consensus.cc:2243] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:51.256614 18142 consensus_peers.cc:597] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:51.256855  9799 raft_consensus.cc:2272] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:51.257525 18142 consensus_peers.cc:597] T 7dbf7d84f5ff496e905988250445db74 P a08ea42cd3884210924a19c8f570486d -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:51.259678  9799 tablet_replica.cc:333] T 7dbf7d84f5ff496e905988250445db74 P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.260553  9799 raft_consensus.cc:2243] T 7dbf7d84f5ff496e905988250445db74 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.261121  9799 raft_consensus.cc:2272] T 7dbf7d84f5ff496e905988250445db74 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:51.263109 18142 consensus_peers.cc:597] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:51.264133  9799 tablet_replica.cc:333] T a61bb69fcfd54ef88c37917a48d1cb30 P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
W20260709 12:26:51.264521 18142 consensus_peers.cc:597] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:51.265062  9799 raft_consensus.cc:2243] T a61bb69fcfd54ef88c37917a48d1cb30 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.265579  9799 raft_consensus.cc:2272] T a61bb69fcfd54ef88c37917a48d1cb30 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.268342  9799 tablet_replica.cc:333] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.269160  9799 raft_consensus.cc:2243] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.269712  9799 raft_consensus.cc:2272] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.272392  9799 tablet_replica.cc:333] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.273186  9799 raft_consensus.cc:2243] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.273742  9799 raft_consensus.cc:2272] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.276613  9799 tablet_replica.cc:333] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.277443  9799 raft_consensus.cc:2243] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:51.278537  9799 raft_consensus.cc:2272] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.280741  9799 tablet_replica.cc:333] T d8b351ffd4864761bb49da4eceac3566 P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.281410  9799 raft_consensus.cc:2243] T d8b351ffd4864761bb49da4eceac3566 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.281872  9799 raft_consensus.cc:2272] T d8b351ffd4864761bb49da4eceac3566 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.283954  9799 tablet_replica.cc:333] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.284482  9799 raft_consensus.cc:2243] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:51.285414  9799 raft_consensus.cc:2272] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.288146  9799 tablet_replica.cc:333] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.288846  9799 raft_consensus.cc:2243] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.289399  9799 raft_consensus.cc:2272] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.291539  9799 tablet_replica.cc:333] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.292120  9799 raft_consensus.cc:2243] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:51.293025  9799 raft_consensus.cc:2272] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.295285  9799 tablet_replica.cc:333] T 440b2a57096e45188762ccb05301beec P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.295840  9799 raft_consensus.cc:2243] T 440b2a57096e45188762ccb05301beec P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.296304  9799 raft_consensus.cc:2272] T 440b2a57096e45188762ccb05301beec P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.299105  9799 tablet_replica.cc:333] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.299950  9799 raft_consensus.cc:2243] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.300549  9799 raft_consensus.cc:2272] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:51.300981 18216 consensus_peers.cc:597] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:51.303119 18142 consensus_peers.cc:597] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:51.303750  9799 tablet_replica.cc:333] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.304445  9799 raft_consensus.cc:2243] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.304921  9799 raft_consensus.cc:2272] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.307183  9799 tablet_replica.cc:333] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.307749  9799 raft_consensus.cc:2243] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:51.308661  9799 raft_consensus.cc:2272] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.310966  9799 tablet_replica.cc:333] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.311558  9799 raft_consensus.cc:2243] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:51.312482  9799 raft_consensus.cc:2272] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.315104  9799 tablet_replica.cc:333] T fa35871af5624c709008fe86090c0ad1 P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.315784  9799 raft_consensus.cc:2243] T fa35871af5624c709008fe86090c0ad1 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.316339  9799 raft_consensus.cc:2272] T fa35871af5624c709008fe86090c0ad1 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:51.317701 18068 consensus_peers.cc:597] T dda5199333524768beef0903fe39e300 P 3a269a9c95e0476d9e09c25b4b5aaa2c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:51.318780  9799 tablet_replica.cc:333] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.319427  9799 raft_consensus.cc:2243] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.319886  9799 raft_consensus.cc:2272] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.322083  9799 tablet_replica.cc:333] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.322700  9799 raft_consensus.cc:2243] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.323206  9799 raft_consensus.cc:2272] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.325671  9799 tablet_replica.cc:333] T dda5199333524768beef0903fe39e300 P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.326234  9799 raft_consensus.cc:2243] T dda5199333524768beef0903fe39e300 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.326705  9799 raft_consensus.cc:2272] T dda5199333524768beef0903fe39e300 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.328783  9799 tablet_replica.cc:333] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc: stopping tablet replica
I20260709 12:26:51.329397  9799 raft_consensus.cc:2243] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:51.330305  9799 raft_consensus.cc:2272] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:51.373142 18216 consensus_peers.cc:597] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:51.380272 18216 consensus_peers.cc:597] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:51.398875 18142 consensus_peers.cc:597] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:51.413985  9799 tablet_server.cc:196] TabletServer@127.9.145.193:0 shutdown complete.
W20260709 12:26:51.448464 18142 consensus_peers.cc:597] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:51.458946 18142 consensus_peers.cc:597] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:51.459290 18068 consensus_peers.cc:597] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:51.463531 18068 consensus_peers.cc:597] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:51.483685 18068 consensus_peers.cc:597] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:51.509339 18142 consensus_peers.cc:597] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:51.514379  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:51.523903 18823 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:51.529950 18822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:51.542580  9799 server_base.cc:1061] running on GCE node
W20260709 12:26:51.544616 18825 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:51.547469  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:51.548024  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:51.548285  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783600011548264 us; error 0 us; skew 500 ppm
W20260709 12:26:51.548439 18216 consensus_peers.cc:597] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:51.549093  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:51.556085  9799 webserver.cc:533] Webserver started at http://127.9.145.193:40915/ using document root <none> and password file <none>
I20260709 12:26:51.556618  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:51.556783  9799 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:26:51.561249  9799 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.004s	sys 0.000s
W20260709 12:26:51.564224 18216 consensus_peers.cc:597] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:51.570562 18831 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:51.573307  9799 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:26:51.573706  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599719482688-9799-0/minicluster-data/ts-0-root
uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
format_stamp: "Formatted at 2026-07-09 12:26:37 on dist-test-slave-1sdq"
I20260709 12:26:51.574199  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599719482688-9799-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599719482688-9799-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599719482688-9799-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 12:26:51.581521 18216 consensus_peers.cc:597] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:51.593442  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:51.595428  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:51.597410  9799 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:51.604069 18838 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 12:26:51.904709  9799 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:26:51.905038  9799 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.302s	user 0.009s	sys 0.000s
I20260709 12:26:51.905337  9799 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:26:51.913426 18838 tablet_bootstrap.cc:492] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:51.928896 18838 tablet_bootstrap.cc:492] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:51.930323 18838 tablet_bootstrap.cc:492] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:51.932020 18838 ts_tablet_manager.cc:1403] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.019s	user 0.005s	sys 0.012s
I20260709 12:26:51.934747 18838 raft_consensus.cc:359] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:51.935472 18838 raft_consensus.cc:740] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.936196 18838 consensus_queue.cc:260] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:51.941532 18838 ts_tablet_manager.cc:1434] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:26:51.943593 18838 tablet_bootstrap.cc:492] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:51.963217 18838 tablet_bootstrap.cc:492] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:51.964370 18838 tablet_bootstrap.cc:492] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:51.965127 18838 ts_tablet_manager.cc:1403] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.004s
I20260709 12:26:51.979820 18838 raft_consensus.cc:359] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:51.980571 18838 raft_consensus.cc:740] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.981294 18838 consensus_queue.cc:260] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:51.983234 18838 ts_tablet_manager.cc:1434] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.018s	user 0.016s	sys 0.004s
I20260709 12:26:51.984031 18838 tablet_bootstrap.cc:492] T 7dbf7d84f5ff496e905988250445db74 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:52.015949 18838 tablet_bootstrap.cc:492] T 7dbf7d84f5ff496e905988250445db74 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:52.017041 18838 tablet_bootstrap.cc:492] T 7dbf7d84f5ff496e905988250445db74 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:52.017856 18838 ts_tablet_manager.cc:1403] T 7dbf7d84f5ff496e905988250445db74 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.008s
I20260709 12:26:52.020730 18838 raft_consensus.cc:359] T 7dbf7d84f5ff496e905988250445db74 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:52.021495 18838 raft_consensus.cc:740] T 7dbf7d84f5ff496e905988250445db74 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.022315 18838 consensus_queue.cc:260] T 7dbf7d84f5ff496e905988250445db74 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:52.024500 18838 ts_tablet_manager.cc:1434] T 7dbf7d84f5ff496e905988250445db74 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:52.025403 18838 tablet_bootstrap.cc:492] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:52.043431 18838 tablet_bootstrap.cc:492] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:52.044373 18838 tablet_bootstrap.cc:492] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:52.045040 18838 ts_tablet_manager.cc:1403] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 12:26:52.047564 18838 raft_consensus.cc:359] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.048149 18838 raft_consensus.cc:740] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.049362 18838 consensus_queue.cc:260] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.052212 18838 ts_tablet_manager.cc:1434] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:52.052959 18838 tablet_bootstrap.cc:492] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:52.078624 18838 tablet_bootstrap.cc:492] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:52.079656 18838 tablet_bootstrap.cc:492] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:52.080323 18838 ts_tablet_manager.cc:1403] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.028s	user 0.023s	sys 0.004s
I20260709 12:26:52.082907 18838 raft_consensus.cc:359] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:52.083678 18838 raft_consensus.cc:740] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.084652 18838 consensus_queue.cc:260] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:52.086745 18838 ts_tablet_manager.cc:1434] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:52.087782 18838 tablet_bootstrap.cc:492] T dda5199333524768beef0903fe39e300 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:52.099112 18838 tablet_bootstrap.cc:492] T dda5199333524768beef0903fe39e300 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:52.099895 18838 tablet_bootstrap.cc:492] T dda5199333524768beef0903fe39e300 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:52.100410 18838 ts_tablet_manager.cc:1403] T dda5199333524768beef0903fe39e300 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:26:52.102259 18838 raft_consensus.cc:359] T dda5199333524768beef0903fe39e300 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.102773 18838 raft_consensus.cc:740] T dda5199333524768beef0903fe39e300 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.103420 18838 consensus_queue.cc:260] T dda5199333524768beef0903fe39e300 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.105271 18838 ts_tablet_manager.cc:1434] T dda5199333524768beef0903fe39e300 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:52.106073 18838 tablet_bootstrap.cc:492] T f124d65e17c143b08d3428ef325ae9a5 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:52.120728 18838 tablet_bootstrap.cc:492] T f124d65e17c143b08d3428ef325ae9a5 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:52.121452 18838 tablet_bootstrap.cc:492] T f124d65e17c143b08d3428ef325ae9a5 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:52.121986 18838 ts_tablet_manager.cc:1403] T f124d65e17c143b08d3428ef325ae9a5 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.016s	user 0.004s	sys 0.008s
I20260709 12:26:52.124066 18838 raft_consensus.cc:359] T f124d65e17c143b08d3428ef325ae9a5 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:52.124788 18838 raft_consensus.cc:740] T f124d65e17c143b08d3428ef325ae9a5 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.125563 18838 consensus_queue.cc:260] T f124d65e17c143b08d3428ef325ae9a5 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:52.127539 18838 ts_tablet_manager.cc:1434] T f124d65e17c143b08d3428ef325ae9a5 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:52.128340 18838 tablet_bootstrap.cc:492] T 049a535902f64c44bb4e1b9ecc92694c P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:52.141206 18838 tablet_bootstrap.cc:492] T 049a535902f64c44bb4e1b9ecc92694c P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:52.142246 18838 tablet_bootstrap.cc:492] T 049a535902f64c44bb4e1b9ecc92694c P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:52.142959 18838 ts_tablet_manager.cc:1403] T 049a535902f64c44bb4e1b9ecc92694c P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 12:26:52.145412 18838 raft_consensus.cc:359] T 049a535902f64c44bb4e1b9ecc92694c P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.145686 18839 raft_consensus.cc:493] T 29e1b7b25f15438ba055b0ea299ada27 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.146157 18838 raft_consensus.cc:740] T 049a535902f64c44bb4e1b9ecc92694c P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.146939 18838 consensus_queue.cc:260] T 049a535902f64c44bb4e1b9ecc92694c P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.149032 18838 ts_tablet_manager.cc:1434] T 049a535902f64c44bb4e1b9ecc92694c P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:52.149976 18838 tablet_bootstrap.cc:492] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:52.153460 18839 raft_consensus.cc:515] T 29e1b7b25f15438ba055b0ea299ada27 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:52.155817 18839 leader_election.cc:290] T 29e1b7b25f15438ba055b0ea299ada27 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:52.157601 18244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e1b7b25f15438ba055b0ea299ada27" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
W20260709 12:26:52.165627 18068 leader_election.cc:336] T 29e1b7b25f15438ba055b0ea299ada27 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:26:52.166150 18068 leader_election.cc:304] T 29e1b7b25f15438ba055b0ea299ada27 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:52.166936 18838 tablet_bootstrap.cc:492] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:52.167968 18819 raft_consensus.cc:493] T c697128b8d274c8790595b833d9b74eb P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.168570 18819 raft_consensus.cc:515] T c697128b8d274c8790595b833d9b74eb P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:52.170876 18819 leader_election.cc:290] T c697128b8d274c8790595b833d9b74eb P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:52.168042 18838 tablet_bootstrap.cc:492] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:52.172533 18838 ts_tablet_manager.cc:1403] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.004s
I20260709 12:26:52.173969 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c697128b8d274c8790595b833d9b74eb" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:52.175263 18838 raft_consensus.cc:359] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:52.176028 18838 raft_consensus.cc:740] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.176065 18819 raft_consensus.cc:493] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.176827 18819 raft_consensus.cc:515] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:52.176954 18838 consensus_queue.cc:260] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:52.179263 18819 leader_election.cc:290] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:52.179349 18838 ts_tablet_manager.cc:1434] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:52.180305 18838 tablet_bootstrap.cc:492] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:52.181694 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e1b7b25f15438ba055b0ea299ada27" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:52.175318 18839 raft_consensus.cc:2749] T 29e1b7b25f15438ba055b0ea299ada27 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:52.183632 18099 raft_consensus.cc:2468] T 29e1b7b25f15438ba055b0ea299ada27 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 1.
I20260709 12:26:52.186594 18215 leader_election.cc:304] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 
W20260709 12:26:52.187054 18216 leader_election.cc:336] T c697128b8d274c8790595b833d9b74eb P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:26:52.187666 18216 leader_election.cc:304] T c697128b8d274c8790595b833d9b74eb P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c938681fc04e66968531267f39f16c; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:52.187583 18818 raft_consensus.cc:2804] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:52.188427 18818 raft_consensus.cc:493] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.188805 18818 raft_consensus.cc:3060] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.188897 18819 raft_consensus.cc:2749] T c697128b8d274c8790595b833d9b74eb P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:52.194945 18216 leader_election.cc:336] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:26:52.204658 18818 raft_consensus.cc:515] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:52.208884 18818 leader_election.cc:290] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 election: Requested vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:52.209050 18838 tablet_bootstrap.cc:492] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:52.209213 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e1b7b25f15438ba055b0ea299ada27" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:52.209950 18099 raft_consensus.cc:3060] T 29e1b7b25f15438ba055b0ea299ada27 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.210597 18838 tablet_bootstrap.cc:492] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:52.211433 18838 ts_tablet_manager.cc:1403] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.031s	user 0.022s	sys 0.006s
W20260709 12:26:52.213819 18216 leader_election.cc:336] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:26:52.214298 18838 raft_consensus.cc:359] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.215062 18838 raft_consensus.cc:740] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.215827 18838 consensus_queue.cc:260] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.216969 18099 raft_consensus.cc:2468] T 29e1b7b25f15438ba055b0ea299ada27 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 2.
I20260709 12:26:52.217922 18838 ts_tablet_manager.cc:1434] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.002s
I20260709 12:26:52.217998 18215 leader_election.cc:304] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:52.218976 18838 tablet_bootstrap.cc:492] T 96957d639eed4a1395857a97a292f8ea P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:52.220141 18819 raft_consensus.cc:2804] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:52.220682 18819 raft_consensus.cc:697] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c [term 2 LEADER]: Becoming Leader. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:26:52.221557 18819 consensus_queue.cc:237] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:52.228602  9799 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:26:52.229028  9799 ts_tablet_manager.cc:595] Time spent register tablets: real 0.324s	user 0.267s	sys 0.008s
I20260709 12:26:52.237694 18838 tablet_bootstrap.cc:492] T 96957d639eed4a1395857a97a292f8ea P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:52.238890 18838 tablet_bootstrap.cc:492] T 96957d639eed4a1395857a97a292f8ea P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:52.239620 18838 ts_tablet_manager.cc:1403] T 96957d639eed4a1395857a97a292f8ea P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 12:26:52.241423 17924 catalog_manager.cc:5697] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c reported cstate change: term changed from 1 to 2, leader changed from ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193) to 10c938681fc04e66968531267f39f16c (127.9.145.196). New cstate: current_term: 2 leader_uuid: "10c938681fc04e66968531267f39f16c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.242398 18838 raft_consensus.cc:359] T 96957d639eed4a1395857a97a292f8ea P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:52.243255 18838 raft_consensus.cc:740] T 96957d639eed4a1395857a97a292f8ea P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.244604 18838 consensus_queue.cc:260] T 96957d639eed4a1395857a97a292f8ea P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:52.247000 18838 ts_tablet_manager.cc:1434] T 96957d639eed4a1395857a97a292f8ea P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:52.247999 18838 tablet_bootstrap.cc:492] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:52.283241 18819 raft_consensus.cc:493] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.284034 18819 raft_consensus.cc:515] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:52.291518 18819 leader_election.cc:290] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
W20260709 12:26:52.311862 18216 leader_election.cc:336] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:26:52.333644 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cffccb3c736b4f0fa0789217fa65dc2c" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:52.334555 18713 raft_consensus.cc:493] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.335320 18713 raft_consensus.cc:515] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:52.351549 18099 raft_consensus.cc:2468] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 1.
I20260709 12:26:52.353255 18713 leader_election.cc:290] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:52.354717 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cffccb3c736b4f0fa0789217fa65dc2c" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:52.355580 18251 raft_consensus.cc:2468] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 1.
I20260709 12:26:52.356698 18818 raft_consensus.cc:493] T e2114d69fe2c427599f225a7b0686dee P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.357419 18818 raft_consensus.cc:515] T e2114d69fe2c427599f225a7b0686dee P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:52.356734 18215 leader_election.cc:304] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:52.359827 18818 leader_election.cc:290] T e2114d69fe2c427599f225a7b0686dee P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:52.359920 18819 raft_consensus.cc:2804] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:26:52.360224 18068 leader_election.cc:336] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:26:52.361675 18067 leader_election.cc:304] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:52.362823 18713 raft_consensus.cc:2804] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:52.363231 18713 raft_consensus.cc:493] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.363585 18713 raft_consensus.cc:3060] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.364326 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2114d69fe2c427599f225a7b0686dee" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
W20260709 12:26:52.371984 18216 leader_election.cc:336] T e2114d69fe2c427599f225a7b0686dee P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:26:52.372653 18216 leader_election.cc:304] T e2114d69fe2c427599f225a7b0686dee P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c938681fc04e66968531267f39f16c; no voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:52.375315 18812 raft_consensus.cc:2749] T e2114d69fe2c427599f225a7b0686dee P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:52.373282 18818 raft_consensus.cc:493] T bdc0b28c91d54918b8a914c137f9543f P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.377063 18818 raft_consensus.cc:515] T bdc0b28c91d54918b8a914c137f9543f P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:52.378070 18819 raft_consensus.cc:493] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.377842 18713 raft_consensus.cc:515] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:52.378573 18819 raft_consensus.cc:3060] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.379995 18818 leader_election.cc:290] T bdc0b28c91d54918b8a914c137f9543f P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:52.381313 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cffccb3c736b4f0fa0789217fa65dc2c" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:52.386435 18713 leader_election.cc:290] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 election: Requested vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
W20260709 12:26:52.387348 18216 leader_election.cc:336] T bdc0b28c91d54918b8a914c137f9543f P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:26:52.390831 18838 tablet_bootstrap.cc:492] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:52.394155 18838 tablet_bootstrap.cc:492] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:52.395056 18838 ts_tablet_manager.cc:1403] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.147s	user 0.056s	sys 0.033s
I20260709 12:26:52.398329 18838 raft_consensus.cc:359] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:52.399236 18838 raft_consensus.cc:740] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.400239 18838 consensus_queue.cc:260] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:52.403079 18819 raft_consensus.cc:515] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:52.404484 18251 raft_consensus.cc:2393] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in current term 2: Already voted for candidate 10c938681fc04e66968531267f39f16c in this term.
I20260709 12:26:52.406287 18819 leader_election.cc:290] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 election: Requested vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:52.403097 18838 ts_tablet_manager.cc:1434] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:52.407963 18838 tablet_bootstrap.cc:492] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:52.408296 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b28c91d54918b8a914c137f9543f" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:52.409965 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cffccb3c736b4f0fa0789217fa65dc2c" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:52.410745 18099 raft_consensus.cc:2393] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c938681fc04e66968531267f39f16c in current term 2: Already voted for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in this term.
W20260709 12:26:52.411439 18216 leader_election.cc:336] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:26:52.416653 18215 leader_election.cc:304] T bdc0b28c91d54918b8a914c137f9543f P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c938681fc04e66968531267f39f16c; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:52.417827 18819 raft_consensus.cc:2749] T bdc0b28c91d54918b8a914c137f9543f P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:52.419026 18215 leader_election.cc:304] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c938681fc04e66968531267f39f16c; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:52.420138 18818 raft_consensus.cc:2749] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:26:52.432389 18068 leader_election.cc:336] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:26:52.432940 18068 leader_election.cc:304] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:52.433784 18870 raft_consensus.cc:2749] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:52.436297 18713 raft_consensus.cc:493] T f17497d6870f4ff495e91f076239de59 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.437104 18713 raft_consensus.cc:515] T f17497d6870f4ff495e91f076239de59 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.441032 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f17497d6870f4ff495e91f076239de59" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:52.443037 18713 leader_election.cc:290] T f17497d6870f4ff495e91f076239de59 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
W20260709 12:26:52.449102 18068 leader_election.cc:336] T f17497d6870f4ff495e91f076239de59 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:26:52.449623 18068 leader_election.cc:304] T f17497d6870f4ff495e91f076239de59 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:52.450462 18713 raft_consensus.cc:2749] T f17497d6870f4ff495e91f076239de59 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:52.450723 18838 tablet_bootstrap.cc:492] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:52.451819 18838 tablet_bootstrap.cc:492] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:52.452471 18838 ts_tablet_manager.cc:1403] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.004s
I20260709 12:26:52.454888 18838 raft_consensus.cc:359] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:52.455538 18838 raft_consensus.cc:740] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.456254 18838 consensus_queue.cc:260] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:52.458280 18811 raft_consensus.cc:493] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.458355 18838 ts_tablet_manager.cc:1434] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:26:52.458935 18811 raft_consensus.cc:515] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.459483 18838 tablet_bootstrap.cc:492] T d8b351ffd4864761bb49da4eceac3566 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:52.461292 18811 leader_election.cc:290] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:52.462303 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0fb4e45e6e54dbf8b96315fab6e5cb8" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:52.463667 18811 raft_consensus.cc:493] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.464205 18811 raft_consensus.cc:515] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:52.466346 18811 leader_election.cc:290] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:52.467350 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2114d69fe2c427599f225a7b0686dee" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:52.468130 18251 raft_consensus.cc:2468] T e2114d69fe2c427599f225a7b0686dee P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 1.
I20260709 12:26:52.474426 18141 leader_election.cc:304] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:52.475325 18811 raft_consensus.cc:2804] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:52.475726 18811 raft_consensus.cc:493] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.476075 18811 raft_consensus.cc:3060] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:52.477221 18142 leader_election.cc:336] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:26:52.482812 18142 leader_election.cc:304] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a08ea42cd3884210924a19c8f570486d; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:52.483671 18844 raft_consensus.cc:2749] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:52.484469 18811 raft_consensus.cc:515] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:52.487404 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2114d69fe2c427599f225a7b0686dee" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:52.487835 18713 raft_consensus.cc:493] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.488164 18251 raft_consensus.cc:3060] T e2114d69fe2c427599f225a7b0686dee P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.488432 18811 leader_election.cc:290] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 2 election: Requested vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:52.494345 18713 raft_consensus.cc:515] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:52.496635 18713 leader_election.cc:290] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:52.497476 18245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b28c91d54918b8a914c137f9543f" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:52.498515 18245 raft_consensus.cc:2468] T bdc0b28c91d54918b8a914c137f9543f P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 1.
I20260709 12:26:52.499807 18067 leader_election.cc:304] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 
I20260709 12:26:52.500581 18713 raft_consensus.cc:2804] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:52.501029 18713 raft_consensus.cc:493] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.501457 18713 raft_consensus.cc:3060] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.501948 18251 raft_consensus.cc:2468] T e2114d69fe2c427599f225a7b0686dee P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 2.
W20260709 12:26:52.502805 18142 leader_election.cc:336] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:26:52.506378 18141 leader_election.cc:304] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:52.509043 18816 raft_consensus.cc:2804] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:52.509684 18816 raft_consensus.cc:697] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d [term 2 LEADER]: Becoming Leader. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Running, Role: LEADER
I20260709 12:26:52.510710 18816 consensus_queue.cc:237] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:52.513998 18870 raft_consensus.cc:493] T 6cf8e5342a1141b5b3f0ee9ec643beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.514605 18870 raft_consensus.cc:515] T 6cf8e5342a1141b5b3f0ee9ec643beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.517336 18870 leader_election.cc:290] T 6cf8e5342a1141b5b3f0ee9ec643beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:52.518576 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf8e5342a1141b5b3f0ee9ec643beec" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:52.519340 18811 raft_consensus.cc:493] T 91269edd7c074ad2bfced23e62cbe5fc P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.519922 18811 raft_consensus.cc:515] T 91269edd7c074ad2bfced23e62cbe5fc P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:52.520599 18819 raft_consensus.cc:493] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.521160 18819 raft_consensus.cc:515] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:52.522369 18811 leader_election.cc:290] T 91269edd7c074ad2bfced23e62cbe5fc P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:52.523270 18819 leader_election.cc:290] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:52.524653 18568 raft_consensus.cc:493] T 2a3e4e4b25f84008b5cd603640f2252f P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.525177 18568 raft_consensus.cc:515] T 2a3e4e4b25f84008b5cd603640f2252f P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.526000 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91269edd7c074ad2bfced23e62cbe5fc" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:52.527067 18568 leader_election.cc:290] T 2a3e4e4b25f84008b5cd603640f2252f P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:52.527518 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5995ee175fed4e3e893b8efe2a7eb7d0" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:52.528173 18099 raft_consensus.cc:2468] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 1.
I20260709 12:26:52.529876 18215 leader_election.cc:304] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 
I20260709 12:26:52.531127 18818 raft_consensus.cc:2804] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:52.531515 18818 raft_consensus.cc:493] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.531875 18818 raft_consensus.cc:3060] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.534375 18839 raft_consensus.cc:493] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.535008 18839 raft_consensus.cc:515] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:52.537129 18839 leader_election.cc:290] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
W20260709 12:26:52.538365 18216 leader_election.cc:336] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
W20260709 12:26:52.540001 18142 leader_election.cc:336] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:26:52.540889 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3e4e4b25f84008b5cd603640f2252f" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:52.544642 18818 raft_consensus.cc:515] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:52.550884 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5995ee175fed4e3e893b8efe2a7eb7d0" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:52.551749 18251 raft_consensus.cc:2393] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in current term 2: Already voted for candidate 10c938681fc04e66968531267f39f16c in this term.
I20260709 12:26:52.556380 18713 raft_consensus.cc:515] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:52.558485 18713 leader_election.cc:290] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 election: Requested vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
W20260709 12:26:52.560643 18142 leader_election.cc:336] T 91269edd7c074ad2bfced23e62cbe5fc P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:26:52.561187 18142 leader_election.cc:304] T 91269edd7c074ad2bfced23e62cbe5fc P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a08ea42cd3884210924a19c8f570486d; no voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc
W20260709 12:26:52.562183 18142 leader_election.cc:336] T 2a3e4e4b25f84008b5cd603640f2252f P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
W20260709 12:26:52.551645 18216 leader_election.cc:336] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:26:52.562670 18141 leader_election.cc:304] T 2a3e4e4b25f84008b5cd603640f2252f P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a08ea42cd3884210924a19c8f570486d; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:52.563169 18844 raft_consensus.cc:2749] T 91269edd7c074ad2bfced23e62cbe5fc P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:52.564510 18818 leader_election.cc:290] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 election: Requested vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:52.563922 18844 raft_consensus.cc:2749] T 2a3e4e4b25f84008b5cd603640f2252f P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:52.573918 18068 leader_election.cc:336] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:26:52.579509 18244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b28c91d54918b8a914c137f9543f" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:52.580292 18244 raft_consensus.cc:3060] T bdc0b28c91d54918b8a914c137f9543f P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.587706 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5995ee175fed4e3e893b8efe2a7eb7d0" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:52.588465 18101 raft_consensus.cc:3060] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.591416 18812 raft_consensus.cc:493] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.592083 18812 raft_consensus.cc:515] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:52.593731 18838 tablet_bootstrap.cc:492] T d8b351ffd4864761bb49da4eceac3566 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:52.593968 18244 raft_consensus.cc:2468] T bdc0b28c91d54918b8a914c137f9543f P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 2.
I20260709 12:26:52.598920 18101 raft_consensus.cc:2468] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 2.
W20260709 12:26:52.599696 18216 leader_election.cc:336] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
W20260709 12:26:52.600471 18068 leader_election.cc:336] T 6cf8e5342a1141b5b3f0ee9ec643beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:26:52.600961 18068 leader_election.cc:304] T 6cf8e5342a1141b5b3f0ee9ec643beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:52.602180 18812 leader_election.cc:290] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:52.606777 18870 raft_consensus.cc:2749] T 6cf8e5342a1141b5b3f0ee9ec643beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:52.608110 18838 tablet_bootstrap.cc:492] T d8b351ffd4864761bb49da4eceac3566 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:52.609231 18067 leader_election.cc:304] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 
I20260709 12:26:52.609843 18838 ts_tablet_manager.cc:1403] T d8b351ffd4864761bb49da4eceac3566 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.151s	user 0.019s	sys 0.012s
I20260709 12:26:52.613786 18839 raft_consensus.cc:2804] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:52.614480 18839 raft_consensus.cc:697] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 LEADER]: Becoming Leader. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Running, Role: LEADER
I20260709 12:26:52.615386 18839 consensus_queue.cc:237] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:52.617869 18838 raft_consensus.cc:359] T d8b351ffd4864761bb49da4eceac3566 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.629704 18215 leader_election.cc:304] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:52.638778 18818 raft_consensus.cc:2804] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:52.639315 18818 raft_consensus.cc:697] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [term 2 LEADER]: Becoming Leader. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:26:52.640242 18818 consensus_queue.cc:237] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:52.640462 18838 raft_consensus.cc:740] T d8b351ffd4864761bb49da4eceac3566 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.643934 18839 raft_consensus.cc:493] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.644654 18839 raft_consensus.cc:515] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.643330 18838 consensus_queue.cc:260] T d8b351ffd4864761bb49da4eceac3566 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.646531 17923 catalog_manager.cc:5697] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c reported cstate change: term changed from 1 to 2, leader changed from ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193) to 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194). New cstate: current_term: 2 leader_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:52.648836 18844 raft_consensus.cc:493] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.647897 18839 leader_election.cc:290] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:52.648088 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0fb4e45e6e54dbf8b96315fab6e5cb8" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:52.649397 18844 raft_consensus.cc:515] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.649844 18174 raft_consensus.cc:2468] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 1.
I20260709 12:26:52.650511 17924 catalog_manager.cc:5697] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d reported cstate change: term changed from 1 to 2, leader changed from ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193) to a08ea42cd3884210924a19c8f570486d (127.9.145.195). New cstate: current_term: 2 leader_uuid: "a08ea42cd3884210924a19c8f570486d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.651543 18070 leader_election.cc:304] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:52.652608 18870 raft_consensus.cc:2804] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:52.653020 18870 raft_consensus.cc:493] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.653409 18870 raft_consensus.cc:3060] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.664558 18870 raft_consensus.cc:515] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.667634 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf8e5342a1141b5b3f0ee9ec643beec" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:52.670639 18101 raft_consensus.cc:2468] T 6cf8e5342a1141b5b3f0ee9ec643beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 1.
I20260709 12:26:52.671926 18141 leader_election.cc:304] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:52.673066 18568 raft_consensus.cc:2804] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:52.673463 18568 raft_consensus.cc:493] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.673605 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d2f53aff8a45a49cadf9fd72b75ee8" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:52.673843 18568 raft_consensus.cc:3060] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.651731 18844 leader_election.cc:290] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:52.648310 18838 ts_tablet_manager.cc:1434] T d8b351ffd4864761bb49da4eceac3566 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 12:26:52.684793 18838 tablet_bootstrap.cc:492] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
W20260709 12:26:52.686533 18216 consensus_peers.cc:597] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:52.686864 18099 raft_consensus.cc:1275] T 29e1b7b25f15438ba055b0ea299ada27 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Refusing update from remote peer 10c938681fc04e66968531267f39f16c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:52.686466 18839 raft_consensus.cc:493] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.688162 18812 raft_consensus.cc:493] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.687994 18839 raft_consensus.cc:515] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:52.688767 18812 raft_consensus.cc:515] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
W20260709 12:26:52.689400 18068 leader_election.cc:336] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:26:52.690320 18844 raft_consensus.cc:493] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.691183 18812 leader_election.cc:290] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:52.690766 18839 leader_election.cc:290] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:52.690883 18844 raft_consensus.cc:515] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.696765 18844 leader_election.cc:290] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:52.697273 18244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c697128b8d274c8790595b833d9b74eb" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
W20260709 12:26:52.697564 18216 leader_election.cc:336] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:26:52.698073 18244 raft_consensus.cc:2468] T c697128b8d274c8790595b833d9b74eb P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 1.
I20260709 12:26:52.699497 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f17497d6870f4ff495e91f076239de59" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:52.700275 18099 raft_consensus.cc:2468] T f17497d6870f4ff495e91f076239de59 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 1.
I20260709 12:26:52.701663 17923 catalog_manager.cc:5697] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c reported cstate change: term changed from 1 to 2, leader changed from ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193) to 10c938681fc04e66968531267f39f16c (127.9.145.196). New cstate: current_term: 2 leader_uuid: "10c938681fc04e66968531267f39f16c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.704067 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91269edd7c074ad2bfced23e62cbe5fc" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:52.704749 18176 raft_consensus.cc:2468] T 91269edd7c074ad2bfced23e62cbe5fc P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 1.
I20260709 12:26:52.703258 18141 leader_election.cc:304] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:52.706561 18844 raft_consensus.cc:2804] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:52.706948 18844 raft_consensus.cc:493] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.707312 18844 raft_consensus.cc:3060] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.708949 18067 leader_election.cc:304] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 
I20260709 12:26:52.712245 18218 leader_election.cc:304] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d; no voters: ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:52.713089 18819 raft_consensus.cc:2804] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:52.713501 18819 raft_consensus.cc:493] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.713912 18819 raft_consensus.cc:3060] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.683681 18568 raft_consensus.cc:515] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.689889 18068 leader_election.cc:304] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:52.718622 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0fb4e45e6e54dbf8b96315fab6e5cb8" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:52.719267 18176 raft_consensus.cc:3060] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.722396 18838 tablet_bootstrap.cc:492] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:52.723483 18838 tablet_bootstrap.cc:492] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:52.724174 18819 raft_consensus.cc:515] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:52.724201 18838 ts_tablet_manager.cc:1403] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.040s	user 0.017s	sys 0.004s
I20260709 12:26:52.727167 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91269edd7c074ad2bfced23e62cbe5fc" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:52.727813 18174 raft_consensus.cc:3060] T 91269edd7c074ad2bfced23e62cbe5fc P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.728401 18838 raft_consensus.cc:359] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.729219 18838 raft_consensus.cc:740] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
W20260709 12:26:52.734676 18216 leader_election.cc:336] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:26:52.735057 18176 raft_consensus.cc:2468] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 2.
I20260709 12:26:52.737421 18174 raft_consensus.cc:2468] T 91269edd7c074ad2bfced23e62cbe5fc P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 2.
I20260709 12:26:52.738066 18819 leader_election.cc:290] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 election: Requested vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:52.738337 18713 raft_consensus.cc:2804] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:52.738732 18713 raft_consensus.cc:493] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.738991 18713 raft_consensus.cc:3060] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.739568 18070 leader_election.cc:304] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:52.740408 18762 raft_consensus.cc:2804] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:52.743228 18838 consensus_queue.cc:260] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.746029 18838 ts_tablet_manager.cc:1434] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:26:52.747076 18838 tablet_bootstrap.cc:492] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:52.747788 18713 raft_consensus.cc:515] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:52.750196 18713 leader_election.cc:290] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 election: Requested vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:52.752609 18244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c697128b8d274c8790595b833d9b74eb" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:52.753120 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf8e5342a1141b5b3f0ee9ec643beec" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:52.753428 18244 raft_consensus.cc:3060] T c697128b8d274c8790595b833d9b74eb P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.753979 18099 raft_consensus.cc:3060] T 6cf8e5342a1141b5b3f0ee9ec643beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.759073 18839 raft_consensus.cc:2749] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:52.759235 18068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.193:36743, user_credentials={real_user=slave}} blocked reactor thread for 69867.9us
W20260709 12:26:52.759979 18068 leader_election.cc:336] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:26:52.763051 18244 raft_consensus.cc:2468] T c697128b8d274c8790595b833d9b74eb P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 2.
I20260709 12:26:52.768229 18762 raft_consensus.cc:697] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 LEADER]: Becoming Leader. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Running, Role: LEADER
I20260709 12:26:52.769316 18762 consensus_queue.cc:237] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.770848 18218 leader_election.cc:304] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, a08ea42cd3884210924a19c8f570486d; no voters: ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:52.713340 18870 leader_election.cc:290] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 election: Requested vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:52.772081 18819 raft_consensus.cc:2804] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:52.772585 18819 raft_consensus.cc:697] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [term 2 LEADER]: Becoming Leader. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:26:52.774290 18819 consensus_queue.cc:237] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:52.781972 18067 leader_election.cc:304] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 
I20260709 12:26:52.783635 18568 leader_election.cc:290] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 2 election: Requested vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:52.784690 18838 tablet_bootstrap.cc:492] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:52.785773 18838 tablet_bootstrap.cc:492] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:52.786520 18838 ts_tablet_manager.cc:1403] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.040s	user 0.020s	sys 0.000s
I20260709 12:26:52.789331 18838 raft_consensus.cc:359] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.790132 18838 raft_consensus.cc:740] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
W20260709 12:26:52.774169 18142 leader_election.cc:336] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:26:52.790958 18838 consensus_queue.cc:260] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.793273 18838 ts_tablet_manager.cc:1434] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:52.794255 18838 tablet_bootstrap.cc:492] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
W20260709 12:26:52.795668 18142 leader_election.cc:336] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:26:52.799726 18215 leader_election.cc:304] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c938681fc04e66968531267f39f16c; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:52.799600 17923 catalog_manager.cc:5697] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c reported cstate change: term changed from 1 to 2, leader changed from ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193) to 10c938681fc04e66968531267f39f16c (127.9.145.196). New cstate: current_term: 2 leader_uuid: "10c938681fc04e66968531267f39f16c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.789813 18870 raft_consensus.cc:2804] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:52.817742 18897 raft_consensus.cc:2749] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:52.818315 18870 raft_consensus.cc:697] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 LEADER]: Becoming Leader. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Running, Role: LEADER
I20260709 12:26:52.818567 18897 consensus_queue.cc:1048] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:52.828697 18870 consensus_queue.cc:237] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:52.813020 18099 raft_consensus.cc:2468] T 6cf8e5342a1141b5b3f0ee9ec643beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 2.
W20260709 12:26:52.823128 18142 leader_election.cc:336] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:26:52.835942 18838 tablet_bootstrap.cc:492] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:52.837060 18141 leader_election.cc:304] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:52.837257 18838 tablet_bootstrap.cc:492] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:52.839358 18838 ts_tablet_manager.cc:1403] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.013s
I20260709 12:26:52.840553 18844 raft_consensus.cc:515] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.843173 18816 raft_consensus.cc:2804] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:52.843436 18838 raft_consensus.cc:359] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.845316 18838 raft_consensus.cc:740] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.846436 18838 consensus_queue.cc:260] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.848997 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f17497d6870f4ff495e91f076239de59" candidate_uuid: "a08ea42cd3884210924a19c8f570486d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:52.849210 18838 ts_tablet_manager.cc:1434] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:26:52.849777 18099 raft_consensus.cc:3060] T f17497d6870f4ff495e91f076239de59 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.850597 18838 tablet_bootstrap.cc:492] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:52.843392 18844 leader_election.cc:290] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 2 election: Requested vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:52.858840 18713 raft_consensus.cc:493] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.860126 18816 raft_consensus.cc:697] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d [term 2 LEADER]: Becoming Leader. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Running, Role: LEADER
I20260709 12:26:52.860287 18713 raft_consensus.cc:515] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:52.861274 18816 consensus_queue.cc:237] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.863301 18713 leader_election.cc:290] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:52.877839 18099 raft_consensus.cc:2468] T f17497d6870f4ff495e91f076239de59 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08ea42cd3884210924a19c8f570486d in term 2.
I20260709 12:26:52.880228 18141 leader_election.cc:304] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:52.882470 18910 raft_consensus.cc:2804] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:52.883219 18910 raft_consensus.cc:697] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d [term 2 LEADER]: Becoming Leader. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Running, Role: LEADER
W20260709 12:26:52.883524 18142 leader_election.cc:336] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:26:52.884281 18910 consensus_queue.cc:237] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.886607 18244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d2f53aff8a45a49cadf9fd72b75ee8" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:52.882467 18913 raft_consensus.cc:493] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.890303 18913 raft_consensus.cc:515] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.894869 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3e4e4b25f84008b5cd603640f2252f" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:52.895545 18176 raft_consensus.cc:2468] T 2a3e4e4b25f84008b5cd603640f2252f P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 1.
I20260709 12:26:52.896622 18070 leader_election.cc:304] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:52.887384 18244 raft_consensus.cc:2468] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 1.
I20260709 12:26:52.900314 18902 raft_consensus.cc:2804] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:52.900925 18902 raft_consensus.cc:493] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.901352 18902 raft_consensus.cc:3060] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.901628 18067 leader_election.cc:304] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 
I20260709 12:26:52.902900 18713 raft_consensus.cc:2804] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:52.903282 18713 raft_consensus.cc:493] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:26:52.903610 18713 raft_consensus.cc:3060] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.897265 18913 leader_election.cc:290] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:52.920442 18902 raft_consensus.cc:515] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:52.922181 18713 raft_consensus.cc:515] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:52.931224 17923 catalog_manager.cc:5697] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c reported cstate change: term changed from 1 to 2, leader changed from ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193) to 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194). New cstate: current_term: 2 leader_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.937469 18713 leader_election.cc:290] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 election: Requested vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:52.939429 18244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d2f53aff8a45a49cadf9fd72b75ee8" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:26:52.940080 18244 raft_consensus.cc:3060] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:52.944835 18068 leader_election.cc:336] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
W20260709 12:26:52.946014 18068 leader_election.cc:336] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
W20260709 12:26:52.948570 18068 leader_election.cc:336] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
W20260709 12:26:52.949275 18068 leader_election.cc:336] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:26:52.945325 17924 catalog_manager.cc:5697] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d reported cstate change: term changed from 1 to 2, leader changed from ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193) to a08ea42cd3884210924a19c8f570486d (127.9.145.195). New cstate: current_term: 2 leader_uuid: "a08ea42cd3884210924a19c8f570486d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:52.971376 18902 leader_election.cc:290] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 election: Requested vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:26:52.973428 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3e4e4b25f84008b5cd603640f2252f" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:26:52.974198 18174 raft_consensus.cc:3060] T 2a3e4e4b25f84008b5cd603640f2252f P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:52.979171 18068 leader_election.cc:336] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
W20260709 12:26:52.980177 18068 leader_election.cc:336] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:26:52.986008 18244 raft_consensus.cc:2468] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 2.
W20260709 12:26:52.994056 18215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.194:45595, user_credentials={real_user=slave}} blocked reactor thread for 53462us
W20260709 12:26:52.991834 18068 leader_election.cc:336] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:26:52.986753 18174 raft_consensus.cc:2468] T 2a3e4e4b25f84008b5cd603640f2252f P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 2.
I20260709 12:26:52.996642 18070 leader_election.cc:304] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:26:52.997471 18902 raft_consensus.cc:2804] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:52.997970 18902 raft_consensus.cc:697] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 LEADER]: Becoming Leader. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Running, Role: LEADER
I20260709 12:26:52.998845 18902 consensus_queue.cc:237] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:53.000674 17924 catalog_manager.cc:5697] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d reported cstate change: term changed from 1 to 2, leader changed from ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193) to a08ea42cd3884210924a19c8f570486d (127.9.145.195). New cstate: current_term: 2 leader_uuid: "a08ea42cd3884210924a19c8f570486d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:53.004554 18068 leader_election.cc:336] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:26:53.014217 17923 catalog_manager.cc:5697] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c reported cstate change: term changed from 1 to 2, leader changed from ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193) to 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194). New cstate: current_term: 2 leader_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:53.025236 18067 leader_election.cc:304] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:53.028198 18913 raft_consensus.cc:2804] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:53.035290 18913 raft_consensus.cc:697] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 LEADER]: Becoming Leader. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Running, Role: LEADER
I20260709 12:26:53.040668 18244 raft_consensus.cc:1275] T bdc0b28c91d54918b8a914c137f9543f P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Refusing update from remote peer 3a269a9c95e0476d9e09c25b4b5aaa2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:53.040498 18913 consensus_queue.cc:237] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:53.052313 18838 tablet_bootstrap.cc:492] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:53.048480 18902 consensus_queue.cc:1048] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:26:53.068373 18838 tablet_bootstrap.cc:492] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:53.069211 18838 ts_tablet_manager.cc:1403] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.219s	user 0.020s	sys 0.012s
I20260709 12:26:53.071779 18838 raft_consensus.cc:359] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:53.072508 18838 raft_consensus.cc:740] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.073539 18838 consensus_queue.cc:260] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:53.081543 18838 ts_tablet_manager.cc:1434] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:26:53.088343 18838 tablet_bootstrap.cc:492] T f68e8047f5ff4aa0b631cbd912091d25 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:53.128284 18244 raft_consensus.cc:1275] T e2114d69fe2c427599f225a7b0686dee P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Refusing update from remote peer a08ea42cd3884210924a19c8f570486d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:53.134464 18838 tablet_bootstrap.cc:492] T f68e8047f5ff4aa0b631cbd912091d25 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:53.135668 18838 tablet_bootstrap.cc:492] T f68e8047f5ff4aa0b631cbd912091d25 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
W20260709 12:26:53.135779 18068 consensus_peers.cc:597] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:53.136384 18838 ts_tablet_manager.cc:1403] T f68e8047f5ff4aa0b631cbd912091d25 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.008s
I20260709 12:26:53.108530 17924 catalog_manager.cc:5697] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c reported cstate change: term changed from 1 to 2, leader changed from ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193) to 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194). New cstate: current_term: 2 leader_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:53.131443 18100 raft_consensus.cc:1275] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Refusing update from remote peer 10c938681fc04e66968531267f39f16c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:53.138185 17924 catalog_manager.cc:5697] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c reported cstate change: term changed from 1 to 2, leader changed from ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193) to 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194). New cstate: current_term: 2 leader_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:53.136379 18811 consensus_queue.cc:1048] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:26:53.140156 18838 raft_consensus.cc:359] T f68e8047f5ff4aa0b631cbd912091d25 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:53.140875 18838 raft_consensus.cc:740] T f68e8047f5ff4aa0b631cbd912091d25 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.141752 18838 consensus_queue.cc:260] T f68e8047f5ff4aa0b631cbd912091d25 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:53.144028 18838 ts_tablet_manager.cc:1434] T f68e8047f5ff4aa0b631cbd912091d25 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:53.144907 18838 tablet_bootstrap.cc:492] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
W20260709 12:26:53.152119 18216 consensus_peers.cc:597] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:53.160748 18142 consensus_peers.cc:597] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:53.163059 18818 consensus_queue.cc:1048] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:26:53.169400 18216 consensus_peers.cc:597] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:53.171895 18838 tablet_bootstrap.cc:492] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:53.173002 18838 tablet_bootstrap.cc:492] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:53.173698 18838 ts_tablet_manager.cc:1403] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.005s
I20260709 12:26:53.176728 18838 raft_consensus.cc:359] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:53.177448 18838 raft_consensus.cc:740] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.178308 18838 consensus_queue.cc:260] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:53.180581 18838 ts_tablet_manager.cc:1434] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:26:53.181391 18838 tablet_bootstrap.cc:492] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:53.188854 18944 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.193:36743 every 8 connection(s)
I20260709 12:26:53.189436  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.193:36743
I20260709 12:26:53.209350 18174 raft_consensus.cc:1275] T 91269edd7c074ad2bfced23e62cbe5fc P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Refusing update from remote peer 10c938681fc04e66968531267f39f16c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:53.211601 18838 tablet_bootstrap.cc:492] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:53.212715 18838 tablet_bootstrap.cc:492] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:53.213470 18838 ts_tablet_manager.cc:1403] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.011s
I20260709 12:26:53.217088 18897 consensus_queue.cc:1048] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:53.216265 18838 raft_consensus.cc:359] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:53.218423 18838 raft_consensus.cc:740] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.219224 18838 consensus_queue.cc:260] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:53.221738 18838 ts_tablet_manager.cc:1434] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:26:53.222621 18838 tablet_bootstrap.cc:492] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:53.253747 18174 raft_consensus.cc:1275] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Refusing update from remote peer 3a269a9c95e0476d9e09c25b4b5aaa2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:53.255597 18713 consensus_queue.cc:1048] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:53.305698 18838 tablet_bootstrap.cc:492] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:53.306845 18838 tablet_bootstrap.cc:492] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:53.308488 18838 ts_tablet_manager.cc:1403] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.086s	user 0.023s	sys 0.003s
I20260709 12:26:53.311534 18838 raft_consensus.cc:359] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:53.312327 18838 raft_consensus.cc:740] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.313293 18838 consensus_queue.cc:260] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:53.314239 18841 raft_consensus.cc:493] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.314826 18841 raft_consensus.cc:515] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:53.315960 18838 ts_tablet_manager.cc:1434] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:53.317001 18838 tablet_bootstrap.cc:492] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:53.317673 18841 leader_election.cc:290] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:53.337473 18892 raft_consensus.cc:3060] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:53.351315 18068 consensus_peers.cc:597] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:53.354063 18142 consensus_peers.cc:597] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:53.363821 18100 raft_consensus.cc:1275] T 6cf8e5342a1141b5b3f0ee9ec643beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Refusing update from remote peer a08ea42cd3884210924a19c8f570486d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:53.365974 18910 consensus_queue.cc:1048] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:53.377032 18244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447aa2b8d4547c0b737643187aa4bd0" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c938681fc04e66968531267f39f16c" is_pre_election: true
I20260709 12:26:53.375905 18838 tablet_bootstrap.cc:492] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:53.381444 18838 tablet_bootstrap.cc:492] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:53.382218 18838 ts_tablet_manager.cc:1403] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.065s	user 0.027s	sys 0.012s
I20260709 12:26:53.383622 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447aa2b8d4547c0b737643187aa4bd0" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:53.385123 18838 raft_consensus.cc:359] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:53.385852 18838 raft_consensus.cc:740] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.386025 18832 leader_election.cc:304] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac42e2bcf9ac42448a84370269bc6ccc; no voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c
I20260709 12:26:53.386453 18838 consensus_queue.cc:260] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:53.387321 18953 raft_consensus.cc:2749] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:53.388772 18838 ts_tablet_manager.cc:1434] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:53.375041 18892 raft_consensus.cc:1275] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Refusing update from remote peer 3a269a9c95e0476d9e09c25b4b5aaa2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:53.392571 18870 consensus_queue.cc:1048] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:53.392573 18838 tablet_bootstrap.cc:492] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
W20260709 12:26:53.398164 18216 consensus_peers.cc:597] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:53.405282 18946 heartbeater.cc:344] Connected to a master server at 127.9.145.254:45005
I20260709 12:26:53.405848 18946 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:53.406888 18946 heartbeater.cc:507] Master 127.9.145.254:45005 requested a full tablet report, sending...
I20260709 12:26:53.407858 18100 raft_consensus.cc:1275] T f17497d6870f4ff495e91f076239de59 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Refusing update from remote peer a08ea42cd3884210924a19c8f570486d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:53.409631 18568 consensus_queue.cc:1048] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:53.411819 18895 raft_consensus.cc:3060] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:53.412709 18142 consensus_peers.cc:597] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:53.422049 18895 raft_consensus.cc:1275] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Refusing update from remote peer a08ea42cd3884210924a19c8f570486d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:53.428838 18568 consensus_queue.cc:1048] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:53.441413 18244 raft_consensus.cc:1275] T c697128b8d274c8790595b833d9b74eb P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Refusing update from remote peer 3a269a9c95e0476d9e09c25b4b5aaa2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:53.443498 18870 consensus_queue.cc:1048] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:53.451308 18838 tablet_bootstrap.cc:492] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:53.452636 18838 tablet_bootstrap.cc:492] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:53.453362 18838 ts_tablet_manager.cc:1403] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.061s	user 0.014s	sys 0.005s
I20260709 12:26:53.456346 18838 raft_consensus.cc:359] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:53.457454 18838 raft_consensus.cc:740] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.458616 18838 consensus_queue.cc:260] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:53.461364 18838 ts_tablet_manager.cc:1434] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:53.462543 18838 tablet_bootstrap.cc:492] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:53.469425 18245 raft_consensus.cc:1275] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Refusing update from remote peer 3a269a9c95e0476d9e09c25b4b5aaa2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:53.471114 18713 consensus_queue.cc:1048] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:53.498251 17923 ts_manager.cc:194] Re-registered known tserver with Master: ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:26:53.506567 18838 tablet_bootstrap.cc:492] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:53.507653 18838 tablet_bootstrap.cc:492] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:53.508379 18838 ts_tablet_manager.cc:1403] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.000s
I20260709 12:26:53.511214 18838 raft_consensus.cc:359] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:53.511920 18838 raft_consensus.cc:740] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.512562 18838 consensus_queue.cc:260] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:53.514784 18838 ts_tablet_manager.cc:1434] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:26:53.515659 18838 tablet_bootstrap.cc:492] T 02af88afdc444f268f05df276bf720c0 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:53.659895 18841 raft_consensus.cc:493] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:53.660048 18068 consensus_peers.cc:597] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:53.659051 18838 tablet_bootstrap.cc:700] T 02af88afdc444f268f05df276bf720c0 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent opening tablet: real 0.139s	user 0.025s	sys 0.025s
I20260709 12:26:53.660544 18841 raft_consensus.cc:515] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:53.663304 18841 leader_election.cc:290] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
W20260709 12:26:53.676076 18068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:36743, user_credentials={real_user=slave}} blocked reactor thread for 155583us
I20260709 12:26:53.684446 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3e4e4b25f84008b5cd603640f2252f" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
W20260709 12:26:53.689604 18142 consensus_peers.cc:597] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:53.718626 18142 consensus_peers.cc:597] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:53.733134 18895 raft_consensus.cc:3060] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.756012 18838 tablet_bootstrap.cc:492] T 02af88afdc444f268f05df276bf720c0 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:53.763751 18887 raft_consensus.cc:3060] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.771349 18174 raft_consensus.cc:1275] T 2a3e4e4b25f84008b5cd603640f2252f P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Refusing update from remote peer 3a269a9c95e0476d9e09c25b4b5aaa2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:53.788769 18838 tablet_bootstrap.cc:492] T 02af88afdc444f268f05df276bf720c0 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:53.789652 18838 ts_tablet_manager.cc:1403] T 02af88afdc444f268f05df276bf720c0 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.274s	user 0.043s	sys 0.033s
I20260709 12:26:53.792546 18838 raft_consensus.cc:359] T 02af88afdc444f268f05df276bf720c0 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:53.793282 18838 raft_consensus.cc:740] T 02af88afdc444f268f05df276bf720c0 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.785580 18913 consensus_queue.cc:1048] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:26:53.793989 18838 consensus_queue.cc:260] T 02af88afdc444f268f05df276bf720c0 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:53.797986 18891 raft_consensus.cc:3060] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.801461 18838 ts_tablet_manager.cc:1434] T 02af88afdc444f268f05df276bf720c0 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:26:53.811103 18887 raft_consensus.cc:1275] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Refusing update from remote peer 3a269a9c95e0476d9e09c25b4b5aaa2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:53.815768 18892 raft_consensus.cc:3060] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.817011 18913 consensus_queue.cc:1048] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:53.841784 18838 tablet_bootstrap.cc:492] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
W20260709 12:26:53.851702 18216 consensus_peers.cc:597] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:53.861836 18216 consensus_peers.cc:597] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:53.874692 18172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3e4e4b25f84008b5cd603640f2252f" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a08ea42cd3884210924a19c8f570486d" is_pre_election: true
I20260709 12:26:53.876726 18835 leader_election.cc:304] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac42e2bcf9ac42448a84370269bc6ccc; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d
I20260709 12:26:53.878032 18841 raft_consensus.cc:2749] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:53.907279 18838 tablet_bootstrap.cc:492] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:53.919162 18838 tablet_bootstrap.cc:492] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:53.919849 18838 ts_tablet_manager.cc:1403] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.078s	user 0.019s	sys 0.003s
W20260709 12:26:53.923038 18216 consensus_peers.cc:597] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:53.926472 18838 raft_consensus.cc:359] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:53.927356 18838 raft_consensus.cc:740] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.928275 18838 consensus_queue.cc:260] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:53.930850 18838 ts_tablet_manager.cc:1434] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:26:53.931730 18838 tablet_bootstrap.cc:492] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
W20260709 12:26:53.952768 18068 consensus_peers.cc:597] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:53.965968 18142 consensus_peers.cc:597] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:53.981472 18838 tablet_bootstrap.cc:492] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:53.982656 18838 tablet_bootstrap.cc:492] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:53.983384 18838 ts_tablet_manager.cc:1403] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.052s	user 0.022s	sys 0.006s
I20260709 12:26:53.991394 18838 raft_consensus.cc:359] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:53.992163 18838 raft_consensus.cc:740] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.993075 18838 consensus_queue.cc:260] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:53.995555 18838 ts_tablet_manager.cc:1434] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:26:53.996402 18838 tablet_bootstrap.cc:492] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:54.005601 17923 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56886
W20260709 12:26:54.010707 18216 consensus_peers.cc:597] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:54.011677 18946 heartbeater.cc:499] Master 127.9.145.254:45005 was elected leader, sending a full tablet report...
W20260709 12:26:54.011930 18068 consensus_peers.cc:597] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:54.020738 18838 tablet_bootstrap.cc:492] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:54.021852 18838 tablet_bootstrap.cc:492] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:54.023015 18838 ts_tablet_manager.cc:1403] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.000s
I20260709 12:26:54.025839 18838 raft_consensus.cc:359] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:54.026505 18838 raft_consensus.cc:740] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.027253 18838 consensus_queue.cc:260] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:54.029433 18838 ts_tablet_manager.cc:1434] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:26:54.030364 18838 tablet_bootstrap.cc:492] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:54.044952 18838 tablet_bootstrap.cc:492] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:54.045778 18838 tablet_bootstrap.cc:492] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:54.046404 18838 ts_tablet_manager.cc:1403] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.003s
I20260709 12:26:54.048621 18838 raft_consensus.cc:359] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:54.051537 18977 raft_consensus.cc:493] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.055325 18977 raft_consensus.cc:515] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:54.054850 18838 raft_consensus.cc:740] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.057837 18977 leader_election.cc:290] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:26:54.059388 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cffccb3c736b4f0fa0789217fa65dc2c" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" is_pre_election: true
I20260709 12:26:54.059844 18887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cffccb3c736b4f0fa0789217fa65dc2c" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" is_pre_election: true
I20260709 12:26:54.060191 18099 raft_consensus.cc:2468] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 2.
I20260709 12:26:54.057693 18838 consensus_queue.cc:260] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:54.061358 18215 leader_election.cc:304] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 
W20260709 12:26:54.061859 18216 leader_election.cc:343] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:54.062690 18838 ts_tablet_manager.cc:1434] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:26:54.064198 18838 tablet_bootstrap.cc:492] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:54.064235 18977 raft_consensus.cc:2804] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:54.068274 18977 raft_consensus.cc:493] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:54.068693 18977 raft_consensus.cc:3060] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:54.100354 18838 tablet_bootstrap.cc:492] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:54.101482 18838 tablet_bootstrap.cc:492] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:54.109789 18838 ts_tablet_manager.cc:1403] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.046s	user 0.019s	sys 0.007s
I20260709 12:26:54.115072 18838 raft_consensus.cc:359] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:54.116122 18838 raft_consensus.cc:740] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.116843 18838 consensus_queue.cc:260] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:54.119112 18838 ts_tablet_manager.cc:1434] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:26:54.119966 18838 tablet_bootstrap.cc:492] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:54.136663 18838 tablet_bootstrap.cc:492] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:54.137697 18838 tablet_bootstrap.cc:492] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:54.138561 18838 ts_tablet_manager.cc:1403] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.001s
I20260709 12:26:54.100576 18977 raft_consensus.cc:515] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:54.145216 18891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cffccb3c736b4f0fa0789217fa65dc2c" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
I20260709 12:26:54.146616 18977 leader_election.cc:290] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 election: Requested vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
W20260709 12:26:54.146927 18216 leader_election.cc:343] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:54.148125 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cffccb3c736b4f0fa0789217fa65dc2c" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:26:54.148777 18099 raft_consensus.cc:3060] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:54.158370 18099 raft_consensus.cc:2468] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 3.
I20260709 12:26:54.158601 18838 raft_consensus.cc:359] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:54.159427 18838 raft_consensus.cc:740] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.159688 18215 leader_election.cc:304] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:26:54.160176 18838 consensus_queue.cc:260] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:54.160560 18977 raft_consensus.cc:2804] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:54.162618 18977 raft_consensus.cc:697] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 3 LEADER]: Becoming Leader. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:26:54.163575 18977 consensus_queue.cc:237] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:54.167930 18838 ts_tablet_manager.cc:1434] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 12:26:54.170054 18838 tablet_bootstrap.cc:492] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:54.193212 17923 catalog_manager.cc:5697] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c reported cstate change: term changed from 1 to 3, leader changed from ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193) to 10c938681fc04e66968531267f39f16c (127.9.145.196). New cstate: current_term: 3 leader_uuid: "10c938681fc04e66968531267f39f16c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:54.194360 18838 tablet_bootstrap.cc:492] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:54.195708 18838 tablet_bootstrap.cc:492] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:54.196683 18838 ts_tablet_manager.cc:1403] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.008s
I20260709 12:26:54.199761 18838 raft_consensus.cc:359] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:54.200498 18838 raft_consensus.cc:740] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.201241 18838 consensus_queue.cc:260] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:54.203723 18838 ts_tablet_manager.cc:1434] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:54.204627 18838 tablet_bootstrap.cc:492] T ebb7b63685e841a2a975e727c46f1b64 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
W20260709 12:26:54.243147 18216 consensus_peers.cc:597] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:54.255657 18838 tablet_bootstrap.cc:492] T ebb7b63685e841a2a975e727c46f1b64 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:54.256949 18838 tablet_bootstrap.cc:492] T ebb7b63685e841a2a975e727c46f1b64 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:54.257757 18838 ts_tablet_manager.cc:1403] T ebb7b63685e841a2a975e727c46f1b64 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.007s
I20260709 12:26:54.261080 18838 raft_consensus.cc:359] T ebb7b63685e841a2a975e727c46f1b64 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:54.261881 18838 raft_consensus.cc:740] T ebb7b63685e841a2a975e727c46f1b64 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.263926 18838 consensus_queue.cc:260] T ebb7b63685e841a2a975e727c46f1b64 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:54.266189 18838 ts_tablet_manager.cc:1434] T ebb7b63685e841a2a975e727c46f1b64 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 12:26:54.267032 18838 tablet_bootstrap.cc:492] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:54.287426 18838 tablet_bootstrap.cc:492] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:54.288353 18838 tablet_bootstrap.cc:492] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:54.289078 18838 ts_tablet_manager.cc:1403] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.003s
I20260709 12:26:54.291743 18838 raft_consensus.cc:359] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:54.292284 18838 raft_consensus.cc:740] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.292882 18838 consensus_queue.cc:260] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:54.294615 18838 ts_tablet_manager.cc:1434] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:26:54.295495 18838 tablet_bootstrap.cc:492] T fa35871af5624c709008fe86090c0ad1 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:54.308905 18838 tablet_bootstrap.cc:492] T fa35871af5624c709008fe86090c0ad1 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:54.308892 18891 raft_consensus.cc:3060] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.309969 18838 tablet_bootstrap.cc:492] T fa35871af5624c709008fe86090c0ad1 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:54.310638 18838 ts_tablet_manager.cc:1403] T fa35871af5624c709008fe86090c0ad1 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 12:26:54.313308 18838 raft_consensus.cc:359] T fa35871af5624c709008fe86090c0ad1 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:54.314005 18838 raft_consensus.cc:740] T fa35871af5624c709008fe86090c0ad1 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.314738 18838 consensus_queue.cc:260] T fa35871af5624c709008fe86090c0ad1 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:54.316972 18838 ts_tablet_manager.cc:1434] T fa35871af5624c709008fe86090c0ad1 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:54.317876 18838 tablet_bootstrap.cc:492] T 440b2a57096e45188762ccb05301beec P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:54.337616 18838 tablet_bootstrap.cc:492] T 440b2a57096e45188762ccb05301beec P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:54.338750 18838 tablet_bootstrap.cc:492] T 440b2a57096e45188762ccb05301beec P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:54.339512 18838 ts_tablet_manager.cc:1403] T 440b2a57096e45188762ccb05301beec P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.003s
I20260709 12:26:54.342738 18838 raft_consensus.cc:359] T 440b2a57096e45188762ccb05301beec P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:54.343446 18838 raft_consensus.cc:740] T 440b2a57096e45188762ccb05301beec P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.344120 18838 consensus_queue.cc:260] T 440b2a57096e45188762ccb05301beec P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:54.346323 18838 ts_tablet_manager.cc:1434] T 440b2a57096e45188762ccb05301beec P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:26:54.349100 18838 tablet_bootstrap.cc:492] T a61bb69fcfd54ef88c37917a48d1cb30 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:54.376590 18838 tablet_bootstrap.cc:492] T a61bb69fcfd54ef88c37917a48d1cb30 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:54.377547 18838 tablet_bootstrap.cc:492] T a61bb69fcfd54ef88c37917a48d1cb30 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:54.378221 18838 ts_tablet_manager.cc:1403] T a61bb69fcfd54ef88c37917a48d1cb30 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.008s
I20260709 12:26:54.380626 18838 raft_consensus.cc:359] T a61bb69fcfd54ef88c37917a48d1cb30 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:54.381150 18838 raft_consensus.cc:740] T a61bb69fcfd54ef88c37917a48d1cb30 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.381740 18838 consensus_queue.cc:260] T a61bb69fcfd54ef88c37917a48d1cb30 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:54.383810 18838 ts_tablet_manager.cc:1434] T a61bb69fcfd54ef88c37917a48d1cb30 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:54.385136 18838 tablet_bootstrap.cc:492] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:54.398206 18838 tablet_bootstrap.cc:492] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:54.399186 18838 tablet_bootstrap.cc:492] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:54.399930 18838 ts_tablet_manager.cc:1403] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 12:26:54.401903 18838 raft_consensus.cc:359] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:54.402462 18838 raft_consensus.cc:740] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.403105 18838 consensus_queue.cc:260] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:54.404661 18838 ts_tablet_manager.cc:1434] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:26:54.405457 18838 tablet_bootstrap.cc:492] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:54.422621 18838 tablet_bootstrap.cc:492] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:54.423556 18838 tablet_bootstrap.cc:492] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:54.423755 18887 raft_consensus.cc:3060] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.424294 18838 ts_tablet_manager.cc:1403] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.003s
I20260709 12:26:54.427126 18838 raft_consensus.cc:359] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:54.427789 18838 raft_consensus.cc:740] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.428468 18838 consensus_queue.cc:260] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:54.430538 18838 ts_tablet_manager.cc:1434] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:26:54.431378 18838 tablet_bootstrap.cc:492] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:54.449151 18838 tablet_bootstrap.cc:492] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:54.450188 18838 tablet_bootstrap.cc:492] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:54.450927 18838 ts_tablet_manager.cc:1403] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 12:26:54.453431 18838 raft_consensus.cc:359] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:54.454387 18838 raft_consensus.cc:740] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.455096 18838 consensus_queue.cc:260] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:54.456977 18838 ts_tablet_manager.cc:1434] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:54.458294 18838 tablet_bootstrap.cc:492] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:54.473647 18838 tablet_bootstrap.cc:492] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:54.474556 18838 tablet_bootstrap.cc:492] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:54.475235 18838 ts_tablet_manager.cc:1403] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.007s
I20260709 12:26:54.478246 18838 raft_consensus.cc:359] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:54.478775 18838 raft_consensus.cc:740] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.479452 18838 consensus_queue.cc:260] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:54.481516 18838 ts_tablet_manager.cc:1434] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:26:54.486763 18838 tablet_bootstrap.cc:492] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:54.501336 18838 tablet_bootstrap.cc:492] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:54.502280 18838 tablet_bootstrap.cc:492] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:54.502980 18838 ts_tablet_manager.cc:1403] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.001s
I20260709 12:26:54.504982 18838 raft_consensus.cc:359] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:54.505473 18838 raft_consensus.cc:740] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.506026 18838 consensus_queue.cc:260] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:26:54.507936 18838 ts_tablet_manager.cc:1434] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:54.509667 18838 tablet_bootstrap.cc:492] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:54.514295 18887 raft_consensus.cc:3060] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.524688 18891 raft_consensus.cc:3060] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.549069 18838 tablet_bootstrap.cc:492] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:54.550208 18838 tablet_bootstrap.cc:492] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:54.551009 18838 ts_tablet_manager.cc:1403] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.042s	user 0.026s	sys 0.007s
I20260709 12:26:54.553702 18838 raft_consensus.cc:359] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:54.554352 18838 raft_consensus.cc:740] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.554996 18838 consensus_queue.cc:260] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:26:54.557195 18838 ts_tablet_manager.cc:1434] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:26:54.558051 18838 tablet_bootstrap.cc:492] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap starting.
I20260709 12:26:54.576958 18838 tablet_bootstrap.cc:492] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:54.577859 18838 tablet_bootstrap.cc:492] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc: Bootstrap complete.
I20260709 12:26:54.578608 18838 ts_tablet_manager.cc:1403] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.004s
I20260709 12:26:54.581348 18838 raft_consensus.cc:359] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:54.582065 18838 raft_consensus.cc:740] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.582795 18838 consensus_queue.cc:260] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:26:54.591872 18838 ts_tablet_manager.cc:1434] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.004s
I20260709 12:26:54.695451 18891 raft_consensus.cc:3060] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.697984 18104 raft_consensus.cc:1275] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 3 FOLLOWER]: Refusing update from remote peer 10c938681fc04e66968531267f39f16c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:54.699358 18892 raft_consensus.cc:3060] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:54.703162 18977 consensus_queue.cc:1048] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:54.707640 18892 raft_consensus.cc:1275] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [term 3 FOLLOWER]: Refusing update from remote peer 10c938681fc04e66968531267f39f16c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:54.718823 18812 consensus_queue.cc:1048] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:03.234822  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:03.287521 18171 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11b3b0ee25aa435586a0fd8c3f186681"
dest_uuid: "a08ea42cd3884210924a19c8f570486d"
mode: GRACEFUL
new_leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
 from {username='slave'} at 127.0.0.1:44066
I20260709 12:27:03.288319 18171 raft_consensus.cc:606] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Received request to transfer leadership to TS ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:27:03.303426 18245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1660568f1208485fb6f74d572deee2d9"
dest_uuid: "10c938681fc04e66968531267f39f16c"
mode: GRACEFUL
new_leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
 from {username='slave'} at 127.0.0.1:35958
I20260709 12:27:03.303965 18245 raft_consensus.cc:606] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Received request to transfer leadership to TS ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:27:03.306564 18245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e88e93a00044d1482497fa864163047"
dest_uuid: "10c938681fc04e66968531267f39f16c"
mode: GRACEFUL
new_leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
 from {username='slave'} at 127.0.0.1:35958
I20260709 12:27:03.307143 18245 raft_consensus.cc:606] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Received request to transfer leadership to TS ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:27:03.309677 18245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "740537a0f03c42caa8182d3b9f403859"
dest_uuid: "10c938681fc04e66968531267f39f16c"
mode: GRACEFUL
new_leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
 from {username='slave'} at 127.0.0.1:35958
I20260709 12:27:03.310535 18245 raft_consensus.cc:606] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Received request to transfer leadership to TS ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:27:03.314220 18245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cffccb3c736b4f0fa0789217fa65dc2c"
dest_uuid: "10c938681fc04e66968531267f39f16c"
mode: GRACEFUL
new_leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
 from {username='slave'} at 127.0.0.1:35958
I20260709 12:27:03.314826 18245 raft_consensus.cc:606] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 3 LEADER]: Received request to transfer leadership to TS ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:27:03.317350 18245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc4b6b0d4466443f9c077e9a45bb3b89"
dest_uuid: "10c938681fc04e66968531267f39f16c"
mode: GRACEFUL
new_leader_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
 from {username='slave'} at 127.0.0.1:35958
I20260709 12:27:03.317842 18245 raft_consensus.cc:606] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Received request to transfer leadership to TS 3a269a9c95e0476d9e09c25b4b5aaa2c
I20260709 12:27:03.330345 18099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed8548d1e22c49f7a5341ec0e2f7b073"
dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
mode: GRACEFUL
new_leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
 from {username='slave'} at 127.0.0.1:60802
I20260709 12:27:03.330950 18099 raft_consensus.cc:606] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Received request to transfer leadership to TS ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:27:03.332331  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:27:03.333686  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:03.334559  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:03.414785 19038 raft_consensus.cc:993] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c: : Instructing follower ac42e2bcf9ac42448a84370269bc6ccc to start an election
I20260709 12:27:03.415392 18812 raft_consensus.cc:1081] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Signalling peer ac42e2bcf9ac42448a84370269bc6ccc to start an election
I20260709 12:27:03.417183 18887 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e88e93a00044d1482497fa864163047"
dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
 from {username='slave'} at 127.0.0.1:48446
I20260709 12:27:03.417725 18887 raft_consensus.cc:493] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:03.418078 18887 raft_consensus.cc:3060] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.427767 18887 raft_consensus.cc:515] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:27:03.430269 18887 leader_election.cc:290] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 election: Requested vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:27:03.430903 18245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e88e93a00044d1482497fa864163047" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:27:03.431555 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e88e93a00044d1482497fa864163047" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:27:03.431967 18245 raft_consensus.cc:3055] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:03.432204 18099 raft_consensus.cc:3060] T 5e88e93a00044d1482497fa864163047 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.432345 18245 raft_consensus.cc:740] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:27:03.433367 18245 consensus_queue.cc:260] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:27:03.434681 18245 raft_consensus.cc:3060] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.439944 18099 raft_consensus.cc:2468] T 5e88e93a00044d1482497fa864163047 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 2.
I20260709 12:27:03.441314 18832 leader_election.cc:304] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:27:03.441313 18245 raft_consensus.cc:2468] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 2.
I20260709 12:27:03.443437 19046 raft_consensus.cc:2804] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:03.444795 19046 raft_consensus.cc:697] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 LEADER]: Becoming Leader. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Running, Role: LEADER
I20260709 12:27:03.446025 19046 consensus_queue.cc:237] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:27:03.457425 17926 catalog_manager.cc:5697] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc reported cstate change: term changed from 1 to 2, leader changed from 10c938681fc04e66968531267f39f16c (127.9.145.196) to ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193). New cstate: current_term: 2 leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:03.523527 19038 raft_consensus.cc:993] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c: : Instructing follower 3a269a9c95e0476d9e09c25b4b5aaa2c to start an election
I20260709 12:27:03.524286 19054 raft_consensus.cc:1081] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Signalling peer 3a269a9c95e0476d9e09c25b4b5aaa2c to start an election
I20260709 12:27:03.525935 18099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc4b6b0d4466443f9c077e9a45bb3b89"
dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
 from {username='slave'} at 127.0.0.1:37856
I20260709 12:27:03.526537 18099 raft_consensus.cc:493] T dc4b6b0d4466443f9c077e9a45bb3b89 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:03.526906 18099 raft_consensus.cc:3060] T dc4b6b0d4466443f9c077e9a45bb3b89 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.534970 18099 raft_consensus.cc:515] T dc4b6b0d4466443f9c077e9a45bb3b89 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:27:03.538436 18171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4b6b0d4466443f9c077e9a45bb3b89" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:27:03.539045 18171 raft_consensus.cc:3060] T dc4b6b0d4466443f9c077e9a45bb3b89 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.539039 18244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4b6b0d4466443f9c077e9a45bb3b89" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:27:03.540056 18244 raft_consensus.cc:3055] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:03.540361 18244 raft_consensus.cc:740] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:27:03.540375 18099 leader_election.cc:290] T dc4b6b0d4466443f9c077e9a45bb3b89 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 election: Requested vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:27:03.541328 18244 consensus_queue.cc:260] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:27:03.542553 18244 raft_consensus.cc:3060] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.547418 18171 raft_consensus.cc:2468] T dc4b6b0d4466443f9c077e9a45bb3b89 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 2.
I20260709 12:27:03.549002 18070 leader_election.cc:304] T dc4b6b0d4466443f9c077e9a45bb3b89 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:27:03.549986 19039 raft_consensus.cc:2804] T dc4b6b0d4466443f9c077e9a45bb3b89 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:03.550174 18244 raft_consensus.cc:2468] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 2.
I20260709 12:27:03.550596 19039 raft_consensus.cc:697] T dc4b6b0d4466443f9c077e9a45bb3b89 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 LEADER]: Becoming Leader. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Running, Role: LEADER
I20260709 12:27:03.551813 19039 consensus_queue.cc:237] T dc4b6b0d4466443f9c077e9a45bb3b89 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:27:03.555384 19038 raft_consensus.cc:993] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c: : Instructing follower ac42e2bcf9ac42448a84370269bc6ccc to start an election
I20260709 12:27:03.556032 19038 raft_consensus.cc:1081] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Signalling peer ac42e2bcf9ac42448a84370269bc6ccc to start an election
I20260709 12:27:03.558012 18891 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "740537a0f03c42caa8182d3b9f403859"
dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
 from {username='slave'} at 127.0.0.1:48446
I20260709 12:27:03.558571 18891 raft_consensus.cc:493] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:03.559002 18891 raft_consensus.cc:3060] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.568068 17926 catalog_manager.cc:5697] T dc4b6b0d4466443f9c077e9a45bb3b89 P 3a269a9c95e0476d9e09c25b4b5aaa2c reported cstate change: term changed from 1 to 2, leader changed from 10c938681fc04e66968531267f39f16c (127.9.145.196) to 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194). New cstate: current_term: 2 leader_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:03.572403 18891 raft_consensus.cc:515] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:27:03.578732 18891 leader_election.cc:290] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 election: Requested vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:27:03.580554 18244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "740537a0f03c42caa8182d3b9f403859" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:27:03.581259 18244 raft_consensus.cc:3055] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:03.581547 18244 raft_consensus.cc:740] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:27:03.582933 18244 consensus_queue.cc:260] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:27:03.582895 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "740537a0f03c42caa8182d3b9f403859" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:27:03.585525 18244 raft_consensus.cc:3060] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.586050 18099 raft_consensus.cc:3060] T 740537a0f03c42caa8182d3b9f403859 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.592748 18244 raft_consensus.cc:2468] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 2.
I20260709 12:27:03.593560 18099 raft_consensus.cc:2468] T 740537a0f03c42caa8182d3b9f403859 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 2.
I20260709 12:27:03.593999 18832 leader_election.cc:304] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:27:03.594899 19046 raft_consensus.cc:2804] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:03.595414 19046 raft_consensus.cc:697] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 LEADER]: Becoming Leader. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Running, Role: LEADER
I20260709 12:27:03.596180 19046 consensus_queue.cc:237] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:27:03.610189 18812 raft_consensus.cc:993] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c: : Instructing follower ac42e2bcf9ac42448a84370269bc6ccc to start an election
I20260709 12:27:03.610698 19038 raft_consensus.cc:1081] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Signalling peer ac42e2bcf9ac42448a84370269bc6ccc to start an election
I20260709 12:27:03.610708 17926 catalog_manager.cc:5697] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc reported cstate change: term changed from 1 to 2, leader changed from 10c938681fc04e66968531267f39f16c (127.9.145.196) to ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193). New cstate: current_term: 2 leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:03.612709 18887 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1660568f1208485fb6f74d572deee2d9"
dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
 from {username='slave'} at 127.0.0.1:48446
I20260709 12:27:03.613296 18887 raft_consensus.cc:493] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:03.613673 18887 raft_consensus.cc:3060] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.620242 18887 raft_consensus.cc:515] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:27:03.621843 18887 leader_election.cc:290] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 election: Requested vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:27:03.622980 18171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1660568f1208485fb6f74d572deee2d9" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:27:03.623677 18171 raft_consensus.cc:3060] T 1660568f1208485fb6f74d572deee2d9 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.630033 18244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1660568f1208485fb6f74d572deee2d9" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:27:03.630720 18244 raft_consensus.cc:3055] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:03.631052 18244 raft_consensus.cc:740] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:27:03.631839 18244 consensus_queue.cc:260] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:27:03.633050 18244 raft_consensus.cc:3060] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.639230 18171 raft_consensus.cc:2468] T 1660568f1208485fb6f74d572deee2d9 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 2.
I20260709 12:27:03.640611 18835 leader_election.cc:304] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:27:03.641570 19046 raft_consensus.cc:2804] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:03.641666 18244 raft_consensus.cc:2468] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 2.
I20260709 12:27:03.642238 19046 raft_consensus.cc:697] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 LEADER]: Becoming Leader. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Running, Role: LEADER
I20260709 12:27:03.643289 19046 consensus_queue.cc:237] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:27:03.653990 17926 catalog_manager.cc:5697] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc reported cstate change: term changed from 1 to 2, leader changed from 10c938681fc04e66968531267f39f16c (127.9.145.196) to ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193). New cstate: current_term: 2 leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:03.705053 19054 raft_consensus.cc:993] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c: : Instructing follower ac42e2bcf9ac42448a84370269bc6ccc to start an election
I20260709 12:27:03.705624 18812 raft_consensus.cc:1081] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 3 LEADER]: Signalling peer ac42e2bcf9ac42448a84370269bc6ccc to start an election
I20260709 12:27:03.707209 18891 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cffccb3c736b4f0fa0789217fa65dc2c"
dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
 from {username='slave'} at 127.0.0.1:48446
I20260709 12:27:03.707733 18891 raft_consensus.cc:493] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:03.708004 18891 raft_consensus.cc:3060] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:03.713761 18891 raft_consensus.cc:515] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:27:03.716140 18891 leader_election.cc:290] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 4 election: Requested vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:27:03.716295 18244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cffccb3c736b4f0fa0789217fa65dc2c" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:27:03.717026 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cffccb3c736b4f0fa0789217fa65dc2c" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:27:03.717098 18244 raft_consensus.cc:3055] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:03.717569 18244 raft_consensus.cc:740] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:27:03.717553 18099 raft_consensus.cc:3060] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:03.718586 18244 consensus_queue.cc:260] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:27:03.719969 18244 raft_consensus.cc:3060] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:03.725129 18099 raft_consensus.cc:2468] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 4.
I20260709 12:27:03.727633 18244 raft_consensus.cc:2468] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 4.
I20260709 12:27:03.726627 18832 leader_election.cc:304] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:27:03.729243 19046 raft_consensus.cc:2804] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:03.729748 19046 raft_consensus.cc:697] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [term 4 LEADER]: Becoming Leader. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Running, Role: LEADER
I20260709 12:27:03.730980 19046 consensus_queue.cc:237] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:27:03.733719 19039 raft_consensus.cc:993] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c: : Instructing follower ac42e2bcf9ac42448a84370269bc6ccc to start an election
I20260709 12:27:03.734542 19035 raft_consensus.cc:1081] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Signalling peer ac42e2bcf9ac42448a84370269bc6ccc to start an election
I20260709 12:27:03.736398 18891 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed8548d1e22c49f7a5341ec0e2f7b073"
dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
 from {username='slave'} at 127.0.0.1:48462
I20260709 12:27:03.737025 18891 raft_consensus.cc:493] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:03.737437 18891 raft_consensus.cc:3060] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.743295 17926 catalog_manager.cc:5697] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc reported cstate change: term changed from 3 to 4, leader changed from 10c938681fc04e66968531267f39f16c (127.9.145.196) to ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193). New cstate: current_term: 4 leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:03.746371 18891 raft_consensus.cc:515] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:27:03.748953 18891 leader_election.cc:290] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 election: Requested vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:27:03.749195 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed8548d1e22c49f7a5341ec0e2f7b073" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:27:03.749866 18104 raft_consensus.cc:3055] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:03.750226 18104 raft_consensus.cc:740] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Running, Role: LEADER
I20260709 12:27:03.750982 18104 consensus_queue.cc:260] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:27:03.752431 18104 raft_consensus.cc:3060] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.758215 18173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed8548d1e22c49f7a5341ec0e2f7b073" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:27:03.758944 18173 raft_consensus.cc:3060] T ed8548d1e22c49f7a5341ec0e2f7b073 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.764195 18104 raft_consensus.cc:2468] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 2.
I20260709 12:27:03.765712 18832 leader_election.cc:304] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:27:03.766562 19046 raft_consensus.cc:2804] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:03.767313 19046 raft_consensus.cc:697] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 LEADER]: Becoming Leader. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Running, Role: LEADER
I20260709 12:27:03.768150 19046 consensus_queue.cc:237] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:27:03.770678 18173 raft_consensus.cc:2468] T ed8548d1e22c49f7a5341ec0e2f7b073 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 2.
I20260709 12:27:03.778703 17926 catalog_manager.cc:5697] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc reported cstate change: term changed from 1 to 2, leader changed from 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194) to ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193). New cstate: current_term: 2 leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:03.829890 19033 raft_consensus.cc:993] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d: : Instructing follower ac42e2bcf9ac42448a84370269bc6ccc to start an election
I20260709 12:27:03.830523 19041 raft_consensus.cc:1081] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Signalling peer ac42e2bcf9ac42448a84370269bc6ccc to start an election
I20260709 12:27:03.832005 18887 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11b3b0ee25aa435586a0fd8c3f186681"
dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
 from {username='slave'} at 127.0.0.1:48468
I20260709 12:27:03.832554 18887 raft_consensus.cc:493] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:03.832899 18887 raft_consensus.cc:3060] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.838570 18887 raft_consensus.cc:515] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:27:03.840541 18887 leader_election.cc:290] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 election: Requested vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:27:03.841264 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11b3b0ee25aa435586a0fd8c3f186681" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:27:03.841543 18173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11b3b0ee25aa435586a0fd8c3f186681" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:27:03.841848 18104 raft_consensus.cc:3060] T 11b3b0ee25aa435586a0fd8c3f186681 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.842221 18173 raft_consensus.cc:3055] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:03.842571 18173 raft_consensus.cc:740] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Running, Role: LEADER
I20260709 12:27:03.843416 18173 consensus_queue.cc:260] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:27:03.844517 18173 raft_consensus.cc:3060] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.847831 18104 raft_consensus.cc:2468] T 11b3b0ee25aa435586a0fd8c3f186681 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 2.
I20260709 12:27:03.848886 18832 leader_election.cc:304] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:27:03.849561 19046 raft_consensus.cc:2804] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:03.850086 19046 raft_consensus.cc:697] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 LEADER]: Becoming Leader. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Running, Role: LEADER
I20260709 12:27:03.851032 18173 raft_consensus.cc:2468] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 2.
I20260709 12:27:03.850993 19046 consensus_queue.cc:237] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:27:03.861433 17926 catalog_manager.cc:5697] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc reported cstate change: term changed from 1 to 2, leader changed from a08ea42cd3884210924a19c8f570486d (127.9.145.195) to ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193). New cstate: current_term: 2 leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:03.928232 18104 raft_consensus.cc:1275] T 5e88e93a00044d1482497fa864163047 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Refusing update from remote peer ac42e2bcf9ac42448a84370269bc6ccc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:03.929498 19046 consensus_queue.cc:1048] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:03.937036 18245 raft_consensus.cc:1275] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Refusing update from remote peer 3a269a9c95e0476d9e09c25b4b5aaa2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:03.938584 19039 consensus_queue.cc:1048] T dc4b6b0d4466443f9c077e9a45bb3b89 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:03.944746 18245 raft_consensus.cc:1275] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Refusing update from remote peer ac42e2bcf9ac42448a84370269bc6ccc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:03.946626 19047 consensus_queue.cc:1048] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:03.971697 18171 raft_consensus.cc:1275] T dc4b6b0d4466443f9c077e9a45bb3b89 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Refusing update from remote peer 3a269a9c95e0476d9e09c25b4b5aaa2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:03.976102 19035 consensus_queue.cc:1048] T dc4b6b0d4466443f9c077e9a45bb3b89 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:04.016080 18099 raft_consensus.cc:1275] T 740537a0f03c42caa8182d3b9f403859 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Refusing update from remote peer ac42e2bcf9ac42448a84370269bc6ccc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:04.017261 19047 consensus_queue.cc:1048] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:04.029948 18245 raft_consensus.cc:1275] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Refusing update from remote peer ac42e2bcf9ac42448a84370269bc6ccc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:04.032157 19046 consensus_queue.cc:1048] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:04.076812 18244 raft_consensus.cc:1275] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Refusing update from remote peer ac42e2bcf9ac42448a84370269bc6ccc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:04.078166 19071 consensus_queue.cc:1048] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:04.088462 18173 raft_consensus.cc:1275] T 1660568f1208485fb6f74d572deee2d9 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Refusing update from remote peer ac42e2bcf9ac42448a84370269bc6ccc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:04.091626 19047 consensus_queue.cc:1048] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:04.163312 18173 raft_consensus.cc:1275] T ed8548d1e22c49f7a5341ec0e2f7b073 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Refusing update from remote peer ac42e2bcf9ac42448a84370269bc6ccc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:04.165068 19074 consensus_queue.cc:1048] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:04.175663 18104 raft_consensus.cc:1275] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Refusing update from remote peer ac42e2bcf9ac42448a84370269bc6ccc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:04.178340 19071 consensus_queue.cc:1048] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:04.255013 18173 raft_consensus.cc:1275] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Refusing update from remote peer ac42e2bcf9ac42448a84370269bc6ccc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:04.256340 19074 consensus_queue.cc:1048] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:04.265892 18104 raft_consensus.cc:1275] T 11b3b0ee25aa435586a0fd8c3f186681 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Refusing update from remote peer ac42e2bcf9ac42448a84370269bc6ccc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:04.267403 19071 consensus_queue.cc:1048] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:04.306995 18244 raft_consensus.cc:1275] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 4 FOLLOWER]: Refusing update from remote peer ac42e2bcf9ac42448a84370269bc6ccc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:04.308308 19071 consensus_queue.cc:1048] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:04.322866 18104 raft_consensus.cc:1275] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 4 FOLLOWER]: Refusing update from remote peer ac42e2bcf9ac42448a84370269bc6ccc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:04.329061 19071 consensus_queue.cc:1048] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:04.375960  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:04.417973 18104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10895331ca6e49d4aad97aec0e629dd7"
dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
mode: GRACEFUL
new_leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
 from {username='slave'} at 127.0.0.1:60802
I20260709 12:27:04.418637 18104 raft_consensus.cc:606] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Received request to transfer leadership to TS ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:27:04.421187 18104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "223eb34bd9744014b3c011eebcb37f11"
dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
mode: GRACEFUL
new_leader_uuid: "10c938681fc04e66968531267f39f16c"
 from {username='slave'} at 127.0.0.1:60802
I20260709 12:27:04.421657 18104 raft_consensus.cc:606] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Received request to transfer leadership to TS 10c938681fc04e66968531267f39f16c
I20260709 12:27:04.424294 18173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35683295be3042a4bc1839bda16f6f40"
dest_uuid: "a08ea42cd3884210924a19c8f570486d"
mode: GRACEFUL
new_leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
 from {username='slave'} at 127.0.0.1:44066
I20260709 12:27:04.424889 18173 raft_consensus.cc:606] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Received request to transfer leadership to TS ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:27:04.427597 18244 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90509aaa02f84d8a983c9f13d8155ded"
dest_uuid: "10c938681fc04e66968531267f39f16c"
mode: GRACEFUL
new_leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
 from {username='slave'} at 127.0.0.1:35958
I20260709 12:27:04.428143 18244 raft_consensus.cc:606] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Received request to transfer leadership to TS ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:27:04.431303 18104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9984112bc75a4e66b55655a1bdd99052"
dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
mode: GRACEFUL
new_leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
 from {username='slave'} at 127.0.0.1:60802
I20260709 12:27:04.431861 18104 raft_consensus.cc:606] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Received request to transfer leadership to TS ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:27:04.437084 18244 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a019c53d9a9946c59ed8a1b201786adc"
dest_uuid: "10c938681fc04e66968531267f39f16c"
mode: GRACEFUL
new_leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
 from {username='slave'} at 127.0.0.1:35958
I20260709 12:27:04.437734 18244 raft_consensus.cc:606] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Received request to transfer leadership to TS ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:27:04.439167  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:27:04.441004  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:04.441866  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:04.482506 19035 raft_consensus.cc:993] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c: : Instructing follower 10c938681fc04e66968531267f39f16c to start an election
I20260709 12:27:04.483063 19039 raft_consensus.cc:1081] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Signalling peer 10c938681fc04e66968531267f39f16c to start an election
I20260709 12:27:04.484862 18245 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "223eb34bd9744014b3c011eebcb37f11"
dest_uuid: "10c938681fc04e66968531267f39f16c"
 from {username='slave'} at 127.0.0.1:50818
I20260709 12:27:04.485463 18245 raft_consensus.cc:493] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:04.485822 18245 raft_consensus.cc:3060] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:04.492483 18245 raft_consensus.cc:515] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:27:04.494503 18245 leader_election.cc:290] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 election: Requested vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:27:04.495234 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "223eb34bd9744014b3c011eebcb37f11" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:27:04.495498 18173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "223eb34bd9744014b3c011eebcb37f11" candidate_uuid: "10c938681fc04e66968531267f39f16c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:27:04.495918 18104 raft_consensus.cc:3055] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:04.496040 18173 raft_consensus.cc:3060] T 223eb34bd9744014b3c011eebcb37f11 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:04.496205 18104 raft_consensus.cc:740] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Running, Role: LEADER
I20260709 12:27:04.497120 18104 consensus_queue.cc:260] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:27:04.498404 18104 raft_consensus.cc:3060] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:04.503719 18173 raft_consensus.cc:2468] T 223eb34bd9744014b3c011eebcb37f11 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 2.
I20260709 12:27:04.505873 18104 raft_consensus.cc:2468] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c938681fc04e66968531267f39f16c in term 2.
I20260709 12:27:04.508778 18215 leader_election.cc:304] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, 3a269a9c95e0476d9e09c25b4b5aaa2c; no voters: 
I20260709 12:27:04.509622 19082 raft_consensus.cc:2804] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:04.510200 19082 raft_consensus.cc:697] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c [term 2 LEADER]: Becoming Leader. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:27:04.511144 19082 consensus_queue.cc:237] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:27:04.523726 17924 catalog_manager.cc:5697] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c reported cstate change: term changed from 1 to 2, leader changed from 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194) to 10c938681fc04e66968531267f39f16c (127.9.145.196). New cstate: current_term: 2 leader_uuid: "10c938681fc04e66968531267f39f16c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:04.641675 19039 raft_consensus.cc:993] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c: : Instructing follower ac42e2bcf9ac42448a84370269bc6ccc to start an election
I20260709 12:27:04.642227 19039 raft_consensus.cc:1081] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Signalling peer ac42e2bcf9ac42448a84370269bc6ccc to start an election
I20260709 12:27:04.643884 18887 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9984112bc75a4e66b55655a1bdd99052"
dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
 from {username='slave'} at 127.0.0.1:48462
I20260709 12:27:04.644474 18887 raft_consensus.cc:493] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:04.644846 18887 raft_consensus.cc:3060] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:04.652571 18887 raft_consensus.cc:515] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:27:04.654644 18887 leader_election.cc:290] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 election: Requested vote from peers 10c938681fc04e66968531267f39f16c (127.9.145.196:37881), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:27:04.655342 18245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9984112bc75a4e66b55655a1bdd99052" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:27:04.655635 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9984112bc75a4e66b55655a1bdd99052" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:27:04.656023 18245 raft_consensus.cc:3060] T 9984112bc75a4e66b55655a1bdd99052 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:04.656251 18099 raft_consensus.cc:3055] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:04.656628 18099 raft_consensus.cc:740] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Running, Role: LEADER
I20260709 12:27:04.657526 18099 consensus_queue.cc:260] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:27:04.658692 18099 raft_consensus.cc:3060] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:04.663764 18245 raft_consensus.cc:2468] T 9984112bc75a4e66b55655a1bdd99052 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 2.
I20260709 12:27:04.664036 18099 raft_consensus.cc:2468] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 2.
I20260709 12:27:04.665167 18832 leader_election.cc:304] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:27:04.666221 19071 raft_consensus.cc:2804] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:04.666721 19071 raft_consensus.cc:697] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 LEADER]: Becoming Leader. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Running, Role: LEADER
I20260709 12:27:04.667620 19071 consensus_queue.cc:237] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:27:04.678611 17924 catalog_manager.cc:5697] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc reported cstate change: term changed from 1 to 2, leader changed from 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194) to ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193). New cstate: current_term: 2 leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:04.682269 19039 raft_consensus.cc:993] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c: : Instructing follower ac42e2bcf9ac42448a84370269bc6ccc to start an election
I20260709 12:27:04.682994 19053 raft_consensus.cc:1081] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Signalling peer ac42e2bcf9ac42448a84370269bc6ccc to start an election
I20260709 12:27:04.684926 18887 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10895331ca6e49d4aad97aec0e629dd7"
dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
 from {username='slave'} at 127.0.0.1:48462
I20260709 12:27:04.685406 18887 raft_consensus.cc:493] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:04.685743 18887 raft_consensus.cc:3060] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:04.692795 18887 raft_consensus.cc:515] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:27:04.694391 18887 leader_election.cc:290] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 election: Requested vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:27:04.695241 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10895331ca6e49d4aad97aec0e629dd7" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:27:04.695488 18245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10895331ca6e49d4aad97aec0e629dd7" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:27:04.695942 18099 raft_consensus.cc:3055] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:04.696062 18245 raft_consensus.cc:3060] T 10895331ca6e49d4aad97aec0e629dd7 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:04.696338 18099 raft_consensus.cc:740] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Running, Role: LEADER
I20260709 12:27:04.697192 18099 consensus_queue.cc:260] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:27:04.707096 18099 raft_consensus.cc:3060] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:04.707342 18245 raft_consensus.cc:2468] T 10895331ca6e49d4aad97aec0e629dd7 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 2.
I20260709 12:27:04.708673 18832 leader_election.cc:304] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:27:04.709544 19071 raft_consensus.cc:2804] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:04.710058 19071 raft_consensus.cc:697] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 LEADER]: Becoming Leader. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Running, Role: LEADER
I20260709 12:27:04.710955 19071 consensus_queue.cc:237] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:27:04.714394 18099 raft_consensus.cc:2468] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 2.
I20260709 12:27:04.722420 19082 raft_consensus.cc:993] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c: : Instructing follower ac42e2bcf9ac42448a84370269bc6ccc to start an election
I20260709 12:27:04.722903 19054 raft_consensus.cc:1081] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Signalling peer ac42e2bcf9ac42448a84370269bc6ccc to start an election
I20260709 12:27:04.724424 18887 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a019c53d9a9946c59ed8a1b201786adc"
dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
 from {username='slave'} at 127.0.0.1:48446
I20260709 12:27:04.724020 17924 catalog_manager.cc:5697] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc reported cstate change: term changed from 1 to 2, leader changed from 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194) to ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193). New cstate: current_term: 2 leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:04.725049 18887 raft_consensus.cc:493] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:04.725514 18887 raft_consensus.cc:3060] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:04.732880 18887 raft_consensus.cc:515] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:27:04.739681 18245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019c53d9a9946c59ed8a1b201786adc" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:27:04.740545 18887 leader_election.cc:290] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 election: Requested vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:27:04.740794 18245 raft_consensus.cc:3055] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:04.741287 18245 raft_consensus.cc:740] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:27:04.739681 18173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019c53d9a9946c59ed8a1b201786adc" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:27:04.742671 18173 raft_consensus.cc:3060] T a019c53d9a9946c59ed8a1b201786adc P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:04.742242 18245 consensus_queue.cc:260] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:27:04.743780 18245 raft_consensus.cc:3060] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:04.749933 18173 raft_consensus.cc:2468] T a019c53d9a9946c59ed8a1b201786adc P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 2.
I20260709 12:27:04.750468 18245 raft_consensus.cc:2468] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 2.
I20260709 12:27:04.751317 18835 leader_election.cc:304] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:27:04.752151 19071 raft_consensus.cc:2804] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:04.752619 19071 raft_consensus.cc:697] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc [term 2 LEADER]: Becoming Leader. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Running, Role: LEADER
I20260709 12:27:04.753340 19071 consensus_queue.cc:237] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:27:04.762774 17924 catalog_manager.cc:5697] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc reported cstate change: term changed from 1 to 2, leader changed from 10c938681fc04e66968531267f39f16c (127.9.145.196) to ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193). New cstate: current_term: 2 leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:04.822950 19033 raft_consensus.cc:993] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d: : Instructing follower ac42e2bcf9ac42448a84370269bc6ccc to start an election
I20260709 12:27:04.823395 19041 raft_consensus.cc:1081] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Signalling peer ac42e2bcf9ac42448a84370269bc6ccc to start an election
I20260709 12:27:04.824858 18891 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35683295be3042a4bc1839bda16f6f40"
dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
 from {username='slave'} at 127.0.0.1:48468
I20260709 12:27:04.825316 18891 raft_consensus.cc:493] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:04.825591 18891 raft_consensus.cc:3060] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:04.832063 18891 raft_consensus.cc:515] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:27:04.833577 18891 leader_election.cc:290] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 election: Requested vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:27:04.834446 18173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35683295be3042a4bc1839bda16f6f40" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:27:04.834601 18245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35683295be3042a4bc1839bda16f6f40" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:27:04.835204 18173 raft_consensus.cc:3055] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:04.835269 18245 raft_consensus.cc:3060] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:04.835636 18173 raft_consensus.cc:740] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Running, Role: LEADER
I20260709 12:27:04.836467 18173 consensus_queue.cc:260] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:27:04.837718 18173 raft_consensus.cc:3060] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:04.842729 18245 raft_consensus.cc:2468] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 2.
I20260709 12:27:04.844359 18832 leader_election.cc:304] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:27:04.845114 19071 raft_consensus.cc:2804] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:04.845460 18173 raft_consensus.cc:2468] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 2.
I20260709 12:27:04.845609 19071 raft_consensus.cc:697] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 LEADER]: Becoming Leader. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Running, Role: LEADER
I20260709 12:27:04.846838 19071 consensus_queue.cc:237] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:27:04.864277 17924 catalog_manager.cc:5697] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc reported cstate change: term changed from 1 to 2, leader changed from a08ea42cd3884210924a19c8f570486d (127.9.145.195) to ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193). New cstate: current_term: 2 leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:04.896384 18173 raft_consensus.cc:1275] T 223eb34bd9744014b3c011eebcb37f11 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Refusing update from remote peer 10c938681fc04e66968531267f39f16c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:04.898223 19054 consensus_queue.cc:1048] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:04.910128 18099 raft_consensus.cc:1275] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Refusing update from remote peer 10c938681fc04e66968531267f39f16c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:04.912237 19038 consensus_queue.cc:1048] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:04.936960 19054 raft_consensus.cc:993] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c: : Instructing follower ac42e2bcf9ac42448a84370269bc6ccc to start an election
I20260709 12:27:04.937593 19038 raft_consensus.cc:1081] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Signalling peer ac42e2bcf9ac42448a84370269bc6ccc to start an election
I20260709 12:27:04.939448 18887 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90509aaa02f84d8a983c9f13d8155ded"
dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
 from {username='slave'} at 127.0.0.1:48446
I20260709 12:27:04.940068 18887 raft_consensus.cc:493] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:04.940416 18887 raft_consensus.cc:3060] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:04.945731 18887 raft_consensus.cc:515] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:27:04.948246 18887 leader_election.cc:290] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 election: Requested vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:27:04.948361 18171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90509aaa02f84d8a983c9f13d8155ded" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:27:04.949043 18171 raft_consensus.cc:3060] T 90509aaa02f84d8a983c9f13d8155ded P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:04.949278 18245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90509aaa02f84d8a983c9f13d8155ded" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:27:04.949906 18245 raft_consensus.cc:3055] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:04.950271 18245 raft_consensus.cc:740] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:27:04.951386 18245 consensus_queue.cc:260] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:27:04.952670 18245 raft_consensus.cc:3060] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:04.956604 18171 raft_consensus.cc:2468] T 90509aaa02f84d8a983c9f13d8155ded P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 2.
I20260709 12:27:04.957906 18835 leader_election.cc:304] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:27:04.958870 19074 raft_consensus.cc:2804] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:04.959401 19074 raft_consensus.cc:697] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc [term 2 LEADER]: Becoming Leader. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Running, Role: LEADER
I20260709 12:27:04.960268 19074 consensus_queue.cc:237] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:27:04.962144 18245 raft_consensus.cc:2468] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 2.
I20260709 12:27:04.970360 17924 catalog_manager.cc:5697] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc reported cstate change: term changed from 1 to 2, leader changed from 10c938681fc04e66968531267f39f16c (127.9.145.196) to ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193). New cstate: current_term: 2 leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:05.085062 18104 raft_consensus.cc:1275] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Refusing update from remote peer ac42e2bcf9ac42448a84370269bc6ccc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:05.086440 19074 consensus_queue.cc:1048] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:05.102119 18251 raft_consensus.cc:1275] T 9984112bc75a4e66b55655a1bdd99052 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Refusing update from remote peer ac42e2bcf9ac42448a84370269bc6ccc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:05.103715 19046 consensus_queue.cc:1048] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:05.208411 18251 raft_consensus.cc:1275] T 10895331ca6e49d4aad97aec0e629dd7 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Refusing update from remote peer ac42e2bcf9ac42448a84370269bc6ccc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:05.209805 19046 consensus_queue.cc:1048] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:05.220512 18104 raft_consensus.cc:1275] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Refusing update from remote peer ac42e2bcf9ac42448a84370269bc6ccc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:05.221859 19046 consensus_queue.cc:1048] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:05.273963 18245 raft_consensus.cc:1275] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Refusing update from remote peer ac42e2bcf9ac42448a84370269bc6ccc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:05.275429 19046 consensus_queue.cc:1048] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:05.285395 18173 raft_consensus.cc:1275] T a019c53d9a9946c59ed8a1b201786adc P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Refusing update from remote peer ac42e2bcf9ac42448a84370269bc6ccc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:05.290223 19071 consensus_queue.cc:1048] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:05.294015 18245 raft_consensus.cc:1275] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Refusing update from remote peer ac42e2bcf9ac42448a84370269bc6ccc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:05.298243 19071 consensus_queue.cc:1048] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:05.315641 18171 raft_consensus.cc:1275] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Refusing update from remote peer ac42e2bcf9ac42448a84370269bc6ccc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:05.317226 19046 consensus_queue.cc:1048] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:05.490818  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:05.531066 18173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb4d4ed1ab54477ca58913fad1bc93b1"
dest_uuid: "a08ea42cd3884210924a19c8f570486d"
mode: GRACEFUL
new_leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
 from {username='slave'} at 127.0.0.1:44066
I20260709 12:27:05.531726 18173 raft_consensus.cc:606] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Received request to transfer leadership to TS ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:27:05.534874 18173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d52578a055b2452883b1a598a35ca322"
dest_uuid: "a08ea42cd3884210924a19c8f570486d"
mode: GRACEFUL
new_leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
 from {username='slave'} at 127.0.0.1:44066
I20260709 12:27:05.535284 18251 raft_consensus.cc:1275] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Refusing update from remote peer ac42e2bcf9ac42448a84370269bc6ccc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:05.535475 18173 raft_consensus.cc:606] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Received request to transfer leadership to TS ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:27:05.537547 19104 consensus_queue.cc:1048] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:05.538718 18251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e48eb1372ff4402498990d2abd8c6da2"
dest_uuid: "10c938681fc04e66968531267f39f16c"
mode: GRACEFUL
new_leader_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
 from {username='slave'} at 127.0.0.1:35958
I20260709 12:27:05.539398 18251 raft_consensus.cc:606] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Received request to transfer leadership to TS 3a269a9c95e0476d9e09c25b4b5aaa2c
I20260709 12:27:05.541962  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:27:05.543823  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:05.544596  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:05.552620 18173 raft_consensus.cc:1275] T 90509aaa02f84d8a983c9f13d8155ded P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Refusing update from remote peer ac42e2bcf9ac42448a84370269bc6ccc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:05.557822 19104 consensus_queue.cc:1048] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:05.625615 19041 raft_consensus.cc:993] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d: : Instructing follower ac42e2bcf9ac42448a84370269bc6ccc to start an election
I20260709 12:27:05.626147 19105 raft_consensus.cc:1081] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Signalling peer ac42e2bcf9ac42448a84370269bc6ccc to start an election
I20260709 12:27:05.627674 18891 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d52578a055b2452883b1a598a35ca322"
dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
 from {username='slave'} at 127.0.0.1:48468
I20260709 12:27:05.628147 18891 raft_consensus.cc:493] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:05.628427 18891 raft_consensus.cc:3060] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:05.633912 18891 raft_consensus.cc:515] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:27:05.635480 18891 leader_election.cc:290] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 election: Requested vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:27:05.636286 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52578a055b2452883b1a598a35ca322" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:27:05.636693 18171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52578a055b2452883b1a598a35ca322" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:27:05.636885 18104 raft_consensus.cc:3060] T d52578a055b2452883b1a598a35ca322 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:05.637270 18171 raft_consensus.cc:3055] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:05.637619 18171 raft_consensus.cc:740] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Running, Role: LEADER
I20260709 12:27:05.638365 18171 consensus_queue.cc:260] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:27:05.639763 18171 raft_consensus.cc:3060] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:05.643206 18104 raft_consensus.cc:2468] T d52578a055b2452883b1a598a35ca322 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 2.
I20260709 12:27:05.644516 18832 leader_election.cc:304] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:27:05.645334 19104 raft_consensus.cc:2804] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:05.645859 19104 raft_consensus.cc:697] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 LEADER]: Becoming Leader. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Running, Role: LEADER
I20260709 12:27:05.645889 18171 raft_consensus.cc:2468] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 2.
I20260709 12:27:05.646876 19104 consensus_queue.cc:237] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:27:05.659526 17924 catalog_manager.cc:5697] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc reported cstate change: term changed from 1 to 2, leader changed from a08ea42cd3884210924a19c8f570486d (127.9.145.195) to ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193). New cstate: current_term: 2 leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:05.767843 19082 raft_consensus.cc:993] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c: : Instructing follower 3a269a9c95e0476d9e09c25b4b5aaa2c to start an election
I20260709 12:27:05.768379 19054 raft_consensus.cc:1081] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Signalling peer 3a269a9c95e0476d9e09c25b4b5aaa2c to start an election
I20260709 12:27:05.769824 18104 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e48eb1372ff4402498990d2abd8c6da2"
dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
 from {username='slave'} at 127.0.0.1:37856
I20260709 12:27:05.770349 18104 raft_consensus.cc:493] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:05.770725 18104 raft_consensus.cc:3060] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:05.779528 18104 raft_consensus.cc:515] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:27:05.781787 18104 leader_election.cc:290] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 election: Requested vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:27:05.782027 18171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e48eb1372ff4402498990d2abd8c6da2" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:27:05.782274 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e48eb1372ff4402498990d2abd8c6da2" candidate_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:27:05.782704 18171 raft_consensus.cc:3060] T e48eb1372ff4402498990d2abd8c6da2 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:05.782938 18251 raft_consensus.cc:3055] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:05.783309 18251 raft_consensus.cc:740] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10c938681fc04e66968531267f39f16c, State: Running, Role: LEADER
I20260709 12:27:05.784125 18251 consensus_queue.cc:260] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:27:05.785399 18251 raft_consensus.cc:3060] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:05.788645 18171 raft_consensus.cc:2468] T e48eb1372ff4402498990d2abd8c6da2 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 2.
I20260709 12:27:05.790117 18070 leader_election.cc:304] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, a08ea42cd3884210924a19c8f570486d; no voters: 
I20260709 12:27:05.791311 19035 raft_consensus.cc:2804] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:05.791759 19035 raft_consensus.cc:697] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 LEADER]: Becoming Leader. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Running, Role: LEADER
I20260709 12:27:05.792590 19035 consensus_queue.cc:237] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } }
I20260709 12:27:05.804911 17924 catalog_manager.cc:5697] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c reported cstate change: term changed from 1 to 2, leader changed from 10c938681fc04e66968531267f39f16c (127.9.145.196) to 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194). New cstate: current_term: 2 leader_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:05.816462 18251 raft_consensus.cc:2468] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a269a9c95e0476d9e09c25b4b5aaa2c in term 2.
I20260709 12:27:06.037575 19105 raft_consensus.cc:993] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d: : Instructing follower ac42e2bcf9ac42448a84370269bc6ccc to start an election
I20260709 12:27:06.038071 19041 raft_consensus.cc:1081] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Signalling peer ac42e2bcf9ac42448a84370269bc6ccc to start an election
I20260709 12:27:06.039635 18887 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb4d4ed1ab54477ca58913fad1bc93b1"
dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
 from {username='slave'} at 127.0.0.1:48468
I20260709 12:27:06.040138 18887 raft_consensus.cc:493] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:06.040421 18887 raft_consensus.cc:3060] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:06.045758 18887 raft_consensus.cc:515] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:27:06.047528 18887 leader_election.cc:290] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 election: Requested vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), 10c938681fc04e66968531267f39f16c (127.9.145.196:37881)
I20260709 12:27:06.048704 18171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4d4ed1ab54477ca58913fad1bc93b1" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:27:06.049373 18171 raft_consensus.cc:3055] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:06.048895 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4d4ed1ab54477ca58913fad1bc93b1" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10c938681fc04e66968531267f39f16c"
I20260709 12:27:06.049984 18251 raft_consensus.cc:3060] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:06.049703 18171 raft_consensus.cc:740] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a08ea42cd3884210924a19c8f570486d, State: Running, Role: LEADER
I20260709 12:27:06.051245 18171 consensus_queue.cc:260] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:27:06.052584 18171 raft_consensus.cc:3060] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:06.059319 18251 raft_consensus.cc:2468] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 2.
I20260709 12:27:06.060276 18171 raft_consensus.cc:2468] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 2.
I20260709 12:27:06.060529 18832 leader_election.cc:304] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c938681fc04e66968531267f39f16c, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:27:06.061507 19074 raft_consensus.cc:2804] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:06.062005 19074 raft_consensus.cc:697] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 LEADER]: Becoming Leader. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Running, Role: LEADER
I20260709 12:27:06.062887 19074 consensus_queue.cc:237] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:27:06.073138 17924 catalog_manager.cc:5697] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc reported cstate change: term changed from 1 to 2, leader changed from a08ea42cd3884210924a19c8f570486d (127.9.145.195) to ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193). New cstate: current_term: 2 leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:06.105497 18173 raft_consensus.cc:1275] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Refusing update from remote peer ac42e2bcf9ac42448a84370269bc6ccc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:06.106743 19074 consensus_queue.cc:1048] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:06.128257 18104 raft_consensus.cc:1275] T d52578a055b2452883b1a598a35ca322 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Refusing update from remote peer ac42e2bcf9ac42448a84370269bc6ccc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:06.131062 19104 consensus_queue.cc:1048] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:06.304131 18173 raft_consensus.cc:1275] T e48eb1372ff4402498990d2abd8c6da2 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Refusing update from remote peer 3a269a9c95e0476d9e09c25b4b5aaa2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:06.305392 19035 consensus_queue.cc:1048] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:06.326386 18245 raft_consensus.cc:1275] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Refusing update from remote peer 3a269a9c95e0476d9e09c25b4b5aaa2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:06.327811 19123 consensus_queue.cc:1048] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:06.584059 18173 raft_consensus.cc:1275] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Refusing update from remote peer ac42e2bcf9ac42448a84370269bc6ccc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:06.585696 19046 consensus_queue.cc:1048] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:06.599545 18245 raft_consensus.cc:1275] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Refusing update from remote peer ac42e2bcf9ac42448a84370269bc6ccc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:06.602321 19074 consensus_queue.cc:1048] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:06.602643  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:06.649665 18104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "629843ee608f4aff9e667570f73f9d6f"
dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
mode: GRACEFUL
new_leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
 from {username='slave'} at 127.0.0.1:60802
I20260709 12:27:06.650290 18104 raft_consensus.cc:606] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Received request to transfer leadership to TS ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:27:06.651598  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:27:06.652961  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:06.653682  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:06.772282 19123 raft_consensus.cc:993] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c: : Instructing follower ac42e2bcf9ac42448a84370269bc6ccc to start an election
I20260709 12:27:06.772861 19053 raft_consensus.cc:1081] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Signalling peer ac42e2bcf9ac42448a84370269bc6ccc to start an election
I20260709 12:27:06.775170 18887 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "629843ee608f4aff9e667570f73f9d6f"
dest_uuid: "ac42e2bcf9ac42448a84370269bc6ccc"
 from {username='slave'} at 127.0.0.1:48462
I20260709 12:27:06.776011 18887 raft_consensus.cc:493] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:06.776762 18887 raft_consensus.cc:3060] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:06.783517 18887 raft_consensus.cc:515] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:27:06.785593 18887 leader_election.cc:290] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 election: Requested vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695)
I20260709 12:27:06.786345 18171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "629843ee608f4aff9e667570f73f9d6f" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a08ea42cd3884210924a19c8f570486d"
I20260709 12:27:06.786007 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "629843ee608f4aff9e667570f73f9d6f" candidate_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c"
I20260709 12:27:06.786989 18171 raft_consensus.cc:3060] T 629843ee608f4aff9e667570f73f9d6f P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:06.787322 18104 raft_consensus.cc:3055] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:06.787772 18104 raft_consensus.cc:740] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a269a9c95e0476d9e09c25b4b5aaa2c, State: Running, Role: LEADER
I20260709 12:27:06.789719 18104 consensus_queue.cc:260] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:27:06.791069 18104 raft_consensus.cc:3060] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:06.798545 18171 raft_consensus.cc:2468] T 629843ee608f4aff9e667570f73f9d6f P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 2.
I20260709 12:27:06.799989 18835 leader_election.cc:304] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc; no voters: 
I20260709 12:27:06.800917 19104 raft_consensus.cc:2804] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:06.801398 19104 raft_consensus.cc:697] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc [term 2 LEADER]: Becoming Leader. State: Replica: ac42e2bcf9ac42448a84370269bc6ccc, State: Running, Role: LEADER
I20260709 12:27:06.802313 19104 consensus_queue.cc:237] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } }
I20260709 12:27:06.804721 18104 raft_consensus.cc:2468] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac42e2bcf9ac42448a84370269bc6ccc in term 2.
I20260709 12:27:06.812731 17924 catalog_manager.cc:5697] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc reported cstate change: term changed from 1 to 2, leader changed from 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194) to ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193). New cstate: current_term: 2 leader_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:07.298682 18171 raft_consensus.cc:1275] T 629843ee608f4aff9e667570f73f9d6f P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Refusing update from remote peer ac42e2bcf9ac42448a84370269bc6ccc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:07.299908 19074 consensus_queue.cc:1048] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:07.310364 18101 raft_consensus.cc:1275] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Refusing update from remote peer ac42e2bcf9ac42448a84370269bc6ccc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:07.312054 19046 consensus_queue.cc:1048] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:07.694929  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:07.736326  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:07.737784  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:07.738487  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:07.773694  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:07.825702  9799 tablet_server.cc:179] TabletServer@127.9.145.193:36743 shutting down...
W20260709 12:27:07.834755 18142 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 183 similar messages]
W20260709 12:27:07.853602 18142 consensus_peers.cc:597] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:07.906306 18216 consensus_peers.cc:597] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:07.907430 18216 consensus_peers.cc:597] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:07.914659 18068 consensus_peers.cc:597] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:07.917466 18142 consensus_peers.cc:597] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:07.918140  9799 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:27:07.918807 18216 consensus_peers.cc:597] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:07.919349 18068 consensus_peers.cc:597] T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:07.919459 18142 consensus_peers.cc:597] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:07.920014  9799 tablet_replica.cc:333] stopping tablet replica
W20260709 12:27:07.920516 18142 consensus_peers.cc:597] T 7dbf7d84f5ff496e905988250445db74 P a08ea42cd3884210924a19c8f570486d -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:07.921208  9799 raft_consensus.cc:2243] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:07.921872  9799 raft_consensus.cc:2272] T bdc0b28c91d54918b8a914c137f9543f P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:07.925209  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:07.925953  9799 raft_consensus.cc:2243] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:07.926828  9799 raft_consensus.cc:2272] T cffccb3c736b4f0fa0789217fa65dc2c P ac42e2bcf9ac42448a84370269bc6ccc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:07.928972  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:07.929957  9799 raft_consensus.cc:2243] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:07.930889  9799 raft_consensus.cc:2272] T f17497d6870f4ff495e91f076239de59 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:07.933899  9799 tablet_replica.cc:333] stopping tablet replica
W20260709 12:27:07.934072 18142 consensus_peers.cc:597] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:07.935103  9799 raft_consensus.cc:2243] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:07.936447  9799 raft_consensus.cc:2272] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:07.937067 18068 consensus_peers.cc:597] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:07.939314  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:07.940179  9799 raft_consensus.cc:2243] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:07.940943  9799 raft_consensus.cc:2272] T a019c53d9a9946c59ed8a1b201786adc P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:07.943660  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:07.944317  9799 raft_consensus.cc:2243] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:07.944687  9799 raft_consensus.cc:2272] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:07.946743  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:07.947311  9799 raft_consensus.cc:2243] T ebb7b63685e841a2a975e727c46f1b64 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:07.947697  9799 raft_consensus.cc:2272] T ebb7b63685e841a2a975e727c46f1b64 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:07.949656  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:07.950287  9799 raft_consensus.cc:2243] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:07.950801  9799 raft_consensus.cc:2272] T 29e1b7b25f15438ba055b0ea299ada27 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:07.953413  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:07.954066  9799 raft_consensus.cc:2243] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:07.955085  9799 raft_consensus.cc:2272] T 1660568f1208485fb6f74d572deee2d9 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:07.957605  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:07.958344  9799 raft_consensus.cc:2243] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:07.958770  9799 raft_consensus.cc:2272] T 91269edd7c074ad2bfced23e62cbe5fc P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:07.960891  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:07.961464  9799 raft_consensus.cc:2243] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:07.961808  9799 raft_consensus.cc:2272] T 2c660b0ce2084a1a9fcc17139d4addd5 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:07.963853  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:07.964561  9799 raft_consensus.cc:2243] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:07.965047  9799 raft_consensus.cc:2272] T c697128b8d274c8790595b833d9b74eb P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:07.967518  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:07.968094  9799 raft_consensus.cc:2243] T a61bb69fcfd54ef88c37917a48d1cb30 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:07.968494  9799 raft_consensus.cc:2272] T a61bb69fcfd54ef88c37917a48d1cb30 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:07.970687  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:07.971251  9799 raft_consensus.cc:2243] T 7dbf7d84f5ff496e905988250445db74 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:07.971649  9799 raft_consensus.cc:2272] T 7dbf7d84f5ff496e905988250445db74 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:07.974346  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:07.975209  9799 raft_consensus.cc:2243] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:07.976158  9799 raft_consensus.cc:2272] T 629843ee608f4aff9e667570f73f9d6f P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:07.979323  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:07.980229  9799 raft_consensus.cc:2243] T 02af88afdc444f268f05df276bf720c0 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:07.980717  9799 raft_consensus.cc:2272] T 02af88afdc444f268f05df276bf720c0 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:07.982726 18142 consensus_peers.cc:597] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:07.983204  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:07.983911  9799 raft_consensus.cc:2243] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:07.984706  9799 raft_consensus.cc:2272] T 740537a0f03c42caa8182d3b9f403859 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:07.987079  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:07.987671  9799 raft_consensus.cc:2243] T f68e8047f5ff4aa0b631cbd912091d25 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:07.988078  9799 raft_consensus.cc:2272] T f68e8047f5ff4aa0b631cbd912091d25 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:07.990324  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:07.991120  9799 raft_consensus.cc:2243] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:07.991930  9799 raft_consensus.cc:2272] T 5e88e93a00044d1482497fa864163047 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:07.994594  9799 tablet_replica.cc:333] stopping tablet replica
W20260709 12:27:07.994594 18216 consensus_peers.cc:597] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:07.995597  9799 raft_consensus.cc:2243] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:07.996768  9799 raft_consensus.cc:2272] T 2a3e4e4b25f84008b5cd603640f2252f P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:07.999831  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:08.000450  9799 raft_consensus.cc:2243] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.000916  9799 raft_consensus.cc:2272] T 5995ee175fed4e3e893b8efe2a7eb7d0 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.003567  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:08.004328  9799 raft_consensus.cc:2243] T fa35871af5624c709008fe86090c0ad1 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.004750  9799 raft_consensus.cc:2272] T fa35871af5624c709008fe86090c0ad1 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.007494  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:08.008286  9799 raft_consensus.cc:2243] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.009090  9799 raft_consensus.cc:2272] T d52578a055b2452883b1a598a35ca322 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.011529  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:08.012094  9799 raft_consensus.cc:2243] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.012490  9799 raft_consensus.cc:2272] T c94eb437be5041e48122e923dc7cc760 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.014587  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:08.015302  9799 raft_consensus.cc:2243] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.015779  9799 raft_consensus.cc:2272] T 01d2f53aff8a45a49cadf9fd72b75ee8 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.017915  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:08.018544  9799 raft_consensus.cc:2243] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.018945  9799 raft_consensus.cc:2272] T 8d1315ba5fa54c50809825b3329d3510 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.021368  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:08.022169  9799 raft_consensus.cc:2243] T d8b351ffd4864761bb49da4eceac3566 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.022632  9799 raft_consensus.cc:2272] T d8b351ffd4864761bb49da4eceac3566 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.025336  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:08.026026  9799 raft_consensus.cc:2243] T 96957d639eed4a1395857a97a292f8ea P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.026466  9799 raft_consensus.cc:2272] T 96957d639eed4a1395857a97a292f8ea P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.028806  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:08.029608  9799 raft_consensus.cc:2243] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.030622  9799 raft_consensus.cc:2272] T 90509aaa02f84d8a983c9f13d8155ded P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.033453  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:08.034197  9799 raft_consensus.cc:2243] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.034682  9799 raft_consensus.cc:2272] T a379e8a15db944b4a33a0c99f05dc6db P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.037382  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:08.038180  9799 raft_consensus.cc:2243] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.039212  9799 raft_consensus.cc:2272] T 11b3b0ee25aa435586a0fd8c3f186681 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.042057  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:08.042872  9799 raft_consensus.cc:2243] T 049a535902f64c44bb4e1b9ecc92694c P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.043375  9799 raft_consensus.cc:2272] T 049a535902f64c44bb4e1b9ecc92694c P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.046303  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:08.046887  9799 raft_consensus.cc:2243] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.047721  9799 raft_consensus.cc:2272] T 10895331ca6e49d4aad97aec0e629dd7 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.050623  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:08.051465  9799 raft_consensus.cc:2243] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.052023  9799 raft_consensus.cc:2272] T 8447aa2b8d4547c0b737643187aa4bd0 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:08.052165 18142 consensus_peers.cc:597] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.055035  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:08.055939  9799 raft_consensus.cc:2243] T f124d65e17c143b08d3428ef325ae9a5 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.056427  9799 raft_consensus.cc:2272] T f124d65e17c143b08d3428ef325ae9a5 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.059262  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:08.059805  9799 raft_consensus.cc:2243] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.060182  9799 raft_consensus.cc:2272] T e735bb4b506c457f8dddf767573d025f P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.062258  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:08.062783  9799 raft_consensus.cc:2243] T 440b2a57096e45188762ccb05301beec P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.063138  9799 raft_consensus.cc:2272] T 440b2a57096e45188762ccb05301beec P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.065202  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:08.065761  9799 raft_consensus.cc:2243] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.066663  9799 raft_consensus.cc:2272] T 9984112bc75a4e66b55655a1bdd99052 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.068902  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:08.069415  9799 raft_consensus.cc:2243] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.069845  9799 raft_consensus.cc:2272] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.072001  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:08.072501  9799 raft_consensus.cc:2243] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.072887  9799 raft_consensus.cc:2272] T 6cf8e5342a1141b5b3f0ee9ec643beec P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.075007  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:08.075488  9799 raft_consensus.cc:2243] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.076349  9799 raft_consensus.cc:2272] T bb4d4ed1ab54477ca58913fad1bc93b1 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.078353  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:08.078840  9799 raft_consensus.cc:2243] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.079252  9799 raft_consensus.cc:2272] T e2114d69fe2c427599f225a7b0686dee P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.081832  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:08.082463  9799 raft_consensus.cc:2243] T dda5199333524768beef0903fe39e300 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.082890  9799 raft_consensus.cc:2272] T dda5199333524768beef0903fe39e300 P ac42e2bcf9ac42448a84370269bc6ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.085422  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:08.086084  9799 raft_consensus.cc:2243] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.087085  9799 raft_consensus.cc:2272] T ed8548d1e22c49f7a5341ec0e2f7b073 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:08.088299 18216 consensus_peers.cc:597] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.089561  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:08.090353  9799 raft_consensus.cc:2243] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.091225  9799 raft_consensus.cc:2272] T 35683295be3042a4bc1839bda16f6f40 P ac42e2bcf9ac42448a84370269bc6ccc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:08.092656 18068 consensus_peers.cc:597] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.106361 18216 consensus_peers.cc:597] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.106456 18068 consensus_peers.cc:597] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.121462 18142 consensus_peers.cc:597] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.139336 18216 consensus_peers.cc:597] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.143924 18068 consensus_peers.cc:597] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.150018 18068 consensus_peers.cc:597] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.152981 18832 connection.cc:466] server connection from 127.0.0.1:48468 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48468 (request call id 441) could send its response
W20260709 12:27:08.154165 18142 consensus_peers.cc:597] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Network error: recv got EOF from 127.9.145.193:36743 (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.171258  9799 tablet_server.cc:196] TabletServer@127.9.145.193:36743 shutdown complete.
W20260709 12:27:08.175235 18068 consensus_peers.cc:597] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.206838 18142 consensus_peers.cc:597] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.219455 18068 consensus_peers.cc:597] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.238868 18142 consensus_peers.cc:597] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.263784  9799 tablet_server.cc:179] TabletServer@127.9.145.194:0 shutting down...
W20260709 12:27:08.271682 18141 consensus_peers.cc:597] T cba48186789449ef9cae51c546ace419 P a08ea42cd3884210924a19c8f570486d -> Peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Couldn't send request to peer 3a269a9c95e0476d9e09c25b4b5aaa2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.306763 18216 consensus_peers.cc:597] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.307665 18216 consensus_peers.cc:597] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.308434 18216 consensus_peers.cc:597] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.340060  9799 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:08.341087  9799 tablet_replica.cc:333] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.341825  9799 raft_consensus.cc:2243] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.342324  9799 raft_consensus.cc:2272] T ed8548d1e22c49f7a5341ec0e2f7b073 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.344485  9799 tablet_replica.cc:333] T 09661bcb87ec455e97022bc6febc4754 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.345084  9799 raft_consensus.cc:2243] T 09661bcb87ec455e97022bc6febc4754 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.345953  9799 raft_consensus.cc:2272] T 09661bcb87ec455e97022bc6febc4754 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.348335  9799 tablet_replica.cc:333] T 02af88afdc444f268f05df276bf720c0 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.349201  9799 raft_consensus.cc:2243] T 02af88afdc444f268f05df276bf720c0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.349823  9799 raft_consensus.cc:2272] T 02af88afdc444f268f05df276bf720c0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.353011  9799 tablet_replica.cc:333] T 740537a0f03c42caa8182d3b9f403859 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.353899  9799 raft_consensus.cc:2243] T 740537a0f03c42caa8182d3b9f403859 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.354523  9799 raft_consensus.cc:2272] T 740537a0f03c42caa8182d3b9f403859 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.356909  9799 tablet_replica.cc:333] T 3463ec2e9f294668adae229e2814b1cf P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.357841  9799 raft_consensus.cc:2243] T 3463ec2e9f294668adae229e2814b1cf P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.358455  9799 raft_consensus.cc:2272] T 3463ec2e9f294668adae229e2814b1cf P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.360857  9799 tablet_replica.cc:333] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.361413  9799 raft_consensus.cc:2243] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.362285  9799 raft_consensus.cc:2272] T bdc0b28c91d54918b8a914c137f9543f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.364440  9799 tablet_replica.cc:333] T cba48186789449ef9cae51c546ace419 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.365264  9799 raft_consensus.cc:2243] T cba48186789449ef9cae51c546ace419 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.365810  9799 raft_consensus.cc:2272] T cba48186789449ef9cae51c546ace419 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.368567  9799 tablet_replica.cc:333] T 6cf8e5342a1141b5b3f0ee9ec643beec P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.369405  9799 raft_consensus.cc:2243] T 6cf8e5342a1141b5b3f0ee9ec643beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.369978  9799 raft_consensus.cc:2272] T 6cf8e5342a1141b5b3f0ee9ec643beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.372885  9799 tablet_replica.cc:333] T 29e1b7b25f15438ba055b0ea299ada27 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
W20260709 12:27:08.373695 18215 consensus_peers.cc:597] T 07d9e11e303c4580a941ccc2943afdd5 P 10c938681fc04e66968531267f39f16c -> Peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Couldn't send request to peer 3a269a9c95e0476d9e09c25b4b5aaa2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.373731  9799 raft_consensus.cc:2243] T 29e1b7b25f15438ba055b0ea299ada27 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.374446  9799 raft_consensus.cc:2272] T 29e1b7b25f15438ba055b0ea299ada27 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.377082  9799 tablet_replica.cc:333] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.377928  9799 raft_consensus.cc:2243] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.378454  9799 raft_consensus.cc:2272] T 10895331ca6e49d4aad97aec0e629dd7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:08.378396 18141 consensus_peers.cc:597] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d -> Peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Couldn't send request to peer 3a269a9c95e0476d9e09c25b4b5aaa2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.381104  9799 tablet_replica.cc:333] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.381994  9799 raft_consensus.cc:2243] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.383071  9799 raft_consensus.cc:2272] T 049a535902f64c44bb4e1b9ecc92694c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.385952  9799 tablet_replica.cc:333] T f17497d6870f4ff495e91f076239de59 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.386777  9799 raft_consensus.cc:2243] T f17497d6870f4ff495e91f076239de59 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.387341  9799 raft_consensus.cc:2272] T f17497d6870f4ff495e91f076239de59 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.390069  9799 tablet_replica.cc:333] T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.390931  9799 raft_consensus.cc:2243] T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:27:08.390842 18141 consensus_peers.cc:597] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d -> Peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Couldn't send request to peer 3a269a9c95e0476d9e09c25b4b5aaa2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.392109  9799 raft_consensus.cc:2272] T 8447aa2b8d4547c0b737643187aa4bd0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:08.392781 18215 consensus_peers.cc:597] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c -> Peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Couldn't send request to peer 3a269a9c95e0476d9e09c25b4b5aaa2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.394974  9799 tablet_replica.cc:333] T f124d65e17c143b08d3428ef325ae9a5 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.395861  9799 raft_consensus.cc:2243] T f124d65e17c143b08d3428ef325ae9a5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.396432  9799 raft_consensus.cc:2272] T f124d65e17c143b08d3428ef325ae9a5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.399556  9799 tablet_replica.cc:333] T b667d19692ec4a3aaa8d0c45edf73db9 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.400367  9799 raft_consensus.cc:2243] T b667d19692ec4a3aaa8d0c45edf73db9 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.400913  9799 raft_consensus.cc:2272] T b667d19692ec4a3aaa8d0c45edf73db9 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.403558  9799 tablet_replica.cc:333] T 81710104264d4f3fa7ecf1c48b2b48ca P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
W20260709 12:27:08.403836 18141 consensus_peers.cc:597] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d -> Peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Couldn't send request to peer 3a269a9c95e0476d9e09c25b4b5aaa2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.404383  9799 raft_consensus.cc:2243] T 81710104264d4f3fa7ecf1c48b2b48ca P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.405001  9799 raft_consensus.cc:2272] T 81710104264d4f3fa7ecf1c48b2b48ca P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.407199  9799 tablet_replica.cc:333] T 8d1315ba5fa54c50809825b3329d3510 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.407814  9799 raft_consensus.cc:2243] T 8d1315ba5fa54c50809825b3329d3510 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.408252  9799 raft_consensus.cc:2272] T 8d1315ba5fa54c50809825b3329d3510 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.410540  9799 tablet_replica.cc:333] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.411365  9799 raft_consensus.cc:2243] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.412420  9799 raft_consensus.cc:2272] T 57c55f2aea594f27bd7ce646464ea07c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.415427  9799 tablet_replica.cc:333] T dc4b6b0d4466443f9c077e9a45bb3b89 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.416249  9799 raft_consensus.cc:2243] T dc4b6b0d4466443f9c077e9a45bb3b89 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:27:08.416564 18068 consensus_peers.cc:597] T dda5199333524768beef0903fe39e300 P 3a269a9c95e0476d9e09c25b4b5aaa2c -> Peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Couldn't send request to peer ac42e2bcf9ac42448a84370269bc6ccc. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.417284  9799 raft_consensus.cc:2272] T dc4b6b0d4466443f9c077e9a45bb3b89 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.419693  9799 tablet_replica.cc:333] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.420372  9799 raft_consensus.cc:2243] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.421252  9799 raft_consensus.cc:2272] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.423867  9799 tablet_replica.cc:333] T 440b2a57096e45188762ccb05301beec P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.424554  9799 raft_consensus.cc:2243] T 440b2a57096e45188762ccb05301beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.425004  9799 raft_consensus.cc:2272] T 440b2a57096e45188762ccb05301beec P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.427264  9799 tablet_replica.cc:333] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.427846  9799 raft_consensus.cc:2243] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.428288  9799 raft_consensus.cc:2272] T 9984112bc75a4e66b55655a1bdd99052 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.430490  9799 tablet_replica.cc:333] T e735bb4b506c457f8dddf767573d025f P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.431298  9799 raft_consensus.cc:2243] T e735bb4b506c457f8dddf767573d025f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.431751  9799 raft_consensus.cc:2272] T e735bb4b506c457f8dddf767573d025f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.433925  9799 tablet_replica.cc:333] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.434535  9799 raft_consensus.cc:2243] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.435372  9799 raft_consensus.cc:2272] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.437479  9799 tablet_replica.cc:333] T 2d9471cf607248b0b7f9090046f63df4 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.438187  9799 raft_consensus.cc:2243] T 2d9471cf607248b0b7f9090046f63df4 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.438623  9799 raft_consensus.cc:2272] T 2d9471cf607248b0b7f9090046f63df4 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.440748  9799 tablet_replica.cc:333] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.441326  9799 raft_consensus.cc:2243] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.441747  9799 raft_consensus.cc:2272] T 629843ee608f4aff9e667570f73f9d6f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.443804  9799 tablet_replica.cc:333] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.444382  9799 raft_consensus.cc:2243] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.445174  9799 raft_consensus.cc:2272] T 2a3e4e4b25f84008b5cd603640f2252f P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.447257  9799 tablet_replica.cc:333] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.447814  9799 raft_consensus.cc:2243] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.448316  9799 raft_consensus.cc:2272] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.450402  9799 tablet_replica.cc:333] T d52578a055b2452883b1a598a35ca322 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.450908  9799 raft_consensus.cc:2243] T d52578a055b2452883b1a598a35ca322 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.451332  9799 raft_consensus.cc:2272] T d52578a055b2452883b1a598a35ca322 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.453178  9799 tablet_replica.cc:333] T c94eb437be5041e48122e923dc7cc760 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.453857  9799 raft_consensus.cc:2243] T c94eb437be5041e48122e923dc7cc760 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.454342  9799 raft_consensus.cc:2272] T c94eb437be5041e48122e923dc7cc760 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.456765  9799 tablet_replica.cc:333] T be25c969559444ae99d240c6f3f60df1 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.457316  9799 raft_consensus.cc:2243] T be25c969559444ae99d240c6f3f60df1 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.458185  9799 raft_consensus.cc:2272] T be25c969559444ae99d240c6f3f60df1 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.460434  9799 tablet_replica.cc:333] T e60fecc50c1d49c2963f342da1b3c2a6 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.461120  9799 raft_consensus.cc:2243] T e60fecc50c1d49c2963f342da1b3c2a6 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.461530  9799 raft_consensus.cc:2272] T e60fecc50c1d49c2963f342da1b3c2a6 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.463708  9799 tablet_replica.cc:333] T dda5199333524768beef0903fe39e300 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.464447  9799 raft_consensus.cc:2243] T dda5199333524768beef0903fe39e300 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.465629  9799 raft_consensus.cc:2272] T dda5199333524768beef0903fe39e300 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.468564  9799 tablet_replica.cc:333] T 07d9e11e303c4580a941ccc2943afdd5 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.469323  9799 raft_consensus.cc:2243] T 07d9e11e303c4580a941ccc2943afdd5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.469892  9799 raft_consensus.cc:2272] T 07d9e11e303c4580a941ccc2943afdd5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:08.471877 18215 consensus_peers.cc:597] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c -> Peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Couldn't send request to peer 3a269a9c95e0476d9e09c25b4b5aaa2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.472708  9799 tablet_replica.cc:333] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.473485  9799 raft_consensus.cc:2243] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.474673  9799 raft_consensus.cc:2272] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.477593  9799 tablet_replica.cc:333] T 11b3b0ee25aa435586a0fd8c3f186681 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.478384  9799 raft_consensus.cc:2243] T 11b3b0ee25aa435586a0fd8c3f186681 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.478928  9799 raft_consensus.cc:2272] T 11b3b0ee25aa435586a0fd8c3f186681 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:08.479887 18141 consensus_peers.cc:597] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d -> Peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Couldn't send request to peer 3a269a9c95e0476d9e09c25b4b5aaa2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.481789  9799 tablet_replica.cc:333] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.482733  9799 raft_consensus.cc:2243] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.483287  9799 raft_consensus.cc:2272] T 223eb34bd9744014b3c011eebcb37f11 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:08.483834 18141 consensus_peers.cc:597] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d -> Peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Couldn't send request to peer 3a269a9c95e0476d9e09c25b4b5aaa2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.486290  9799 tablet_replica.cc:333] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
W20260709 12:27:08.486496 18215 consensus_peers.cc:597] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c -> Peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Couldn't send request to peer 3a269a9c95e0476d9e09c25b4b5aaa2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.487206  9799 raft_consensus.cc:2243] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.488232  9799 raft_consensus.cc:2272] T a379e8a15db944b4a33a0c99f05dc6db P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.490790  9799 tablet_replica.cc:333] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.491379  9799 raft_consensus.cc:2243] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.492419  9799 raft_consensus.cc:2272] T c697128b8d274c8790595b833d9b74eb P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.495004  9799 tablet_replica.cc:333] T 0d8b927123c04143a7b87fa8f129a9e7 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.495661  9799 raft_consensus.cc:2243] T 0d8b927123c04143a7b87fa8f129a9e7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.496146  9799 raft_consensus.cc:2272] T 0d8b927123c04143a7b87fa8f129a9e7 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.499135  9799 tablet_replica.cc:333] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.499866  9799 raft_consensus.cc:2243] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.500455  9799 raft_consensus.cc:2272] T cffccb3c736b4f0fa0789217fa65dc2c P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.503077  9799 tablet_replica.cc:333] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.503597  9799 raft_consensus.cc:2243] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.504383  9799 raft_consensus.cc:2272] T e48eb1372ff4402498990d2abd8c6da2 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.506724  9799 tablet_replica.cc:333] T d8b351ffd4864761bb49da4eceac3566 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.507364  9799 raft_consensus.cc:2243] T d8b351ffd4864761bb49da4eceac3566 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.507881  9799 raft_consensus.cc:2272] T d8b351ffd4864761bb49da4eceac3566 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.510648  9799 tablet_replica.cc:333] T 5e88e93a00044d1482497fa864163047 P 3a269a9c95e0476d9e09c25b4b5aaa2c: stopping tablet replica
I20260709 12:27:08.511242  9799 raft_consensus.cc:2243] T 5e88e93a00044d1482497fa864163047 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.511808  9799 raft_consensus.cc:2272] T 5e88e93a00044d1482497fa864163047 P 3a269a9c95e0476d9e09c25b4b5aaa2c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:08.515820 18215 consensus_peers.cc:597] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c -> Peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Couldn't send request to peer 3a269a9c95e0476d9e09c25b4b5aaa2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.523767 18215 consensus_peers.cc:597] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c -> Peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Couldn't send request to peer 3a269a9c95e0476d9e09c25b4b5aaa2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.536384 18141 consensus_peers.cc:597] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d -> Peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Couldn't send request to peer 3a269a9c95e0476d9e09c25b4b5aaa2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.580096 18141 consensus_peers.cc:597] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d -> Peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Couldn't send request to peer 3a269a9c95e0476d9e09c25b4b5aaa2c. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:45595: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.593276  9799 tablet_server.cc:196] TabletServer@127.9.145.194:0 shutdown complete.
W20260709 12:27:08.593376 18215 consensus_peers.cc:597] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c -> Peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Couldn't send request to peer 3a269a9c95e0476d9e09c25b4b5aaa2c. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:45595: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.603303 18215 consensus_peers.cc:597] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c -> Peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Couldn't send request to peer 3a269a9c95e0476d9e09c25b4b5aaa2c. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:45595: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.619463 18141 consensus_peers.cc:597] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d -> Peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Couldn't send request to peer 3a269a9c95e0476d9e09c25b4b5aaa2c. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:45595: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.635213 18215 consensus_peers.cc:597] T 2d9471cf607248b0b7f9090046f63df4 P 10c938681fc04e66968531267f39f16c -> Peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Couldn't send request to peer 3a269a9c95e0476d9e09c25b4b5aaa2c. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:45595: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.653371 18141 consensus_peers.cc:597] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d -> Peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Couldn't send request to peer 3a269a9c95e0476d9e09c25b4b5aaa2c. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:45595: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.671834 18141 consensus_peers.cc:597] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d -> Peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Couldn't send request to peer 3a269a9c95e0476d9e09c25b4b5aaa2c. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.194:45595: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.687156  9799 tablet_server.cc:179] TabletServer@127.9.145.195:0 shutting down...
I20260709 12:27:08.728268  9799 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:08.729068  9799 tablet_replica.cc:333] T 2c660b0ce2084a1a9fcc17139d4addd5 P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.729869  9799 raft_consensus.cc:2243] T 2c660b0ce2084a1a9fcc17139d4addd5 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.730485  9799 raft_consensus.cc:2272] T 2c660b0ce2084a1a9fcc17139d4addd5 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.732582  9799 tablet_replica.cc:333] T 2a3e4e4b25f84008b5cd603640f2252f P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.733170  9799 raft_consensus.cc:2243] T 2a3e4e4b25f84008b5cd603640f2252f P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.733647  9799 raft_consensus.cc:2272] T 2a3e4e4b25f84008b5cd603640f2252f P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.735749  9799 tablet_replica.cc:333] T ed8548d1e22c49f7a5341ec0e2f7b073 P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.736327  9799 raft_consensus.cc:2243] T ed8548d1e22c49f7a5341ec0e2f7b073 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.736776  9799 raft_consensus.cc:2272] T ed8548d1e22c49f7a5341ec0e2f7b073 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.739802  9799 tablet_replica.cc:333] T 09661bcb87ec455e97022bc6febc4754 P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.740674  9799 raft_consensus.cc:2243] T 09661bcb87ec455e97022bc6febc4754 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.741248  9799 raft_consensus.cc:2272] T 09661bcb87ec455e97022bc6febc4754 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.744271  9799 tablet_replica.cc:333] T cba48186789449ef9cae51c546ace419 P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.745327  9799 raft_consensus.cc:2243] T cba48186789449ef9cae51c546ace419 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.746393  9799 raft_consensus.cc:2272] T cba48186789449ef9cae51c546ace419 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.749038  9799 tablet_replica.cc:333] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.749785  9799 raft_consensus.cc:2243] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.750382  9799 raft_consensus.cc:2272] T 35683295be3042a4bc1839bda16f6f40 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.752942  9799 tablet_replica.cc:333] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.753753  9799 raft_consensus.cc:2243] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.754864  9799 raft_consensus.cc:2272] T 3463ec2e9f294668adae229e2814b1cf P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.757897  9799 tablet_replica.cc:333] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.758756  9799 raft_consensus.cc:2243] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.759781  9799 raft_consensus.cc:2272] T 96957d639eed4a1395857a97a292f8ea P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.762599  9799 tablet_replica.cc:333] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.763310  9799 raft_consensus.cc:2243] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.764281  9799 raft_consensus.cc:2272] T 6cf8e5342a1141b5b3f0ee9ec643beec P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.767125  9799 tablet_replica.cc:333] T 049a535902f64c44bb4e1b9ecc92694c P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.768054  9799 raft_consensus.cc:2243] T 049a535902f64c44bb4e1b9ecc92694c P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.768618  9799 raft_consensus.cc:2272] T 049a535902f64c44bb4e1b9ecc92694c P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.770720  9799 tablet_replica.cc:333] T ebb7b63685e841a2a975e727c46f1b64 P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.771288  9799 raft_consensus.cc:2243] T ebb7b63685e841a2a975e727c46f1b64 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.771696  9799 raft_consensus.cc:2272] T ebb7b63685e841a2a975e727c46f1b64 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.773619  9799 tablet_replica.cc:333] T 07d9e11e303c4580a941ccc2943afdd5 P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.774215  9799 raft_consensus.cc:2243] T 07d9e11e303c4580a941ccc2943afdd5 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.774639  9799 raft_consensus.cc:2272] T 07d9e11e303c4580a941ccc2943afdd5 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.776633  9799 tablet_replica.cc:333] T f68e8047f5ff4aa0b631cbd912091d25 P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.777169  9799 raft_consensus.cc:2243] T f68e8047f5ff4aa0b631cbd912091d25 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.777582  9799 raft_consensus.cc:2272] T f68e8047f5ff4aa0b631cbd912091d25 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.779492  9799 tablet_replica.cc:333] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.780030  9799 raft_consensus.cc:2243] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.780419  9799 raft_consensus.cc:2272] T 11b3b0ee25aa435586a0fd8c3f186681 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.782781  9799 tablet_replica.cc:333] T 223eb34bd9744014b3c011eebcb37f11 P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.783357  9799 raft_consensus.cc:2243] T 223eb34bd9744014b3c011eebcb37f11 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.783885  9799 raft_consensus.cc:2272] T 223eb34bd9744014b3c011eebcb37f11 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.786501  9799 tablet_replica.cc:333] T 90509aaa02f84d8a983c9f13d8155ded P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.787328  9799 raft_consensus.cc:2243] T 90509aaa02f84d8a983c9f13d8155ded P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.787881  9799 raft_consensus.cc:2272] T 90509aaa02f84d8a983c9f13d8155ded P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:08.789508 18218 consensus_peers.cc:597] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c -> Peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Couldn't send request to peer a08ea42cd3884210924a19c8f570486d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.790582  9799 tablet_replica.cc:333] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.791235  9799 raft_consensus.cc:2243] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.792035  9799 raft_consensus.cc:2272] T b667d19692ec4a3aaa8d0c45edf73db9 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.794293  9799 tablet_replica.cc:333] T 81710104264d4f3fa7ecf1c48b2b48ca P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.794869  9799 raft_consensus.cc:2243] T 81710104264d4f3fa7ecf1c48b2b48ca P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.795285  9799 raft_consensus.cc:2272] T 81710104264d4f3fa7ecf1c48b2b48ca P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.797312  9799 tablet_replica.cc:333] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.797883  9799 raft_consensus.cc:2243] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.798774  9799 raft_consensus.cc:2272] T 440b2a57096e45188762ccb05301beec P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.800752  9799 tablet_replica.cc:333] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.801430  9799 raft_consensus.cc:2243] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.802397  9799 raft_consensus.cc:2272] T e735bb4b506c457f8dddf767573d025f P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.804859  9799 tablet_replica.cc:333] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.805465  9799 raft_consensus.cc:2243] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.806382  9799 raft_consensus.cc:2272] T e2114d69fe2c427599f225a7b0686dee P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.808513  9799 tablet_replica.cc:333] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.809098  9799 raft_consensus.cc:2243] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.809504  9799 raft_consensus.cc:2272] T bb4d4ed1ab54477ca58913fad1bc93b1 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.811534  9799 tablet_replica.cc:333] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.812075  9799 raft_consensus.cc:2243] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.812484  9799 raft_consensus.cc:2272] T d0fb4e45e6e54dbf8b96315fab6e5cb8 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.814594  9799 tablet_replica.cc:333] T 2d9471cf607248b0b7f9090046f63df4 P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.815157  9799 raft_consensus.cc:2243] T 2d9471cf607248b0b7f9090046f63df4 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.815582  9799 raft_consensus.cc:2272] T 2d9471cf607248b0b7f9090046f63df4 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.817582  9799 tablet_replica.cc:333] T dda5199333524768beef0903fe39e300 P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.818190  9799 raft_consensus.cc:2243] T dda5199333524768beef0903fe39e300 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.842952  9799 raft_consensus.cc:2272] T dda5199333524768beef0903fe39e300 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.850711  9799 tablet_replica.cc:333] T e60fecc50c1d49c2963f342da1b3c2a6 P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.856434  9799 raft_consensus.cc:2243] T e60fecc50c1d49c2963f342da1b3c2a6 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.859942  9799 raft_consensus.cc:2272] T e60fecc50c1d49c2963f342da1b3c2a6 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.865062  9799 tablet_replica.cc:333] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
W20260709 12:27:08.867017 18218 consensus_peers.cc:597] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c -> Peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Couldn't send request to peer a08ea42cd3884210924a19c8f570486d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.867834  9799 raft_consensus.cc:2243] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.869168  9799 raft_consensus.cc:2272] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:08.874727 18218 consensus_peers.cc:597] T 2d9471cf607248b0b7f9090046f63df4 P 10c938681fc04e66968531267f39f16c -> Peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Couldn't send request to peer a08ea42cd3884210924a19c8f570486d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.875129  9799 tablet_replica.cc:333] T be25c969559444ae99d240c6f3f60df1 P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
W20260709 12:27:08.875602 18218 consensus_peers.cc:597] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c -> Peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Couldn't send request to peer a08ea42cd3884210924a19c8f570486d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.877091  9799 raft_consensus.cc:2243] T be25c969559444ae99d240c6f3f60df1 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.878402  9799 raft_consensus.cc:2272] T be25c969559444ae99d240c6f3f60df1 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.891551  9799 tablet_replica.cc:333] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.892830  9799 raft_consensus.cc:2243] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.895391  9799 raft_consensus.cc:2272] T d8b351ffd4864761bb49da4eceac3566 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.899842  9799 tablet_replica.cc:333] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.901590  9799 raft_consensus.cc:2243] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:27:08.904412 18218 consensus_peers.cc:597] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c -> Peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Couldn't send request to peer a08ea42cd3884210924a19c8f570486d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.904407  9799 raft_consensus.cc:2272] T 0d8b927123c04143a7b87fa8f129a9e7 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.908601  9799 tablet_replica.cc:333] T e48eb1372ff4402498990d2abd8c6da2 P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.909397  9799 raft_consensus.cc:2243] T e48eb1372ff4402498990d2abd8c6da2 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.910322  9799 raft_consensus.cc:2272] T e48eb1372ff4402498990d2abd8c6da2 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.914315  9799 tablet_replica.cc:333] T 91269edd7c074ad2bfced23e62cbe5fc P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.915724  9799 raft_consensus.cc:2243] T 91269edd7c074ad2bfced23e62cbe5fc P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.916697  9799 raft_consensus.cc:2272] T 91269edd7c074ad2bfced23e62cbe5fc P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:08.918674 18218 consensus_peers.cc:597] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c -> Peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Couldn't send request to peer a08ea42cd3884210924a19c8f570486d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.922994  9799 tablet_replica.cc:333] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.923941  9799 raft_consensus.cc:2243] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.926072  9799 raft_consensus.cc:2272] T f17497d6870f4ff495e91f076239de59 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.929800  9799 tablet_replica.cc:333] T a019c53d9a9946c59ed8a1b201786adc P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.930696  9799 raft_consensus.cc:2243] T a019c53d9a9946c59ed8a1b201786adc P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.931382  9799 raft_consensus.cc:2272] T a019c53d9a9946c59ed8a1b201786adc P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.936169  9799 tablet_replica.cc:333] T 7dbf7d84f5ff496e905988250445db74 P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.937036  9799 raft_consensus.cc:2243] T 7dbf7d84f5ff496e905988250445db74 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.938619  9799 raft_consensus.cc:2272] T 7dbf7d84f5ff496e905988250445db74 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.947295  9799 tablet_replica.cc:333] T 629843ee608f4aff9e667570f73f9d6f P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.948580  9799 raft_consensus.cc:2243] T 629843ee608f4aff9e667570f73f9d6f P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.949622  9799 raft_consensus.cc:2272] T 629843ee608f4aff9e667570f73f9d6f P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.953557  9799 tablet_replica.cc:333] T a61bb69fcfd54ef88c37917a48d1cb30 P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.954452  9799 raft_consensus.cc:2243] T a61bb69fcfd54ef88c37917a48d1cb30 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.955346  9799 raft_consensus.cc:2272] T a61bb69fcfd54ef88c37917a48d1cb30 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.960482  9799 tablet_replica.cc:333] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.961261  9799 raft_consensus.cc:2243] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.963526  9799 raft_consensus.cc:2272] T 8d1315ba5fa54c50809825b3329d3510 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.964080 19082 raft_consensus.cc:493] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:27:08.965027 19082 raft_consensus.cc:515] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:27:08.967777  9799 tablet_replica.cc:333] T 57c55f2aea594f27bd7ce646464ea07c P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.968781  9799 raft_consensus.cc:2243] T 57c55f2aea594f27bd7ce646464ea07c P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.969642  9799 raft_consensus.cc:2272] T 57c55f2aea594f27bd7ce646464ea07c P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.973628  9799 tablet_replica.cc:333] T dc4b6b0d4466443f9c077e9a45bb3b89 P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
W20260709 12:27:08.974218 18216 leader_election.cc:336] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:27:08.974611  9799 raft_consensus.cc:2243] T dc4b6b0d4466443f9c077e9a45bb3b89 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.975602  9799 raft_consensus.cc:2272] T dc4b6b0d4466443f9c077e9a45bb3b89 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:08.975898 18218 consensus_peers.cc:597] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c -> Peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Couldn't send request to peer a08ea42cd3884210924a19c8f570486d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.979645  9799 tablet_replica.cc:333] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.980726  9799 raft_consensus.cc:2243] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.983008  9799 raft_consensus.cc:2272] T fa35871af5624c709008fe86090c0ad1 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:08.983366 18215 leader_election.cc:336] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Network error: Client connection negotiation failed: client connection to 127.9.145.194:45595: connect: Connection refused (error 111)
I20260709 12:27:08.983934 18215 leader_election.cc:304] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c938681fc04e66968531267f39f16c; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:27:08.984865 19141 raft_consensus.cc:2749] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:08.985122 19082 leader_election.cc:290] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
I20260709 12:27:08.987716  9799 tablet_replica.cc:333] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.988399  9799 raft_consensus.cc:2243] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.989018  9799 raft_consensus.cc:2272] T d52578a055b2452883b1a598a35ca322 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.991925  9799 tablet_replica.cc:333] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.992486  9799 raft_consensus.cc:2243] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.993569  9799 raft_consensus.cc:2272] T c94eb437be5041e48122e923dc7cc760 P a08ea42cd3884210924a19c8f570486d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.995787  9799 tablet_replica.cc:333] T 1660568f1208485fb6f74d572deee2d9 P a08ea42cd3884210924a19c8f570486d: stopping tablet replica
I20260709 12:27:08.996333  9799 raft_consensus.cc:2243] T 1660568f1208485fb6f74d572deee2d9 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.996989  9799 raft_consensus.cc:2272] T 1660568f1208485fb6f74d572deee2d9 P a08ea42cd3884210924a19c8f570486d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:09.016367 18218 consensus_peers.cc:597] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c -> Peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Couldn't send request to peer a08ea42cd3884210924a19c8f570486d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:09.046890 18218 consensus_peers.cc:597] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c -> Peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Couldn't send request to peer a08ea42cd3884210924a19c8f570486d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:09.069072 19082 raft_consensus.cc:493] T 9984112bc75a4e66b55655a1bdd99052 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:27:09.069833 19082 raft_consensus.cc:515] T 9984112bc75a4e66b55655a1bdd99052 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:27:09.072170 19082 leader_election.cc:290] T 9984112bc75a4e66b55655a1bdd99052 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
W20260709 12:27:09.077476 18216 leader_election.cc:336] T 9984112bc75a4e66b55655a1bdd99052 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
W20260709 12:27:09.080605 18215 leader_election.cc:336] T 9984112bc75a4e66b55655a1bdd99052 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Network error: Client connection negotiation failed: client connection to 127.9.145.194:45595: connect: Connection refused (error 111)
I20260709 12:27:09.081116 18215 leader_election.cc:304] T 9984112bc75a4e66b55655a1bdd99052 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c938681fc04e66968531267f39f16c; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:27:09.082337 19082 raft_consensus.cc:2749] T 9984112bc75a4e66b55655a1bdd99052 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:09.099997 18143 connection.cc:466] server connection from 127.0.0.1:58682 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58682 (request call id 786) could send its response
W20260709 12:27:09.101122 18218 consensus_peers.cc:597] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c -> Peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Couldn't send request to peer a08ea42cd3884210924a19c8f570486d. Status: Network error: recv got EOF from 127.9.145.195:43695 (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:09.117372  9799 tablet_server.cc:196] TabletServer@127.9.145.195:0 shutdown complete.
I20260709 12:27:09.140151 19141 raft_consensus.cc:493] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:27:09.140935 19141 raft_consensus.cc:515] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:27:09.143360 19141 leader_election.cc:290] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
W20260709 12:27:09.148419 18215 leader_election.cc:336] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Network error: Client connection negotiation failed: client connection to 127.9.145.194:45595: connect: Connection refused (error 111)
W20260709 12:27:09.150290 18216 leader_election.cc:336] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:27:09.150792 18216 leader_election.cc:304] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c938681fc04e66968531267f39f16c; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:27:09.151618 19141 raft_consensus.cc:2749] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:09.206156 19141 raft_consensus.cc:493] T 10895331ca6e49d4aad97aec0e629dd7 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:27:09.206738 19141 raft_consensus.cc:515] T 10895331ca6e49d4aad97aec0e629dd7 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:27:09.209146 19141 leader_election.cc:290] T 10895331ca6e49d4aad97aec0e629dd7 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
W20260709 12:27:09.215066 18218 consensus_peers.cc:597] T 07d9e11e303c4580a941ccc2943afdd5 P 10c938681fc04e66968531267f39f16c -> Peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Couldn't send request to peer a08ea42cd3884210924a19c8f570486d. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.195:43695: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:09.215775 18215 leader_election.cc:336] T 10895331ca6e49d4aad97aec0e629dd7 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Network error: Client connection negotiation failed: client connection to 127.9.145.194:45595: connect: Connection refused (error 111)
W20260709 12:27:09.216928 18216 leader_election.cc:336] T 10895331ca6e49d4aad97aec0e629dd7 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:27:09.217319 18216 leader_election.cc:304] T 10895331ca6e49d4aad97aec0e629dd7 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c938681fc04e66968531267f39f16c; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:27:09.218159 19054 raft_consensus.cc:2749] T 10895331ca6e49d4aad97aec0e629dd7 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:09.221421  9799 tablet_server.cc:179] TabletServer@127.9.145.196:0 shutting down...
I20260709 12:27:09.236307 19141 raft_consensus.cc:493] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:27:09.237920 19141 raft_consensus.cc:515] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } } peers { permanent_uuid: "3a269a9c95e0476d9e09c25b4b5aaa2c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45595 } }
I20260709 12:27:09.242935 19141 leader_election.cc:290] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743), 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595)
W20260709 12:27:09.248113 18215 leader_election.cc:336] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3a269a9c95e0476d9e09c25b4b5aaa2c (127.9.145.194:45595): Network error: Client connection negotiation failed: client connection to 127.9.145.194:45595: connect: Connection refused (error 111)
W20260709 12:27:09.254884 18216 leader_election.cc:336] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:27:09.255257 18216 leader_election.cc:304] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c938681fc04e66968531267f39f16c; no voters: 3a269a9c95e0476d9e09c25b4b5aaa2c, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:27:09.255906 19141 raft_consensus.cc:2749] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:09.276175  9799 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:09.277069  9799 tablet_replica.cc:333] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.278007  9799 raft_consensus.cc:2243] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:09.279150  9799 raft_consensus.cc:2272] T 2c660b0ce2084a1a9fcc17139d4addd5 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.281458  9799 tablet_replica.cc:333] T 09661bcb87ec455e97022bc6febc4754 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.282207  9799 raft_consensus.cc:2243] T 09661bcb87ec455e97022bc6febc4754 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:09.282732  9799 raft_consensus.cc:2272] T 09661bcb87ec455e97022bc6febc4754 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.284734 19141 raft_consensus.cc:493] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:27:09.285303  9799 tablet_replica.cc:333] T fa35871af5624c709008fe86090c0ad1 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.285265 19141 raft_consensus.cc:515] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:27:09.286203  9799 raft_consensus.cc:2243] T fa35871af5624c709008fe86090c0ad1 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:09.286814  9799 raft_consensus.cc:2272] T fa35871af5624c709008fe86090c0ad1 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.287432 19141 leader_election.cc:290] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:27:09.289944  9799 tablet_replica.cc:333] T bdc0b28c91d54918b8a914c137f9543f P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.291138  9799 raft_consensus.cc:2243] T bdc0b28c91d54918b8a914c137f9543f P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:09.291675 18218 leader_election.cc:336] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Network error: Client connection negotiation failed: client connection to 127.9.145.195:43695: connect: Connection refused (error 111)
I20260709 12:27:09.291927  9799 raft_consensus.cc:2272] T bdc0b28c91d54918b8a914c137f9543f P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:09.292639 18216 leader_election.cc:336] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:27:09.293045 18216 leader_election.cc:304] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c938681fc04e66968531267f39f16c; no voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:27:09.293663 19141 raft_consensus.cc:2749] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:09.294936  9799 tablet_replica.cc:333] T cba48186789449ef9cae51c546ace419 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.295693  9799 raft_consensus.cc:2243] T cba48186789449ef9cae51c546ace419 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:09.296214  9799 raft_consensus.cc:2272] T cba48186789449ef9cae51c546ace419 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.298472  9799 tablet_replica.cc:333] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.299101  9799 raft_consensus.cc:2243] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:09.299695  9799 raft_consensus.cc:2272] T 35683295be3042a4bc1839bda16f6f40 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.302678  9799 tablet_replica.cc:333] T 3463ec2e9f294668adae229e2814b1cf P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.303527  9799 raft_consensus.cc:2243] T 3463ec2e9f294668adae229e2814b1cf P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:09.304179  9799 raft_consensus.cc:2272] T 3463ec2e9f294668adae229e2814b1cf P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.306483  9799 tablet_replica.cc:333] T 96957d639eed4a1395857a97a292f8ea P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.307127  9799 raft_consensus.cc:2243] T 96957d639eed4a1395857a97a292f8ea P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:09.307667  9799 raft_consensus.cc:2272] T 96957d639eed4a1395857a97a292f8ea P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.309793  9799 tablet_replica.cc:333] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.310459  9799 raft_consensus.cc:2243] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:09.311277  9799 raft_consensus.cc:2272] T 29e1b7b25f15438ba055b0ea299ada27 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.313405  9799 tablet_replica.cc:333] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.313992  9799 raft_consensus.cc:2243] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:09.314908  9799 raft_consensus.cc:2272] T 81710104264d4f3fa7ecf1c48b2b48ca P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.316993  9799 tablet_replica.cc:333] T 9984112bc75a4e66b55655a1bdd99052 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.317503  9799 raft_consensus.cc:2243] T 9984112bc75a4e66b55655a1bdd99052 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:09.317912  9799 raft_consensus.cc:2272] T 9984112bc75a4e66b55655a1bdd99052 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.320081  9799 tablet_replica.cc:333] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.320618  9799 raft_consensus.cc:2243] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:09.321542  9799 raft_consensus.cc:2272] T 02af88afdc444f268f05df276bf720c0 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.324461  9799 tablet_replica.cc:333] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.325322  9799 raft_consensus.cc:2243] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:09.326038  9799 raft_consensus.cc:2272] T 740537a0f03c42caa8182d3b9f403859 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.328636  9799 tablet_replica.cc:333] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.329324  9799 raft_consensus.cc:2243] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:09.330345  9799 raft_consensus.cc:2272] T f68e8047f5ff4aa0b631cbd912091d25 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.332695  9799 tablet_replica.cc:333] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.333336  9799 raft_consensus.cc:2243] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:09.333823  9799 raft_consensus.cc:2272] T 57c55f2aea594f27bd7ce646464ea07c P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.336133  9799 tablet_replica.cc:333] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.336758  9799 raft_consensus.cc:2243] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:09.337335  9799 raft_consensus.cc:2272] T dc4b6b0d4466443f9c077e9a45bb3b89 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.339691  9799 tablet_replica.cc:333] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.340258  9799 raft_consensus.cc:2243] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:09.340727  9799 raft_consensus.cc:2272] T 01d2f53aff8a45a49cadf9fd72b75ee8 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.343235  9799 tablet_replica.cc:333] T 8447aa2b8d4547c0b737643187aa4bd0 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.343896  9799 raft_consensus.cc:2243] T 8447aa2b8d4547c0b737643187aa4bd0 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:09.344460  9799 raft_consensus.cc:2272] T 8447aa2b8d4547c0b737643187aa4bd0 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.346966  9799 tablet_replica.cc:333] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.347586  9799 raft_consensus.cc:2243] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:09.348450  9799 raft_consensus.cc:2272] T f124d65e17c143b08d3428ef325ae9a5 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.350685  9799 tablet_replica.cc:333] T b667d19692ec4a3aaa8d0c45edf73db9 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.351289  9799 raft_consensus.cc:2243] T b667d19692ec4a3aaa8d0c45edf73db9 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:09.351778  9799 raft_consensus.cc:2272] T b667d19692ec4a3aaa8d0c45edf73db9 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.353789  9799 tablet_replica.cc:333] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.354417  9799 raft_consensus.cc:2243] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:09.355347  9799 raft_consensus.cc:2272] T 223eb34bd9744014b3c011eebcb37f11 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.355850 19141 raft_consensus.cc:493] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:27:09.356285 19141 raft_consensus.cc:515] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:27:09.357867  9799 tablet_replica.cc:333] T a379e8a15db944b4a33a0c99f05dc6db P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.358237 19141 leader_election.cc:290] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:27:09.358734  9799 raft_consensus.cc:2243] T a379e8a15db944b4a33a0c99f05dc6db P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:09.359441  9799 raft_consensus.cc:2272] T a379e8a15db944b4a33a0c99f05dc6db P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.362787  9799 tablet_replica.cc:333] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.363662  9799 raft_consensus.cc:2243] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:09.364387  9799 raft_consensus.cc:2272] T 90509aaa02f84d8a983c9f13d8155ded P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:09.364404 18216 leader_election.cc:336] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
W20260709 12:27:09.364972 18218 leader_election.cc:336] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Network error: Client connection negotiation failed: client connection to 127.9.145.195:43695: connect: Connection refused (error 111)
I20260709 12:27:09.365350 18218 leader_election.cc:304] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c938681fc04e66968531267f39f16c; no voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:27:09.365967 19082 raft_consensus.cc:2749] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:09.367348  9799 tablet_replica.cc:333] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.368023  9799 raft_consensus.cc:2243] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:09.368537  9799 raft_consensus.cc:2272] T 7adcc9c41a0d4ffe92d5aa05859d55f5 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.370883  9799 tablet_replica.cc:333] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.371444  9799 raft_consensus.cc:2243] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:09.371909  9799 raft_consensus.cc:2272] T a019c53d9a9946c59ed8a1b201786adc P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.373991  9799 tablet_replica.cc:333] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.374570  9799 raft_consensus.cc:2243] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:09.375414  9799 raft_consensus.cc:2272] T 5995ee175fed4e3e893b8efe2a7eb7d0 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.377453  9799 tablet_replica.cc:333] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.377993  9799 raft_consensus.cc:2243] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:09.378892  9799 raft_consensus.cc:2272] T 8aa7d7ddefbe4ff394a232a4f45e5cd4 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.380894  9799 tablet_replica.cc:333] T be25c969559444ae99d240c6f3f60df1 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.381433  9799 raft_consensus.cc:2243] T be25c969559444ae99d240c6f3f60df1 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:09.381882  9799 raft_consensus.cc:2272] T be25c969559444ae99d240c6f3f60df1 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.384025  9799 tablet_replica.cc:333] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.384616  9799 raft_consensus.cc:2243] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:09.385437  9799 raft_consensus.cc:2272] T e60fecc50c1d49c2963f342da1b3c2a6 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.387629  9799 tablet_replica.cc:333] T 10895331ca6e49d4aad97aec0e629dd7 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.388149  9799 raft_consensus.cc:2243] T 10895331ca6e49d4aad97aec0e629dd7 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:09.388559  9799 raft_consensus.cc:2272] T 10895331ca6e49d4aad97aec0e629dd7 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.390695  9799 tablet_replica.cc:333] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.391171  9799 raft_consensus.cc:2243] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:09.391577  9799 raft_consensus.cc:2272] T 1660568f1208485fb6f74d572deee2d9 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.393648  9799 tablet_replica.cc:333] T 7dbf7d84f5ff496e905988250445db74 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.394181  9799 raft_consensus.cc:2243] T 7dbf7d84f5ff496e905988250445db74 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:09.394572  9799 raft_consensus.cc:2272] T 7dbf7d84f5ff496e905988250445db74 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.396492  9799 tablet_replica.cc:333] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.397001  9799 raft_consensus.cc:2243] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:09.397919  9799 raft_consensus.cc:2272] T a61bb69fcfd54ef88c37917a48d1cb30 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.400085  9799 tablet_replica.cc:333] T 2d9471cf607248b0b7f9090046f63df4 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.400568  9799 raft_consensus.cc:2243] T 2d9471cf607248b0b7f9090046f63df4 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:09.401363  9799 raft_consensus.cc:2272] T 2d9471cf607248b0b7f9090046f63df4 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.403512  9799 tablet_replica.cc:333] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.403995  9799 raft_consensus.cc:2243] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:09.404407  9799 raft_consensus.cc:2272] T 5e88e93a00044d1482497fa864163047 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.405380 19082 raft_consensus.cc:493] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac42e2bcf9ac42448a84370269bc6ccc)
I20260709 12:27:09.405865 19082 raft_consensus.cc:515] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a08ea42cd3884210924a19c8f570486d" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 43695 } } peers { permanent_uuid: "10c938681fc04e66968531267f39f16c" member_type: VOTER last_known_addr { host: "127.9.145.196" port: 37881 } } peers { permanent_uuid: "ac42e2bcf9ac42448a84370269bc6ccc" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36743 } }
I20260709 12:27:09.406774  9799 tablet_replica.cc:333] T c697128b8d274c8790595b833d9b74eb P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.407436  9799 raft_consensus.cc:2243] T c697128b8d274c8790595b833d9b74eb P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:09.407871 19082 leader_election.cc:290] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695), ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743)
I20260709 12:27:09.408007  9799 raft_consensus.cc:2272] T c697128b8d274c8790595b833d9b74eb P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.411263  9799 tablet_replica.cc:333] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c: stopping tablet replica
W20260709 12:27:09.411788 18218 leader_election.cc:336] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a08ea42cd3884210924a19c8f570486d (127.9.145.195:43695): Network error: Client connection negotiation failed: client connection to 127.9.145.195:43695: connect: Connection refused (error 111)
I20260709 12:27:09.412031  9799 raft_consensus.cc:2243] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:27:09.412307 18216 leader_election.cc:336] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ac42e2bcf9ac42448a84370269bc6ccc (127.9.145.193:36743): Network error: Client connection negotiation failed: client connection to 127.9.145.193:36743: connect: Connection refused (error 111)
I20260709 12:27:09.412724 18216 leader_election.cc:304] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c938681fc04e66968531267f39f16c; no voters: a08ea42cd3884210924a19c8f570486d, ac42e2bcf9ac42448a84370269bc6ccc
I20260709 12:27:09.413177  9799 raft_consensus.cc:2272] T 91269edd7c074ad2bfced23e62cbe5fc P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.413296 19082 raft_consensus.cc:2749] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:09.415621  9799 tablet_replica.cc:333] T 0d8b927123c04143a7b87fa8f129a9e7 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.416214  9799 raft_consensus.cc:2243] T 0d8b927123c04143a7b87fa8f129a9e7 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:09.416620  9799 raft_consensus.cc:2272] T 0d8b927123c04143a7b87fa8f129a9e7 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.418758  9799 tablet_replica.cc:333] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.419291  9799 raft_consensus.cc:2243] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:09.419749  9799 raft_consensus.cc:2272] T cffccb3c736b4f0fa0789217fa65dc2c P 10c938681fc04e66968531267f39f16c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.421764  9799 tablet_replica.cc:333] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.422286  9799 raft_consensus.cc:2243] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:09.422775  9799 raft_consensus.cc:2272] T e48eb1372ff4402498990d2abd8c6da2 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.424813  9799 tablet_replica.cc:333] T e2114d69fe2c427599f225a7b0686dee P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.425297  9799 raft_consensus.cc:2243] T e2114d69fe2c427599f225a7b0686dee P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:09.425772  9799 raft_consensus.cc:2272] T e2114d69fe2c427599f225a7b0686dee P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.427908  9799 tablet_replica.cc:333] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.428447  9799 raft_consensus.cc:2243] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:09.428920  9799 raft_consensus.cc:2272] T bb4d4ed1ab54477ca58913fad1bc93b1 P 10c938681fc04e66968531267f39f16c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.431129  9799 tablet_replica.cc:333] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.431674  9799 raft_consensus.cc:2243] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:09.432534  9799 raft_consensus.cc:2272] T ebb7b63685e841a2a975e727c46f1b64 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.434496  9799 tablet_replica.cc:333] T 07d9e11e303c4580a941ccc2943afdd5 P 10c938681fc04e66968531267f39f16c: stopping tablet replica
I20260709 12:27:09.434931  9799 raft_consensus.cc:2243] T 07d9e11e303c4580a941ccc2943afdd5 P 10c938681fc04e66968531267f39f16c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:09.435861  9799 raft_consensus.cc:2272] T 07d9e11e303c4580a941ccc2943afdd5 P 10c938681fc04e66968531267f39f16c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.507802  9799 tablet_server.cc:196] TabletServer@127.9.145.196:0 shutdown complete.
I20260709 12:27:09.576459  9799 master.cc:562] Master@127.9.145.254:45005 shutting down...
I20260709 12:27:09.603330  9799 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 03e98baed3d2465499fb533f47c7aecd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:09.603955  9799 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 03e98baed3d2465499fb533f47c7aecd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:09.604290  9799 tablet_replica.cc:333] T 00000000000000000000000000000000 P 03e98baed3d2465499fb533f47c7aecd: stopping tablet replica
I20260709 12:27:09.625981  9799 master.cc:584] Master@127.9.145.254:45005 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (32111 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:27:09.712226  9799 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.145.254:38757
I20260709 12:27:09.713392  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:09.719384 19151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:09.719380 19150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:09.720340 19153 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:09.721174  9799 server_base.cc:1061] running on GCE node
I20260709 12:27:09.722230  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:09.722414  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:09.722566  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783600029722546 us; error 0 us; skew 500 ppm
I20260709 12:27:09.723069  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:09.725482  9799 webserver.cc:533] Webserver started at http://127.9.145.254:42159/ using document root <none> and password file <none>
I20260709 12:27:09.725952  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:09.726436  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:09.726713  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:09.727952  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599719482688-9799-0/minicluster-data/master-0-root/instance:
uuid: "5645d87757224e6cb583445f296450ef"
format_stamp: "Formatted at 2026-07-09 12:27:09 on dist-test-slave-1sdq"
I20260709 12:27:09.732511  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:27:09.736101 19158 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:09.736901  9799 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:27:09.737207  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599719482688-9799-0/minicluster-data/master-0-root
uuid: "5645d87757224e6cb583445f296450ef"
format_stamp: "Formatted at 2026-07-09 12:27:09 on dist-test-slave-1sdq"
I20260709 12:27:09.737498  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599719482688-9799-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599719482688-9799-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599719482688-9799-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:09.754518  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:09.755777  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:09.795261  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.254:38757
I20260709 12:27:09.795385 19209 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.254:38757 every 8 connection(s)
I20260709 12:27:09.799320 19210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:09.811172 19210 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5645d87757224e6cb583445f296450ef: Bootstrap starting.
I20260709 12:27:09.816111 19210 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5645d87757224e6cb583445f296450ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:09.820729 19210 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5645d87757224e6cb583445f296450ef: No bootstrap required, opened a new log
I20260709 12:27:09.823092 19210 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5645d87757224e6cb583445f296450ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5645d87757224e6cb583445f296450ef" member_type: VOTER }
I20260709 12:27:09.823499 19210 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5645d87757224e6cb583445f296450ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:09.823726 19210 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5645d87757224e6cb583445f296450ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5645d87757224e6cb583445f296450ef, State: Initialized, Role: FOLLOWER
I20260709 12:27:09.824299 19210 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5645d87757224e6cb583445f296450ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5645d87757224e6cb583445f296450ef" member_type: VOTER }
I20260709 12:27:09.824756 19210 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5645d87757224e6cb583445f296450ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:27:09.824968 19210 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5645d87757224e6cb583445f296450ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:27:09.825220 19210 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5645d87757224e6cb583445f296450ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:09.831179 19210 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5645d87757224e6cb583445f296450ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5645d87757224e6cb583445f296450ef" member_type: VOTER }
I20260709 12:27:09.831736 19210 leader_election.cc:304] T 00000000000000000000000000000000 P 5645d87757224e6cb583445f296450ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5645d87757224e6cb583445f296450ef; no voters: 
I20260709 12:27:09.832888 19210 leader_election.cc:290] T 00000000000000000000000000000000 P 5645d87757224e6cb583445f296450ef [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:27:09.833307 19213 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5645d87757224e6cb583445f296450ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:09.834774 19213 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5645d87757224e6cb583445f296450ef [term 1 LEADER]: Becoming Leader. State: Replica: 5645d87757224e6cb583445f296450ef, State: Running, Role: LEADER
I20260709 12:27:09.835510 19213 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5645d87757224e6cb583445f296450ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5645d87757224e6cb583445f296450ef" member_type: VOTER }
I20260709 12:27:09.835798 19210 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5645d87757224e6cb583445f296450ef [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:27:09.840297 19215 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5645d87757224e6cb583445f296450ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5645d87757224e6cb583445f296450ef. Latest consensus state: current_term: 1 leader_uuid: "5645d87757224e6cb583445f296450ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5645d87757224e6cb583445f296450ef" member_type: VOTER } }
I20260709 12:27:09.840744 19214 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5645d87757224e6cb583445f296450ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5645d87757224e6cb583445f296450ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5645d87757224e6cb583445f296450ef" member_type: VOTER } }
I20260709 12:27:09.841079 19215 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5645d87757224e6cb583445f296450ef [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:09.841439 19214 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5645d87757224e6cb583445f296450ef [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:09.843693 19221 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:27:09.848695 19221 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:27:09.855480  9799 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:27:09.858871 19221 catalog_manager.cc:1383] Generated new cluster ID: 3de74f8793b14419806b7d57e6c65559
I20260709 12:27:09.859162 19221 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:27:09.883756 19221 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:27:09.885135 19221 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:27:09.904240 19221 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5645d87757224e6cb583445f296450ef: Generated new TSK 0
I20260709 12:27:09.904868 19221 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:27:09.925104  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:09.931541 19231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:09.932459 19232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:09.933496 19234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:09.934419  9799 server_base.cc:1061] running on GCE node
I20260709 12:27:09.935355  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:09.935547  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:09.935712  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783600029935698 us; error 0 us; skew 500 ppm
I20260709 12:27:09.936256  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:09.938745  9799 webserver.cc:533] Webserver started at http://127.9.145.193:39277/ using document root <none> and password file <none>
I20260709 12:27:09.939232  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:09.939415  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:09.939744  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:09.940909  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599719482688-9799-0/minicluster-data/ts-0-root/instance:
uuid: "5924eff3e27946ee95859aa91a310ac3"
format_stamp: "Formatted at 2026-07-09 12:27:09 on dist-test-slave-1sdq"
I20260709 12:27:09.945866  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 12:27:09.949461 19239 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:09.950470  9799 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:27:09.950778  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599719482688-9799-0/minicluster-data/ts-0-root
uuid: "5924eff3e27946ee95859aa91a310ac3"
format_stamp: "Formatted at 2026-07-09 12:27:09 on dist-test-slave-1sdq"
I20260709 12:27:09.951077  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599719482688-9799-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599719482688-9799-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599719482688-9799-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:09.976961  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:09.978320  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:09.979820  9799 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:09.982147  9799 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:09.982349  9799 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:09.982580  9799 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:09.982751  9799 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:10.023574  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.193:35521
I20260709 12:27:10.023676 19301 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.193:35521 every 8 connection(s)
I20260709 12:27:10.028831  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:10.036705 19306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:10.037493 19307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:10.038931 19309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:10.040479  9799 server_base.cc:1061] running on GCE node
I20260709 12:27:10.042001  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:10.042272  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:10.042436  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783600030042422 us; error 0 us; skew 500 ppm
I20260709 12:27:10.042848 19302 heartbeater.cc:344] Connected to a master server at 127.9.145.254:38757
I20260709 12:27:10.043098  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:10.043340 19302 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:10.044286 19302 heartbeater.cc:507] Master 127.9.145.254:38757 requested a full tablet report, sending...
I20260709 12:27:10.046059  9799 webserver.cc:533] Webserver started at http://127.9.145.194:33789/ using document root <none> and password file <none>
I20260709 12:27:10.046689  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:10.046841 19175 ts_manager.cc:194] Registered new tserver with Master: 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521)
I20260709 12:27:10.046882  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:10.047451  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:10.048719  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599719482688-9799-0/minicluster-data/ts-1-root/instance:
uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
format_stamp: "Formatted at 2026-07-09 12:27:10 on dist-test-slave-1sdq"
I20260709 12:27:10.048852 19175 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60484
I20260709 12:27:10.054358  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:27:10.058091 19314 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:10.058943  9799 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 12:27:10.059262  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599719482688-9799-0/minicluster-data/ts-1-root
uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
format_stamp: "Formatted at 2026-07-09 12:27:10 on dist-test-slave-1sdq"
I20260709 12:27:10.059541  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599719482688-9799-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599719482688-9799-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599719482688-9799-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:10.084148  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:10.085417  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:10.086997  9799 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:10.089355  9799 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:10.089561  9799 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:10.089810  9799 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:10.089968  9799 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:10.132174  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.194:45315
I20260709 12:27:10.132278 19376 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.194:45315 every 8 connection(s)
I20260709 12:27:10.137458  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:10.145026 19380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:10.147375 19381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:10.149240 19383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:10.150815 19377 heartbeater.cc:344] Connected to a master server at 127.9.145.254:38757
I20260709 12:27:10.151062  9799 server_base.cc:1061] running on GCE node
I20260709 12:27:10.151413 19377 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:10.152215  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:10.152585  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:10.152486 19377 heartbeater.cc:507] Master 127.9.145.254:38757 requested a full tablet report, sending...
I20260709 12:27:10.152908  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783600030152887 us; error 0 us; skew 500 ppm
I20260709 12:27:10.153643  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:10.155205 19175 ts_manager.cc:194] Registered new tserver with Master: 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315)
I20260709 12:27:10.156633  9799 webserver.cc:533] Webserver started at http://127.9.145.195:40707/ using document root <none> and password file <none>
I20260709 12:27:10.157241 19175 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60500
I20260709 12:27:10.157409  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:10.157764  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:10.158159  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:10.159536  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599719482688-9799-0/minicluster-data/ts-2-root/instance:
uuid: "298958962bdd41fe95575d9841ccdc56"
format_stamp: "Formatted at 2026-07-09 12:27:10 on dist-test-slave-1sdq"
I20260709 12:27:10.164382  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:27:10.168067 19388 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:10.168923  9799 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:27:10.169269  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599719482688-9799-0/minicluster-data/ts-2-root
uuid: "298958962bdd41fe95575d9841ccdc56"
format_stamp: "Formatted at 2026-07-09 12:27:10 on dist-test-slave-1sdq"
I20260709 12:27:10.169723  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599719482688-9799-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599719482688-9799-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599719482688-9799-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:10.181556  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:10.182930  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:10.184446  9799 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:10.186956  9799 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:10.187194  9799 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:10.187441  9799 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:10.187598  9799 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:10.229481  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.195:34685
I20260709 12:27:10.229575 19450 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.195:34685 every 8 connection(s)
I20260709 12:27:10.244724 19451 heartbeater.cc:344] Connected to a master server at 127.9.145.254:38757
I20260709 12:27:10.245299 19451 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:10.246286 19451 heartbeater.cc:507] Master 127.9.145.254:38757 requested a full tablet report, sending...
I20260709 12:27:10.248340 19175 ts_manager.cc:194] Registered new tserver with Master: 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685)
I20260709 12:27:10.248881  9799 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01591243s
I20260709 12:27:10.249873 19175 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60514
I20260709 12:27:10.275713 19175 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60516:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:27:10.278748 19175 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:27:10.350421 19416 tablet_service.cc:1511] Processing CreateTablet for tablet 9d27567ec64648da953818113fca8920 (DEFAULT_TABLE table=test-workload [id=63bb649ab64640dd82a20f587177f27d]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:27:10.351969 19416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d27567ec64648da953818113fca8920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.353681 19415 tablet_service.cc:1511] Processing CreateTablet for tablet b7c87e92594d479988a81bd758077e6d (DEFAULT_TABLE table=test-workload [id=63bb649ab64640dd82a20f587177f27d]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:27:10.355271 19415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7c87e92594d479988a81bd758077e6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.357358 19341 tablet_service.cc:1511] Processing CreateTablet for tablet b7c87e92594d479988a81bd758077e6d (DEFAULT_TABLE table=test-workload [id=63bb649ab64640dd82a20f587177f27d]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:27:10.364358 19341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7c87e92594d479988a81bd758077e6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.364480 19264 tablet_service.cc:1511] Processing CreateTablet for tablet 8cdc52ff09ec40c582ff078f8d61029f (DEFAULT_TABLE table=test-workload [id=63bb649ab64640dd82a20f587177f27d]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:27:10.365944 19264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cdc52ff09ec40c582ff078f8d61029f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.363341 19265 tablet_service.cc:1511] Processing CreateTablet for tablet 4072c2eca5ff4c9fa4fceaa513e8f5ad (DEFAULT_TABLE table=test-workload [id=63bb649ab64640dd82a20f587177f27d]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:27:10.367537 19265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4072c2eca5ff4c9fa4fceaa513e8f5ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.367758 19338 tablet_service.cc:1511] Processing CreateTablet for tablet 35c9c4b10c8144a089d4a67b3bc2d167 (DEFAULT_TABLE table=test-workload [id=63bb649ab64640dd82a20f587177f27d]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:27:10.368801 19262 tablet_service.cc:1511] Processing CreateTablet for tablet b52bce4ea207438c9830561dddf50ee6 (DEFAULT_TABLE table=test-workload [id=63bb649ab64640dd82a20f587177f27d]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:27:10.369305 19338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35c9c4b10c8144a089d4a67b3bc2d167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.359565 19339 tablet_service.cc:1511] Processing CreateTablet for tablet 8cdc52ff09ec40c582ff078f8d61029f (DEFAULT_TABLE table=test-workload [id=63bb649ab64640dd82a20f587177f27d]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:27:10.365865 19263 tablet_service.cc:1511] Processing CreateTablet for tablet 35c9c4b10c8144a089d4a67b3bc2d167 (DEFAULT_TABLE table=test-workload [id=63bb649ab64640dd82a20f587177f27d]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:27:10.371066 19339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cdc52ff09ec40c582ff078f8d61029f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.361397 19267 tablet_service.cc:1511] Processing CreateTablet for tablet 9d27567ec64648da953818113fca8920 (DEFAULT_TABLE table=test-workload [id=63bb649ab64640dd82a20f587177f27d]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:27:10.361707 19266 tablet_service.cc:1511] Processing CreateTablet for tablet b7c87e92594d479988a81bd758077e6d (DEFAULT_TABLE table=test-workload [id=63bb649ab64640dd82a20f587177f27d]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:27:10.361486 19340 tablet_service.cc:1511] Processing CreateTablet for tablet 4072c2eca5ff4c9fa4fceaa513e8f5ad (DEFAULT_TABLE table=test-workload [id=63bb649ab64640dd82a20f587177f27d]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:27:10.373226 19340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4072c2eca5ff4c9fa4fceaa513e8f5ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.373355 19414 tablet_service.cc:1511] Processing CreateTablet for tablet 4072c2eca5ff4c9fa4fceaa513e8f5ad (DEFAULT_TABLE table=test-workload [id=63bb649ab64640dd82a20f587177f27d]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:27:10.362819 19342 tablet_service.cc:1511] Processing CreateTablet for tablet 9d27567ec64648da953818113fca8920 (DEFAULT_TABLE table=test-workload [id=63bb649ab64640dd82a20f587177f27d]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:27:10.374827 19414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4072c2eca5ff4c9fa4fceaa513e8f5ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.375234 19342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d27567ec64648da953818113fca8920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.378028 19261 tablet_service.cc:1511] Processing CreateTablet for tablet 06cbe0f5cc0a42fcb50365c0ce355c71 (DEFAULT_TABLE table=test-workload [id=63bb649ab64640dd82a20f587177f27d]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:27:10.379401 19413 tablet_service.cc:1511] Processing CreateTablet for tablet 8cdc52ff09ec40c582ff078f8d61029f (DEFAULT_TABLE table=test-workload [id=63bb649ab64640dd82a20f587177f27d]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:27:10.380860 19413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cdc52ff09ec40c582ff078f8d61029f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.371582 19263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35c9c4b10c8144a089d4a67b3bc2d167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.382669 19260 tablet_service.cc:1511] Processing CreateTablet for tablet 4831316659774caf9b5a1bac14d279e0 (DEFAULT_TABLE table=test-workload [id=63bb649ab64640dd82a20f587177f27d]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:27:10.383373 19412 tablet_service.cc:1511] Processing CreateTablet for tablet 35c9c4b10c8144a089d4a67b3bc2d167 (DEFAULT_TABLE table=test-workload [id=63bb649ab64640dd82a20f587177f27d]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:27:10.384133 19260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4831316659774caf9b5a1bac14d279e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.386482 19266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7c87e92594d479988a81bd758077e6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.387388 19410 tablet_service.cc:1511] Processing CreateTablet for tablet 06cbe0f5cc0a42fcb50365c0ce355c71 (DEFAULT_TABLE table=test-workload [id=63bb649ab64640dd82a20f587177f27d]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:27:10.385701 19411 tablet_service.cc:1511] Processing CreateTablet for tablet b52bce4ea207438c9830561dddf50ee6 (DEFAULT_TABLE table=test-workload [id=63bb649ab64640dd82a20f587177f27d]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:27:10.390539 19261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06cbe0f5cc0a42fcb50365c0ce355c71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.392720 19337 tablet_service.cc:1511] Processing CreateTablet for tablet b52bce4ea207438c9830561dddf50ee6 (DEFAULT_TABLE table=test-workload [id=63bb649ab64640dd82a20f587177f27d]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:27:10.394550 19262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b52bce4ea207438c9830561dddf50ee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.395490 19267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d27567ec64648da953818113fca8920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.398285 19337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b52bce4ea207438c9830561dddf50ee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.399756 19409 tablet_service.cc:1511] Processing CreateTablet for tablet 4831316659774caf9b5a1bac14d279e0 (DEFAULT_TABLE table=test-workload [id=63bb649ab64640dd82a20f587177f27d]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:27:10.402566 19259 tablet_service.cc:1511] Processing CreateTablet for tablet ba07e5f1b5f14036bd2155d3e47e008a (DEFAULT_TABLE table=test-workload [id=63bb649ab64640dd82a20f587177f27d]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:27:10.404187 19259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba07e5f1b5f14036bd2155d3e47e008a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.405426 19336 tablet_service.cc:1511] Processing CreateTablet for tablet 06cbe0f5cc0a42fcb50365c0ce355c71 (DEFAULT_TABLE table=test-workload [id=63bb649ab64640dd82a20f587177f27d]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:27:10.410930 19336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06cbe0f5cc0a42fcb50365c0ce355c71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.412828 19408 tablet_service.cc:1511] Processing CreateTablet for tablet ba07e5f1b5f14036bd2155d3e47e008a (DEFAULT_TABLE table=test-workload [id=63bb649ab64640dd82a20f587177f27d]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:27:10.407841 19335 tablet_service.cc:1511] Processing CreateTablet for tablet 4831316659774caf9b5a1bac14d279e0 (DEFAULT_TABLE table=test-workload [id=63bb649ab64640dd82a20f587177f27d]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:27:10.417752 19258 tablet_service.cc:1511] Processing CreateTablet for tablet 0bd3742c69244d18847d16a933efdcc1 (DEFAULT_TABLE table=test-workload [id=63bb649ab64640dd82a20f587177f27d]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:27:10.419304 19335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4831316659774caf9b5a1bac14d279e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.419409 19258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bd3742c69244d18847d16a933efdcc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.421833 19408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba07e5f1b5f14036bd2155d3e47e008a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.422200 19407 tablet_service.cc:1511] Processing CreateTablet for tablet 0bd3742c69244d18847d16a933efdcc1 (DEFAULT_TABLE table=test-workload [id=63bb649ab64640dd82a20f587177f27d]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:27:10.426533 19409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4831316659774caf9b5a1bac14d279e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.428382 19412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35c9c4b10c8144a089d4a67b3bc2d167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.430074 19410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06cbe0f5cc0a42fcb50365c0ce355c71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.431802 19411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b52bce4ea207438c9830561dddf50ee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.433615 19466 tablet_bootstrap.cc:492] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3: Bootstrap starting.
I20260709 12:27:10.434525 19407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bd3742c69244d18847d16a933efdcc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.443516 19334 tablet_service.cc:1511] Processing CreateTablet for tablet ba07e5f1b5f14036bd2155d3e47e008a (DEFAULT_TABLE table=test-workload [id=63bb649ab64640dd82a20f587177f27d]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:27:10.445250 19334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba07e5f1b5f14036bd2155d3e47e008a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.455772 19333 tablet_service.cc:1511] Processing CreateTablet for tablet 0bd3742c69244d18847d16a933efdcc1 (DEFAULT_TABLE table=test-workload [id=63bb649ab64640dd82a20f587177f27d]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:27:10.457208 19333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bd3742c69244d18847d16a933efdcc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.486783 19468 tablet_bootstrap.cc:492] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56: Bootstrap starting.
I20260709 12:27:10.495378 19468 tablet_bootstrap.cc:654] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:10.507380 19468 tablet_bootstrap.cc:492] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56: No bootstrap required, opened a new log
I20260709 12:27:10.507925 19468 ts_tablet_manager.cc:1403] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.003s
I20260709 12:27:10.511135 19468 raft_consensus.cc:359] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.511912 19468 raft_consensus.cc:385] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:10.512233 19468 raft_consensus.cc:740] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 298958962bdd41fe95575d9841ccdc56, State: Initialized, Role: FOLLOWER
I20260709 12:27:10.513294 19468 consensus_queue.cc:260] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.514034 19467 tablet_bootstrap.cc:492] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c: Bootstrap starting.
I20260709 12:27:10.521585 19467 tablet_bootstrap.cc:654] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:10.524271 19468 ts_tablet_manager.cc:1434] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56: Time spent starting tablet: real 0.016s	user 0.014s	sys 0.001s
I20260709 12:27:10.525381 19451 heartbeater.cc:499] Master 127.9.145.254:38757 was elected leader, sending a full tablet report...
I20260709 12:27:10.528813 19468 tablet_bootstrap.cc:492] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56: Bootstrap starting.
I20260709 12:27:10.535670 19468 tablet_bootstrap.cc:654] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:10.584237 19466 tablet_bootstrap.cc:654] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:10.605886 19467 tablet_bootstrap.cc:492] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c: No bootstrap required, opened a new log
I20260709 12:27:10.606462 19467 ts_tablet_manager.cc:1403] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c: Time spent bootstrapping tablet: real 0.093s	user 0.011s	sys 0.034s
I20260709 12:27:10.609485 19468 tablet_bootstrap.cc:492] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56: No bootstrap required, opened a new log
I20260709 12:27:10.610255 19468 ts_tablet_manager.cc:1403] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56: Time spent bootstrapping tablet: real 0.082s	user 0.008s	sys 0.011s
I20260709 12:27:10.613632 19468 raft_consensus.cc:359] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.614405 19468 raft_consensus.cc:385] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:10.614707 19468 raft_consensus.cc:740] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 298958962bdd41fe95575d9841ccdc56, State: Initialized, Role: FOLLOWER
I20260709 12:27:10.609577 19467 raft_consensus.cc:359] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } }
I20260709 12:27:10.615809 19467 raft_consensus.cc:385] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:10.616364 19466 tablet_bootstrap.cc:492] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3: No bootstrap required, opened a new log
I20260709 12:27:10.615664 19468 consensus_queue.cc:260] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.616523 19467 raft_consensus.cc:740] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e78a1fe6ea845f5bcd564ad658ec40c, State: Initialized, Role: FOLLOWER
I20260709 12:27:10.617038 19466 ts_tablet_manager.cc:1403] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3: Time spent bootstrapping tablet: real 0.184s	user 0.014s	sys 0.006s
I20260709 12:27:10.617538 19467 consensus_queue.cc:260] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } }
I20260709 12:27:10.618465 19468 ts_tablet_manager.cc:1434] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:27:10.619544 19468 tablet_bootstrap.cc:492] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56: Bootstrap starting.
I20260709 12:27:10.621343 19466 raft_consensus.cc:359] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.622191 19466 raft_consensus.cc:385] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:10.622507 19466 raft_consensus.cc:740] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5924eff3e27946ee95859aa91a310ac3, State: Initialized, Role: FOLLOWER
I20260709 12:27:10.623432 19466 consensus_queue.cc:260] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.625988 19468 tablet_bootstrap.cc:654] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:10.632274 19377 heartbeater.cc:499] Master 127.9.145.254:38757 was elected leader, sending a full tablet report...
I20260709 12:27:10.632999 19467 ts_tablet_manager.cc:1434] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.013s
I20260709 12:27:10.634450 19467 tablet_bootstrap.cc:492] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c: Bootstrap starting.
W20260709 12:27:10.636636 19378 tablet.cc:2406] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:27:10.639374 19302 heartbeater.cc:499] Master 127.9.145.254:38757 was elected leader, sending a full tablet report...
I20260709 12:27:10.641710 19467 tablet_bootstrap.cc:654] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:10.643599 19468 tablet_bootstrap.cc:492] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56: No bootstrap required, opened a new log
I20260709 12:27:10.644455 19468 ts_tablet_manager.cc:1403] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.004s
I20260709 12:27:10.647789 19468 raft_consensus.cc:359] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.648792 19468 raft_consensus.cc:385] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:10.649196 19468 raft_consensus.cc:740] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 298958962bdd41fe95575d9841ccdc56, State: Initialized, Role: FOLLOWER
I20260709 12:27:10.649876 19466 ts_tablet_manager.cc:1434] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3: Time spent starting tablet: real 0.032s	user 0.010s	sys 0.012s
I20260709 12:27:10.650296 19468 consensus_queue.cc:260] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.651420 19466 tablet_bootstrap.cc:492] T 35c9c4b10c8144a089d4a67b3bc2d167 P 5924eff3e27946ee95859aa91a310ac3: Bootstrap starting.
I20260709 12:27:10.655880 19468 ts_tablet_manager.cc:1434] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:27:10.657189 19468 tablet_bootstrap.cc:492] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56: Bootstrap starting.
I20260709 12:27:10.662381 19466 tablet_bootstrap.cc:654] T 35c9c4b10c8144a089d4a67b3bc2d167 P 5924eff3e27946ee95859aa91a310ac3: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:10.663998 19468 tablet_bootstrap.cc:654] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:10.674032 19474 raft_consensus.cc:493] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.674759 19474 raft_consensus.cc:515] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } }
I20260709 12:27:10.677956 19474 leader_election.cc:290] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685), 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521)
I20260709 12:27:10.680068 19466 tablet_bootstrap.cc:492] T 35c9c4b10c8144a089d4a67b3bc2d167 P 5924eff3e27946ee95859aa91a310ac3: No bootstrap required, opened a new log
I20260709 12:27:10.680821 19466 ts_tablet_manager.cc:1403] T 35c9c4b10c8144a089d4a67b3bc2d167 P 5924eff3e27946ee95859aa91a310ac3: Time spent bootstrapping tablet: real 0.030s	user 0.000s	sys 0.019s
I20260709 12:27:10.684418 19466 raft_consensus.cc:359] T 35c9c4b10c8144a089d4a67b3bc2d167 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.685346 19466 raft_consensus.cc:385] T 35c9c4b10c8144a089d4a67b3bc2d167 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:10.685670 19466 raft_consensus.cc:740] T 35c9c4b10c8144a089d4a67b3bc2d167 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5924eff3e27946ee95859aa91a310ac3, State: Initialized, Role: FOLLOWER
I20260709 12:27:10.686787 19466 consensus_queue.cc:260] T 35c9c4b10c8144a089d4a67b3bc2d167 P 5924eff3e27946ee95859aa91a310ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.689160 19466 ts_tablet_manager.cc:1434] T 35c9c4b10c8144a089d4a67b3bc2d167 P 5924eff3e27946ee95859aa91a310ac3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:27:10.690325 19466 tablet_bootstrap.cc:492] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3: Bootstrap starting.
I20260709 12:27:10.697562 19466 tablet_bootstrap.cc:654] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:10.710400 19466 tablet_bootstrap.cc:492] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3: No bootstrap required, opened a new log
I20260709 12:27:10.711059 19466 ts_tablet_manager.cc:1403] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.010s
I20260709 12:27:10.714428 19466 raft_consensus.cc:359] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.715255 19466 raft_consensus.cc:385] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:10.715559 19466 raft_consensus.cc:740] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5924eff3e27946ee95859aa91a310ac3, State: Initialized, Role: FOLLOWER
I20260709 12:27:10.716630 19466 consensus_queue.cc:260] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.719696 19467 tablet_bootstrap.cc:492] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c: No bootstrap required, opened a new log
I20260709 12:27:10.720348 19467 ts_tablet_manager.cc:1403] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c: Time spent bootstrapping tablet: real 0.086s	user 0.017s	sys 0.065s
I20260709 12:27:10.722486 19466 ts_tablet_manager.cc:1434] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:27:10.723747 19466 tablet_bootstrap.cc:492] T 0bd3742c69244d18847d16a933efdcc1 P 5924eff3e27946ee95859aa91a310ac3: Bootstrap starting.
I20260709 12:27:10.723786 19467 raft_consensus.cc:359] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.724727 19467 raft_consensus.cc:385] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:10.725085 19467 raft_consensus.cc:740] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e78a1fe6ea845f5bcd564ad658ec40c, State: Initialized, Role: FOLLOWER
I20260709 12:27:10.725898 19467 consensus_queue.cc:260] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.728307 19467 ts_tablet_manager.cc:1434] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:27:10.729410 19467 tablet_bootstrap.cc:492] T 4831316659774caf9b5a1bac14d279e0 P 0e78a1fe6ea845f5bcd564ad658ec40c: Bootstrap starting.
I20260709 12:27:10.732159 19426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d27567ec64648da953818113fca8920" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "298958962bdd41fe95575d9841ccdc56" is_pre_election: true
I20260709 12:27:10.732954 19468 tablet_bootstrap.cc:492] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56: No bootstrap required, opened a new log
I20260709 12:27:10.733578 19468 ts_tablet_manager.cc:1403] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56: Time spent bootstrapping tablet: real 0.077s	user 0.032s	sys 0.026s
W20260709 12:27:10.734143 19318 leader_election.cc:343] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:10.736155 19277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d27567ec64648da953818113fca8920" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5924eff3e27946ee95859aa91a310ac3" is_pre_election: true
W20260709 12:27:10.738075 19318 leader_election.cc:343] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:10.738586 19318 leader_election.cc:304] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e78a1fe6ea845f5bcd564ad658ec40c; no voters: 298958962bdd41fe95575d9841ccdc56, 5924eff3e27946ee95859aa91a310ac3
I20260709 12:27:10.739147 19466 tablet_bootstrap.cc:654] T 0bd3742c69244d18847d16a933efdcc1 P 5924eff3e27946ee95859aa91a310ac3: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:10.739435 19474 raft_consensus.cc:2749] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:10.736515 19467 tablet_bootstrap.cc:654] T 4831316659774caf9b5a1bac14d279e0 P 0e78a1fe6ea845f5bcd564ad658ec40c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:10.739461 19468 raft_consensus.cc:359] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } }
I20260709 12:27:10.741523 19468 raft_consensus.cc:385] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:10.741829 19468 raft_consensus.cc:740] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 298958962bdd41fe95575d9841ccdc56, State: Initialized, Role: FOLLOWER
I20260709 12:27:10.743008 19468 consensus_queue.cc:260] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } }
I20260709 12:27:10.746153 19468 ts_tablet_manager.cc:1434] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 12:27:10.749428 19468 tablet_bootstrap.cc:492] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 298958962bdd41fe95575d9841ccdc56: Bootstrap starting.
I20260709 12:27:10.756901 19468 tablet_bootstrap.cc:654] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 298958962bdd41fe95575d9841ccdc56: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:10.763895 19466 tablet_bootstrap.cc:492] T 0bd3742c69244d18847d16a933efdcc1 P 5924eff3e27946ee95859aa91a310ac3: No bootstrap required, opened a new log
I20260709 12:27:10.764518 19466 ts_tablet_manager.cc:1403] T 0bd3742c69244d18847d16a933efdcc1 P 5924eff3e27946ee95859aa91a310ac3: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.018s
I20260709 12:27:10.765739 19467 tablet_bootstrap.cc:492] T 4831316659774caf9b5a1bac14d279e0 P 0e78a1fe6ea845f5bcd564ad658ec40c: No bootstrap required, opened a new log
I20260709 12:27:10.766453 19467 ts_tablet_manager.cc:1403] T 4831316659774caf9b5a1bac14d279e0 P 0e78a1fe6ea845f5bcd564ad658ec40c: Time spent bootstrapping tablet: real 0.037s	user 0.023s	sys 0.008s
I20260709 12:27:10.768246 19466 raft_consensus.cc:359] T 0bd3742c69244d18847d16a933efdcc1 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.769179 19466 raft_consensus.cc:385] T 0bd3742c69244d18847d16a933efdcc1 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:10.769582 19466 raft_consensus.cc:740] T 0bd3742c69244d18847d16a933efdcc1 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5924eff3e27946ee95859aa91a310ac3, State: Initialized, Role: FOLLOWER
I20260709 12:27:10.770632 19467 raft_consensus.cc:359] T 4831316659774caf9b5a1bac14d279e0 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.770578 19466 consensus_queue.cc:260] T 0bd3742c69244d18847d16a933efdcc1 P 5924eff3e27946ee95859aa91a310ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.771340 19467 raft_consensus.cc:385] T 4831316659774caf9b5a1bac14d279e0 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:10.771639 19467 raft_consensus.cc:740] T 4831316659774caf9b5a1bac14d279e0 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e78a1fe6ea845f5bcd564ad658ec40c, State: Initialized, Role: FOLLOWER
I20260709 12:27:10.772627 19467 consensus_queue.cc:260] T 4831316659774caf9b5a1bac14d279e0 P 0e78a1fe6ea845f5bcd564ad658ec40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.773097 19468 tablet_bootstrap.cc:492] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 298958962bdd41fe95575d9841ccdc56: No bootstrap required, opened a new log
I20260709 12:27:10.773357 19466 ts_tablet_manager.cc:1434] T 0bd3742c69244d18847d16a933efdcc1 P 5924eff3e27946ee95859aa91a310ac3: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:27:10.773773 19468 ts_tablet_manager.cc:1403] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 298958962bdd41fe95575d9841ccdc56: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.008s
I20260709 12:27:10.774502 19466 tablet_bootstrap.cc:492] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3: Bootstrap starting.
I20260709 12:27:10.775332 19467 ts_tablet_manager.cc:1434] T 4831316659774caf9b5a1bac14d279e0 P 0e78a1fe6ea845f5bcd564ad658ec40c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:27:10.776456 19467 tablet_bootstrap.cc:492] T b7c87e92594d479988a81bd758077e6d P 0e78a1fe6ea845f5bcd564ad658ec40c: Bootstrap starting.
I20260709 12:27:10.776994 19468 raft_consensus.cc:359] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.777807 19468 raft_consensus.cc:385] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:10.778138 19468 raft_consensus.cc:740] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 298958962bdd41fe95575d9841ccdc56, State: Initialized, Role: FOLLOWER
I20260709 12:27:10.778985 19468 consensus_queue.cc:260] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 298958962bdd41fe95575d9841ccdc56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.781445 19468 ts_tablet_manager.cc:1434] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 298958962bdd41fe95575d9841ccdc56: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:27:10.781776 19466 tablet_bootstrap.cc:654] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:10.783696 19467 tablet_bootstrap.cc:654] T b7c87e92594d479988a81bd758077e6d P 0e78a1fe6ea845f5bcd564ad658ec40c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:10.785032 19468 tablet_bootstrap.cc:492] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56: Bootstrap starting.
I20260709 12:27:10.788489 19474 raft_consensus.cc:493] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.789134 19474 raft_consensus.cc:515] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.791359 19474 leader_election.cc:290] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685)
I20260709 12:27:10.792778 19468 tablet_bootstrap.cc:654] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:10.794979 19277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4072c2eca5ff4c9fa4fceaa513e8f5ad" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5924eff3e27946ee95859aa91a310ac3" is_pre_election: true
I20260709 12:27:10.796850 19466 tablet_bootstrap.cc:492] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3: No bootstrap required, opened a new log
I20260709 12:27:10.796790 19426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4072c2eca5ff4c9fa4fceaa513e8f5ad" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "298958962bdd41fe95575d9841ccdc56" is_pre_election: true
I20260709 12:27:10.797312 19475 raft_consensus.cc:493] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.797644 19466 ts_tablet_manager.cc:1403] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.005s
I20260709 12:27:10.797639 19426 raft_consensus.cc:2468] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e78a1fe6ea845f5bcd564ad658ec40c in term 0.
I20260709 12:27:10.796788 19467 tablet_bootstrap.cc:492] T b7c87e92594d479988a81bd758077e6d P 0e78a1fe6ea845f5bcd564ad658ec40c: No bootstrap required, opened a new log
I20260709 12:27:10.799226 19470 raft_consensus.cc:493] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.799748 19470 raft_consensus.cc:515] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.800719 19318 leader_election.cc:304] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 298958962bdd41fe95575d9841ccdc56; no voters: 
I20260709 12:27:10.802016 19474 raft_consensus.cc:2804] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:10.802423 19474 raft_consensus.cc:493] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.802920 19474 raft_consensus.cc:3060] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:10.802801 19318 leader_election.cc:343] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:10.808230 19470 leader_election.cc:290] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315)
I20260709 12:27:10.803241 19475 raft_consensus.cc:515] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.811673 19475 leader_election.cc:290] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315), 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685)
I20260709 12:27:10.812211 19474 raft_consensus.cc:515] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.802395 19466 raft_consensus.cc:359] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.814998 19466 raft_consensus.cc:385] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:10.815348 19466 raft_consensus.cc:740] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5924eff3e27946ee95859aa91a310ac3, State: Initialized, Role: FOLLOWER
I20260709 12:27:10.816387 19470 raft_consensus.cc:493] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.816434 19466 consensus_queue.cc:260] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.817016 19470 raft_consensus.cc:515] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.821286 19470 leader_election.cc:290] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315)
I20260709 12:27:10.798719 19467 ts_tablet_manager.cc:1403] T b7c87e92594d479988a81bd758077e6d P 0e78a1fe6ea845f5bcd564ad658ec40c: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.000s
I20260709 12:27:10.821352 19277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4072c2eca5ff4c9fa4fceaa513e8f5ad" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5924eff3e27946ee95859aa91a310ac3"
W20260709 12:27:10.823654 19318 leader_election.cc:343] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:10.826213 19426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4072c2eca5ff4c9fa4fceaa513e8f5ad" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "298958962bdd41fe95575d9841ccdc56"
I20260709 12:27:10.827039 19426 raft_consensus.cc:3060] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:10.827643 19467 raft_consensus.cc:359] T b7c87e92594d479988a81bd758077e6d P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.835000 19467 raft_consensus.cc:385] T b7c87e92594d479988a81bd758077e6d P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:10.835427 19467 raft_consensus.cc:740] T b7c87e92594d479988a81bd758077e6d P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e78a1fe6ea845f5bcd564ad658ec40c, State: Initialized, Role: FOLLOWER
I20260709 12:27:10.837572 19474 leader_election.cc:290] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 1 election: Requested vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685)
I20260709 12:27:10.837736 19467 consensus_queue.cc:260] T b7c87e92594d479988a81bd758077e6d P 0e78a1fe6ea845f5bcd564ad658ec40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.836686 19426 raft_consensus.cc:2468] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e78a1fe6ea845f5bcd564ad658ec40c in term 1.
I20260709 12:27:10.824095 19466 ts_tablet_manager.cc:1434] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:27:10.843218 19466 tablet_bootstrap.cc:492] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3: Bootstrap starting.
I20260709 12:27:10.845661 19470 raft_consensus.cc:493] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.845888 19468 tablet_bootstrap.cc:492] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56: No bootstrap required, opened a new log
I20260709 12:27:10.846580 19468 ts_tablet_manager.cc:1403] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56: Time spent bootstrapping tablet: real 0.062s	user 0.023s	sys 0.036s
I20260709 12:27:10.846354 19470 raft_consensus.cc:515] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } }
I20260709 12:27:10.848546 19318 leader_election.cc:304] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 298958962bdd41fe95575d9841ccdc56; no voters: 5924eff3e27946ee95859aa91a310ac3
W20260709 12:27:10.850545 19223 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:10.848735 19470 leader_election.cc:290] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315), 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521)
I20260709 12:27:10.851318 19468 raft_consensus.cc:359] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.853346 19474 raft_consensus.cc:2804] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:10.852144 19468 raft_consensus.cc:385] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:10.855242 19468 raft_consensus.cc:740] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 298958962bdd41fe95575d9841ccdc56, State: Initialized, Role: FOLLOWER
I20260709 12:27:10.853901 19474 raft_consensus.cc:697] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 LEADER]: Becoming Leader. State: Replica: 0e78a1fe6ea845f5bcd564ad658ec40c, State: Running, Role: LEADER
I20260709 12:27:10.856616 19474 consensus_queue.cc:237] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.857177 19468 consensus_queue.cc:260] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.860397 19466 tablet_bootstrap.cc:654] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:10.863375 19468 ts_tablet_manager.cc:1434] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:27:10.864670 19468 tablet_bootstrap.cc:492] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56: Bootstrap starting.
I20260709 12:27:10.869639 19426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4831316659774caf9b5a1bac14d279e0" candidate_uuid: "5924eff3e27946ee95859aa91a310ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "298958962bdd41fe95575d9841ccdc56" is_pre_election: true
I20260709 12:27:10.870458 19426 raft_consensus.cc:2468] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5924eff3e27946ee95859aa91a310ac3 in term 0.
I20260709 12:27:10.872392 19243 leader_election.cc:304] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 298958962bdd41fe95575d9841ccdc56, 5924eff3e27946ee95859aa91a310ac3; no voters: 
I20260709 12:27:10.872989 19470 raft_consensus.cc:493] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.873546 19470 raft_consensus.cc:515] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.875733 19470 leader_election.cc:290] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315)
I20260709 12:27:10.876091 19466 tablet_bootstrap.cc:492] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3: No bootstrap required, opened a new log
I20260709 12:27:10.876667 19466 ts_tablet_manager.cc:1403] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.000s
I20260709 12:27:10.878433 19468 tablet_bootstrap.cc:654] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:10.879895 19466 raft_consensus.cc:359] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.880716 19466 raft_consensus.cc:385] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:10.881016 19466 raft_consensus.cc:740] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5924eff3e27946ee95859aa91a310ac3, State: Initialized, Role: FOLLOWER
I20260709 12:27:10.882557 19277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c87e92594d479988a81bd758077e6d" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5924eff3e27946ee95859aa91a310ac3" is_pre_election: true
I20260709 12:27:10.882589 19475 raft_consensus.cc:2804] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:10.883944 19352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4831316659774caf9b5a1bac14d279e0" candidate_uuid: "5924eff3e27946ee95859aa91a310ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" is_pre_election: true
I20260709 12:27:10.884876 19352 raft_consensus.cc:2468] T 4831316659774caf9b5a1bac14d279e0 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5924eff3e27946ee95859aa91a310ac3 in term 0.
W20260709 12:27:10.885878 19392 leader_election.cc:343] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:10.882781 19467 ts_tablet_manager.cc:1434] T b7c87e92594d479988a81bd758077e6d P 0e78a1fe6ea845f5bcd564ad658ec40c: Time spent starting tablet: real 0.058s	user 0.011s	sys 0.011s
I20260709 12:27:10.886299 19276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4831316659774caf9b5a1bac14d279e0" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5924eff3e27946ee95859aa91a310ac3" is_pre_election: true
I20260709 12:27:10.887008 19475 raft_consensus.cc:493] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.887514 19475 raft_consensus.cc:3060] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:10.887681 19275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d27567ec64648da953818113fca8920" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5924eff3e27946ee95859aa91a310ac3" is_pre_election: true
I20260709 12:27:10.889314 19274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c9c4b10c8144a089d4a67b3bc2d167" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5924eff3e27946ee95859aa91a310ac3" is_pre_election: true
I20260709 12:27:10.890069 19274 raft_consensus.cc:2468] T 35c9c4b10c8144a089d4a67b3bc2d167 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 298958962bdd41fe95575d9841ccdc56 in term 0.
I20260709 12:27:10.890974 19467 tablet_bootstrap.cc:492] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c: Bootstrap starting.
W20260709 12:27:10.891999 19392 leader_election.cc:343] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:10.897377 19392 leader_election.cc:304] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 298958962bdd41fe95575d9841ccdc56, 5924eff3e27946ee95859aa91a310ac3; no voters: 
I20260709 12:27:10.898386 19470 raft_consensus.cc:2804] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:10.898784 19470 raft_consensus.cc:493] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.899147 19470 raft_consensus.cc:3060] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:10.900297 19475 raft_consensus.cc:515] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.900259 19467 tablet_bootstrap.cc:654] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:10.905314 19276 raft_consensus.cc:2393] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 298958962bdd41fe95575d9841ccdc56 in current term 1: Already voted for candidate 5924eff3e27946ee95859aa91a310ac3 in this term.
I20260709 12:27:10.896441 19175 catalog_manager.cc:5697] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194). New cstate: current_term: 1 leader_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:10.909976 19351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4831316659774caf9b5a1bac14d279e0" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" is_pre_election: true
I20260709 12:27:10.910483 19352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c87e92594d479988a81bd758077e6d" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" is_pre_election: true
I20260709 12:27:10.910820 19351 raft_consensus.cc:2468] T 4831316659774caf9b5a1bac14d279e0 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 298958962bdd41fe95575d9841ccdc56 in term 0.
I20260709 12:27:10.908643 19468 tablet_bootstrap.cc:492] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56: No bootstrap required, opened a new log
I20260709 12:27:10.911732 19350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d27567ec64648da953818113fca8920" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" is_pre_election: true
I20260709 12:27:10.912112 19468 ts_tablet_manager.cc:1403] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.020s
I20260709 12:27:10.911168 19352 raft_consensus.cc:2468] T b7c87e92594d479988a81bd758077e6d P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 298958962bdd41fe95575d9841ccdc56 in term 0.
I20260709 12:27:10.913139 19470 raft_consensus.cc:515] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.914151 19352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c9c4b10c8144a089d4a67b3bc2d167" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" is_pre_election: true
I20260709 12:27:10.881817 19466 consensus_queue.cc:260] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.915503 19392 leader_election.cc:304] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 298958962bdd41fe95575d9841ccdc56; no voters: 
I20260709 12:27:10.915622 19468 raft_consensus.cc:359] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.916427 19468 raft_consensus.cc:385] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:10.917006 19350 raft_consensus.cc:2468] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 298958962bdd41fe95575d9841ccdc56 in term 0.
I20260709 12:27:10.916957 19499 raft_consensus.cc:493] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.918615 19499 raft_consensus.cc:515] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.919891 19470 leader_election.cc:290] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 election: Requested vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315)
I20260709 12:27:10.920660 19470 raft_consensus.cc:2804] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:10.924239 19470 raft_consensus.cc:493] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.924618 19470 raft_consensus.cc:3060] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:10.924739 19466 ts_tablet_manager.cc:1434] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3: Time spent starting tablet: real 0.048s	user 0.010s	sys 0.000s
I20260709 12:27:10.922072 19392 leader_election.cc:304] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 298958962bdd41fe95575d9841ccdc56; no voters: 5924eff3e27946ee95859aa91a310ac3
I20260709 12:27:10.925259 19467 tablet_bootstrap.cc:492] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c: No bootstrap required, opened a new log
I20260709 12:27:10.916740 19468 raft_consensus.cc:740] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 298958962bdd41fe95575d9841ccdc56, State: Initialized, Role: FOLLOWER
I20260709 12:27:10.923485 19426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4831316659774caf9b5a1bac14d279e0" candidate_uuid: "5924eff3e27946ee95859aa91a310ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "298958962bdd41fe95575d9841ccdc56"
I20260709 12:27:10.926324 19467 ts_tablet_manager.cc:1403] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c: Time spent bootstrapping tablet: real 0.036s	user 0.019s	sys 0.009s
I20260709 12:27:10.926599 19468 consensus_queue.cc:260] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
W20260709 12:27:10.927314 19392 leader_election.cc:343] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:10.928392 19392 leader_election.cc:304] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 298958962bdd41fe95575d9841ccdc56; no voters: 5924eff3e27946ee95859aa91a310ac3
I20260709 12:27:10.929340 19502 raft_consensus.cc:2804] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:10.923825 19350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4831316659774caf9b5a1bac14d279e0" candidate_uuid: "5924eff3e27946ee95859aa91a310ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
I20260709 12:27:10.929948 19467 raft_consensus.cc:359] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.930632 19350 raft_consensus.cc:3060] T 4831316659774caf9b5a1bac14d279e0 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:10.930919 19467 raft_consensus.cc:385] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:10.931367 19467 raft_consensus.cc:740] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e78a1fe6ea845f5bcd564ad658ec40c, State: Initialized, Role: FOLLOWER
I20260709 12:27:10.932268 19467 consensus_queue.cc:260] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.929862 19502 raft_consensus.cc:493] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.921661 19475 leader_election.cc:290] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3 [CANDIDATE]: Term 1 election: Requested vote from peers 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315), 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685)
I20260709 12:27:10.934314 19502 raft_consensus.cc:3060] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:10.935459 19467 ts_tablet_manager.cc:1434] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:27:10.936729 19467 tablet_bootstrap.cc:492] T 35c9c4b10c8144a089d4a67b3bc2d167 P 0e78a1fe6ea845f5bcd564ad658ec40c: Bootstrap starting.
I20260709 12:27:10.938884 19475 raft_consensus.cc:493] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.939546 19475 raft_consensus.cc:515] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.941146 19466 tablet_bootstrap.cc:492] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3: Bootstrap starting.
I20260709 12:27:10.943027 19352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdc52ff09ec40c582ff078f8d61029f" candidate_uuid: "5924eff3e27946ee95859aa91a310ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" is_pre_election: true
I20260709 12:27:10.944180 19467 tablet_bootstrap.cc:654] T 35c9c4b10c8144a089d4a67b3bc2d167 P 0e78a1fe6ea845f5bcd564ad658ec40c: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:10.944999 19243 leader_election.cc:343] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:10.947947 19425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdc52ff09ec40c582ff078f8d61029f" candidate_uuid: "5924eff3e27946ee95859aa91a310ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "298958962bdd41fe95575d9841ccdc56" is_pre_election: true
I20260709 12:27:10.948235 19475 leader_election.cc:290] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315), 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685)
W20260709 12:27:10.949685 19243 leader_election.cc:343] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:10.950291 19243 leader_election.cc:304] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5924eff3e27946ee95859aa91a310ac3; no voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 298958962bdd41fe95575d9841ccdc56
I20260709 12:27:10.952589 19350 raft_consensus.cc:2468] T 4831316659774caf9b5a1bac14d279e0 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5924eff3e27946ee95859aa91a310ac3 in term 1.
I20260709 12:27:10.920948 19499 leader_election.cc:290] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315)
I20260709 12:27:10.958362 19499 raft_consensus.cc:2804] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:10.958567 19475 raft_consensus.cc:2749] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:10.958912 19499 raft_consensus.cc:493] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.959424 19499 raft_consensus.cc:3060] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:10.965674 19243 leader_election.cc:304] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 5924eff3e27946ee95859aa91a310ac3; no voters: 
I20260709 12:27:10.966939 19475 raft_consensus.cc:2804] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:10.968636 19475 raft_consensus.cc:697] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3 [term 1 LEADER]: Becoming Leader. State: Replica: 5924eff3e27946ee95859aa91a310ac3, State: Running, Role: LEADER
I20260709 12:27:10.969610 19501 raft_consensus.cc:493] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.970342 19501 raft_consensus.cc:515] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.974388 19501 leader_election.cc:290] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315), 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685)
I20260709 12:27:10.976552 19350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba07e5f1b5f14036bd2155d3e47e008a" candidate_uuid: "5924eff3e27946ee95859aa91a310ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" is_pre_election: true
I20260709 12:27:10.977223 19425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba07e5f1b5f14036bd2155d3e47e008a" candidate_uuid: "5924eff3e27946ee95859aa91a310ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "298958962bdd41fe95575d9841ccdc56" is_pre_election: true
W20260709 12:27:10.979256 19243 leader_election.cc:343] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:10.980145 19243 leader_election.cc:343] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:10.980587 19243 leader_election.cc:304] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5924eff3e27946ee95859aa91a310ac3; no voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 298958962bdd41fe95575d9841ccdc56
I20260709 12:27:10.981935 19501 raft_consensus.cc:2749] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:10.983628 19475 consensus_queue.cc:237] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
W20260709 12:27:10.994625 19392 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:45315, user_credentials={real_user=slave}} blocked reactor thread for 66320.4us
I20260709 12:27:10.996944 19502 raft_consensus.cc:515] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:10.997656 19276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c9c4b10c8144a089d4a67b3bc2d167" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5924eff3e27946ee95859aa91a310ac3"
I20260709 12:27:10.998596 19276 raft_consensus.cc:3060] T 35c9c4b10c8144a089d4a67b3bc2d167 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:11.003113 19466 tablet_bootstrap.cc:654] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:11.009878 19350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c9c4b10c8144a089d4a67b3bc2d167" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
I20260709 12:27:11.010571 19274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd3742c69244d18847d16a933efdcc1" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5924eff3e27946ee95859aa91a310ac3" is_pre_election: true
I20260709 12:27:11.011384 19274 raft_consensus.cc:2468] T 0bd3742c69244d18847d16a933efdcc1 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 298958962bdd41fe95575d9841ccdc56 in term 0.
I20260709 12:27:10.993647 19499 raft_consensus.cc:515] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } }
I20260709 12:27:11.012966 19392 leader_election.cc:304] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 298958962bdd41fe95575d9841ccdc56, 5924eff3e27946ee95859aa91a310ac3; no voters: 
I20260709 12:27:11.011430 19352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd3742c69244d18847d16a933efdcc1" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" is_pre_election: true
I20260709 12:27:11.021663 19502 leader_election.cc:290] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 election: Requested vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315)
W20260709 12:27:11.022677 19392 leader_election.cc:343] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:11.023468 19392 leader_election.cc:343] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:11.026476 19274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c87e92594d479988a81bd758077e6d" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5924eff3e27946ee95859aa91a310ac3"
I20260709 12:27:11.026957 19468 ts_tablet_manager.cc:1434] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56: Time spent starting tablet: real 0.114s	user 0.051s	sys 0.045s
I20260709 12:27:11.028131 19172 catalog_manager.cc:5697] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193). New cstate: current_term: 1 leader_uuid: "5924eff3e27946ee95859aa91a310ac3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:11.028800 19468 tablet_bootstrap.cc:492] T 8cdc52ff09ec40c582ff078f8d61029f P 298958962bdd41fe95575d9841ccdc56: Bootstrap starting.
I20260709 12:27:11.032984 19470 raft_consensus.cc:515] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.034320 19426 raft_consensus.cc:2393] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5924eff3e27946ee95859aa91a310ac3 in current term 1: Already voted for candidate 298958962bdd41fe95575d9841ccdc56 in this term.
I20260709 12:27:11.038390 19470 leader_election.cc:290] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 election: Requested vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315)
I20260709 12:27:11.039124 19504 raft_consensus.cc:2804] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:11.039649 19504 raft_consensus.cc:493] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.040026 19504 raft_consensus.cc:3060] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:11.040544 19467 tablet_bootstrap.cc:492] T 35c9c4b10c8144a089d4a67b3bc2d167 P 0e78a1fe6ea845f5bcd564ad658ec40c: No bootstrap required, opened a new log
I20260709 12:27:11.041517 19467 ts_tablet_manager.cc:1403] T 35c9c4b10c8144a089d4a67b3bc2d167 P 0e78a1fe6ea845f5bcd564ad658ec40c: Time spent bootstrapping tablet: real 0.105s	user 0.031s	sys 0.039s
I20260709 12:27:11.042368 19468 tablet_bootstrap.cc:654] T 8cdc52ff09ec40c582ff078f8d61029f P 298958962bdd41fe95575d9841ccdc56: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:11.043383 19499 leader_election.cc:290] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 election: Requested vote from peers 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315), 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521)
I20260709 12:27:11.045799 19352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c87e92594d479988a81bd758077e6d" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
I20260709 12:27:11.046619 19352 raft_consensus.cc:3060] T b7c87e92594d479988a81bd758077e6d P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:11.048581 19467 raft_consensus.cc:359] T 35c9c4b10c8144a089d4a67b3bc2d167 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.055337 19274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4831316659774caf9b5a1bac14d279e0" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5924eff3e27946ee95859aa91a310ac3"
I20260709 12:27:11.053840 19467 raft_consensus.cc:385] T 35c9c4b10c8144a089d4a67b3bc2d167 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:11.056996 19467 raft_consensus.cc:740] T 35c9c4b10c8144a089d4a67b3bc2d167 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e78a1fe6ea845f5bcd564ad658ec40c, State: Initialized, Role: FOLLOWER
I20260709 12:27:11.053859 19276 raft_consensus.cc:2468] T 35c9c4b10c8144a089d4a67b3bc2d167 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 298958962bdd41fe95575d9841ccdc56 in term 1.
I20260709 12:27:11.059490 19350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4831316659774caf9b5a1bac14d279e0" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
I20260709 12:27:11.060268 19350 raft_consensus.cc:2393] T 4831316659774caf9b5a1bac14d279e0 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 298958962bdd41fe95575d9841ccdc56 in current term 1: Already voted for candidate 5924eff3e27946ee95859aa91a310ac3 in this term.
I20260709 12:27:11.061375 19467 consensus_queue.cc:260] T 35c9c4b10c8144a089d4a67b3bc2d167 P 0e78a1fe6ea845f5bcd564ad658ec40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.062999 19350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d27567ec64648da953818113fca8920" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
I20260709 12:27:11.063652 19350 raft_consensus.cc:3060] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:11.063982 19467 ts_tablet_manager.cc:1434] T 35c9c4b10c8144a089d4a67b3bc2d167 P 0e78a1fe6ea845f5bcd564ad658ec40c: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.004s
I20260709 12:27:11.065126 19467 tablet_bootstrap.cc:492] T 0bd3742c69244d18847d16a933efdcc1 P 0e78a1fe6ea845f5bcd564ad658ec40c: Bootstrap starting.
I20260709 12:27:11.071413 19274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d27567ec64648da953818113fca8920" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5924eff3e27946ee95859aa91a310ac3"
I20260709 12:27:11.071734 19352 raft_consensus.cc:2468] T b7c87e92594d479988a81bd758077e6d P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 298958962bdd41fe95575d9841ccdc56 in term 1.
I20260709 12:27:11.072798 19466 tablet_bootstrap.cc:492] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3: No bootstrap required, opened a new log
I20260709 12:27:11.073381 19466 ts_tablet_manager.cc:1403] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3: Time spent bootstrapping tablet: real 0.133s	user 0.023s	sys 0.019s
W20260709 12:27:11.074653 19392 leader_election.cc:343] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:11.075767 19392 leader_election.cc:304] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 298958962bdd41fe95575d9841ccdc56, 5924eff3e27946ee95859aa91a310ac3; no voters: 0e78a1fe6ea845f5bcd564ad658ec40c
I20260709 12:27:11.076637 19466 raft_consensus.cc:359] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.077440 19466 raft_consensus.cc:385] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:11.077739 19466 raft_consensus.cc:740] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5924eff3e27946ee95859aa91a310ac3, State: Initialized, Role: FOLLOWER
I20260709 12:27:11.078751 19503 raft_consensus.cc:2804] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:11.078584 19466 consensus_queue.cc:260] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.081090 19466 ts_tablet_manager.cc:1434] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:27:11.079332 19503 raft_consensus.cc:697] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [term 1 LEADER]: Becoming Leader. State: Replica: 298958962bdd41fe95575d9841ccdc56, State: Running, Role: LEADER
I20260709 12:27:11.082836 19503 consensus_queue.cc:237] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.083681 19467 tablet_bootstrap.cc:654] T 0bd3742c69244d18847d16a933efdcc1 P 0e78a1fe6ea845f5bcd564ad658ec40c: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:11.087883 19392 leader_election.cc:343] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:11.089385 19392 leader_election.cc:304] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 298958962bdd41fe95575d9841ccdc56; no voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 5924eff3e27946ee95859aa91a310ac3
I20260709 12:27:11.090268 19466 tablet_bootstrap.cc:492] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3: Bootstrap starting.
I20260709 12:27:11.096283 19350 raft_consensus.cc:2468] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 298958962bdd41fe95575d9841ccdc56 in term 1.
I20260709 12:27:11.077967 19504 raft_consensus.cc:515] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.099994 19504 leader_election.cc:290] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 election: Requested vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315)
I20260709 12:27:11.106765 19504 raft_consensus.cc:2749] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:11.104023 19392 leader_election.cc:304] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 298958962bdd41fe95575d9841ccdc56; no voters: 5924eff3e27946ee95859aa91a310ac3
I20260709 12:27:11.110798 19475 raft_consensus.cc:493] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.111375 19475 raft_consensus.cc:515] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.113222 19466 tablet_bootstrap.cc:654] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:11.113674 19475 leader_election.cc:290] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315), 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685)
I20260709 12:27:11.110862 19503 raft_consensus.cc:2804] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:11.114717 19503 raft_consensus.cc:697] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [term 1 LEADER]: Becoming Leader. State: Replica: 298958962bdd41fe95575d9841ccdc56, State: Running, Role: LEADER
I20260709 12:27:11.115097 19426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cbe0f5cc0a42fcb50365c0ce355c71" candidate_uuid: "5924eff3e27946ee95859aa91a310ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "298958962bdd41fe95575d9841ccdc56" is_pre_election: true
I20260709 12:27:11.115813 19426 raft_consensus.cc:2468] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5924eff3e27946ee95859aa91a310ac3 in term 0.
I20260709 12:27:11.115618 19503 consensus_queue.cc:237] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.116070 19350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cbe0f5cc0a42fcb50365c0ce355c71" candidate_uuid: "5924eff3e27946ee95859aa91a310ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" is_pre_election: true
I20260709 12:27:11.116845 19350 raft_consensus.cc:2468] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5924eff3e27946ee95859aa91a310ac3 in term 0.
I20260709 12:27:11.117362 19243 leader_election.cc:304] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 298958962bdd41fe95575d9841ccdc56, 5924eff3e27946ee95859aa91a310ac3; no voters: 
I20260709 12:27:11.118968 19475 raft_consensus.cc:2804] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:11.119355 19475 raft_consensus.cc:493] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.119670 19468 tablet_bootstrap.cc:492] T 8cdc52ff09ec40c582ff078f8d61029f P 298958962bdd41fe95575d9841ccdc56: No bootstrap required, opened a new log
I20260709 12:27:11.119693 19475 raft_consensus.cc:3060] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:11.120448 19468 ts_tablet_manager.cc:1403] T 8cdc52ff09ec40c582ff078f8d61029f P 298958962bdd41fe95575d9841ccdc56: Time spent bootstrapping tablet: real 0.092s	user 0.036s	sys 0.035s
I20260709 12:27:11.120714 19467 tablet_bootstrap.cc:492] T 0bd3742c69244d18847d16a933efdcc1 P 0e78a1fe6ea845f5bcd564ad658ec40c: No bootstrap required, opened a new log
I20260709 12:27:11.121301 19467 ts_tablet_manager.cc:1403] T 0bd3742c69244d18847d16a933efdcc1 P 0e78a1fe6ea845f5bcd564ad658ec40c: Time spent bootstrapping tablet: real 0.056s	user 0.019s	sys 0.015s
I20260709 12:27:11.111554 19392 leader_election.cc:304] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 298958962bdd41fe95575d9841ccdc56; no voters: 5924eff3e27946ee95859aa91a310ac3
I20260709 12:27:11.123448 19504 raft_consensus.cc:2804] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:11.123786 19468 raft_consensus.cc:359] T 8cdc52ff09ec40c582ff078f8d61029f P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.124599 19468 raft_consensus.cc:385] T 8cdc52ff09ec40c582ff078f8d61029f P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:11.124964 19468 raft_consensus.cc:740] T 8cdc52ff09ec40c582ff078f8d61029f P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 298958962bdd41fe95575d9841ccdc56, State: Initialized, Role: FOLLOWER
I20260709 12:27:11.125898 19468 consensus_queue.cc:260] T 8cdc52ff09ec40c582ff078f8d61029f P 298958962bdd41fe95575d9841ccdc56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.126700 19350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd3742c69244d18847d16a933efdcc1" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
I20260709 12:27:11.123925 19504 raft_consensus.cc:697] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [term 1 LEADER]: Becoming Leader. State: Replica: 298958962bdd41fe95575d9841ccdc56, State: Running, Role: LEADER
I20260709 12:27:11.127704 19475 raft_consensus.cc:515] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.128374 19468 ts_tablet_manager.cc:1434] T 8cdc52ff09ec40c582ff078f8d61029f P 298958962bdd41fe95575d9841ccdc56: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:27:11.124818 19276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd3742c69244d18847d16a933efdcc1" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5924eff3e27946ee95859aa91a310ac3"
I20260709 12:27:11.129101 19276 raft_consensus.cc:3060] T 0bd3742c69244d18847d16a933efdcc1 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:11.129495 19468 tablet_bootstrap.cc:492] T ba07e5f1b5f14036bd2155d3e47e008a P 298958962bdd41fe95575d9841ccdc56: Bootstrap starting.
I20260709 12:27:11.130571 19475 leader_election.cc:290] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [CANDIDATE]: Term 1 election: Requested vote from peers 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315), 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685)
I20260709 12:27:11.132201 19426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cbe0f5cc0a42fcb50365c0ce355c71" candidate_uuid: "5924eff3e27946ee95859aa91a310ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "298958962bdd41fe95575d9841ccdc56"
I20260709 12:27:11.132220 19350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cbe0f5cc0a42fcb50365c0ce355c71" candidate_uuid: "5924eff3e27946ee95859aa91a310ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
I20260709 12:27:11.132954 19426 raft_consensus.cc:3060] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:11.133024 19350 raft_consensus.cc:3060] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:11.128461 19504 consensus_queue.cc:237] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } }
I20260709 12:27:11.135599 19468 tablet_bootstrap.cc:654] T ba07e5f1b5f14036bd2155d3e47e008a P 298958962bdd41fe95575d9841ccdc56: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:11.140270 19276 raft_consensus.cc:2468] T 0bd3742c69244d18847d16a933efdcc1 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 298958962bdd41fe95575d9841ccdc56 in term 1.
I20260709 12:27:11.140671 19350 raft_consensus.cc:2468] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5924eff3e27946ee95859aa91a310ac3 in term 1.
I20260709 12:27:11.142117 19243 leader_election.cc:304] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 5924eff3e27946ee95859aa91a310ac3; no voters: 
I20260709 12:27:11.143447 19392 leader_election.cc:304] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 298958962bdd41fe95575d9841ccdc56, 5924eff3e27946ee95859aa91a310ac3; no voters: 
I20260709 12:27:11.127709 19467 raft_consensus.cc:359] T 0bd3742c69244d18847d16a933efdcc1 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.144238 19467 raft_consensus.cc:385] T 0bd3742c69244d18847d16a933efdcc1 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:11.144348 19503 raft_consensus.cc:2804] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:11.144658 19467 raft_consensus.cc:740] T 0bd3742c69244d18847d16a933efdcc1 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e78a1fe6ea845f5bcd564ad658ec40c, State: Initialized, Role: FOLLOWER
I20260709 12:27:11.145139 19503 raft_consensus.cc:697] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [term 1 LEADER]: Becoming Leader. State: Replica: 298958962bdd41fe95575d9841ccdc56, State: Running, Role: LEADER
I20260709 12:27:11.145244 19475 raft_consensus.cc:2804] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:11.145900 19475 raft_consensus.cc:697] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [term 1 LEADER]: Becoming Leader. State: Replica: 5924eff3e27946ee95859aa91a310ac3, State: Running, Role: LEADER
I20260709 12:27:11.145731 19467 consensus_queue.cc:260] T 0bd3742c69244d18847d16a933efdcc1 P 0e78a1fe6ea845f5bcd564ad658ec40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.146152 19503 consensus_queue.cc:237] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.146934 19475 consensus_queue.cc:237] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.148195 19468 tablet_bootstrap.cc:492] T ba07e5f1b5f14036bd2155d3e47e008a P 298958962bdd41fe95575d9841ccdc56: No bootstrap required, opened a new log
I20260709 12:27:11.148761 19468 ts_tablet_manager.cc:1403] T ba07e5f1b5f14036bd2155d3e47e008a P 298958962bdd41fe95575d9841ccdc56: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 12:27:11.150657 19466 tablet_bootstrap.cc:492] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3: No bootstrap required, opened a new log
I20260709 12:27:11.151255 19466 ts_tablet_manager.cc:1403] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3: Time spent bootstrapping tablet: real 0.069s	user 0.010s	sys 0.005s
I20260709 12:27:11.152022 19468 raft_consensus.cc:359] T ba07e5f1b5f14036bd2155d3e47e008a P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.152962 19468 raft_consensus.cc:385] T ba07e5f1b5f14036bd2155d3e47e008a P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:11.153070 19426 raft_consensus.cc:2468] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5924eff3e27946ee95859aa91a310ac3 in term 1.
I20260709 12:27:11.153254 19468 raft_consensus.cc:740] T ba07e5f1b5f14036bd2155d3e47e008a P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 298958962bdd41fe95575d9841ccdc56, State: Initialized, Role: FOLLOWER
I20260709 12:27:11.154706 19468 consensus_queue.cc:260] T ba07e5f1b5f14036bd2155d3e47e008a P 298958962bdd41fe95575d9841ccdc56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.156891 19468 ts_tablet_manager.cc:1434] T ba07e5f1b5f14036bd2155d3e47e008a P 298958962bdd41fe95575d9841ccdc56: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:27:11.157632 19467 ts_tablet_manager.cc:1434] T 0bd3742c69244d18847d16a933efdcc1 P 0e78a1fe6ea845f5bcd564ad658ec40c: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.005s
I20260709 12:27:11.158255 19468 tablet_bootstrap.cc:492] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56: Bootstrap starting.
W20260709 12:27:11.158747 19392 leader_election.cc:343] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:11.159197 19466 raft_consensus.cc:359] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.159925 19466 raft_consensus.cc:385] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:11.160207 19466 raft_consensus.cc:740] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5924eff3e27946ee95859aa91a310ac3, State: Initialized, Role: FOLLOWER
I20260709 12:27:11.161144 19466 consensus_queue.cc:260] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.163604 19466 ts_tablet_manager.cc:1434] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 12:27:11.164669 19466 tablet_bootstrap.cc:492] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3: Bootstrap starting.
I20260709 12:27:11.164883 19468 tablet_bootstrap.cc:654] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:11.168156 19174 catalog_manager.cc:5697] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 reported cstate change: term changed from 0 to 1, leader changed from <none> to 298958962bdd41fe95575d9841ccdc56 (127.9.145.195). New cstate: current_term: 1 leader_uuid: "298958962bdd41fe95575d9841ccdc56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:11.170671 19174 catalog_manager.cc:5697] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 reported cstate change: term changed from 0 to 1, leader changed from <none> to 298958962bdd41fe95575d9841ccdc56 (127.9.145.195). New cstate: current_term: 1 leader_uuid: "298958962bdd41fe95575d9841ccdc56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:11.174024 19174 catalog_manager.cc:5697] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 reported cstate change: term changed from 0 to 1, leader changed from <none> to 298958962bdd41fe95575d9841ccdc56 (127.9.145.195). New cstate: current_term: 1 leader_uuid: "298958962bdd41fe95575d9841ccdc56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:11.172775 19467 tablet_bootstrap.cc:492] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c: Bootstrap starting.
I20260709 12:27:11.175060 19466 tablet_bootstrap.cc:654] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:11.177652 19468 tablet_bootstrap.cc:492] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56: No bootstrap required, opened a new log
I20260709 12:27:11.176733 19172 catalog_manager.cc:5697] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193). New cstate: current_term: 1 leader_uuid: "5924eff3e27946ee95859aa91a310ac3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:11.178260 19468 ts_tablet_manager.cc:1403] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.006s
I20260709 12:27:11.181288 19468 raft_consensus.cc:359] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.182003 19468 raft_consensus.cc:385] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:11.182314 19468 raft_consensus.cc:740] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 298958962bdd41fe95575d9841ccdc56, State: Initialized, Role: FOLLOWER
I20260709 12:27:11.183612 19468 consensus_queue.cc:260] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.185942 19468 ts_tablet_manager.cc:1434] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:27:11.190382 19467 tablet_bootstrap.cc:654] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:11.195385 19466 tablet_bootstrap.cc:492] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3: No bootstrap required, opened a new log
I20260709 12:27:11.195930 19466 ts_tablet_manager.cc:1403] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.008s
I20260709 12:27:11.198814 19466 raft_consensus.cc:359] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.199532 19466 raft_consensus.cc:385] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:11.199805 19466 raft_consensus.cc:740] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5924eff3e27946ee95859aa91a310ac3, State: Initialized, Role: FOLLOWER
I20260709 12:27:11.200507 19466 consensus_queue.cc:260] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.202620 19466 ts_tablet_manager.cc:1434] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:27:11.203438 19467 tablet_bootstrap.cc:492] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c: No bootstrap required, opened a new log
I20260709 12:27:11.203702 19466 tablet_bootstrap.cc:492] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3: Bootstrap starting.
I20260709 12:27:11.204049 19467 ts_tablet_manager.cc:1403] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.007s
I20260709 12:27:11.205556 19172 catalog_manager.cc:5697] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 reported cstate change: term changed from 0 to 1, leader changed from <none> to 298958962bdd41fe95575d9841ccdc56 (127.9.145.195). New cstate: current_term: 1 leader_uuid: "298958962bdd41fe95575d9841ccdc56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:11.207221 19467 raft_consensus.cc:359] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.207993 19467 raft_consensus.cc:385] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:11.208283 19467 raft_consensus.cc:740] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e78a1fe6ea845f5bcd564ad658ec40c, State: Initialized, Role: FOLLOWER
I20260709 12:27:11.210254 19466 tablet_bootstrap.cc:654] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:11.210319 19467 consensus_queue.cc:260] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.214720 19467 ts_tablet_manager.cc:1434] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:27:11.215816 19467 tablet_bootstrap.cc:492] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c: Bootstrap starting.
I20260709 12:27:11.219295 19475 raft_consensus.cc:493] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.220000 19475 raft_consensus.cc:515] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.221747 19467 tablet_bootstrap.cc:654] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:11.222405 19475 leader_election.cc:290] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315), 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685)
I20260709 12:27:11.225253 19350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4072c2eca5ff4c9fa4fceaa513e8f5ad" candidate_uuid: "5924eff3e27946ee95859aa91a310ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" is_pre_election: true
I20260709 12:27:11.227150 19426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4072c2eca5ff4c9fa4fceaa513e8f5ad" candidate_uuid: "5924eff3e27946ee95859aa91a310ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "298958962bdd41fe95575d9841ccdc56" is_pre_election: true
I20260709 12:27:11.228188 19426 raft_consensus.cc:2393] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5924eff3e27946ee95859aa91a310ac3 in current term 1: Already voted for candidate 0e78a1fe6ea845f5bcd564ad658ec40c in this term.
I20260709 12:27:11.229933 19243 leader_election.cc:304] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5924eff3e27946ee95859aa91a310ac3; no voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 298958962bdd41fe95575d9841ccdc56
I20260709 12:27:11.231508 19466 tablet_bootstrap.cc:492] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3: No bootstrap required, opened a new log
I20260709 12:27:11.232059 19466 ts_tablet_manager.cc:1403] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.008s
I20260709 12:27:11.231616 19475 raft_consensus.cc:3060] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:11.237344 19466 raft_consensus.cc:359] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } }
I20260709 12:27:11.237918 19466 raft_consensus.cc:385] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:11.238196 19466 raft_consensus.cc:740] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5924eff3e27946ee95859aa91a310ac3, State: Initialized, Role: FOLLOWER
I20260709 12:27:11.239408 19466 consensus_queue.cc:260] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } }
I20260709 12:27:11.241547 19466 ts_tablet_manager.cc:1434] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:27:11.241936 19467 tablet_bootstrap.cc:492] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c: No bootstrap required, opened a new log
I20260709 12:27:11.242486 19467 ts_tablet_manager.cc:1403] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.001s
I20260709 12:27:11.245177 19467 raft_consensus.cc:359] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.245877 19467 raft_consensus.cc:385] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:11.246173 19467 raft_consensus.cc:740] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e78a1fe6ea845f5bcd564ad658ec40c, State: Initialized, Role: FOLLOWER
I20260709 12:27:11.246881 19467 consensus_queue.cc:260] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.248620 19467 ts_tablet_manager.cc:1434] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:27:11.249634 19467 tablet_bootstrap.cc:492] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c: Bootstrap starting.
I20260709 12:27:11.252924 19475 raft_consensus.cc:2749] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:11.255043 19467 tablet_bootstrap.cc:654] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:11.259481 19467 tablet_bootstrap.cc:492] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c: No bootstrap required, opened a new log
I20260709 12:27:11.259974 19467 ts_tablet_manager.cc:1403] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:27:11.262171 19503 raft_consensus.cc:493] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.262770 19503 raft_consensus.cc:515] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.262764 19467 raft_consensus.cc:359] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.263696 19467 raft_consensus.cc:385] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:11.263999 19467 raft_consensus.cc:740] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e78a1fe6ea845f5bcd564ad658ec40c, State: Initialized, Role: FOLLOWER
I20260709 12:27:11.264742 19467 consensus_queue.cc:260] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.265183 19503 leader_election.cc:290] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315)
I20260709 12:27:11.266269 19350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52bce4ea207438c9830561dddf50ee6" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" is_pre_election: true
I20260709 12:27:11.266286 19276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52bce4ea207438c9830561dddf50ee6" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5924eff3e27946ee95859aa91a310ac3" is_pre_election: true
I20260709 12:27:11.267087 19350 raft_consensus.cc:2468] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 298958962bdd41fe95575d9841ccdc56 in term 0.
I20260709 12:27:11.267330 19467 ts_tablet_manager.cc:1434] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:27:11.267131 19276 raft_consensus.cc:2468] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 298958962bdd41fe95575d9841ccdc56 in term 0.
I20260709 12:27:11.268584 19392 leader_election.cc:304] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 298958962bdd41fe95575d9841ccdc56, 5924eff3e27946ee95859aa91a310ac3; no voters: 
I20260709 12:27:11.269217 19494 consensus_queue.cc:1048] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:11.270120 19503 raft_consensus.cc:2804] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:11.270569 19503 raft_consensus.cc:493] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.270910 19503 raft_consensus.cc:3060] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:11.279704 19503 raft_consensus.cc:515] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.281890 19503 leader_election.cc:290] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 election: Requested vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315)
I20260709 12:27:11.282954 19350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52bce4ea207438c9830561dddf50ee6" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
I20260709 12:27:11.283458 19276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52bce4ea207438c9830561dddf50ee6" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5924eff3e27946ee95859aa91a310ac3"
I20260709 12:27:11.283666 19350 raft_consensus.cc:3060] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:11.284147 19276 raft_consensus.cc:3060] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:11.291769 19350 raft_consensus.cc:2468] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 298958962bdd41fe95575d9841ccdc56 in term 1.
I20260709 12:27:11.292820 19276 raft_consensus.cc:2468] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 298958962bdd41fe95575d9841ccdc56 in term 1.
I20260709 12:27:11.293227 19392 leader_election.cc:304] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 298958962bdd41fe95575d9841ccdc56; no voters: 
I20260709 12:27:11.294798 19503 raft_consensus.cc:2804] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:11.295548 19503 raft_consensus.cc:697] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 1 LEADER]: Becoming Leader. State: Replica: 298958962bdd41fe95575d9841ccdc56, State: Running, Role: LEADER
I20260709 12:27:11.297297 19503 consensus_queue.cc:237] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.302075 19529 consensus_queue.cc:1048] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:11.307178 19529 raft_consensus.cc:493] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.307736 19529 raft_consensus.cc:515] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.308878 19174 catalog_manager.cc:5697] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 reported cstate change: term changed from 0 to 1, leader changed from <none> to 298958962bdd41fe95575d9841ccdc56 (127.9.145.195). New cstate: current_term: 1 leader_uuid: "298958962bdd41fe95575d9841ccdc56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:11.310999 19274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba07e5f1b5f14036bd2155d3e47e008a" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5924eff3e27946ee95859aa91a310ac3" is_pre_election: true
I20260709 12:27:11.311808 19274 raft_consensus.cc:2468] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e78a1fe6ea845f5bcd564ad658ec40c in term 0.
I20260709 12:27:11.312024 19426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba07e5f1b5f14036bd2155d3e47e008a" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "298958962bdd41fe95575d9841ccdc56" is_pre_election: true
I20260709 12:27:11.312794 19426 raft_consensus.cc:2468] T ba07e5f1b5f14036bd2155d3e47e008a P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e78a1fe6ea845f5bcd564ad658ec40c in term 0.
I20260709 12:27:11.313241 19318 leader_election.cc:304] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 5924eff3e27946ee95859aa91a310ac3; no voters: 
I20260709 12:27:11.313932 19529 leader_election.cc:290] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685)
I20260709 12:27:11.314595 19474 raft_consensus.cc:2804] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:11.315044 19474 raft_consensus.cc:493] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.315394 19474 raft_consensus.cc:3060] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:11.323256 19474 raft_consensus.cc:515] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.325428 19474 leader_election.cc:290] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 1 election: Requested vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685)
I20260709 12:27:11.326584 19426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba07e5f1b5f14036bd2155d3e47e008a" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "298958962bdd41fe95575d9841ccdc56"
I20260709 12:27:11.327075 19276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba07e5f1b5f14036bd2155d3e47e008a" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5924eff3e27946ee95859aa91a310ac3"
I20260709 12:27:11.327349 19426 raft_consensus.cc:3060] T ba07e5f1b5f14036bd2155d3e47e008a P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:11.327795 19276 raft_consensus.cc:3060] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:11.335103 19426 raft_consensus.cc:2468] T ba07e5f1b5f14036bd2155d3e47e008a P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e78a1fe6ea845f5bcd564ad658ec40c in term 1.
I20260709 12:27:11.335103 19276 raft_consensus.cc:2468] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e78a1fe6ea845f5bcd564ad658ec40c in term 1.
I20260709 12:27:11.336622 19318 leader_election.cc:304] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 5924eff3e27946ee95859aa91a310ac3; no voters: 
I20260709 12:27:11.337422 19474 raft_consensus.cc:2804] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:11.337949 19474 raft_consensus.cc:697] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 LEADER]: Becoming Leader. State: Replica: 0e78a1fe6ea845f5bcd564ad658ec40c, State: Running, Role: LEADER
I20260709 12:27:11.338711 19474 consensus_queue.cc:237] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.347175 19171 catalog_manager.cc:5697] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194). New cstate: current_term: 1 leader_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:11.378018 19474 raft_consensus.cc:493] T 35c9c4b10c8144a089d4a67b3bc2d167 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.378545 19474 raft_consensus.cc:515] T 35c9c4b10c8144a089d4a67b3bc2d167 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.379657 19475 raft_consensus.cc:493] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.380215 19475 raft_consensus.cc:515] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } }
I20260709 12:27:11.380681 19474 leader_election.cc:290] T 35c9c4b10c8144a089d4a67b3bc2d167 P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685)
I20260709 12:27:11.381485 19276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c9c4b10c8144a089d4a67b3bc2d167" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5924eff3e27946ee95859aa91a310ac3" is_pre_election: true
I20260709 12:27:11.381892 19426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c9c4b10c8144a089d4a67b3bc2d167" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "298958962bdd41fe95575d9841ccdc56" is_pre_election: true
I20260709 12:27:11.382231 19475 leader_election.cc:290] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685), 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315)
I20260709 12:27:11.382380 19276 raft_consensus.cc:2393] T 35c9c4b10c8144a089d4a67b3bc2d167 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0e78a1fe6ea845f5bcd564ad658ec40c in current term 1: Already voted for candidate 298958962bdd41fe95575d9841ccdc56 in this term.
I20260709 12:27:11.383352 19425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d27567ec64648da953818113fca8920" candidate_uuid: "5924eff3e27946ee95859aa91a310ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "298958962bdd41fe95575d9841ccdc56" is_pre_election: true
I20260709 12:27:11.383442 19350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d27567ec64648da953818113fca8920" candidate_uuid: "5924eff3e27946ee95859aa91a310ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" is_pre_election: true
I20260709 12:27:11.384261 19350 raft_consensus.cc:2393] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5924eff3e27946ee95859aa91a310ac3 in current term 1: Already voted for candidate 298958962bdd41fe95575d9841ccdc56 in this term.
I20260709 12:27:11.384193 19318 leader_election.cc:304] T 35c9c4b10c8144a089d4a67b3bc2d167 P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e78a1fe6ea845f5bcd564ad658ec40c; no voters: 298958962bdd41fe95575d9841ccdc56, 5924eff3e27946ee95859aa91a310ac3
I20260709 12:27:11.385244 19474 raft_consensus.cc:3060] T 35c9c4b10c8144a089d4a67b3bc2d167 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:11.385390 19475 raft_consensus.cc:493] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.385653 19243 leader_election.cc:304] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5924eff3e27946ee95859aa91a310ac3; no voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 298958962bdd41fe95575d9841ccdc56
I20260709 12:27:11.385959 19475 raft_consensus.cc:515] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.386448 19501 raft_consensus.cc:3060] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:11.388244 19475 leader_election.cc:290] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315), 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685)
I20260709 12:27:11.389240 19350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c87e92594d479988a81bd758077e6d" candidate_uuid: "5924eff3e27946ee95859aa91a310ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" is_pre_election: true
I20260709 12:27:11.390172 19350 raft_consensus.cc:2393] T b7c87e92594d479988a81bd758077e6d P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5924eff3e27946ee95859aa91a310ac3 in current term 1: Already voted for candidate 298958962bdd41fe95575d9841ccdc56 in this term.
I20260709 12:27:11.390331 19425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c87e92594d479988a81bd758077e6d" candidate_uuid: "5924eff3e27946ee95859aa91a310ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "298958962bdd41fe95575d9841ccdc56" is_pre_election: true
I20260709 12:27:11.392462 19243 leader_election.cc:304] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5924eff3e27946ee95859aa91a310ac3; no voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 298958962bdd41fe95575d9841ccdc56
I20260709 12:27:11.392942 19474 raft_consensus.cc:2749] T 35c9c4b10c8144a089d4a67b3bc2d167 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:11.393803 19475 raft_consensus.cc:3060] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:11.394382 19501 raft_consensus.cc:2749] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:11.399552 19475 raft_consensus.cc:2749] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:11.460070 19474 raft_consensus.cc:493] T 0bd3742c69244d18847d16a933efdcc1 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.460649 19474 raft_consensus.cc:515] T 0bd3742c69244d18847d16a933efdcc1 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.462469 19474 leader_election.cc:290] T 0bd3742c69244d18847d16a933efdcc1 P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685)
I20260709 12:27:11.463335 19276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd3742c69244d18847d16a933efdcc1" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5924eff3e27946ee95859aa91a310ac3" is_pre_election: true
I20260709 12:27:11.463548 19425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd3742c69244d18847d16a933efdcc1" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "298958962bdd41fe95575d9841ccdc56" is_pre_election: true
I20260709 12:27:11.464066 19276 raft_consensus.cc:2393] T 0bd3742c69244d18847d16a933efdcc1 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0e78a1fe6ea845f5bcd564ad658ec40c in current term 1: Already voted for candidate 298958962bdd41fe95575d9841ccdc56 in this term.
I20260709 12:27:11.465168 19318 leader_election.cc:304] T 0bd3742c69244d18847d16a933efdcc1 P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e78a1fe6ea845f5bcd564ad658ec40c; no voters: 298958962bdd41fe95575d9841ccdc56, 5924eff3e27946ee95859aa91a310ac3
I20260709 12:27:11.465870 19474 raft_consensus.cc:3060] T 0bd3742c69244d18847d16a933efdcc1 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:11.471312 19474 raft_consensus.cc:2749] T 0bd3742c69244d18847d16a933efdcc1 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:11.508574 19475 consensus_queue.cc:1048] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:11.519593 19475 consensus_queue.cc:1048] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:11.523932 19503 consensus_queue.cc:1048] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:11.540503 19470 consensus_queue.cc:1048] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:11.574874 19470 consensus_queue.cc:1048] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:11.585808 19499 consensus_queue.cc:1048] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:11.587698 19474 raft_consensus.cc:493] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.588317 19474 raft_consensus.cc:515] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.590494 19474 leader_election.cc:290] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685)
I20260709 12:27:11.592365 19274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdc52ff09ec40c582ff078f8d61029f" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5924eff3e27946ee95859aa91a310ac3" is_pre_election: true
I20260709 12:27:11.593137 19274 raft_consensus.cc:2468] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e78a1fe6ea845f5bcd564ad658ec40c in term 0.
I20260709 12:27:11.594216 19475 consensus_queue.cc:1048] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:11.595494 19425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdc52ff09ec40c582ff078f8d61029f" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "298958962bdd41fe95575d9841ccdc56" is_pre_election: true
I20260709 12:27:11.596130 19318 leader_election.cc:304] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 5924eff3e27946ee95859aa91a310ac3; no voters: 
I20260709 12:27:11.596220 19425 raft_consensus.cc:2468] T 8cdc52ff09ec40c582ff078f8d61029f P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e78a1fe6ea845f5bcd564ad658ec40c in term 0.
I20260709 12:27:11.597386 19474 raft_consensus.cc:2804] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:11.597801 19474 raft_consensus.cc:493] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.598193 19474 raft_consensus.cc:3060] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:11.605633 19535 consensus_queue.cc:1048] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:11.605993 19474 raft_consensus.cc:515] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.608259 19474 leader_election.cc:290] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 1 election: Requested vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685)
I20260709 12:27:11.609475 19276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdc52ff09ec40c582ff078f8d61029f" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5924eff3e27946ee95859aa91a310ac3"
I20260709 12:27:11.609767 19426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdc52ff09ec40c582ff078f8d61029f" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "298958962bdd41fe95575d9841ccdc56"
I20260709 12:27:11.610246 19276 raft_consensus.cc:3060] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:11.610405 19426 raft_consensus.cc:3060] T 8cdc52ff09ec40c582ff078f8d61029f P 298958962bdd41fe95575d9841ccdc56 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:11.621825 19426 raft_consensus.cc:2468] T 8cdc52ff09ec40c582ff078f8d61029f P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e78a1fe6ea845f5bcd564ad658ec40c in term 1.
I20260709 12:27:11.626431 19318 leader_election.cc:304] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 298958962bdd41fe95575d9841ccdc56; no voters: 
I20260709 12:27:11.626940 19276 raft_consensus.cc:2468] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e78a1fe6ea845f5bcd564ad658ec40c in term 1.
I20260709 12:27:11.628095 19474 raft_consensus.cc:2804] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:11.628917 19474 raft_consensus.cc:697] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 LEADER]: Becoming Leader. State: Replica: 0e78a1fe6ea845f5bcd564ad658ec40c, State: Running, Role: LEADER
I20260709 12:27:11.629848 19474 consensus_queue.cc:237] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:11.631505 19499 consensus_queue.cc:1048] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:11.643659 19470 consensus_queue.cc:1048] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:11.649645 19172 catalog_manager.cc:5697] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194). New cstate: current_term: 1 leader_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:11.721015 19470 consensus_queue.cc:1048] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:11.731803 19503 consensus_queue.cc:1048] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:11.814662 19529 consensus_queue.cc:1048] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:11.825908 19494 consensus_queue.cc:1048] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:11.836596 19503 consensus_queue.cc:1048] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:11.847272 19499 consensus_queue.cc:1048] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:11.890998  9799 ts_manager.cc:295] Set tserver state for 5924eff3e27946ee95859aa91a310ac3 to MAINTENANCE_MODE
I20260709 12:27:11.891810  9799 tablet_server.cc:179] TabletServer@127.9.145.193:0 shutting down...
I20260709 12:27:11.915047  9799 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:11.915769  9799 tablet_replica.cc:333] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3: stopping tablet replica
I20260709 12:27:11.916426  9799 raft_consensus.cc:2243] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.916889  9799 raft_consensus.cc:2272] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.919339  9799 tablet_replica.cc:333] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3: stopping tablet replica
I20260709 12:27:11.919946  9799 raft_consensus.cc:2243] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.920374  9799 raft_consensus.cc:2272] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.922681  9799 tablet_replica.cc:333] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3: stopping tablet replica
I20260709 12:27:11.923246  9799 raft_consensus.cc:2243] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.923676  9799 raft_consensus.cc:2272] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.925909  9799 tablet_replica.cc:333] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3: stopping tablet replica
I20260709 12:27:11.926524  9799 raft_consensus.cc:2243] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.926898  9799 raft_consensus.cc:2272] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.928759  9799 tablet_replica.cc:333] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3: stopping tablet replica
I20260709 12:27:11.929281  9799 raft_consensus.cc:2243] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.929689  9799 raft_consensus.cc:2272] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.932222  9799 tablet_replica.cc:333] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3: stopping tablet replica
I20260709 12:27:11.932817  9799 raft_consensus.cc:2243] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.933641  9799 raft_consensus.cc:2272] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.935827  9799 tablet_replica.cc:333] T 35c9c4b10c8144a089d4a67b3bc2d167 P 5924eff3e27946ee95859aa91a310ac3: stopping tablet replica
I20260709 12:27:11.936420  9799 raft_consensus.cc:2243] T 35c9c4b10c8144a089d4a67b3bc2d167 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.936849  9799 raft_consensus.cc:2272] T 35c9c4b10c8144a089d4a67b3bc2d167 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.939247  9799 tablet_replica.cc:333] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3: stopping tablet replica
I20260709 12:27:11.939945  9799 raft_consensus.cc:2243] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.940392  9799 raft_consensus.cc:2272] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.942845  9799 tablet_replica.cc:333] T 0bd3742c69244d18847d16a933efdcc1 P 5924eff3e27946ee95859aa91a310ac3: stopping tablet replica
I20260709 12:27:11.943557  9799 raft_consensus.cc:2243] T 0bd3742c69244d18847d16a933efdcc1 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.944021  9799 raft_consensus.cc:2272] T 0bd3742c69244d18847d16a933efdcc1 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.946641  9799 tablet_replica.cc:333] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3: stopping tablet replica
I20260709 12:27:11.947177  9799 raft_consensus.cc:2243] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.948297  9799 raft_consensus.cc:2272] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.977595  9799 tablet_server.cc:196] TabletServer@127.9.145.193:0 shutdown complete.
W20260709 12:27:12.059653 19318 consensus_peers.cc:597] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:12.072921 19392 consensus_peers.cc:597] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:12.086355 19392 consensus_peers.cc:597] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:12.090462 19494 consensus_queue.cc:1048] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:27:12.134310 19392 consensus_peers.cc:597] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:12.222993 19318 consensus_peers.cc:597] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:12.314654 19392 consensus_peers.cc:597] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:12.342514 19392 consensus_peers.cc:597] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:12.347770 19318 consensus_peers.cc:597] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:12.867672 19223 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:27:12.881328 19392 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111) [suppressed 145 similar messages]
I20260709 12:27:13.118309 19529 raft_consensus.cc:493] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5924eff3e27946ee95859aa91a310ac3)
I20260709 12:27:13.118827 19529 raft_consensus.cc:515] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:13.120541 19529 leader_election.cc:290] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685)
I20260709 12:27:13.122277 19425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cbe0f5cc0a42fcb50365c0ce355c71" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "298958962bdd41fe95575d9841ccdc56" is_pre_election: true
W20260709 12:27:13.124152 19318 leader_election.cc:336] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111)
I20260709 12:27:13.124522 19318 leader_election.cc:304] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e78a1fe6ea845f5bcd564ad658ec40c; no voters: 298958962bdd41fe95575d9841ccdc56, 5924eff3e27946ee95859aa91a310ac3
I20260709 12:27:13.125094 19529 raft_consensus.cc:2749] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:13.127404 19499 raft_consensus.cc:493] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5924eff3e27946ee95859aa91a310ac3)
I20260709 12:27:13.127884 19499 raft_consensus.cc:515] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:13.129491 19499 leader_election.cc:290] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315)
I20260709 12:27:13.131033 19350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cbe0f5cc0a42fcb50365c0ce355c71" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" is_pre_election: true
I20260709 12:27:13.131671 19350 raft_consensus.cc:2468] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 298958962bdd41fe95575d9841ccdc56 in term 1.
I20260709 12:27:13.132686 19392 leader_election.cc:304] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 298958962bdd41fe95575d9841ccdc56; no voters: 
W20260709 12:27:13.133489 19392 leader_election.cc:336] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111)
I20260709 12:27:13.133512 19499 raft_consensus.cc:2804] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:13.133982 19499 raft_consensus.cc:493] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5924eff3e27946ee95859aa91a310ac3)
I20260709 12:27:13.134310 19499 raft_consensus.cc:3060] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.139811 19499 raft_consensus.cc:515] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:13.141513 19499 leader_election.cc:290] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 2 election: Requested vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315)
I20260709 12:27:13.143142 19350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cbe0f5cc0a42fcb50365c0ce355c71" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
I20260709 12:27:13.143796 19350 raft_consensus.cc:3060] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:13.145350 19392 leader_election.cc:336] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111)
I20260709 12:27:13.150017 19350 raft_consensus.cc:2468] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 298958962bdd41fe95575d9841ccdc56 in term 2.
I20260709 12:27:13.151166 19392 leader_election.cc:304] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 298958962bdd41fe95575d9841ccdc56; no voters: 5924eff3e27946ee95859aa91a310ac3
I20260709 12:27:13.151889 19499 raft_consensus.cc:2804] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:13.152318 19499 raft_consensus.cc:697] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [term 2 LEADER]: Becoming Leader. State: Replica: 298958962bdd41fe95575d9841ccdc56, State: Running, Role: LEADER
I20260709 12:27:13.153084 19499 consensus_queue.cc:237] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:13.161023 19172 catalog_manager.cc:5697] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 reported cstate change: term changed from 1 to 2, leader changed from 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193) to 298958962bdd41fe95575d9841ccdc56 (127.9.145.195). New cstate: current_term: 2 leader_uuid: "298958962bdd41fe95575d9841ccdc56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:13.407397 19529 raft_consensus.cc:493] T 4831316659774caf9b5a1bac14d279e0 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5924eff3e27946ee95859aa91a310ac3)
I20260709 12:27:13.407886 19529 raft_consensus.cc:515] T 4831316659774caf9b5a1bac14d279e0 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:13.409745 19529 leader_election.cc:290] T 4831316659774caf9b5a1bac14d279e0 P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685)
I20260709 12:27:13.411352 19425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4831316659774caf9b5a1bac14d279e0" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "298958962bdd41fe95575d9841ccdc56" is_pre_election: true
W20260709 12:27:13.413516 19318 leader_election.cc:336] T 4831316659774caf9b5a1bac14d279e0 P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111)
I20260709 12:27:13.414359 19318 leader_election.cc:304] T 4831316659774caf9b5a1bac14d279e0 P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e78a1fe6ea845f5bcd564ad658ec40c; no voters: 298958962bdd41fe95575d9841ccdc56, 5924eff3e27946ee95859aa91a310ac3
I20260709 12:27:13.414994 19529 raft_consensus.cc:2749] T 4831316659774caf9b5a1bac14d279e0 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:13.444859 19499 raft_consensus.cc:493] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5924eff3e27946ee95859aa91a310ac3)
I20260709 12:27:13.445631 19499 raft_consensus.cc:515] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:13.447781 19499 leader_election.cc:290] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315)
I20260709 12:27:13.450212 19350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4831316659774caf9b5a1bac14d279e0" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" is_pre_election: true
I20260709 12:27:13.450879 19350 raft_consensus.cc:2468] T 4831316659774caf9b5a1bac14d279e0 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 298958962bdd41fe95575d9841ccdc56 in term 1.
W20260709 12:27:13.451722 19392 leader_election.cc:336] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111)
I20260709 12:27:13.452440 19392 leader_election.cc:304] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 298958962bdd41fe95575d9841ccdc56; no voters: 5924eff3e27946ee95859aa91a310ac3
I20260709 12:27:13.453083 19499 raft_consensus.cc:2804] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:13.453378 19499 raft_consensus.cc:493] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5924eff3e27946ee95859aa91a310ac3)
I20260709 12:27:13.453709 19499 raft_consensus.cc:3060] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.459494 19499 raft_consensus.cc:515] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:13.461256 19499 leader_election.cc:290] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 2 election: Requested vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315)
I20260709 12:27:13.462899 19350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4831316659774caf9b5a1bac14d279e0" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
I20260709 12:27:13.463500 19350 raft_consensus.cc:3060] T 4831316659774caf9b5a1bac14d279e0 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:13.464917 19392 leader_election.cc:336] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111)
I20260709 12:27:13.469017 19350 raft_consensus.cc:2468] T 4831316659774caf9b5a1bac14d279e0 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 298958962bdd41fe95575d9841ccdc56 in term 2.
I20260709 12:27:13.470250 19392 leader_election.cc:304] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 298958962bdd41fe95575d9841ccdc56; no voters: 5924eff3e27946ee95859aa91a310ac3
I20260709 12:27:13.471001 19499 raft_consensus.cc:2804] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:13.471503 19499 raft_consensus.cc:697] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [term 2 LEADER]: Becoming Leader. State: Replica: 298958962bdd41fe95575d9841ccdc56, State: Running, Role: LEADER
I20260709 12:27:13.472273 19499 consensus_queue.cc:237] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:13.479935 19172 catalog_manager.cc:5697] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 reported cstate change: term changed from 1 to 2, leader changed from 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193) to 298958962bdd41fe95575d9841ccdc56 (127.9.145.195). New cstate: current_term: 2 leader_uuid: "298958962bdd41fe95575d9841ccdc56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:13.572553 19350 raft_consensus.cc:1275] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 FOLLOWER]: Refusing update from remote peer 298958962bdd41fe95575d9841ccdc56: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:13.573921 19499 consensus_queue.cc:1048] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:27:13.599241 19392 consensus_peers.cc:597] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:13.868706 19223 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:27:13.890802 19350 raft_consensus.cc:1275] T 4831316659774caf9b5a1bac14d279e0 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 FOLLOWER]: Refusing update from remote peer 298958962bdd41fe95575d9841ccdc56: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:13.892364 19567 consensus_queue.cc:1048] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:27:13.906488 19392 consensus_peers.cc:597] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:14.442798 19318 consensus_peers.cc:597] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:14.488562 19392 consensus_peers.cc:597] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:14.568279 19392 consensus_peers.cc:597] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:14.624722 19392 consensus_peers.cc:597] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:14.713876 19392 consensus_peers.cc:597] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:14.850255 19318 consensus_peers.cc:597] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:14.852190 19392 consensus_peers.cc:597] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:14.860845 19318 consensus_peers.cc:597] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:14.869831 19223 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:27:15.871009 19223 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:27:15.973587 19392 consensus_peers.cc:597] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:16.542007 19392 consensus_peers.cc:597] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:16.614566 19392 consensus_peers.cc:597] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:16.712113 19318 consensus_peers.cc:597] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:16.872079 19223 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:27:16.903258 19392 consensus_peers.cc:597] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:16.997632  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:17.004460 19569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:17.004745 19570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:17.007654 19572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:17.008360  9799 server_base.cc:1061] running on GCE node
I20260709 12:27:17.011140  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:17.011415  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:17.011611  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783600037011592 us; error 0 us; skew 500 ppm
I20260709 12:27:17.012173  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:17.014816  9799 webserver.cc:533] Webserver started at http://127.9.145.193:39277/ using document root <none> and password file <none>
I20260709 12:27:17.015328  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:17.015486  9799 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:27:17.019387  9799 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:27:17.023900 19577 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
W20260709 12:27:17.024782 19392 consensus_peers.cc:597] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:17.024974  9799 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 12:27:17.025490  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599719482688-9799-0/minicluster-data/ts-0-root
uuid: "5924eff3e27946ee95859aa91a310ac3"
format_stamp: "Formatted at 2026-07-09 12:27:09 on dist-test-slave-1sdq"
I20260709 12:27:17.025820  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599719482688-9799-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599719482688-9799-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599719482688-9799-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:17.039326  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:17.040653  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:17.042179  9799 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:17.045713 19584 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 12:27:17.101671  9799 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:27:17.102007  9799 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.057s	user 0.002s	sys 0.000s
I20260709 12:27:17.102309  9799 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:27:17.107462 19584 tablet_bootstrap.cc:492] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3: Bootstrap starting.
I20260709 12:27:17.120265 19584 tablet_bootstrap.cc:492] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:17.121045 19584 tablet_bootstrap.cc:492] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3: Bootstrap complete.
I20260709 12:27:17.121599 19584 ts_tablet_manager.cc:1403] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:27:17.123683 19584 raft_consensus.cc:359] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:17.124239 19584 raft_consensus.cc:740] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5924eff3e27946ee95859aa91a310ac3, State: Initialized, Role: FOLLOWER
I20260709 12:27:17.124835 19584 consensus_queue.cc:260] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:17.127053 19584 ts_tablet_manager.cc:1434] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:27:17.127805 19584 tablet_bootstrap.cc:492] T 35c9c4b10c8144a089d4a67b3bc2d167 P 5924eff3e27946ee95859aa91a310ac3: Bootstrap starting.
W20260709 12:27:17.134743 19318 consensus_peers.cc:597] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:17.141736 19584 tablet_bootstrap.cc:492] T 35c9c4b10c8144a089d4a67b3bc2d167 P 5924eff3e27946ee95859aa91a310ac3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:17.142944 19584 tablet_bootstrap.cc:492] T 35c9c4b10c8144a089d4a67b3bc2d167 P 5924eff3e27946ee95859aa91a310ac3: Bootstrap complete.
I20260709 12:27:17.143549 19584 ts_tablet_manager.cc:1403] T 35c9c4b10c8144a089d4a67b3bc2d167 P 5924eff3e27946ee95859aa91a310ac3: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 12:27:17.145838 19584 raft_consensus.cc:359] T 35c9c4b10c8144a089d4a67b3bc2d167 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:17.146438 19584 raft_consensus.cc:740] T 35c9c4b10c8144a089d4a67b3bc2d167 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5924eff3e27946ee95859aa91a310ac3, State: Initialized, Role: FOLLOWER
I20260709 12:27:17.147207 19584 consensus_queue.cc:260] T 35c9c4b10c8144a089d4a67b3bc2d167 P 5924eff3e27946ee95859aa91a310ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:17.147699  9799 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:27:17.148092  9799 ts_tablet_manager.cc:595] Time spent register tablets: real 0.046s	user 0.044s	sys 0.000s
I20260709 12:27:17.148819 19584 ts_tablet_manager.cc:1434] T 35c9c4b10c8144a089d4a67b3bc2d167 P 5924eff3e27946ee95859aa91a310ac3: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.002s
I20260709 12:27:17.149827 19584 tablet_bootstrap.cc:492] T 0bd3742c69244d18847d16a933efdcc1 P 5924eff3e27946ee95859aa91a310ac3: Bootstrap starting.
I20260709 12:27:17.164117 19584 tablet_bootstrap.cc:492] T 0bd3742c69244d18847d16a933efdcc1 P 5924eff3e27946ee95859aa91a310ac3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:17.164960 19584 tablet_bootstrap.cc:492] T 0bd3742c69244d18847d16a933efdcc1 P 5924eff3e27946ee95859aa91a310ac3: Bootstrap complete.
I20260709 12:27:17.165556 19584 ts_tablet_manager.cc:1403] T 0bd3742c69244d18847d16a933efdcc1 P 5924eff3e27946ee95859aa91a310ac3: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 12:27:17.167843 19584 raft_consensus.cc:359] T 0bd3742c69244d18847d16a933efdcc1 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:17.168496 19584 raft_consensus.cc:740] T 0bd3742c69244d18847d16a933efdcc1 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5924eff3e27946ee95859aa91a310ac3, State: Initialized, Role: FOLLOWER
I20260709 12:27:17.169178 19584 consensus_queue.cc:260] T 0bd3742c69244d18847d16a933efdcc1 P 5924eff3e27946ee95859aa91a310ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:17.170742 19584 ts_tablet_manager.cc:1434] T 0bd3742c69244d18847d16a933efdcc1 P 5924eff3e27946ee95859aa91a310ac3: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:27:17.171545 19584 tablet_bootstrap.cc:492] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3: Bootstrap starting.
W20260709 12:27:17.184708 19318 consensus_peers.cc:597] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:17.185158 19584 tablet_bootstrap.cc:492] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:17.186005 19584 tablet_bootstrap.cc:492] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3: Bootstrap complete.
I20260709 12:27:17.186661 19584 ts_tablet_manager.cc:1403] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 12:27:17.188602 19584 raft_consensus.cc:359] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:17.189133 19584 raft_consensus.cc:740] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5924eff3e27946ee95859aa91a310ac3, State: Initialized, Role: FOLLOWER
I20260709 12:27:17.189750 19584 consensus_queue.cc:260] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:17.191223 19584 ts_tablet_manager.cc:1434] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:27:17.192044 19584 tablet_bootstrap.cc:492] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3: Bootstrap starting.
I20260709 12:27:17.203353 19584 tablet_bootstrap.cc:492] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:17.204123 19584 tablet_bootstrap.cc:492] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3: Bootstrap complete.
I20260709 12:27:17.204694 19584 ts_tablet_manager.cc:1403] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:27:17.206676 19584 raft_consensus.cc:359] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:17.207180 19584 raft_consensus.cc:740] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5924eff3e27946ee95859aa91a310ac3, State: Initialized, Role: FOLLOWER
I20260709 12:27:17.207705 19584 consensus_queue.cc:260] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:17.208604  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.193:35521
I20260709 12:27:17.208745 19647 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.193:35521 every 8 connection(s)
I20260709 12:27:17.209367 19584 ts_tablet_manager.cc:1434] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:27:17.210137 19584 tablet_bootstrap.cc:492] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3: Bootstrap starting.
I20260709 12:27:17.215551  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:17.238847 19584 tablet_bootstrap.cc:492] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:17.239655 19584 tablet_bootstrap.cc:492] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3: Bootstrap complete.
I20260709 12:27:17.240443 19584 ts_tablet_manager.cc:1403] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.004s
I20260709 12:27:17.242151 19648 heartbeater.cc:344] Connected to a master server at 127.9.145.254:38757
I20260709 12:27:17.242725 19648 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:17.243074 19425 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06cbe0f5cc0a42fcb50365c0ce355c71"
dest_uuid: "298958962bdd41fe95575d9841ccdc56"
mode: GRACEFUL
new_leader_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
 from {username='slave'} at 127.0.0.1:45062
I20260709 12:27:17.243577 19648 heartbeater.cc:507] Master 127.9.145.254:38757 requested a full tablet report, sending...
I20260709 12:27:17.243129 19584 raft_consensus.cc:359] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:17.244061 19425 raft_consensus.cc:606] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [term 2 LEADER]: Received request to transfer leadership to TS 0e78a1fe6ea845f5bcd564ad658ec40c
I20260709 12:27:17.244163 19584 raft_consensus.cc:740] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5924eff3e27946ee95859aa91a310ac3, State: Initialized, Role: FOLLOWER
I20260709 12:27:17.245044 19584 consensus_queue.cc:260] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:17.246788 19584 ts_tablet_manager.cc:1434] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:27:17.247468 19584 tablet_bootstrap.cc:492] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3: Bootstrap starting.
I20260709 12:27:17.248116 19425 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d27567ec64648da953818113fca8920"
dest_uuid: "298958962bdd41fe95575d9841ccdc56"
mode: GRACEFUL
new_leader_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
 from {username='slave'} at 127.0.0.1:45062
I20260709 12:27:17.248769 19425 raft_consensus.cc:606] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [term 1 LEADER]: Received request to transfer leadership to TS 0e78a1fe6ea845f5bcd564ad658ec40c
I20260709 12:27:17.250829 19174 ts_manager.cc:194] Re-registered known tserver with Master: 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521)
I20260709 12:27:17.252512 19425 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7c87e92594d479988a81bd758077e6d"
dest_uuid: "298958962bdd41fe95575d9841ccdc56"
mode: GRACEFUL
new_leader_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
 from {username='slave'} at 127.0.0.1:45062
I20260709 12:27:17.254312 19425 raft_consensus.cc:606] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [term 1 LEADER]: Received request to transfer leadership to TS 0e78a1fe6ea845f5bcd564ad658ec40c
I20260709 12:27:17.255954  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:27:17.256695  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:17.257481  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:17.262431 19584 tablet_bootstrap.cc:492] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:17.263458 19584 tablet_bootstrap.cc:492] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3: Bootstrap complete.
I20260709 12:27:17.264128 19174 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60520
I20260709 12:27:17.264276 19584 ts_tablet_manager.cc:1403] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 12:27:17.267263 19584 raft_consensus.cc:359] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:17.267750 19648 heartbeater.cc:499] Master 127.9.145.254:38757 was elected leader, sending a full tablet report...
I20260709 12:27:17.268107 19584 raft_consensus.cc:740] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5924eff3e27946ee95859aa91a310ac3, State: Initialized, Role: FOLLOWER
I20260709 12:27:17.269148 19584 consensus_queue.cc:260] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:17.271605 19584 ts_tablet_manager.cc:1434] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:27:17.272594 19584 tablet_bootstrap.cc:492] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3: Bootstrap starting.
I20260709 12:27:17.279147 19470 raft_consensus.cc:993] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56: : Instructing follower 0e78a1fe6ea845f5bcd564ad658ec40c to start an election
I20260709 12:27:17.279722 19470 raft_consensus.cc:1081] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [term 1 LEADER]: Signalling peer 0e78a1fe6ea845f5bcd564ad658ec40c to start an election
I20260709 12:27:17.281543 19350 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d27567ec64648da953818113fca8920"
dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
 from {username='slave'} at 127.0.0.1:48040
I20260709 12:27:17.282207 19350 raft_consensus.cc:493] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:17.282557 19350 raft_consensus.cc:3060] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:17.289314 19350 raft_consensus.cc:515] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } }
I20260709 12:27:17.291579 19584 tablet_bootstrap.cc:492] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:17.292634 19584 tablet_bootstrap.cc:492] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3: Bootstrap complete.
I20260709 12:27:17.293324 19584 ts_tablet_manager.cc:1403] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 12:27:17.294597 19350 leader_election.cc:290] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 2 election: Requested vote from peers 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685), 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521)
I20260709 12:27:17.296173 19425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d27567ec64648da953818113fca8920" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "298958962bdd41fe95575d9841ccdc56"
I20260709 12:27:17.297623 19425 raft_consensus.cc:3055] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:17.296604 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d27567ec64648da953818113fca8920" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5924eff3e27946ee95859aa91a310ac3"
I20260709 12:27:17.295853 19584 raft_consensus.cc:359] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:17.297976 19425 raft_consensus.cc:740] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 298958962bdd41fe95575d9841ccdc56, State: Running, Role: LEADER
I20260709 12:27:17.298234 19584 raft_consensus.cc:740] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5924eff3e27946ee95859aa91a310ac3, State: Initialized, Role: FOLLOWER
W20260709 12:27:17.299162 19318 leader_election.cc:343] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:17.299403 19425 consensus_queue.cc:260] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } }
I20260709 12:27:17.299909 19584 consensus_queue.cc:260] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:17.300973 19425 raft_consensus.cc:3060] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:17.301695 19584 ts_tablet_manager.cc:1434] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:27:17.302520 19584 tablet_bootstrap.cc:492] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3: Bootstrap starting.
I20260709 12:27:17.309078 19425 raft_consensus.cc:2468] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e78a1fe6ea845f5bcd564ad658ec40c in term 2.
I20260709 12:27:17.310396 19318 leader_election.cc:304] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 298958962bdd41fe95575d9841ccdc56; no voters: 5924eff3e27946ee95859aa91a310ac3
I20260709 12:27:17.311484 19529 raft_consensus.cc:2804] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:17.314569 19529 raft_consensus.cc:697] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 LEADER]: Becoming Leader. State: Replica: 0e78a1fe6ea845f5bcd564ad658ec40c, State: Running, Role: LEADER
I20260709 12:27:17.315033 19584 tablet_bootstrap.cc:492] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:17.316008 19584 tablet_bootstrap.cc:492] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3: Bootstrap complete.
I20260709 12:27:17.315647 19529 consensus_queue.cc:237] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } }
I20260709 12:27:17.316753 19584 ts_tablet_manager.cc:1403] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:27:17.319099 19584 raft_consensus.cc:359] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } }
I20260709 12:27:17.319641 19584 raft_consensus.cc:740] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5924eff3e27946ee95859aa91a310ac3, State: Initialized, Role: FOLLOWER
I20260709 12:27:17.320415 19584 consensus_queue.cc:260] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } }
I20260709 12:27:17.322490 19584 ts_tablet_manager.cc:1434] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:27:17.323537 19584 tablet_bootstrap.cc:492] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3: Bootstrap starting.
I20260709 12:27:17.324958 19174 catalog_manager.cc:5697] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c reported cstate change: term changed from 1 to 2, leader changed from 298958962bdd41fe95575d9841ccdc56 (127.9.145.195) to 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194). New cstate: current_term: 2 leader_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:17.338928 19584 tablet_bootstrap.cc:492] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:17.339957 19584 tablet_bootstrap.cc:492] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3: Bootstrap complete.
I20260709 12:27:17.341913 19584 ts_tablet_manager.cc:1403] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 12:27:17.344669 19584 raft_consensus.cc:359] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:17.345217 19584 raft_consensus.cc:740] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5924eff3e27946ee95859aa91a310ac3, State: Initialized, Role: FOLLOWER
I20260709 12:27:17.345851 19584 consensus_queue.cc:260] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:17.347920 19584 ts_tablet_manager.cc:1434] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:27:17.366987 19470 raft_consensus.cc:993] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56: : Instructing follower 0e78a1fe6ea845f5bcd564ad658ec40c to start an election
I20260709 12:27:17.367455 19588 raft_consensus.cc:1081] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [term 1 LEADER]: Signalling peer 0e78a1fe6ea845f5bcd564ad658ec40c to start an election
I20260709 12:27:17.368922 19350 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7c87e92594d479988a81bd758077e6d"
dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
 from {username='slave'} at 127.0.0.1:48040
I20260709 12:27:17.369417 19350 raft_consensus.cc:493] T b7c87e92594d479988a81bd758077e6d P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:17.369691 19350 raft_consensus.cc:3060] T b7c87e92594d479988a81bd758077e6d P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:17.374840 19350 raft_consensus.cc:515] T b7c87e92594d479988a81bd758077e6d P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:17.376379 19350 leader_election.cc:290] T b7c87e92594d479988a81bd758077e6d P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 2 election: Requested vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685)
I20260709 12:27:17.377319 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c87e92594d479988a81bd758077e6d" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5924eff3e27946ee95859aa91a310ac3"
I20260709 12:27:17.377485 19425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c87e92594d479988a81bd758077e6d" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "298958962bdd41fe95575d9841ccdc56"
I20260709 12:27:17.378187 19619 raft_consensus.cc:3060] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:17.378275 19425 raft_consensus.cc:3055] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:17.378692 19425 raft_consensus.cc:740] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 298958962bdd41fe95575d9841ccdc56, State: Running, Role: LEADER
I20260709 12:27:17.379361 19425 consensus_queue.cc:260] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:17.380358 19425 raft_consensus.cc:3060] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:17.383958 19619 raft_consensus.cc:2468] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e78a1fe6ea845f5bcd564ad658ec40c in term 2.
I20260709 12:27:17.385166 19318 leader_election.cc:304] T b7c87e92594d479988a81bd758077e6d P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 5924eff3e27946ee95859aa91a310ac3; no voters: 
I20260709 12:27:17.385985 19661 raft_consensus.cc:2804] T b7c87e92594d479988a81bd758077e6d P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:17.386237 19425 raft_consensus.cc:2468] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e78a1fe6ea845f5bcd564ad658ec40c in term 2.
I20260709 12:27:17.386613 19661 raft_consensus.cc:697] T b7c87e92594d479988a81bd758077e6d P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 LEADER]: Becoming Leader. State: Replica: 0e78a1fe6ea845f5bcd564ad658ec40c, State: Running, Role: LEADER
I20260709 12:27:17.387626 19661 consensus_queue.cc:237] T b7c87e92594d479988a81bd758077e6d P 0e78a1fe6ea845f5bcd564ad658ec40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:17.396152 19174 catalog_manager.cc:5697] T b7c87e92594d479988a81bd758077e6d P 0e78a1fe6ea845f5bcd564ad658ec40c reported cstate change: term changed from 1 to 2, leader changed from 298958962bdd41fe95575d9841ccdc56 (127.9.145.195) to 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194). New cstate: current_term: 2 leader_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:17.514135 19619 raft_consensus.cc:3060] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:17.621958 19619 raft_consensus.cc:3060] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:17.692620 19470 raft_consensus.cc:993] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56: : Instructing follower 0e78a1fe6ea845f5bcd564ad658ec40c to start an election
I20260709 12:27:17.693094 19588 raft_consensus.cc:1081] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [term 2 LEADER]: Signalling peer 0e78a1fe6ea845f5bcd564ad658ec40c to start an election
I20260709 12:27:17.694638 19350 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06cbe0f5cc0a42fcb50365c0ce355c71"
dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
 from {username='slave'} at 127.0.0.1:48040
I20260709 12:27:17.695093 19350 raft_consensus.cc:493] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:17.695326 19350 raft_consensus.cc:3060] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:17.700384 19350 raft_consensus.cc:515] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:17.702137 19350 leader_election.cc:290] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 3 election: Requested vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685)
I20260709 12:27:17.702991 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cbe0f5cc0a42fcb50365c0ce355c71" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5924eff3e27946ee95859aa91a310ac3"
I20260709 12:27:17.703231 19425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cbe0f5cc0a42fcb50365c0ce355c71" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "298958962bdd41fe95575d9841ccdc56"
I20260709 12:27:17.703711 19619 raft_consensus.cc:3060] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:17.703823 19425 raft_consensus.cc:3055] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:17.704272 19425 raft_consensus.cc:740] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 298958962bdd41fe95575d9841ccdc56, State: Running, Role: LEADER
I20260709 12:27:17.705106 19425 consensus_queue.cc:260] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:17.706475 19425 raft_consensus.cc:3060] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:17.711498 19619 raft_consensus.cc:2468] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e78a1fe6ea845f5bcd564ad658ec40c in term 3.
I20260709 12:27:17.712881 19318 leader_election.cc:304] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 5924eff3e27946ee95859aa91a310ac3; no voters: 
I20260709 12:27:17.713792 19661 raft_consensus.cc:2804] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:17.713754 19425 raft_consensus.cc:2468] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e78a1fe6ea845f5bcd564ad658ec40c in term 3.
I20260709 12:27:17.714578 19661 raft_consensus.cc:697] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 3 LEADER]: Becoming Leader. State: Replica: 0e78a1fe6ea845f5bcd564ad658ec40c, State: Running, Role: LEADER
I20260709 12:27:17.715497 19661 consensus_queue.cc:237] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:17.723060 19174 catalog_manager.cc:5697] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c reported cstate change: term changed from 2 to 3, leader changed from 298958962bdd41fe95575d9841ccdc56 (127.9.145.195) to 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194). New cstate: current_term: 3 leader_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:17.778265 19425 raft_consensus.cc:1275] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [term 2 FOLLOWER]: Refusing update from remote peer 0e78a1fe6ea845f5bcd564ad658ec40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:17.779551 19661 consensus_queue.cc:1048] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:17.787699 19425 raft_consensus.cc:1275] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [term 2 FOLLOWER]: Refusing update from remote peer 0e78a1fe6ea845f5bcd564ad658ec40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:17.789618 19672 consensus_queue.cc:1048] T b7c87e92594d479988a81bd758077e6d P 0e78a1fe6ea845f5bcd564ad658ec40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:17.795042 19619 raft_consensus.cc:3060] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:17.803941 19619 raft_consensus.cc:1275] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3 [term 2 FOLLOWER]: Refusing update from remote peer 0e78a1fe6ea845f5bcd564ad658ec40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:17.806648 19661 consensus_queue.cc:1048] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:17.815950 19619 raft_consensus.cc:1275] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3 [term 2 FOLLOWER]: Refusing update from remote peer 0e78a1fe6ea845f5bcd564ad658ec40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:17.817252 19678 consensus_queue.cc:1048] T b7c87e92594d479988a81bd758077e6d P 0e78a1fe6ea845f5bcd564ad658ec40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:27:17.873107 19223 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:27:18.211414 19426 raft_consensus.cc:1275] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [term 3 FOLLOWER]: Refusing update from remote peer 0e78a1fe6ea845f5bcd564ad658ec40c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:18.212980 19678 consensus_queue.cc:1048] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:18.221653 19619 raft_consensus.cc:1275] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [term 3 FOLLOWER]: Refusing update from remote peer 0e78a1fe6ea845f5bcd564ad658ec40c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:18.223694 19529 consensus_queue.cc:1048] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:18.287346  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:18.304175 19350 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06cbe0f5cc0a42fcb50365c0ce355c71"
dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
mode: GRACEFUL
new_leader_uuid: "298958962bdd41fe95575d9841ccdc56"
 from {username='slave'} at 127.0.0.1:48042
I20260709 12:27:18.304754 19350 raft_consensus.cc:606] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 3 LEADER]: Received request to transfer leadership to TS 298958962bdd41fe95575d9841ccdc56
I20260709 12:27:18.307286 19352 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4072c2eca5ff4c9fa4fceaa513e8f5ad"
dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
mode: GRACEFUL
new_leader_uuid: "298958962bdd41fe95575d9841ccdc56"
 from {username='slave'} at 127.0.0.1:48042
I20260709 12:27:18.307797 19352 raft_consensus.cc:606] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 LEADER]: Received request to transfer leadership to TS 298958962bdd41fe95575d9841ccdc56
I20260709 12:27:18.308816  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:27:18.309345  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:18.309926  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:18.325723 19661 raft_consensus.cc:993] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c: : Instructing follower 298958962bdd41fe95575d9841ccdc56 to start an election
I20260709 12:27:18.326300 19529 raft_consensus.cc:1081] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 LEADER]: Signalling peer 298958962bdd41fe95575d9841ccdc56 to start an election
I20260709 12:27:18.327875 19426 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4072c2eca5ff4c9fa4fceaa513e8f5ad"
dest_uuid: "298958962bdd41fe95575d9841ccdc56"
 from {username='slave'} at 127.0.0.1:45046
I20260709 12:27:18.328377 19426 raft_consensus.cc:493] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:18.328663 19426 raft_consensus.cc:3060] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:18.333746 19426 raft_consensus.cc:515] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 298958962bdd41fe95575d9841ccdc56 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:18.335551 19426 leader_election.cc:290] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 2 election: Requested vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315)
I20260709 12:27:18.336513 19622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4072c2eca5ff4c9fa4fceaa513e8f5ad" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5924eff3e27946ee95859aa91a310ac3"
I20260709 12:27:18.336726 19352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4072c2eca5ff4c9fa4fceaa513e8f5ad" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
I20260709 12:27:18.337298 19622 raft_consensus.cc:3060] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:18.337395 19352 raft_consensus.cc:3055] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:18.337841 19352 raft_consensus.cc:740] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e78a1fe6ea845f5bcd564ad658ec40c, State: Running, Role: LEADER
I20260709 12:27:18.338711 19352 consensus_queue.cc:260] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:18.340061 19352 raft_consensus.cc:3060] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:18.345307 19622 raft_consensus.cc:2468] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 298958962bdd41fe95575d9841ccdc56 in term 2.
I20260709 12:27:18.346750 19392 leader_election.cc:304] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 298958962bdd41fe95575d9841ccdc56, 5924eff3e27946ee95859aa91a310ac3; no voters: 
I20260709 12:27:18.347200 19352 raft_consensus.cc:2468] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 298958962bdd41fe95575d9841ccdc56 in term 2.
I20260709 12:27:18.347481 19673 raft_consensus.cc:2804] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 298958962bdd41fe95575d9841ccdc56 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:18.348018 19673 raft_consensus.cc:697] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 298958962bdd41fe95575d9841ccdc56 [term 2 LEADER]: Becoming Leader. State: Replica: 298958962bdd41fe95575d9841ccdc56, State: Running, Role: LEADER
I20260709 12:27:18.348773 19673 consensus_queue.cc:237] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:18.356330 19172 catalog_manager.cc:5697] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 298958962bdd41fe95575d9841ccdc56 reported cstate change: term changed from 1 to 2, leader changed from 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194) to 298958962bdd41fe95575d9841ccdc56 (127.9.145.195). New cstate: current_term: 2 leader_uuid: "298958962bdd41fe95575d9841ccdc56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:18.722378 19672 raft_consensus.cc:993] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c: : Instructing follower 298958962bdd41fe95575d9841ccdc56 to start an election
I20260709 12:27:18.722836 19529 raft_consensus.cc:1081] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 3 LEADER]: Signalling peer 298958962bdd41fe95575d9841ccdc56 to start an election
I20260709 12:27:18.724805 19426 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06cbe0f5cc0a42fcb50365c0ce355c71"
dest_uuid: "298958962bdd41fe95575d9841ccdc56"
 from {username='slave'} at 127.0.0.1:45046
I20260709 12:27:18.725446 19426 raft_consensus.cc:493] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:18.725839 19426 raft_consensus.cc:3060] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:18.732409 19426 raft_consensus.cc:515] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:18.734319 19426 leader_election.cc:290] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 4 election: Requested vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315)
I20260709 12:27:18.735028 19622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cbe0f5cc0a42fcb50365c0ce355c71" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5924eff3e27946ee95859aa91a310ac3"
I20260709 12:27:18.735545 19352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cbe0f5cc0a42fcb50365c0ce355c71" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
I20260709 12:27:18.735697 19622 raft_consensus.cc:3060] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:18.736176 19352 raft_consensus.cc:3055] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:18.736490 19352 raft_consensus.cc:740] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0e78a1fe6ea845f5bcd564ad658ec40c, State: Running, Role: LEADER
I20260709 12:27:18.737289 19352 consensus_queue.cc:260] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:18.738431 19352 raft_consensus.cc:3060] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:18.742044 19622 raft_consensus.cc:2468] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 298958962bdd41fe95575d9841ccdc56 in term 4.
I20260709 12:27:18.743359 19392 leader_election.cc:304] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 298958962bdd41fe95575d9841ccdc56, 5924eff3e27946ee95859aa91a310ac3; no voters: 
I20260709 12:27:18.744024 19673 raft_consensus.cc:2804] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:18.744457 19673 raft_consensus.cc:697] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [term 4 LEADER]: Becoming Leader. State: Replica: 298958962bdd41fe95575d9841ccdc56, State: Running, Role: LEADER
I20260709 12:27:18.745266 19673 consensus_queue.cc:237] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:18.745393 19352 raft_consensus.cc:2468] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 298958962bdd41fe95575d9841ccdc56 in term 4.
I20260709 12:27:18.752023 19174 catalog_manager.cc:5697] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 reported cstate change: term changed from 3 to 4, leader changed from 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194) to 298958962bdd41fe95575d9841ccdc56 (127.9.145.195). New cstate: current_term: 4 leader_uuid: "298958962bdd41fe95575d9841ccdc56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:18.900774 19223 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:27:18.905687 19352 raft_consensus.cc:1275] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 FOLLOWER]: Refusing update from remote peer 298958962bdd41fe95575d9841ccdc56: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:18.909250 19622 raft_consensus.cc:1275] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3 [term 2 FOLLOWER]: Refusing update from remote peer 298958962bdd41fe95575d9841ccdc56: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:18.909754 19691 consensus_queue.cc:1048] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:27:18.911536 19673 consensus_queue.cc:1048] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:19.149700 19619 raft_consensus.cc:1275] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [term 4 FOLLOWER]: Refusing update from remote peer 298958962bdd41fe95575d9841ccdc56: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:19.151088 19588 consensus_queue.cc:1048] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:19.160648 19350 raft_consensus.cc:1275] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 4 FOLLOWER]: Refusing update from remote peer 298958962bdd41fe95575d9841ccdc56: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:19.163050 19588 consensus_queue.cc:1048] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:19.316928  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:19.326366 19426 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35c9c4b10c8144a089d4a67b3bc2d167"
dest_uuid: "298958962bdd41fe95575d9841ccdc56"
mode: GRACEFUL
new_leader_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
 from {username='slave'} at 127.0.0.1:45062
I20260709 12:27:19.327071 19426 raft_consensus.cc:606] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [term 1 LEADER]: Received request to transfer leadership to TS 0e78a1fe6ea845f5bcd564ad658ec40c
I20260709 12:27:19.330185 19426 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b52bce4ea207438c9830561dddf50ee6"
dest_uuid: "298958962bdd41fe95575d9841ccdc56"
mode: GRACEFUL
new_leader_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
 from {username='slave'} at 127.0.0.1:45062
I20260709 12:27:19.330876 19426 raft_consensus.cc:606] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 1 LEADER]: Received request to transfer leadership to TS 0e78a1fe6ea845f5bcd564ad658ec40c
I20260709 12:27:19.332267  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:27:19.332911  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:19.333848  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:19.783089 19673 raft_consensus.cc:993] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56: : Instructing follower 0e78a1fe6ea845f5bcd564ad658ec40c to start an election
I20260709 12:27:19.783540 19691 raft_consensus.cc:1081] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [term 1 LEADER]: Signalling peer 0e78a1fe6ea845f5bcd564ad658ec40c to start an election
I20260709 12:27:19.785096 19350 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35c9c4b10c8144a089d4a67b3bc2d167"
dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
 from {username='slave'} at 127.0.0.1:48040
I20260709 12:27:19.785607 19350 raft_consensus.cc:493] T 35c9c4b10c8144a089d4a67b3bc2d167 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:19.785879 19350 raft_consensus.cc:3060] T 35c9c4b10c8144a089d4a67b3bc2d167 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:19.792898 19350 raft_consensus.cc:515] T 35c9c4b10c8144a089d4a67b3bc2d167 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:19.794672 19350 leader_election.cc:290] T 35c9c4b10c8144a089d4a67b3bc2d167 P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 2 election: Requested vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685)
I20260709 12:27:19.795753 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c9c4b10c8144a089d4a67b3bc2d167" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5924eff3e27946ee95859aa91a310ac3"
I20260709 12:27:19.796156 19426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c9c4b10c8144a089d4a67b3bc2d167" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "298958962bdd41fe95575d9841ccdc56"
I20260709 12:27:19.796727 19621 raft_consensus.cc:3060] T 35c9c4b10c8144a089d4a67b3bc2d167 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:19.796805 19426 raft_consensus.cc:3055] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:19.797201 19426 raft_consensus.cc:740] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 298958962bdd41fe95575d9841ccdc56, State: Running, Role: LEADER
I20260709 12:27:19.798470 19426 consensus_queue.cc:260] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:19.800101 19426 raft_consensus.cc:3060] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:19.806445 19621 raft_consensus.cc:2468] T 35c9c4b10c8144a089d4a67b3bc2d167 P 5924eff3e27946ee95859aa91a310ac3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e78a1fe6ea845f5bcd564ad658ec40c in term 2.
I20260709 12:27:19.808332 19318 leader_election.cc:304] T 35c9c4b10c8144a089d4a67b3bc2d167 P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 5924eff3e27946ee95859aa91a310ac3; no voters: 
I20260709 12:27:19.809243 19689 raft_consensus.cc:2804] T 35c9c4b10c8144a089d4a67b3bc2d167 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:19.810191 19426 raft_consensus.cc:2468] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e78a1fe6ea845f5bcd564ad658ec40c in term 2.
I20260709 12:27:19.810355 19689 raft_consensus.cc:697] T 35c9c4b10c8144a089d4a67b3bc2d167 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 LEADER]: Becoming Leader. State: Replica: 0e78a1fe6ea845f5bcd564ad658ec40c, State: Running, Role: LEADER
I20260709 12:27:19.811697 19689 consensus_queue.cc:237] T 35c9c4b10c8144a089d4a67b3bc2d167 P 0e78a1fe6ea845f5bcd564ad658ec40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:19.818789 19172 catalog_manager.cc:5697] T 35c9c4b10c8144a089d4a67b3bc2d167 P 0e78a1fe6ea845f5bcd564ad658ec40c reported cstate change: term changed from 1 to 2, leader changed from 298958962bdd41fe95575d9841ccdc56 (127.9.145.195) to 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194). New cstate: current_term: 2 leader_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:19.902547 19223 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:27:19.924418 19673 raft_consensus.cc:993] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56: : Instructing follower 0e78a1fe6ea845f5bcd564ad658ec40c to start an election
I20260709 12:27:19.924939 19691 raft_consensus.cc:1081] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 1 LEADER]: Signalling peer 0e78a1fe6ea845f5bcd564ad658ec40c to start an election
I20260709 12:27:19.926551 19350 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b52bce4ea207438c9830561dddf50ee6"
dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
 from {username='slave'} at 127.0.0.1:48040
I20260709 12:27:19.927022 19350 raft_consensus.cc:493] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:19.927320 19350 raft_consensus.cc:3060] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:19.932896 19350 raft_consensus.cc:515] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:19.934736 19350 leader_election.cc:290] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 2 election: Requested vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685)
I20260709 12:27:19.935531 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52bce4ea207438c9830561dddf50ee6" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5924eff3e27946ee95859aa91a310ac3"
I20260709 12:27:19.935945 19426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52bce4ea207438c9830561dddf50ee6" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "298958962bdd41fe95575d9841ccdc56"
I20260709 12:27:19.936209 19621 raft_consensus.cc:3060] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:19.936556 19426 raft_consensus.cc:3055] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:19.936863 19426 raft_consensus.cc:740] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 298958962bdd41fe95575d9841ccdc56, State: Running, Role: LEADER
I20260709 12:27:19.937844 19426 consensus_queue.cc:260] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:19.939442 19426 raft_consensus.cc:3060] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:19.944029 19621 raft_consensus.cc:2468] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e78a1fe6ea845f5bcd564ad658ec40c in term 2.
I20260709 12:27:19.945340 19318 leader_election.cc:304] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 5924eff3e27946ee95859aa91a310ac3; no voters: 
I20260709 12:27:19.946048 19689 raft_consensus.cc:2804] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:19.946151 19426 raft_consensus.cc:2468] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e78a1fe6ea845f5bcd564ad658ec40c in term 2.
I20260709 12:27:19.946664 19689 raft_consensus.cc:697] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 LEADER]: Becoming Leader. State: Replica: 0e78a1fe6ea845f5bcd564ad658ec40c, State: Running, Role: LEADER
I20260709 12:27:19.948001 19689 consensus_queue.cc:237] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:19.955421 19172 catalog_manager.cc:5697] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c reported cstate change: term changed from 1 to 2, leader changed from 298958962bdd41fe95575d9841ccdc56 (127.9.145.195) to 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194). New cstate: current_term: 2 leader_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:20.214336 19426 raft_consensus.cc:1275] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [term 2 FOLLOWER]: Refusing update from remote peer 0e78a1fe6ea845f5bcd564ad658ec40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:20.215556 19689 consensus_queue.cc:1048] T 35c9c4b10c8144a089d4a67b3bc2d167 P 0e78a1fe6ea845f5bcd564ad658ec40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:20.225680 19621 raft_consensus.cc:1275] T 35c9c4b10c8144a089d4a67b3bc2d167 P 5924eff3e27946ee95859aa91a310ac3 [term 2 FOLLOWER]: Refusing update from remote peer 0e78a1fe6ea845f5bcd564ad658ec40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:20.228260 19707 consensus_queue.cc:1048] T 35c9c4b10c8144a089d4a67b3bc2d167 P 0e78a1fe6ea845f5bcd564ad658ec40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:20.340562  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:20.348268 19350 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d27567ec64648da953818113fca8920"
dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
mode: GRACEFUL
new_leader_uuid: "298958962bdd41fe95575d9841ccdc56"
 from {username='slave'} at 127.0.0.1:48042
I20260709 12:27:20.348794 19350 raft_consensus.cc:606] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 LEADER]: Received request to transfer leadership to TS 298958962bdd41fe95575d9841ccdc56
I20260709 12:27:20.351605 19350 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b52bce4ea207438c9830561dddf50ee6"
dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
mode: GRACEFUL
new_leader_uuid: "298958962bdd41fe95575d9841ccdc56"
 from {username='slave'} at 127.0.0.1:48042
I20260709 12:27:20.352075 19350 raft_consensus.cc:606] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 LEADER]: Received request to transfer leadership to TS 298958962bdd41fe95575d9841ccdc56
I20260709 12:27:20.353088  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:27:20.353637  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:20.354249  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:20.413929 19426 raft_consensus.cc:1275] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 2 FOLLOWER]: Refusing update from remote peer 0e78a1fe6ea845f5bcd564ad658ec40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:20.414124 19621 raft_consensus.cc:1275] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3 [term 2 FOLLOWER]: Refusing update from remote peer 0e78a1fe6ea845f5bcd564ad658ec40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:20.415721 19689 consensus_queue.cc:1048] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:20.416996 19707 consensus_queue.cc:1048] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:20.428113 19698 raft_consensus.cc:993] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c: : Instructing follower 298958962bdd41fe95575d9841ccdc56 to start an election
I20260709 12:27:20.428665 19698 raft_consensus.cc:1081] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 LEADER]: Signalling peer 298958962bdd41fe95575d9841ccdc56 to start an election
I20260709 12:27:20.434782 19425 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b52bce4ea207438c9830561dddf50ee6"
dest_uuid: "298958962bdd41fe95575d9841ccdc56"
 from {username='slave'} at 127.0.0.1:45046
I20260709 12:27:20.435446 19425 raft_consensus.cc:493] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:20.435894 19425 raft_consensus.cc:3060] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:20.447216 19425 raft_consensus.cc:515] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:20.449093 19425 leader_election.cc:290] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 3 election: Requested vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315)
I20260709 12:27:20.449970 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52bce4ea207438c9830561dddf50ee6" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5924eff3e27946ee95859aa91a310ac3"
I20260709 12:27:20.450223 19350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52bce4ea207438c9830561dddf50ee6" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
I20260709 12:27:20.450822 19621 raft_consensus.cc:3060] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:20.450853 19350 raft_consensus.cc:3055] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:20.451268 19350 raft_consensus.cc:740] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0e78a1fe6ea845f5bcd564ad658ec40c, State: Running, Role: LEADER
I20260709 12:27:20.451862 19350 consensus_queue.cc:260] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:20.452813 19350 raft_consensus.cc:3060] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:20.456912 19621 raft_consensus.cc:2468] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 298958962bdd41fe95575d9841ccdc56 in term 3.
I20260709 12:27:20.458206 19350 raft_consensus.cc:2468] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 298958962bdd41fe95575d9841ccdc56 in term 3.
I20260709 12:27:20.458343 19392 leader_election.cc:304] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 298958962bdd41fe95575d9841ccdc56, 5924eff3e27946ee95859aa91a310ac3; no voters: 
I20260709 12:27:20.459237 19673 raft_consensus.cc:2804] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:20.459637 19673 raft_consensus.cc:697] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 3 LEADER]: Becoming Leader. State: Replica: 298958962bdd41fe95575d9841ccdc56, State: Running, Role: LEADER
I20260709 12:27:20.460413 19673 consensus_queue.cc:237] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:20.467278 19174 catalog_manager.cc:5697] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 reported cstate change: term changed from 2 to 3, leader changed from 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194) to 298958962bdd41fe95575d9841ccdc56 (127.9.145.195). New cstate: current_term: 3 leader_uuid: "298958962bdd41fe95575d9841ccdc56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:20.655941 19707 raft_consensus.cc:993] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c: : Instructing follower 298958962bdd41fe95575d9841ccdc56 to start an election
I20260709 12:27:20.656388 19698 raft_consensus.cc:1081] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 LEADER]: Signalling peer 298958962bdd41fe95575d9841ccdc56 to start an election
I20260709 12:27:20.658001 19425 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d27567ec64648da953818113fca8920"
dest_uuid: "298958962bdd41fe95575d9841ccdc56"
 from {username='slave'} at 127.0.0.1:45046
I20260709 12:27:20.658546 19425 raft_consensus.cc:493] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:20.658840 19425 raft_consensus.cc:3060] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:20.664639 19425 raft_consensus.cc:515] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } }
I20260709 12:27:20.666415 19425 leader_election.cc:290] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 3 election: Requested vote from peers 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315), 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521)
I20260709 12:27:20.667531 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d27567ec64648da953818113fca8920" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5924eff3e27946ee95859aa91a310ac3"
I20260709 12:27:20.667779 19350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d27567ec64648da953818113fca8920" candidate_uuid: "298958962bdd41fe95575d9841ccdc56" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
I20260709 12:27:20.668267 19621 raft_consensus.cc:3060] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:20.668321 19350 raft_consensus.cc:3055] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:20.668761 19350 raft_consensus.cc:740] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0e78a1fe6ea845f5bcd564ad658ec40c, State: Running, Role: LEADER
I20260709 12:27:20.669832 19350 consensus_queue.cc:260] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } }
I20260709 12:27:20.671317 19350 raft_consensus.cc:3060] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:20.676522 19621 raft_consensus.cc:2468] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 298958962bdd41fe95575d9841ccdc56 in term 3.
I20260709 12:27:20.677852 19392 leader_election.cc:304] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 298958962bdd41fe95575d9841ccdc56, 5924eff3e27946ee95859aa91a310ac3; no voters: 
I20260709 12:27:20.678718 19673 raft_consensus.cc:2804] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:20.678767 19350 raft_consensus.cc:2468] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 298958962bdd41fe95575d9841ccdc56 in term 3.
I20260709 12:27:20.679225 19673 raft_consensus.cc:697] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [term 3 LEADER]: Becoming Leader. State: Replica: 298958962bdd41fe95575d9841ccdc56, State: Running, Role: LEADER
I20260709 12:27:20.680197 19673 consensus_queue.cc:237] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } }
I20260709 12:27:20.687121 19174 catalog_manager.cc:5697] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 reported cstate change: term changed from 2 to 3, leader changed from 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194) to 298958962bdd41fe95575d9841ccdc56 (127.9.145.195). New cstate: current_term: 3 leader_uuid: "298958962bdd41fe95575d9841ccdc56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:20.889587 19350 raft_consensus.cc:1275] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 3 FOLLOWER]: Refusing update from remote peer 298958962bdd41fe95575d9841ccdc56: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:20.890817 19673 consensus_queue.cc:1048] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:20.898751 19621 raft_consensus.cc:1275] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3 [term 3 FOLLOWER]: Refusing update from remote peer 298958962bdd41fe95575d9841ccdc56: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:20.900691 19673 consensus_queue.cc:1048] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:27:20.903550 19223 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:27:21.080751 19350 raft_consensus.cc:1275] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 3 FOLLOWER]: Refusing update from remote peer 298958962bdd41fe95575d9841ccdc56: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:21.081975 19673 consensus_queue.cc:1048] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:21.092286 19621 raft_consensus.cc:1275] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3 [term 3 FOLLOWER]: Refusing update from remote peer 298958962bdd41fe95575d9841ccdc56: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:21.094129 19720 consensus_queue.cc:1048] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:21.360895  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:21.369692 19425 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bd3742c69244d18847d16a933efdcc1"
dest_uuid: "298958962bdd41fe95575d9841ccdc56"
mode: GRACEFUL
new_leader_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
 from {username='slave'} at 127.0.0.1:45062
I20260709 12:27:21.370576 19425 raft_consensus.cc:606] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [term 1 LEADER]: Received request to transfer leadership to TS 0e78a1fe6ea845f5bcd564ad658ec40c
I20260709 12:27:21.374029 19673 raft_consensus.cc:993] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56: : Instructing follower 0e78a1fe6ea845f5bcd564ad658ec40c to start an election
I20260709 12:27:21.374531 19720 raft_consensus.cc:1081] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [term 1 LEADER]: Signalling peer 0e78a1fe6ea845f5bcd564ad658ec40c to start an election
I20260709 12:27:21.374792 19425 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b52bce4ea207438c9830561dddf50ee6"
dest_uuid: "298958962bdd41fe95575d9841ccdc56"
mode: GRACEFUL
new_leader_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
 from {username='slave'} at 127.0.0.1:45062
I20260709 12:27:21.375605 19425 raft_consensus.cc:606] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 3 LEADER]: Received request to transfer leadership to TS 0e78a1fe6ea845f5bcd564ad658ec40c
I20260709 12:27:21.376520 19352 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bd3742c69244d18847d16a933efdcc1"
dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
 from {username='slave'} at 127.0.0.1:48040
I20260709 12:27:21.376820  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:27:21.377318 19352 raft_consensus.cc:493] T 0bd3742c69244d18847d16a933efdcc1 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:21.377720  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:21.377789 19352 raft_consensus.cc:3060] T 0bd3742c69244d18847d16a933efdcc1 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:21.378288 19720 raft_consensus.cc:993] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56: : Instructing follower 0e78a1fe6ea845f5bcd564ad658ec40c to start an election
I20260709 12:27:21.378796 19673 raft_consensus.cc:1081] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 3 LEADER]: Signalling peer 0e78a1fe6ea845f5bcd564ad658ec40c to start an election
I20260709 12:27:21.378755  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:21.382436 19350 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b52bce4ea207438c9830561dddf50ee6"
dest_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c"
 from {username='slave'} at 127.0.0.1:48040
I20260709 12:27:21.383033 19350 raft_consensus.cc:493] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:21.383370 19350 raft_consensus.cc:3060] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:21.387501 19352 raft_consensus.cc:515] T 0bd3742c69244d18847d16a933efdcc1 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:21.389894 19352 leader_election.cc:290] T 0bd3742c69244d18847d16a933efdcc1 P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 2 election: Requested vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685)
I20260709 12:27:21.390724 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd3742c69244d18847d16a933efdcc1" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5924eff3e27946ee95859aa91a310ac3"
I20260709 12:27:21.391054 19425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd3742c69244d18847d16a933efdcc1" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "298958962bdd41fe95575d9841ccdc56"
I20260709 12:27:21.390834 19350 raft_consensus.cc:515] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:21.391575 19621 raft_consensus.cc:3060] T 0bd3742c69244d18847d16a933efdcc1 P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:21.391697 19425 raft_consensus.cc:3055] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:21.392119 19425 raft_consensus.cc:740] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 298958962bdd41fe95575d9841ccdc56, State: Running, Role: LEADER
I20260709 12:27:21.393082 19425 consensus_queue.cc:260] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:21.393501 19622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52bce4ea207438c9830561dddf50ee6" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5924eff3e27946ee95859aa91a310ac3"
I20260709 12:27:21.394047 19622 raft_consensus.cc:3060] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:21.394757 19425 raft_consensus.cc:3060] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:21.396981 19426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52bce4ea207438c9830561dddf50ee6" candidate_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "298958962bdd41fe95575d9841ccdc56"
I20260709 12:27:21.397574 19426 raft_consensus.cc:3055] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:21.397930 19426 raft_consensus.cc:740] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 298958962bdd41fe95575d9841ccdc56, State: Running, Role: LEADER
I20260709 12:27:21.398869 19426 consensus_queue.cc:260] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:21.399860 19621 raft_consensus.cc:2468] T 0bd3742c69244d18847d16a933efdcc1 P 5924eff3e27946ee95859aa91a310ac3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e78a1fe6ea845f5bcd564ad658ec40c in term 2.
I20260709 12:27:21.400048 19426 raft_consensus.cc:3060] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:21.401398 19318 leader_election.cc:304] T 0bd3742c69244d18847d16a933efdcc1 P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 5924eff3e27946ee95859aa91a310ac3; no voters: 
I20260709 12:27:21.392832 19350 leader_election.cc:290] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 4 election: Requested vote from peers 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521), 298958962bdd41fe95575d9841ccdc56 (127.9.145.195:34685)
I20260709 12:27:21.402248 19698 raft_consensus.cc:2804] T 0bd3742c69244d18847d16a933efdcc1 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:21.404822 19698 raft_consensus.cc:697] T 0bd3742c69244d18847d16a933efdcc1 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 LEADER]: Becoming Leader. State: Replica: 0e78a1fe6ea845f5bcd564ad658ec40c, State: Running, Role: LEADER
I20260709 12:27:21.405740 19425 raft_consensus.cc:2468] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e78a1fe6ea845f5bcd564ad658ec40c in term 2.
I20260709 12:27:21.406555 19698 consensus_queue.cc:237] T 0bd3742c69244d18847d16a933efdcc1 P 0e78a1fe6ea845f5bcd564ad658ec40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:21.408048 19622 raft_consensus.cc:2468] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e78a1fe6ea845f5bcd564ad658ec40c in term 4.
I20260709 12:27:21.409085 19318 leader_election.cc:304] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e78a1fe6ea845f5bcd564ad658ec40c, 5924eff3e27946ee95859aa91a310ac3; no voters: 
I20260709 12:27:21.409736 19722 raft_consensus.cc:2804] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:21.410851 19722 raft_consensus.cc:697] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 4 LEADER]: Becoming Leader. State: Replica: 0e78a1fe6ea845f5bcd564ad658ec40c, State: Running, Role: LEADER
I20260709 12:27:21.411145 19426 raft_consensus.cc:2468] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e78a1fe6ea845f5bcd564ad658ec40c in term 4.
I20260709 12:27:21.411741 19722 consensus_queue.cc:237] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } }
I20260709 12:27:21.416402 19171 catalog_manager.cc:5697] T 0bd3742c69244d18847d16a933efdcc1 P 0e78a1fe6ea845f5bcd564ad658ec40c reported cstate change: term changed from 1 to 2, leader changed from 298958962bdd41fe95575d9841ccdc56 (127.9.145.195) to 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194). New cstate: current_term: 2 leader_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:21.432106 19171 catalog_manager.cc:5697] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c reported cstate change: term changed from 3 to 4, leader changed from 298958962bdd41fe95575d9841ccdc56 (127.9.145.195) to 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194). New cstate: current_term: 4 leader_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e78a1fe6ea845f5bcd564ad658ec40c" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 45315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:21.850458 19425 raft_consensus.cc:1275] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [term 2 FOLLOWER]: Refusing update from remote peer 0e78a1fe6ea845f5bcd564ad658ec40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:21.851661 19722 consensus_queue.cc:1048] T 0bd3742c69244d18847d16a933efdcc1 P 0e78a1fe6ea845f5bcd564ad658ec40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:21.864225 19622 raft_consensus.cc:1275] T 0bd3742c69244d18847d16a933efdcc1 P 5924eff3e27946ee95859aa91a310ac3 [term 2 FOLLOWER]: Refusing update from remote peer 0e78a1fe6ea845f5bcd564ad658ec40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:21.866950 19722 consensus_queue.cc:1048] T 0bd3742c69244d18847d16a933efdcc1 P 0e78a1fe6ea845f5bcd564ad658ec40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:21.897374 19426 raft_consensus.cc:1275] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 4 FOLLOWER]: Refusing update from remote peer 0e78a1fe6ea845f5bcd564ad658ec40c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:21.898630 19698 consensus_queue.cc:1048] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "298958962bdd41fe95575d9841ccdc56" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 34685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:21.901201 19622 raft_consensus.cc:1275] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3 [term 4 FOLLOWER]: Refusing update from remote peer 0e78a1fe6ea845f5bcd564ad658ec40c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:21.902699 19698 consensus_queue.cc:1048] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5924eff3e27946ee95859aa91a310ac3" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:27:21.904706 19223 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:27:22.387724  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:22.420069  9799 tablet_server.cc:179] TabletServer@127.9.145.193:35521 shutting down...
W20260709 12:27:22.446346 19318 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 92 similar messages]
I20260709 12:27:22.446750  9799 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:22.447944  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:22.449115  9799 raft_consensus.cc:2243] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3 [term 4 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:22.449388 19318 consensus_peers.cc:597] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:22.449756  9799 raft_consensus.cc:2272] T b52bce4ea207438c9830561dddf50ee6 P 5924eff3e27946ee95859aa91a310ac3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.452975  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:22.453719  9799 raft_consensus.cc:2243] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.454246  9799 raft_consensus.cc:2272] T 9d27567ec64648da953818113fca8920 P 5924eff3e27946ee95859aa91a310ac3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.456997  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:22.457597  9799 raft_consensus.cc:2243] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.458073  9799 raft_consensus.cc:2272] T 8cdc52ff09ec40c582ff078f8d61029f P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.460616  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:22.461205  9799 raft_consensus.cc:2243] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.461663  9799 raft_consensus.cc:2272] T ba07e5f1b5f14036bd2155d3e47e008a P 5924eff3e27946ee95859aa91a310ac3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.464697  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:22.465600  9799 raft_consensus.cc:2243] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.466136  9799 raft_consensus.cc:2272] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 5924eff3e27946ee95859aa91a310ac3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:22.467307 19392 consensus_peers.cc:597] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:22.468716  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:22.469448  9799 raft_consensus.cc:2243] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.469962  9799 raft_consensus.cc:2272] T 4831316659774caf9b5a1bac14d279e0 P 5924eff3e27946ee95859aa91a310ac3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.472523  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:22.473114  9799 raft_consensus.cc:2243] T 0bd3742c69244d18847d16a933efdcc1 P 5924eff3e27946ee95859aa91a310ac3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.473564  9799 raft_consensus.cc:2272] T 0bd3742c69244d18847d16a933efdcc1 P 5924eff3e27946ee95859aa91a310ac3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.476420  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:22.476994  9799 raft_consensus.cc:2243] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.477504  9799 raft_consensus.cc:2272] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 5924eff3e27946ee95859aa91a310ac3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.479933  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:22.480463  9799 raft_consensus.cc:2243] T 35c9c4b10c8144a089d4a67b3bc2d167 P 5924eff3e27946ee95859aa91a310ac3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.480913  9799 raft_consensus.cc:2272] T 35c9c4b10c8144a089d4a67b3bc2d167 P 5924eff3e27946ee95859aa91a310ac3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.483234  9799 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:22.483743  9799 raft_consensus.cc:2243] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.484225  9799 raft_consensus.cc:2272] T b7c87e92594d479988a81bd758077e6d P 5924eff3e27946ee95859aa91a310ac3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:22.507028 19318 consensus_peers.cc:597] T 35c9c4b10c8144a089d4a67b3bc2d167 P 0e78a1fe6ea845f5bcd564ad658ec40c -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:22.515839  9799 tablet_server.cc:196] TabletServer@127.9.145.193:35521 shutdown complete.
W20260709 12:27:22.534476 19392 consensus_peers.cc:597] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:22.544579  9799 tablet_server.cc:179] TabletServer@127.9.145.194:0 shutting down...
W20260709 12:27:22.553726 19392 consensus_peers.cc:597] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 -> Peer 5924eff3e27946ee95859aa91a310ac3 (127.9.145.193:35521): Couldn't send request to peer 5924eff3e27946ee95859aa91a310ac3. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:35521: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:22.567320 19392 consensus_peers.cc:597] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 298958962bdd41fe95575d9841ccdc56 -> Peer 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315): Couldn't send request to peer 0e78a1fe6ea845f5bcd564ad658ec40c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:22.571041  9799 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:22.572016  9799 tablet_replica.cc:333] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c: stopping tablet replica
I20260709 12:27:22.572955  9799 raft_consensus.cc:2243] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:27:22.573144 19392 consensus_peers.cc:597] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 -> Peer 0e78a1fe6ea845f5bcd564ad658ec40c (127.9.145.194:45315): Couldn't send request to peer 0e78a1fe6ea845f5bcd564ad658ec40c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:22.574191  9799 raft_consensus.cc:2272] T ba07e5f1b5f14036bd2155d3e47e008a P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.576835  9799 tablet_replica.cc:333] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c: stopping tablet replica
I20260709 12:27:22.577556  9799 raft_consensus.cc:2243] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:22.578580  9799 raft_consensus.cc:2272] T 8cdc52ff09ec40c582ff078f8d61029f P 0e78a1fe6ea845f5bcd564ad658ec40c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.580935  9799 tablet_replica.cc:333] T 35c9c4b10c8144a089d4a67b3bc2d167 P 0e78a1fe6ea845f5bcd564ad658ec40c: stopping tablet replica
I20260709 12:27:22.581550  9799 raft_consensus.cc:2243] T 35c9c4b10c8144a089d4a67b3bc2d167 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:22.582382  9799 raft_consensus.cc:2272] T 35c9c4b10c8144a089d4a67b3bc2d167 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.584640  9799 tablet_replica.cc:333] T 0bd3742c69244d18847d16a933efdcc1 P 0e78a1fe6ea845f5bcd564ad658ec40c: stopping tablet replica
I20260709 12:27:22.585243  9799 raft_consensus.cc:2243] T 0bd3742c69244d18847d16a933efdcc1 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:22.586016  9799 raft_consensus.cc:2272] T 0bd3742c69244d18847d16a933efdcc1 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.588562  9799 tablet_replica.cc:333] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c: stopping tablet replica
I20260709 12:27:22.589180  9799 raft_consensus.cc:2243] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.589640  9799 raft_consensus.cc:2272] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.591887  9799 tablet_replica.cc:333] T 4831316659774caf9b5a1bac14d279e0 P 0e78a1fe6ea845f5bcd564ad658ec40c: stopping tablet replica
I20260709 12:27:22.592456  9799 raft_consensus.cc:2243] T 4831316659774caf9b5a1bac14d279e0 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.592999  9799 raft_consensus.cc:2272] T 4831316659774caf9b5a1bac14d279e0 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.595443  9799 tablet_replica.cc:333] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c: stopping tablet replica
I20260709 12:27:22.595968  9799 raft_consensus.cc:2243] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.596429  9799 raft_consensus.cc:2272] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.598647  9799 tablet_replica.cc:333] T b7c87e92594d479988a81bd758077e6d P 0e78a1fe6ea845f5bcd564ad658ec40c: stopping tablet replica
I20260709 12:27:22.599226  9799 raft_consensus.cc:2243] T b7c87e92594d479988a81bd758077e6d P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:22.600096  9799 raft_consensus.cc:2272] T b7c87e92594d479988a81bd758077e6d P 0e78a1fe6ea845f5bcd564ad658ec40c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.602351  9799 tablet_replica.cc:333] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c: stopping tablet replica
I20260709 12:27:22.602849  9799 raft_consensus.cc:2243] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:22.603636  9799 raft_consensus.cc:2272] T b52bce4ea207438c9830561dddf50ee6 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.606308  9799 tablet_replica.cc:333] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c: stopping tablet replica
I20260709 12:27:22.606871  9799 raft_consensus.cc:2243] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.607316  9799 raft_consensus.cc:2272] T 9d27567ec64648da953818113fca8920 P 0e78a1fe6ea845f5bcd564ad658ec40c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.641645  9799 tablet_server.cc:196] TabletServer@127.9.145.194:0 shutdown complete.
I20260709 12:27:22.668785  9799 tablet_server.cc:179] TabletServer@127.9.145.195:0 shutting down...
I20260709 12:27:22.692747  9799 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:22.693495  9799 tablet_replica.cc:333] T ba07e5f1b5f14036bd2155d3e47e008a P 298958962bdd41fe95575d9841ccdc56: stopping tablet replica
I20260709 12:27:22.694244  9799 raft_consensus.cc:2243] T ba07e5f1b5f14036bd2155d3e47e008a P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.694741  9799 raft_consensus.cc:2272] T ba07e5f1b5f14036bd2155d3e47e008a P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.697052  9799 tablet_replica.cc:333] T 8cdc52ff09ec40c582ff078f8d61029f P 298958962bdd41fe95575d9841ccdc56: stopping tablet replica
I20260709 12:27:22.697625  9799 raft_consensus.cc:2243] T 8cdc52ff09ec40c582ff078f8d61029f P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.698086  9799 raft_consensus.cc:2272] T 8cdc52ff09ec40c582ff078f8d61029f P 298958962bdd41fe95575d9841ccdc56 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.700474  9799 tablet_replica.cc:333] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56: stopping tablet replica
I20260709 12:27:22.701052  9799 raft_consensus.cc:2243] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:22.701859  9799 raft_consensus.cc:2272] T 06cbe0f5cc0a42fcb50365c0ce355c71 P 298958962bdd41fe95575d9841ccdc56 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.704052  9799 tablet_replica.cc:333] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56: stopping tablet replica
I20260709 12:27:22.704563  9799 raft_consensus.cc:2243] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.704957  9799 raft_consensus.cc:2272] T 0bd3742c69244d18847d16a933efdcc1 P 298958962bdd41fe95575d9841ccdc56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.708067  9799 tablet_replica.cc:333] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56: stopping tablet replica
I20260709 12:27:22.708678  9799 raft_consensus.cc:2243] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:22.709518  9799 raft_consensus.cc:2272] T 4831316659774caf9b5a1bac14d279e0 P 298958962bdd41fe95575d9841ccdc56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.711859  9799 tablet_replica.cc:333] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 298958962bdd41fe95575d9841ccdc56: stopping tablet replica
I20260709 12:27:22.712386  9799 raft_consensus.cc:2243] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 298958962bdd41fe95575d9841ccdc56 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:22.713218  9799 raft_consensus.cc:2272] T 4072c2eca5ff4c9fa4fceaa513e8f5ad P 298958962bdd41fe95575d9841ccdc56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.715579  9799 tablet_replica.cc:333] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56: stopping tablet replica
I20260709 12:27:22.716073  9799 raft_consensus.cc:2243] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.716467  9799 raft_consensus.cc:2272] T 35c9c4b10c8144a089d4a67b3bc2d167 P 298958962bdd41fe95575d9841ccdc56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.718705  9799 tablet_replica.cc:333] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56: stopping tablet replica
I20260709 12:27:22.719237  9799 raft_consensus.cc:2243] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.719640  9799 raft_consensus.cc:2272] T b52bce4ea207438c9830561dddf50ee6 P 298958962bdd41fe95575d9841ccdc56 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.722353  9799 tablet_replica.cc:333] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56: stopping tablet replica
I20260709 12:27:22.722915  9799 raft_consensus.cc:2243] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:22.723721  9799 raft_consensus.cc:2272] T 9d27567ec64648da953818113fca8920 P 298958962bdd41fe95575d9841ccdc56 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.726012  9799 tablet_replica.cc:333] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56: stopping tablet replica
I20260709 12:27:22.726545  9799 raft_consensus.cc:2243] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.727030  9799 raft_consensus.cc:2272] T b7c87e92594d479988a81bd758077e6d P 298958962bdd41fe95575d9841ccdc56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.763990  9799 tablet_server.cc:196] TabletServer@127.9.145.195:0 shutdown complete.
I20260709 12:27:22.792086  9799 master.cc:562] Master@127.9.145.254:38757 shutting down...
I20260709 12:27:22.814234  9799 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5645d87757224e6cb583445f296450ef [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:22.814772  9799 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5645d87757224e6cb583445f296450ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.815083  9799 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5645d87757224e6cb583445f296450ef: stopping tablet replica
I20260709 12:27:22.834750  9799 master.cc:584] Master@127.9.145.254:38757 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13168 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:27:22.881017  9799 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.145.254:39507
I20260709 12:27:22.882259  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:22.888608 19741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:22.888675 19742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:22.889153 19744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:22.889842  9799 server_base.cc:1061] running on GCE node
I20260709 12:27:22.890867  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:22.891083  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:22.891245  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783600042891228 us; error 0 us; skew 500 ppm
I20260709 12:27:22.891814  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:22.894415  9799 webserver.cc:533] Webserver started at http://127.9.145.254:43517/ using document root <none> and password file <none>
I20260709 12:27:22.895001  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:22.895181  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:22.895484  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:22.896703  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599719482688-9799-0/minicluster-data/master-0-root/instance:
uuid: "b25f1711e708473eb33f90ff5f53d4f0"
format_stamp: "Formatted at 2026-07-09 12:27:22 on dist-test-slave-1sdq"
I20260709 12:27:22.901418  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:27:22.905146 19749 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:22.905999  9799 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:27:22.906370  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599719482688-9799-0/minicluster-data/master-0-root
uuid: "b25f1711e708473eb33f90ff5f53d4f0"
format_stamp: "Formatted at 2026-07-09 12:27:22 on dist-test-slave-1sdq"
I20260709 12:27:22.906669  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599719482688-9799-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599719482688-9799-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599719482688-9799-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:22.928442  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:22.929813  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:22.969121  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.254:39507
I20260709 12:27:22.969269 19800 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.254:39507 every 8 connection(s)
I20260709 12:27:22.973337 19801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.985761 19801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b25f1711e708473eb33f90ff5f53d4f0: Bootstrap starting.
I20260709 12:27:22.990929 19801 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b25f1711e708473eb33f90ff5f53d4f0: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:22.995561 19801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b25f1711e708473eb33f90ff5f53d4f0: No bootstrap required, opened a new log
I20260709 12:27:22.997925 19801 raft_consensus.cc:359] T 00000000000000000000000000000000 P b25f1711e708473eb33f90ff5f53d4f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b25f1711e708473eb33f90ff5f53d4f0" member_type: VOTER }
I20260709 12:27:22.998389 19801 raft_consensus.cc:385] T 00000000000000000000000000000000 P b25f1711e708473eb33f90ff5f53d4f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:22.998632 19801 raft_consensus.cc:740] T 00000000000000000000000000000000 P b25f1711e708473eb33f90ff5f53d4f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f1711e708473eb33f90ff5f53d4f0, State: Initialized, Role: FOLLOWER
I20260709 12:27:22.999212 19801 consensus_queue.cc:260] T 00000000000000000000000000000000 P b25f1711e708473eb33f90ff5f53d4f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b25f1711e708473eb33f90ff5f53d4f0" member_type: VOTER }
I20260709 12:27:22.999688 19801 raft_consensus.cc:399] T 00000000000000000000000000000000 P b25f1711e708473eb33f90ff5f53d4f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:27:22.999907 19801 raft_consensus.cc:493] T 00000000000000000000000000000000 P b25f1711e708473eb33f90ff5f53d4f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:27:23.000172 19801 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b25f1711e708473eb33f90ff5f53d4f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:23.005527 19801 raft_consensus.cc:515] T 00000000000000000000000000000000 P b25f1711e708473eb33f90ff5f53d4f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b25f1711e708473eb33f90ff5f53d4f0" member_type: VOTER }
I20260709 12:27:23.006158 19801 leader_election.cc:304] T 00000000000000000000000000000000 P b25f1711e708473eb33f90ff5f53d4f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b25f1711e708473eb33f90ff5f53d4f0; no voters: 
I20260709 12:27:23.007299 19801 leader_election.cc:290] T 00000000000000000000000000000000 P b25f1711e708473eb33f90ff5f53d4f0 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:27:23.007658 19804 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b25f1711e708473eb33f90ff5f53d4f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:23.009040 19804 raft_consensus.cc:697] T 00000000000000000000000000000000 P b25f1711e708473eb33f90ff5f53d4f0 [term 1 LEADER]: Becoming Leader. State: Replica: b25f1711e708473eb33f90ff5f53d4f0, State: Running, Role: LEADER
I20260709 12:27:23.009763 19804 consensus_queue.cc:237] T 00000000000000000000000000000000 P b25f1711e708473eb33f90ff5f53d4f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b25f1711e708473eb33f90ff5f53d4f0" member_type: VOTER }
I20260709 12:27:23.010474 19801 sys_catalog.cc:565] T 00000000000000000000000000000000 P b25f1711e708473eb33f90ff5f53d4f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:27:23.014076 19805 sys_catalog.cc:455] T 00000000000000000000000000000000 P b25f1711e708473eb33f90ff5f53d4f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b25f1711e708473eb33f90ff5f53d4f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b25f1711e708473eb33f90ff5f53d4f0" member_type: VOTER } }
I20260709 12:27:23.014690 19806 sys_catalog.cc:455] T 00000000000000000000000000000000 P b25f1711e708473eb33f90ff5f53d4f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b25f1711e708473eb33f90ff5f53d4f0. Latest consensus state: current_term: 1 leader_uuid: "b25f1711e708473eb33f90ff5f53d4f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b25f1711e708473eb33f90ff5f53d4f0" member_type: VOTER } }
I20260709 12:27:23.015298 19805 sys_catalog.cc:458] T 00000000000000000000000000000000 P b25f1711e708473eb33f90ff5f53d4f0 [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:23.015365 19806 sys_catalog.cc:458] T 00000000000000000000000000000000 P b25f1711e708473eb33f90ff5f53d4f0 [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:23.020696 19811 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:27:23.026965 19811 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:27:23.028035  9799 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:27:23.036095 19811 catalog_manager.cc:1383] Generated new cluster ID: af54a4589e2641c1a7eb1f6d49581d83
I20260709 12:27:23.036386 19811 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:27:23.050558 19811 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:27:23.051900 19811 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:27:23.068203 19811 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b25f1711e708473eb33f90ff5f53d4f0: Generated new TSK 0
I20260709 12:27:23.068816 19811 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:27:23.095422  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:23.101483 19822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:23.102591 19823 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:23.104053 19825 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:23.104349  9799 server_base.cc:1061] running on GCE node
I20260709 12:27:23.105332  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:23.105532  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:23.105741  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783600043105701 us; error 0 us; skew 500 ppm
I20260709 12:27:23.106352  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:23.108796  9799 webserver.cc:533] Webserver started at http://127.9.145.193:42515/ using document root <none> and password file <none>
I20260709 12:27:23.109282  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:23.109465  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:23.109725  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:23.110926  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599719482688-9799-0/minicluster-data/ts-0-root/instance:
uuid: "f530da9a3fdf4391ac68411923f40a9c"
format_stamp: "Formatted at 2026-07-09 12:27:23 on dist-test-slave-1sdq"
I20260709 12:27:23.115713  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 12:27:23.119340 19830 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:23.120193  9799 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:27:23.120512  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599719482688-9799-0/minicluster-data/ts-0-root
uuid: "f530da9a3fdf4391ac68411923f40a9c"
format_stamp: "Formatted at 2026-07-09 12:27:23 on dist-test-slave-1sdq"
I20260709 12:27:23.120815  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599719482688-9799-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599719482688-9799-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599719482688-9799-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:23.148757  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:23.150027  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:23.151566  9799 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:23.153858  9799 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:23.154076  9799 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:23.154342  9799 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:23.154511  9799 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:23.196182  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.193:44463
I20260709 12:27:23.196321 19892 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.193:44463 every 8 connection(s)
I20260709 12:27:23.201663  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:23.209089 19897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:23.209721 19898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:23.211645 19900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:23.213727  9799 server_base.cc:1061] running on GCE node
I20260709 12:27:23.214910 19893 heartbeater.cc:344] Connected to a master server at 127.9.145.254:39507
I20260709 12:27:23.215091  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:27:23.215346 19893 heartbeater.cc:461] Registering TS with master...
W20260709 12:27:23.215461  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:23.215699  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783600043215681 us; error 0 us; skew 500 ppm
I20260709 12:27:23.216209 19893 heartbeater.cc:507] Master 127.9.145.254:39507 requested a full tablet report, sending...
I20260709 12:27:23.216377  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:23.218797 19766 ts_manager.cc:194] Registered new tserver with Master: f530da9a3fdf4391ac68411923f40a9c (127.9.145.193:44463)
I20260709 12:27:23.219300  9799 webserver.cc:533] Webserver started at http://127.9.145.194:34095/ using document root <none> and password file <none>
I20260709 12:27:23.219844  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:23.220050  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:23.220319  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:23.220893 19766 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45614
I20260709 12:27:23.221735  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599719482688-9799-0/minicluster-data/ts-1-root/instance:
uuid: "8ddb3044320b43f7b381f52701f76c82"
format_stamp: "Formatted at 2026-07-09 12:27:23 on dist-test-slave-1sdq"
I20260709 12:27:23.226727  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:27:23.230520 19905 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:23.231323  9799 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:27:23.231648  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599719482688-9799-0/minicluster-data/ts-1-root
uuid: "8ddb3044320b43f7b381f52701f76c82"
format_stamp: "Formatted at 2026-07-09 12:27:23 on dist-test-slave-1sdq"
I20260709 12:27:23.231974  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599719482688-9799-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599719482688-9799-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599719482688-9799-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:23.250752  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:23.252040  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:23.253597  9799 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:23.256047  9799 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:23.256299  9799 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:23.256554  9799 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:23.256716  9799 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:23.304764  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.194:38193
I20260709 12:27:23.304876 19967 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.194:38193 every 8 connection(s)
I20260709 12:27:23.310012  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:23.318974 19971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:23.319016 19972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:23.322499 19968 heartbeater.cc:344] Connected to a master server at 127.9.145.254:39507
W20260709 12:27:23.322690 19974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:23.323195 19968 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:23.324276 19968 heartbeater.cc:507] Master 127.9.145.254:39507 requested a full tablet report, sending...
I20260709 12:27:23.324573  9799 server_base.cc:1061] running on GCE node
I20260709 12:27:23.325733  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:23.325964  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:23.326191  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783600043326171 us; error 0 us; skew 500 ppm
I20260709 12:27:23.326735  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:23.326872 19766 ts_manager.cc:194] Registered new tserver with Master: 8ddb3044320b43f7b381f52701f76c82 (127.9.145.194:38193)
I20260709 12:27:23.328675 19766 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45620
I20260709 12:27:23.329542  9799 webserver.cc:533] Webserver started at http://127.9.145.195:46173/ using document root <none> and password file <none>
I20260709 12:27:23.330224  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:23.330447  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:23.330734  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:23.331990  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599719482688-9799-0/minicluster-data/ts-2-root/instance:
uuid: "d3a31dc990cc4add9dd80576101ce350"
format_stamp: "Formatted at 2026-07-09 12:27:23 on dist-test-slave-1sdq"
I20260709 12:27:23.336993  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:27:23.340904 19979 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:23.341863  9799 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:27:23.342244  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599719482688-9799-0/minicluster-data/ts-2-root
uuid: "d3a31dc990cc4add9dd80576101ce350"
format_stamp: "Formatted at 2026-07-09 12:27:23 on dist-test-slave-1sdq"
I20260709 12:27:23.342554  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599719482688-9799-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599719482688-9799-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599719482688-9799-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:23.353153  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:23.354478  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:23.355934  9799 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:23.358330  9799 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:23.358556  9799 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:23.358784  9799 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:23.358937  9799 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:23.399811  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.195:44833
I20260709 12:27:23.399910 20041 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.195:44833 every 8 connection(s)
I20260709 12:27:23.413970 20042 heartbeater.cc:344] Connected to a master server at 127.9.145.254:39507
I20260709 12:27:23.414476 20042 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:23.415259 20042 heartbeater.cc:507] Master 127.9.145.254:39507 requested a full tablet report, sending...
I20260709 12:27:23.417330 19766 ts_manager.cc:194] Registered new tserver with Master: d3a31dc990cc4add9dd80576101ce350 (127.9.145.195:44833)
I20260709 12:27:23.418229  9799 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015184028s
I20260709 12:27:23.419085 19766 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45626
I20260709 12:27:23.444672 19766 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45642:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:27:23.446883 19766 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:27:23.492133 19858 tablet_service.cc:1511] Processing CreateTablet for tablet ab344f5b13f24784b8ca5136f0ec53e6 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=434db9d82e5e4bf68624fbd6d092a073]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:27:23.493392 19858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab344f5b13f24784b8ca5136f0ec53e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.492527 19857 tablet_service.cc:1511] Processing CreateTablet for tablet d6775a1abf78451bbc3c51f589f4b440 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=434db9d82e5e4bf68624fbd6d092a073]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:27:23.494724 20007 tablet_service.cc:1511] Processing CreateTablet for tablet ab344f5b13f24784b8ca5136f0ec53e6 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=434db9d82e5e4bf68624fbd6d092a073]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:27:23.495241 19857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6775a1abf78451bbc3c51f589f4b440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.496683 20006 tablet_service.cc:1511] Processing CreateTablet for tablet d6775a1abf78451bbc3c51f589f4b440 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=434db9d82e5e4bf68624fbd6d092a073]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:27:23.498088 20006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6775a1abf78451bbc3c51f589f4b440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.501617 20007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab344f5b13f24784b8ca5136f0ec53e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.503860 19933 tablet_service.cc:1511] Processing CreateTablet for tablet ab344f5b13f24784b8ca5136f0ec53e6 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=434db9d82e5e4bf68624fbd6d092a073]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:27:23.504194 19932 tablet_service.cc:1511] Processing CreateTablet for tablet d6775a1abf78451bbc3c51f589f4b440 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=434db9d82e5e4bf68624fbd6d092a073]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:27:23.505411 19933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab344f5b13f24784b8ca5136f0ec53e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.507778 19932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6775a1abf78451bbc3c51f589f4b440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.524775 20057 tablet_bootstrap.cc:492] T d6775a1abf78451bbc3c51f589f4b440 P f530da9a3fdf4391ac68411923f40a9c: Bootstrap starting.
I20260709 12:27:23.527680 20058 tablet_bootstrap.cc:492] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82: Bootstrap starting.
I20260709 12:27:23.536144 20058 tablet_bootstrap.cc:654] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.536233 20057 tablet_bootstrap.cc:654] T d6775a1abf78451bbc3c51f589f4b440 P f530da9a3fdf4391ac68411923f40a9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.543876 20059 tablet_bootstrap.cc:492] T ab344f5b13f24784b8ca5136f0ec53e6 P d3a31dc990cc4add9dd80576101ce350: Bootstrap starting.
I20260709 12:27:23.547114 20057 tablet_bootstrap.cc:492] T d6775a1abf78451bbc3c51f589f4b440 P f530da9a3fdf4391ac68411923f40a9c: No bootstrap required, opened a new log
I20260709 12:27:23.547643 20057 ts_tablet_manager.cc:1403] T d6775a1abf78451bbc3c51f589f4b440 P f530da9a3fdf4391ac68411923f40a9c: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.000s
I20260709 12:27:23.547837 20058 tablet_bootstrap.cc:492] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82: No bootstrap required, opened a new log
I20260709 12:27:23.548470 20058 ts_tablet_manager.cc:1403] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.003s
I20260709 12:27:23.550179 20057 raft_consensus.cc:359] T d6775a1abf78451bbc3c51f589f4b440 P f530da9a3fdf4391ac68411923f40a9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:23.550863 20057 raft_consensus.cc:385] T d6775a1abf78451bbc3c51f589f4b440 P f530da9a3fdf4391ac68411923f40a9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:23.551102 20057 raft_consensus.cc:740] T d6775a1abf78451bbc3c51f589f4b440 P f530da9a3fdf4391ac68411923f40a9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f530da9a3fdf4391ac68411923f40a9c, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.551782 20057 consensus_queue.cc:260] T d6775a1abf78451bbc3c51f589f4b440 P f530da9a3fdf4391ac68411923f40a9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:23.552160 20059 tablet_bootstrap.cc:654] T ab344f5b13f24784b8ca5136f0ec53e6 P d3a31dc990cc4add9dd80576101ce350: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.551653 20058 raft_consensus.cc:359] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } }
I20260709 12:27:23.552649 20058 raft_consensus.cc:385] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:23.552960 20058 raft_consensus.cc:740] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ddb3044320b43f7b381f52701f76c82, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.554327 19893 heartbeater.cc:499] Master 127.9.145.254:39507 was elected leader, sending a full tablet report...
I20260709 12:27:23.553988 20058 consensus_queue.cc:260] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } }
I20260709 12:27:23.554832 20057 ts_tablet_manager.cc:1434] T d6775a1abf78451bbc3c51f589f4b440 P f530da9a3fdf4391ac68411923f40a9c: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.005s
I20260709 12:27:23.555845 20057 tablet_bootstrap.cc:492] T ab344f5b13f24784b8ca5136f0ec53e6 P f530da9a3fdf4391ac68411923f40a9c: Bootstrap starting.
I20260709 12:27:23.562461 20057 tablet_bootstrap.cc:654] T ab344f5b13f24784b8ca5136f0ec53e6 P f530da9a3fdf4391ac68411923f40a9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.577039 19968 heartbeater.cc:499] Master 127.9.145.254:39507 was elected leader, sending a full tablet report...
I20260709 12:27:23.577980 20058 ts_tablet_manager.cc:1434] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82: Time spent starting tablet: real 0.029s	user 0.014s	sys 0.017s
I20260709 12:27:23.579290 20058 tablet_bootstrap.cc:492] T d6775a1abf78451bbc3c51f589f4b440 P 8ddb3044320b43f7b381f52701f76c82: Bootstrap starting.
I20260709 12:27:23.581050 20059 tablet_bootstrap.cc:492] T ab344f5b13f24784b8ca5136f0ec53e6 P d3a31dc990cc4add9dd80576101ce350: No bootstrap required, opened a new log
I20260709 12:27:23.581719 20059 ts_tablet_manager.cc:1403] T ab344f5b13f24784b8ca5136f0ec53e6 P d3a31dc990cc4add9dd80576101ce350: Time spent bootstrapping tablet: real 0.038s	user 0.022s	sys 0.013s
I20260709 12:27:23.583367 20057 tablet_bootstrap.cc:492] T ab344f5b13f24784b8ca5136f0ec53e6 P f530da9a3fdf4391ac68411923f40a9c: No bootstrap required, opened a new log
I20260709 12:27:23.583992 20057 ts_tablet_manager.cc:1403] T ab344f5b13f24784b8ca5136f0ec53e6 P f530da9a3fdf4391ac68411923f40a9c: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.004s
I20260709 12:27:23.585186 20059 raft_consensus.cc:359] T ab344f5b13f24784b8ca5136f0ec53e6 P d3a31dc990cc4add9dd80576101ce350 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } }
I20260709 12:27:23.586057 20059 raft_consensus.cc:385] T ab344f5b13f24784b8ca5136f0ec53e6 P d3a31dc990cc4add9dd80576101ce350 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:23.586434 20059 raft_consensus.cc:740] T ab344f5b13f24784b8ca5136f0ec53e6 P d3a31dc990cc4add9dd80576101ce350 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3a31dc990cc4add9dd80576101ce350, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.587100 20058 tablet_bootstrap.cc:654] T d6775a1abf78451bbc3c51f589f4b440 P 8ddb3044320b43f7b381f52701f76c82: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.587044 20057 raft_consensus.cc:359] T ab344f5b13f24784b8ca5136f0ec53e6 P f530da9a3fdf4391ac68411923f40a9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } }
I20260709 12:27:23.587985 20057 raft_consensus.cc:385] T ab344f5b13f24784b8ca5136f0ec53e6 P f530da9a3fdf4391ac68411923f40a9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:23.587478 20059 consensus_queue.cc:260] T ab344f5b13f24784b8ca5136f0ec53e6 P d3a31dc990cc4add9dd80576101ce350 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } }
I20260709 12:27:23.588301 20057 raft_consensus.cc:740] T ab344f5b13f24784b8ca5136f0ec53e6 P f530da9a3fdf4391ac68411923f40a9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f530da9a3fdf4391ac68411923f40a9c, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.589155 20057 consensus_queue.cc:260] T ab344f5b13f24784b8ca5136f0ec53e6 P f530da9a3fdf4391ac68411923f40a9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } }
I20260709 12:27:23.594842 20057 ts_tablet_manager.cc:1434] T ab344f5b13f24784b8ca5136f0ec53e6 P f530da9a3fdf4391ac68411923f40a9c: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:27:23.597642 20042 heartbeater.cc:499] Master 127.9.145.254:39507 was elected leader, sending a full tablet report...
I20260709 12:27:23.598354 20059 ts_tablet_manager.cc:1434] T ab344f5b13f24784b8ca5136f0ec53e6 P d3a31dc990cc4add9dd80576101ce350: Time spent starting tablet: real 0.016s	user 0.012s	sys 0.004s
I20260709 12:27:23.599647 20059 tablet_bootstrap.cc:492] T d6775a1abf78451bbc3c51f589f4b440 P d3a31dc990cc4add9dd80576101ce350: Bootstrap starting.
I20260709 12:27:23.599995 20058 tablet_bootstrap.cc:492] T d6775a1abf78451bbc3c51f589f4b440 P 8ddb3044320b43f7b381f52701f76c82: No bootstrap required, opened a new log
I20260709 12:27:23.600585 20058 ts_tablet_manager.cc:1403] T d6775a1abf78451bbc3c51f589f4b440 P 8ddb3044320b43f7b381f52701f76c82: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.011s
I20260709 12:27:23.603763 20058 raft_consensus.cc:359] T d6775a1abf78451bbc3c51f589f4b440 P 8ddb3044320b43f7b381f52701f76c82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:23.604544 20058 raft_consensus.cc:385] T d6775a1abf78451bbc3c51f589f4b440 P 8ddb3044320b43f7b381f52701f76c82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:23.604841 20058 raft_consensus.cc:740] T d6775a1abf78451bbc3c51f589f4b440 P 8ddb3044320b43f7b381f52701f76c82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ddb3044320b43f7b381f52701f76c82, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.605993 20059 tablet_bootstrap.cc:654] T d6775a1abf78451bbc3c51f589f4b440 P d3a31dc990cc4add9dd80576101ce350: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.605808 20058 consensus_queue.cc:260] T d6775a1abf78451bbc3c51f589f4b440 P 8ddb3044320b43f7b381f52701f76c82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:23.608500 20058 ts_tablet_manager.cc:1434] T d6775a1abf78451bbc3c51f589f4b440 P 8ddb3044320b43f7b381f52701f76c82: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:27:23.611995 20059 tablet_bootstrap.cc:492] T d6775a1abf78451bbc3c51f589f4b440 P d3a31dc990cc4add9dd80576101ce350: No bootstrap required, opened a new log
I20260709 12:27:23.612721 20059 ts_tablet_manager.cc:1403] T d6775a1abf78451bbc3c51f589f4b440 P d3a31dc990cc4add9dd80576101ce350: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:27:23.615693 20059 raft_consensus.cc:359] T d6775a1abf78451bbc3c51f589f4b440 P d3a31dc990cc4add9dd80576101ce350 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:23.616259 20059 raft_consensus.cc:385] T d6775a1abf78451bbc3c51f589f4b440 P d3a31dc990cc4add9dd80576101ce350 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:23.616498 20059 raft_consensus.cc:740] T d6775a1abf78451bbc3c51f589f4b440 P d3a31dc990cc4add9dd80576101ce350 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3a31dc990cc4add9dd80576101ce350, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.617161 20059 consensus_queue.cc:260] T d6775a1abf78451bbc3c51f589f4b440 P d3a31dc990cc4add9dd80576101ce350 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:23.619139 20059 ts_tablet_manager.cc:1434] T d6775a1abf78451bbc3c51f589f4b440 P d3a31dc990cc4add9dd80576101ce350: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:27:23.700325 20063 raft_consensus.cc:493] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.700922 20063 raft_consensus.cc:515] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } }
I20260709 12:27:23.703213 20063 leader_election.cc:290] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f530da9a3fdf4391ac68411923f40a9c (127.9.145.193:44463), d3a31dc990cc4add9dd80576101ce350 (127.9.145.195:44833)
I20260709 12:27:23.712144 19868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab344f5b13f24784b8ca5136f0ec53e6" candidate_uuid: "8ddb3044320b43f7b381f52701f76c82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f530da9a3fdf4391ac68411923f40a9c" is_pre_election: true
I20260709 12:27:23.713018 19868 raft_consensus.cc:2468] T ab344f5b13f24784b8ca5136f0ec53e6 P f530da9a3fdf4391ac68411923f40a9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ddb3044320b43f7b381f52701f76c82 in term 0.
I20260709 12:27:23.713901 20017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab344f5b13f24784b8ca5136f0ec53e6" candidate_uuid: "8ddb3044320b43f7b381f52701f76c82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3a31dc990cc4add9dd80576101ce350" is_pre_election: true
I20260709 12:27:23.714286 19908 leader_election.cc:304] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ddb3044320b43f7b381f52701f76c82, f530da9a3fdf4391ac68411923f40a9c; no voters: 
I20260709 12:27:23.714641 20017 raft_consensus.cc:2468] T ab344f5b13f24784b8ca5136f0ec53e6 P d3a31dc990cc4add9dd80576101ce350 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ddb3044320b43f7b381f52701f76c82 in term 0.
I20260709 12:27:23.715148 20063 raft_consensus.cc:2804] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:23.715533 20063 raft_consensus.cc:493] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.715816 20063 raft_consensus.cc:3060] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:23.721570 20063 raft_consensus.cc:515] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } }
I20260709 12:27:23.723424 20063 leader_election.cc:290] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82 [CANDIDATE]: Term 1 election: Requested vote from peers f530da9a3fdf4391ac68411923f40a9c (127.9.145.193:44463), d3a31dc990cc4add9dd80576101ce350 (127.9.145.195:44833)
I20260709 12:27:23.724383 19868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab344f5b13f24784b8ca5136f0ec53e6" candidate_uuid: "8ddb3044320b43f7b381f52701f76c82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f530da9a3fdf4391ac68411923f40a9c"
I20260709 12:27:23.724610 20017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab344f5b13f24784b8ca5136f0ec53e6" candidate_uuid: "8ddb3044320b43f7b381f52701f76c82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3a31dc990cc4add9dd80576101ce350"
I20260709 12:27:23.724980 19868 raft_consensus.cc:3060] T ab344f5b13f24784b8ca5136f0ec53e6 P f530da9a3fdf4391ac68411923f40a9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:23.725173 20017 raft_consensus.cc:3060] T ab344f5b13f24784b8ca5136f0ec53e6 P d3a31dc990cc4add9dd80576101ce350 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:23.730837 19868 raft_consensus.cc:2468] T ab344f5b13f24784b8ca5136f0ec53e6 P f530da9a3fdf4391ac68411923f40a9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ddb3044320b43f7b381f52701f76c82 in term 1.
I20260709 12:27:23.730882 20017 raft_consensus.cc:2468] T ab344f5b13f24784b8ca5136f0ec53e6 P d3a31dc990cc4add9dd80576101ce350 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ddb3044320b43f7b381f52701f76c82 in term 1.
I20260709 12:27:23.731953 19908 leader_election.cc:304] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ddb3044320b43f7b381f52701f76c82, f530da9a3fdf4391ac68411923f40a9c; no voters: 
I20260709 12:27:23.732641 20063 raft_consensus.cc:2804] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:23.733479 20063 raft_consensus.cc:697] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82 [term 1 LEADER]: Becoming Leader. State: Replica: 8ddb3044320b43f7b381f52701f76c82, State: Running, Role: LEADER
I20260709 12:27:23.734330 20063 consensus_queue.cc:237] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } }
I20260709 12:27:23.740931 19766 catalog_manager.cc:5697] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ddb3044320b43f7b381f52701f76c82 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "8ddb3044320b43f7b381f52701f76c82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:23.856570 20063 raft_consensus.cc:493] T d6775a1abf78451bbc3c51f589f4b440 P 8ddb3044320b43f7b381f52701f76c82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.857125 20063 raft_consensus.cc:515] T d6775a1abf78451bbc3c51f589f4b440 P 8ddb3044320b43f7b381f52701f76c82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:23.858822 20063 leader_election.cc:290] T d6775a1abf78451bbc3c51f589f4b440 P 8ddb3044320b43f7b381f52701f76c82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f530da9a3fdf4391ac68411923f40a9c (127.9.145.193:44463), d3a31dc990cc4add9dd80576101ce350 (127.9.145.195:44833)
I20260709 12:27:23.859797 19868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6775a1abf78451bbc3c51f589f4b440" candidate_uuid: "8ddb3044320b43f7b381f52701f76c82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f530da9a3fdf4391ac68411923f40a9c" is_pre_election: true
I20260709 12:27:23.859948 20017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6775a1abf78451bbc3c51f589f4b440" candidate_uuid: "8ddb3044320b43f7b381f52701f76c82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3a31dc990cc4add9dd80576101ce350" is_pre_election: true
I20260709 12:27:23.860669 19868 raft_consensus.cc:2468] T d6775a1abf78451bbc3c51f589f4b440 P f530da9a3fdf4391ac68411923f40a9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ddb3044320b43f7b381f52701f76c82 in term 0.
I20260709 12:27:23.860734 20017 raft_consensus.cc:2468] T d6775a1abf78451bbc3c51f589f4b440 P d3a31dc990cc4add9dd80576101ce350 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ddb3044320b43f7b381f52701f76c82 in term 0.
I20260709 12:27:23.861676 19908 leader_election.cc:304] T d6775a1abf78451bbc3c51f589f4b440 P 8ddb3044320b43f7b381f52701f76c82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ddb3044320b43f7b381f52701f76c82, f530da9a3fdf4391ac68411923f40a9c; no voters: 
I20260709 12:27:23.862380 20063 raft_consensus.cc:2804] T d6775a1abf78451bbc3c51f589f4b440 P 8ddb3044320b43f7b381f52701f76c82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:23.862720 20063 raft_consensus.cc:493] T d6775a1abf78451bbc3c51f589f4b440 P 8ddb3044320b43f7b381f52701f76c82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.862998 20063 raft_consensus.cc:3060] T d6775a1abf78451bbc3c51f589f4b440 P 8ddb3044320b43f7b381f52701f76c82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:23.868052 20063 raft_consensus.cc:515] T d6775a1abf78451bbc3c51f589f4b440 P 8ddb3044320b43f7b381f52701f76c82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:23.870160 20063 leader_election.cc:290] T d6775a1abf78451bbc3c51f589f4b440 P 8ddb3044320b43f7b381f52701f76c82 [CANDIDATE]: Term 1 election: Requested vote from peers f530da9a3fdf4391ac68411923f40a9c (127.9.145.193:44463), d3a31dc990cc4add9dd80576101ce350 (127.9.145.195:44833)
I20260709 12:27:23.871037 19868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6775a1abf78451bbc3c51f589f4b440" candidate_uuid: "8ddb3044320b43f7b381f52701f76c82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f530da9a3fdf4391ac68411923f40a9c"
I20260709 12:27:23.871296 20017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6775a1abf78451bbc3c51f589f4b440" candidate_uuid: "8ddb3044320b43f7b381f52701f76c82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3a31dc990cc4add9dd80576101ce350"
I20260709 12:27:23.871654 19868 raft_consensus.cc:3060] T d6775a1abf78451bbc3c51f589f4b440 P f530da9a3fdf4391ac68411923f40a9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:23.871803 20017 raft_consensus.cc:3060] T d6775a1abf78451bbc3c51f589f4b440 P d3a31dc990cc4add9dd80576101ce350 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:23.877739 20017 raft_consensus.cc:2468] T d6775a1abf78451bbc3c51f589f4b440 P d3a31dc990cc4add9dd80576101ce350 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ddb3044320b43f7b381f52701f76c82 in term 1.
I20260709 12:27:23.877761 19868 raft_consensus.cc:2468] T d6775a1abf78451bbc3c51f589f4b440 P f530da9a3fdf4391ac68411923f40a9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ddb3044320b43f7b381f52701f76c82 in term 1.
I20260709 12:27:23.878932 19908 leader_election.cc:304] T d6775a1abf78451bbc3c51f589f4b440 P 8ddb3044320b43f7b381f52701f76c82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ddb3044320b43f7b381f52701f76c82, d3a31dc990cc4add9dd80576101ce350; no voters: 
I20260709 12:27:23.879593 20063 raft_consensus.cc:2804] T d6775a1abf78451bbc3c51f589f4b440 P 8ddb3044320b43f7b381f52701f76c82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:23.879989 20063 raft_consensus.cc:697] T d6775a1abf78451bbc3c51f589f4b440 P 8ddb3044320b43f7b381f52701f76c82 [term 1 LEADER]: Becoming Leader. State: Replica: 8ddb3044320b43f7b381f52701f76c82, State: Running, Role: LEADER
I20260709 12:27:23.880774 20063 consensus_queue.cc:237] T d6775a1abf78451bbc3c51f589f4b440 P 8ddb3044320b43f7b381f52701f76c82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:23.887324 19766 catalog_manager.cc:5697] T d6775a1abf78451bbc3c51f589f4b440 P 8ddb3044320b43f7b381f52701f76c82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ddb3044320b43f7b381f52701f76c82 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "8ddb3044320b43f7b381f52701f76c82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:23.991751 19766 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45646:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:27:23.993709 19766 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:27:24.017817 19857 tablet_service.cc:1511] Processing CreateTablet for tablet 3b98bd3471c9423baef34361ab05953c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ff1d63b763354e589ddcf34c1ae84ed9]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:27:24.019219 19857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b98bd3471c9423baef34361ab05953c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:24.019021 19932 tablet_service.cc:1511] Processing CreateTablet for tablet 3b98bd3471c9423baef34361ab05953c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ff1d63b763354e589ddcf34c1ae84ed9]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:27:24.020541 19932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b98bd3471c9423baef34361ab05953c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:24.020421 20006 tablet_service.cc:1511] Processing CreateTablet for tablet 3b98bd3471c9423baef34361ab05953c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ff1d63b763354e589ddcf34c1ae84ed9]), partition=RANGE (key) PARTITION VALUES < 1073741823
W20260709 12:27:24.021811 19814 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:24.023768 19858 tablet_service.cc:1511] Processing CreateTablet for tablet 60146dc4d00b4e73a73970070581f90e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ff1d63b763354e589ddcf34c1ae84ed9]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:27:24.025105 19858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60146dc4d00b4e73a73970070581f90e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:24.021804 20006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b98bd3471c9423baef34361ab05953c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:24.026365 19933 tablet_service.cc:1511] Processing CreateTablet for tablet 60146dc4d00b4e73a73970070581f90e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ff1d63b763354e589ddcf34c1ae84ed9]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:27:24.027664 19933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60146dc4d00b4e73a73970070581f90e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:24.027558 20007 tablet_service.cc:1511] Processing CreateTablet for tablet 60146dc4d00b4e73a73970070581f90e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ff1d63b763354e589ddcf34c1ae84ed9]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:27:24.028903 20007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60146dc4d00b4e73a73970070581f90e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:24.038801 20057 tablet_bootstrap.cc:492] T 3b98bd3471c9423baef34361ab05953c P f530da9a3fdf4391ac68411923f40a9c: Bootstrap starting.
I20260709 12:27:24.041970 20059 tablet_bootstrap.cc:492] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350: Bootstrap starting.
I20260709 12:27:24.048466 20057 tablet_bootstrap.cc:654] T 3b98bd3471c9423baef34361ab05953c P f530da9a3fdf4391ac68411923f40a9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.050295 20059 tablet_bootstrap.cc:654] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.055486 20058 tablet_bootstrap.cc:492] T 3b98bd3471c9423baef34361ab05953c P 8ddb3044320b43f7b381f52701f76c82: Bootstrap starting.
I20260709 12:27:24.063673 20058 tablet_bootstrap.cc:654] T 3b98bd3471c9423baef34361ab05953c P 8ddb3044320b43f7b381f52701f76c82: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.064987 20057 tablet_bootstrap.cc:492] T 3b98bd3471c9423baef34361ab05953c P f530da9a3fdf4391ac68411923f40a9c: No bootstrap required, opened a new log
I20260709 12:27:24.065718 20057 ts_tablet_manager.cc:1403] T 3b98bd3471c9423baef34361ab05953c P f530da9a3fdf4391ac68411923f40a9c: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.008s
I20260709 12:27:24.069260 20057 raft_consensus.cc:359] T 3b98bd3471c9423baef34361ab05953c P f530da9a3fdf4391ac68411923f40a9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:24.070453 20057 raft_consensus.cc:385] T 3b98bd3471c9423baef34361ab05953c P f530da9a3fdf4391ac68411923f40a9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.070807 20057 raft_consensus.cc:740] T 3b98bd3471c9423baef34361ab05953c P f530da9a3fdf4391ac68411923f40a9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f530da9a3fdf4391ac68411923f40a9c, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.071774 20057 consensus_queue.cc:260] T 3b98bd3471c9423baef34361ab05953c P f530da9a3fdf4391ac68411923f40a9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:24.075624 20057 ts_tablet_manager.cc:1434] T 3b98bd3471c9423baef34361ab05953c P f530da9a3fdf4391ac68411923f40a9c: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 12:27:24.076723 20059 tablet_bootstrap.cc:492] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350: No bootstrap required, opened a new log
I20260709 12:27:24.077157 20058 tablet_bootstrap.cc:492] T 3b98bd3471c9423baef34361ab05953c P 8ddb3044320b43f7b381f52701f76c82: No bootstrap required, opened a new log
I20260709 12:27:24.077363 20059 ts_tablet_manager.cc:1403] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350: Time spent bootstrapping tablet: real 0.036s	user 0.004s	sys 0.019s
I20260709 12:27:24.077780 20058 ts_tablet_manager.cc:1403] T 3b98bd3471c9423baef34361ab05953c P 8ddb3044320b43f7b381f52701f76c82: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.001s
I20260709 12:27:24.080956 20057 tablet_bootstrap.cc:492] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c: Bootstrap starting.
I20260709 12:27:24.080986 20058 raft_consensus.cc:359] T 3b98bd3471c9423baef34361ab05953c P 8ddb3044320b43f7b381f52701f76c82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:24.082003 20058 raft_consensus.cc:385] T 3b98bd3471c9423baef34361ab05953c P 8ddb3044320b43f7b381f52701f76c82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.081686 20059 raft_consensus.cc:359] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:24.082383 20058 raft_consensus.cc:740] T 3b98bd3471c9423baef34361ab05953c P 8ddb3044320b43f7b381f52701f76c82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ddb3044320b43f7b381f52701f76c82, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.082538 20059 raft_consensus.cc:385] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.082901 20059 raft_consensus.cc:740] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3a31dc990cc4add9dd80576101ce350, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.083252 20058 consensus_queue.cc:260] T 3b98bd3471c9423baef34361ab05953c P 8ddb3044320b43f7b381f52701f76c82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:24.083899 20059 consensus_queue.cc:260] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:24.085668 20058 ts_tablet_manager.cc:1434] T 3b98bd3471c9423baef34361ab05953c P 8ddb3044320b43f7b381f52701f76c82: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:27:24.086803 20058 tablet_bootstrap.cc:492] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82: Bootstrap starting.
I20260709 12:27:24.092482 20059 ts_tablet_manager.cc:1434] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:27:24.093267 20058 tablet_bootstrap.cc:654] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.093267 20057 tablet_bootstrap.cc:654] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.093768 20059 tablet_bootstrap.cc:492] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350: Bootstrap starting.
I20260709 12:27:24.100932 20059 tablet_bootstrap.cc:654] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.105460 20057 tablet_bootstrap.cc:492] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c: No bootstrap required, opened a new log
I20260709 12:27:24.106065 20057 ts_tablet_manager.cc:1403] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.003s
I20260709 12:27:24.106302 20066 raft_consensus.cc:493] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.106873 20066 raft_consensus.cc:515] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:24.109127 20057 raft_consensus.cc:359] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:24.109545 20058 tablet_bootstrap.cc:492] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82: No bootstrap required, opened a new log
I20260709 12:27:24.110255 20058 ts_tablet_manager.cc:1403] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.007s
I20260709 12:27:24.111241 20057 raft_consensus.cc:385] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.111737 20057 raft_consensus.cc:740] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f530da9a3fdf4391ac68411923f40a9c, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.112818 20057 consensus_queue.cc:260] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:24.115617 20057 ts_tablet_manager.cc:1434] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:27:24.109632 20066 leader_election.cc:290] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f530da9a3fdf4391ac68411923f40a9c (127.9.145.193:44463), 8ddb3044320b43f7b381f52701f76c82 (127.9.145.194:38193)
I20260709 12:27:24.115487 20058 raft_consensus.cc:359] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:24.118516 20058 raft_consensus.cc:385] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.118887 20058 raft_consensus.cc:740] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ddb3044320b43f7b381f52701f76c82, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.119817 20058 consensus_queue.cc:260] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:24.122902 20058 ts_tablet_manager.cc:1434] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:27:24.124238 20059 tablet_bootstrap.cc:492] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350: No bootstrap required, opened a new log
I20260709 12:27:24.124882 20059 ts_tablet_manager.cc:1403] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.004s
I20260709 12:27:24.132318 20059 raft_consensus.cc:359] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:24.133037 20059 raft_consensus.cc:385] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.134223 20059 raft_consensus.cc:740] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3a31dc990cc4add9dd80576101ce350, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.135161 20059 consensus_queue.cc:260] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:24.139523 20059 ts_tablet_manager.cc:1434] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 12:27:24.140115 19868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b98bd3471c9423baef34361ab05953c" candidate_uuid: "d3a31dc990cc4add9dd80576101ce350" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f530da9a3fdf4391ac68411923f40a9c" is_pre_election: true
I20260709 12:27:24.140785 19868 raft_consensus.cc:2468] T 3b98bd3471c9423baef34361ab05953c P f530da9a3fdf4391ac68411923f40a9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3a31dc990cc4add9dd80576101ce350 in term 0.
I20260709 12:27:24.141808 19982 leader_election.cc:304] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d3a31dc990cc4add9dd80576101ce350, f530da9a3fdf4391ac68411923f40a9c; no voters: 
I20260709 12:27:24.142554 20066 raft_consensus.cc:2804] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:24.142861 20066 raft_consensus.cc:493] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.143158 20066 raft_consensus.cc:3060] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.144093 19943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b98bd3471c9423baef34361ab05953c" candidate_uuid: "d3a31dc990cc4add9dd80576101ce350" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ddb3044320b43f7b381f52701f76c82" is_pre_election: true
I20260709 12:27:24.144752 19943 raft_consensus.cc:2468] T 3b98bd3471c9423baef34361ab05953c P 8ddb3044320b43f7b381f52701f76c82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3a31dc990cc4add9dd80576101ce350 in term 0.
I20260709 12:27:24.149832 20066 raft_consensus.cc:515] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:24.152217 20066 leader_election.cc:290] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350 [CANDIDATE]: Term 1 election: Requested vote from peers f530da9a3fdf4391ac68411923f40a9c (127.9.145.193:44463), 8ddb3044320b43f7b381f52701f76c82 (127.9.145.194:38193)
I20260709 12:27:24.152936 19868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b98bd3471c9423baef34361ab05953c" candidate_uuid: "d3a31dc990cc4add9dd80576101ce350" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f530da9a3fdf4391ac68411923f40a9c"
I20260709 12:27:24.153581 19868 raft_consensus.cc:3060] T 3b98bd3471c9423baef34361ab05953c P f530da9a3fdf4391ac68411923f40a9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.153918 19943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b98bd3471c9423baef34361ab05953c" candidate_uuid: "d3a31dc990cc4add9dd80576101ce350" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ddb3044320b43f7b381f52701f76c82"
I20260709 12:27:24.154513 19943 raft_consensus.cc:3060] T 3b98bd3471c9423baef34361ab05953c P 8ddb3044320b43f7b381f52701f76c82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.161118 19868 raft_consensus.cc:2468] T 3b98bd3471c9423baef34361ab05953c P f530da9a3fdf4391ac68411923f40a9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3a31dc990cc4add9dd80576101ce350 in term 1.
I20260709 12:27:24.161876 19943 raft_consensus.cc:2468] T 3b98bd3471c9423baef34361ab05953c P 8ddb3044320b43f7b381f52701f76c82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3a31dc990cc4add9dd80576101ce350 in term 1.
I20260709 12:27:24.162256 19982 leader_election.cc:304] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d3a31dc990cc4add9dd80576101ce350, f530da9a3fdf4391ac68411923f40a9c; no voters: 
I20260709 12:27:24.163030 20066 raft_consensus.cc:2804] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:24.164074 20066 raft_consensus.cc:697] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350 [term 1 LEADER]: Becoming Leader. State: Replica: d3a31dc990cc4add9dd80576101ce350, State: Running, Role: LEADER
I20260709 12:27:24.164793 20066 consensus_queue.cc:237] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:24.172192 19766 catalog_manager.cc:5697] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3a31dc990cc4add9dd80576101ce350 (127.9.145.195). New cstate: current_term: 1 leader_uuid: "d3a31dc990cc4add9dd80576101ce350" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:24.273862 20063 consensus_queue.cc:1048] T d6775a1abf78451bbc3c51f589f4b440 P 8ddb3044320b43f7b381f52701f76c82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:24.287998 20063 consensus_queue.cc:1048] T d6775a1abf78451bbc3c51f589f4b440 P 8ddb3044320b43f7b381f52701f76c82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:24.291365 20063 consensus_queue.cc:1048] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:24.297206 20063 consensus_queue.cc:1048] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:24.437731 20063 raft_consensus.cc:493] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.438231 20063 raft_consensus.cc:515] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:24.440116 20063 leader_election.cc:290] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f530da9a3fdf4391ac68411923f40a9c (127.9.145.193:44463), d3a31dc990cc4add9dd80576101ce350 (127.9.145.195:44833)
I20260709 12:27:24.441007 19867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60146dc4d00b4e73a73970070581f90e" candidate_uuid: "8ddb3044320b43f7b381f52701f76c82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f530da9a3fdf4391ac68411923f40a9c" is_pre_election: true
I20260709 12:27:24.441206 20017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60146dc4d00b4e73a73970070581f90e" candidate_uuid: "8ddb3044320b43f7b381f52701f76c82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3a31dc990cc4add9dd80576101ce350" is_pre_election: true
I20260709 12:27:24.441685 19867 raft_consensus.cc:2468] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ddb3044320b43f7b381f52701f76c82 in term 0.
I20260709 12:27:24.441869 20017 raft_consensus.cc:2468] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ddb3044320b43f7b381f52701f76c82 in term 0.
I20260709 12:27:24.442730 19908 leader_election.cc:304] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ddb3044320b43f7b381f52701f76c82, f530da9a3fdf4391ac68411923f40a9c; no voters: 
I20260709 12:27:24.443403 20063 raft_consensus.cc:2804] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:24.443789 20063 raft_consensus.cc:493] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.444089 20063 raft_consensus.cc:3060] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.449306 20063 raft_consensus.cc:515] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:24.451134 20063 leader_election.cc:290] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [CANDIDATE]: Term 1 election: Requested vote from peers f530da9a3fdf4391ac68411923f40a9c (127.9.145.193:44463), d3a31dc990cc4add9dd80576101ce350 (127.9.145.195:44833)
I20260709 12:27:24.451908 19867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60146dc4d00b4e73a73970070581f90e" candidate_uuid: "8ddb3044320b43f7b381f52701f76c82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f530da9a3fdf4391ac68411923f40a9c"
I20260709 12:27:24.452240 20017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60146dc4d00b4e73a73970070581f90e" candidate_uuid: "8ddb3044320b43f7b381f52701f76c82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3a31dc990cc4add9dd80576101ce350"
I20260709 12:27:24.452518 19867 raft_consensus.cc:3060] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.452826 20017 raft_consensus.cc:3060] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.458248 20017 raft_consensus.cc:2468] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ddb3044320b43f7b381f52701f76c82 in term 1.
I20260709 12:27:24.458931 19867 raft_consensus.cc:2468] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ddb3044320b43f7b381f52701f76c82 in term 1.
I20260709 12:27:24.459391 19908 leader_election.cc:304] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ddb3044320b43f7b381f52701f76c82, d3a31dc990cc4add9dd80576101ce350; no voters: 
I20260709 12:27:24.460147 20063 raft_consensus.cc:2804] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:24.460645 20063 raft_consensus.cc:697] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [term 1 LEADER]: Becoming Leader. State: Replica: 8ddb3044320b43f7b381f52701f76c82, State: Running, Role: LEADER
I20260709 12:27:24.461470 20063 consensus_queue.cc:237] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:24.468453 19766 catalog_manager.cc:5697] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ddb3044320b43f7b381f52701f76c82 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "8ddb3044320b43f7b381f52701f76c82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:24.538566 19943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab344f5b13f24784b8ca5136f0ec53e6"
dest_uuid: "8ddb3044320b43f7b381f52701f76c82"
mode: GRACEFUL
new_leader_uuid: "f530da9a3fdf4391ac68411923f40a9c"
 from {username='slave'} at 127.0.0.1:44700
I20260709 12:27:24.539148 19943 raft_consensus.cc:606] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82 [term 1 LEADER]: Received request to transfer leadership to TS f530da9a3fdf4391ac68411923f40a9c
I20260709 12:27:24.556896 20017 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b98bd3471c9423baef34361ab05953c"
dest_uuid: "d3a31dc990cc4add9dd80576101ce350"
mode: GRACEFUL
new_leader_uuid: "f530da9a3fdf4391ac68411923f40a9c"
 from {username='slave'} at 127.0.0.1:44402
I20260709 12:27:24.557489 20017 raft_consensus.cc:606] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350 [term 1 LEADER]: Received request to transfer leadership to TS f530da9a3fdf4391ac68411923f40a9c
I20260709 12:27:24.563253 19943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60146dc4d00b4e73a73970070581f90e"
dest_uuid: "8ddb3044320b43f7b381f52701f76c82"
mode: GRACEFUL
new_leader_uuid: "f530da9a3fdf4391ac68411923f40a9c"
 from {username='slave'} at 127.0.0.1:44700
I20260709 12:27:24.563848 19943 raft_consensus.cc:606] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [term 1 LEADER]: Received request to transfer leadership to TS f530da9a3fdf4391ac68411923f40a9c
I20260709 12:27:24.666513 20066 consensus_queue.cc:1048] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:24.679340 20102 consensus_queue.cc:1048] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:24.691802 20066 raft_consensus.cc:993] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350: : Instructing follower f530da9a3fdf4391ac68411923f40a9c to start an election
I20260709 12:27:24.692355 20102 raft_consensus.cc:1081] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350 [term 1 LEADER]: Signalling peer f530da9a3fdf4391ac68411923f40a9c to start an election
I20260709 12:27:24.694237 19867 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b98bd3471c9423baef34361ab05953c"
dest_uuid: "f530da9a3fdf4391ac68411923f40a9c"
 from {username='slave'} at 127.0.0.1:44890
I20260709 12:27:24.694818 19867 raft_consensus.cc:493] T 3b98bd3471c9423baef34361ab05953c P f530da9a3fdf4391ac68411923f40a9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:24.695164 19867 raft_consensus.cc:3060] T 3b98bd3471c9423baef34361ab05953c P f530da9a3fdf4391ac68411923f40a9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:24.700760 19867 raft_consensus.cc:515] T 3b98bd3471c9423baef34361ab05953c P f530da9a3fdf4391ac68411923f40a9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:24.702968 19867 leader_election.cc:290] T 3b98bd3471c9423baef34361ab05953c P f530da9a3fdf4391ac68411923f40a9c [CANDIDATE]: Term 2 election: Requested vote from peers 8ddb3044320b43f7b381f52701f76c82 (127.9.145.194:38193), d3a31dc990cc4add9dd80576101ce350 (127.9.145.195:44833)
I20260709 12:27:24.715067 19943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b98bd3471c9423baef34361ab05953c" candidate_uuid: "f530da9a3fdf4391ac68411923f40a9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ddb3044320b43f7b381f52701f76c82"
I20260709 12:27:24.715644 19943 raft_consensus.cc:3060] T 3b98bd3471c9423baef34361ab05953c P 8ddb3044320b43f7b381f52701f76c82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:24.718786 20017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b98bd3471c9423baef34361ab05953c" candidate_uuid: "f530da9a3fdf4391ac68411923f40a9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3a31dc990cc4add9dd80576101ce350"
I20260709 12:27:24.719400 20017 raft_consensus.cc:3055] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:24.719744 20017 raft_consensus.cc:740] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3a31dc990cc4add9dd80576101ce350, State: Running, Role: LEADER
I20260709 12:27:24.720543 20017 consensus_queue.cc:260] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:24.721905 20017 raft_consensus.cc:3060] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:24.722774 19943 raft_consensus.cc:2468] T 3b98bd3471c9423baef34361ab05953c P 8ddb3044320b43f7b381f52701f76c82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f530da9a3fdf4391ac68411923f40a9c in term 2.
I20260709 12:27:24.723855 19833 leader_election.cc:304] T 3b98bd3471c9423baef34361ab05953c P f530da9a3fdf4391ac68411923f40a9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ddb3044320b43f7b381f52701f76c82, f530da9a3fdf4391ac68411923f40a9c; no voters: 
I20260709 12:27:24.724710 20062 raft_consensus.cc:2804] T 3b98bd3471c9423baef34361ab05953c P f530da9a3fdf4391ac68411923f40a9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:24.725968 20062 raft_consensus.cc:697] T 3b98bd3471c9423baef34361ab05953c P f530da9a3fdf4391ac68411923f40a9c [term 2 LEADER]: Becoming Leader. State: Replica: f530da9a3fdf4391ac68411923f40a9c, State: Running, Role: LEADER
I20260709 12:27:24.726841 20062 consensus_queue.cc:237] T 3b98bd3471c9423baef34361ab05953c P f530da9a3fdf4391ac68411923f40a9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:24.729910 20017 raft_consensus.cc:2468] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f530da9a3fdf4391ac68411923f40a9c in term 2.
I20260709 12:27:24.734629 19764 catalog_manager.cc:5697] T 3b98bd3471c9423baef34361ab05953c P f530da9a3fdf4391ac68411923f40a9c reported cstate change: term changed from 1 to 2, leader changed from d3a31dc990cc4add9dd80576101ce350 (127.9.145.195) to f530da9a3fdf4391ac68411923f40a9c (127.9.145.193). New cstate: current_term: 2 leader_uuid: "f530da9a3fdf4391ac68411923f40a9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:24.873294 20070 raft_consensus.cc:993] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82: : Instructing follower f530da9a3fdf4391ac68411923f40a9c to start an election
I20260709 12:27:24.873811 20108 raft_consensus.cc:1081] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82 [term 1 LEADER]: Signalling peer f530da9a3fdf4391ac68411923f40a9c to start an election
I20260709 12:27:24.875613 20108 consensus_queue.cc:1048] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:24.875864 19867 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab344f5b13f24784b8ca5136f0ec53e6"
dest_uuid: "f530da9a3fdf4391ac68411923f40a9c"
 from {username='slave'} at 127.0.0.1:44886
I20260709 12:27:24.876685 19867 raft_consensus.cc:493] T ab344f5b13f24784b8ca5136f0ec53e6 P f530da9a3fdf4391ac68411923f40a9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:24.877117 19867 raft_consensus.cc:3060] T ab344f5b13f24784b8ca5136f0ec53e6 P f530da9a3fdf4391ac68411923f40a9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:24.883769 20070 raft_consensus.cc:993] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82: : Instructing follower f530da9a3fdf4391ac68411923f40a9c to start an election
I20260709 12:27:24.884505 20063 raft_consensus.cc:1081] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [term 1 LEADER]: Signalling peer f530da9a3fdf4391ac68411923f40a9c to start an election
I20260709 12:27:24.885164 19867 raft_consensus.cc:515] T ab344f5b13f24784b8ca5136f0ec53e6 P f530da9a3fdf4391ac68411923f40a9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } }
I20260709 12:27:24.887781 19867 leader_election.cc:290] T ab344f5b13f24784b8ca5136f0ec53e6 P f530da9a3fdf4391ac68411923f40a9c [CANDIDATE]: Term 2 election: Requested vote from peers d3a31dc990cc4add9dd80576101ce350 (127.9.145.195:44833), 8ddb3044320b43f7b381f52701f76c82 (127.9.145.194:38193)
I20260709 12:27:24.887864 19866 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60146dc4d00b4e73a73970070581f90e"
dest_uuid: "f530da9a3fdf4391ac68411923f40a9c"
 from {username='slave'} at 127.0.0.1:44886
I20260709 12:27:24.889158 19866 raft_consensus.cc:493] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:24.889587 19866 raft_consensus.cc:3060] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:24.890550 19943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab344f5b13f24784b8ca5136f0ec53e6" candidate_uuid: "f530da9a3fdf4391ac68411923f40a9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ddb3044320b43f7b381f52701f76c82"
I20260709 12:27:24.891237 19943 raft_consensus.cc:3055] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:24.891539 19943 raft_consensus.cc:740] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ddb3044320b43f7b381f52701f76c82, State: Running, Role: LEADER
I20260709 12:27:24.892380 19943 consensus_queue.cc:260] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } }
I20260709 12:27:24.893534 19943 raft_consensus.cc:3060] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:24.893975 20017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab344f5b13f24784b8ca5136f0ec53e6" candidate_uuid: "f530da9a3fdf4391ac68411923f40a9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3a31dc990cc4add9dd80576101ce350"
I20260709 12:27:24.894683 20017 raft_consensus.cc:3060] T ab344f5b13f24784b8ca5136f0ec53e6 P d3a31dc990cc4add9dd80576101ce350 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:24.900795 19866 raft_consensus.cc:515] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:24.901490 19943 raft_consensus.cc:2468] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f530da9a3fdf4391ac68411923f40a9c in term 2.
I20260709 12:27:24.902948 19833 leader_election.cc:304] T ab344f5b13f24784b8ca5136f0ec53e6 P f530da9a3fdf4391ac68411923f40a9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ddb3044320b43f7b381f52701f76c82, f530da9a3fdf4391ac68411923f40a9c; no voters: 
I20260709 12:27:24.903191 19866 leader_election.cc:290] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c [CANDIDATE]: Term 2 election: Requested vote from peers 8ddb3044320b43f7b381f52701f76c82 (127.9.145.194:38193), d3a31dc990cc4add9dd80576101ce350 (127.9.145.195:44833)
I20260709 12:27:24.901726 20017 raft_consensus.cc:2468] T ab344f5b13f24784b8ca5136f0ec53e6 P d3a31dc990cc4add9dd80576101ce350 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f530da9a3fdf4391ac68411923f40a9c in term 2.
I20260709 12:27:24.904237 20110 consensus_queue.cc:1048] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:24.904716 20062 raft_consensus.cc:2804] T ab344f5b13f24784b8ca5136f0ec53e6 P f530da9a3fdf4391ac68411923f40a9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:24.905311 20062 raft_consensus.cc:697] T ab344f5b13f24784b8ca5136f0ec53e6 P f530da9a3fdf4391ac68411923f40a9c [term 2 LEADER]: Becoming Leader. State: Replica: f530da9a3fdf4391ac68411923f40a9c, State: Running, Role: LEADER
I20260709 12:27:24.906172 20062 consensus_queue.cc:237] T ab344f5b13f24784b8ca5136f0ec53e6 P f530da9a3fdf4391ac68411923f40a9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } }
I20260709 12:27:24.906597 19942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60146dc4d00b4e73a73970070581f90e" candidate_uuid: "f530da9a3fdf4391ac68411923f40a9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ddb3044320b43f7b381f52701f76c82"
I20260709 12:27:24.907277 20017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60146dc4d00b4e73a73970070581f90e" candidate_uuid: "f530da9a3fdf4391ac68411923f40a9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3a31dc990cc4add9dd80576101ce350"
I20260709 12:27:24.907326 19942 raft_consensus.cc:3055] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:24.908197 20017 raft_consensus.cc:3060] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:24.908303 19942 raft_consensus.cc:740] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ddb3044320b43f7b381f52701f76c82, State: Running, Role: LEADER
I20260709 12:27:24.909487 19942 consensus_queue.cc:260] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:24.910748 19942 raft_consensus.cc:3060] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:24.916440 20017 raft_consensus.cc:2468] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f530da9a3fdf4391ac68411923f40a9c in term 2.
I20260709 12:27:24.917598 20016 raft_consensus.cc:1240] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350 [term 2 FOLLOWER]: Rejecting Update request from peer 8ddb3044320b43f7b381f52701f76c82 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:27:24.918292 19833 leader_election.cc:304] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d3a31dc990cc4add9dd80576101ce350, f530da9a3fdf4391ac68411923f40a9c; no voters: 
I20260709 12:27:24.918970 19942 raft_consensus.cc:2468] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f530da9a3fdf4391ac68411923f40a9c in term 2.
I20260709 12:27:24.919498 20062 raft_consensus.cc:2804] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:24.920122 20062 raft_consensus.cc:697] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c [term 2 LEADER]: Becoming Leader. State: Replica: f530da9a3fdf4391ac68411923f40a9c, State: Running, Role: LEADER
I20260709 12:27:24.921056 20062 consensus_queue.cc:237] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:24.924124 19765 catalog_manager.cc:5697] T ab344f5b13f24784b8ca5136f0ec53e6 P f530da9a3fdf4391ac68411923f40a9c reported cstate change: term changed from 1 to 2, leader changed from 8ddb3044320b43f7b381f52701f76c82 (127.9.145.194) to f530da9a3fdf4391ac68411923f40a9c (127.9.145.193). New cstate: current_term: 2 leader_uuid: "f530da9a3fdf4391ac68411923f40a9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:24.937325 19765 catalog_manager.cc:5697] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c reported cstate change: term changed from 1 to 2, leader changed from 8ddb3044320b43f7b381f52701f76c82 (127.9.145.194) to f530da9a3fdf4391ac68411923f40a9c (127.9.145.193). New cstate: current_term: 2 leader_uuid: "f530da9a3fdf4391ac68411923f40a9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:25.030859  9799 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:27:25.032665  9799 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:27:25.033047  9799 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:27:25.046411 19866 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60146dc4d00b4e73a73970070581f90e"
dest_uuid: "f530da9a3fdf4391ac68411923f40a9c"
mode: GRACEFUL
new_leader_uuid: "d3a31dc990cc4add9dd80576101ce350"
 from {username='slave'} at 127.0.0.1:44896
I20260709 12:27:25.046947 19866 raft_consensus.cc:606] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c [term 2 LEADER]: Received request to transfer leadership to TS d3a31dc990cc4add9dd80576101ce350
I20260709 12:27:25.048005  9799 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:27:25.295528 19942 raft_consensus.cc:1275] T 3b98bd3471c9423baef34361ab05953c P 8ddb3044320b43f7b381f52701f76c82 [term 2 FOLLOWER]: Refusing update from remote peer f530da9a3fdf4391ac68411923f40a9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:25.296784 20062 consensus_queue.cc:1048] T 3b98bd3471c9423baef34361ab05953c P f530da9a3fdf4391ac68411923f40a9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:25.305579 20016 raft_consensus.cc:1275] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350 [term 2 FOLLOWER]: Refusing update from remote peer f530da9a3fdf4391ac68411923f40a9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:25.307801 20062 consensus_queue.cc:1048] T 3b98bd3471c9423baef34361ab05953c P f530da9a3fdf4391ac68411923f40a9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:25.340169 20016 raft_consensus.cc:1275] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350 [term 2 FOLLOWER]: Refusing update from remote peer f530da9a3fdf4391ac68411923f40a9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:25.341542 20062 consensus_queue.cc:1048] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:25.348934 20113 raft_consensus.cc:993] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c: : Instructing follower d3a31dc990cc4add9dd80576101ce350 to start an election
I20260709 12:27:25.349792 20107 raft_consensus.cc:1081] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c [term 2 LEADER]: Signalling peer d3a31dc990cc4add9dd80576101ce350 to start an election
I20260709 12:27:25.352046 20017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60146dc4d00b4e73a73970070581f90e"
dest_uuid: "d3a31dc990cc4add9dd80576101ce350"
 from {username='slave'} at 127.0.0.1:44404
I20260709 12:27:25.352697 20017 raft_consensus.cc:493] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:25.353062 20017 raft_consensus.cc:3060] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:25.354581 19942 raft_consensus.cc:1275] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [term 2 FOLLOWER]: Refusing update from remote peer f530da9a3fdf4391ac68411923f40a9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:25.356352 20113 consensus_queue.cc:1048] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:25.360704 20017 raft_consensus.cc:515] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:25.364279 20017 leader_election.cc:290] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350 [CANDIDATE]: Term 3 election: Requested vote from peers f530da9a3fdf4391ac68411923f40a9c (127.9.145.193:44463), 8ddb3044320b43f7b381f52701f76c82 (127.9.145.194:38193)
I20260709 12:27:25.364494 19866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60146dc4d00b4e73a73970070581f90e" candidate_uuid: "d3a31dc990cc4add9dd80576101ce350" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f530da9a3fdf4391ac68411923f40a9c"
I20260709 12:27:25.365249 19866 raft_consensus.cc:3055] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:25.365638 19866 raft_consensus.cc:740] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f530da9a3fdf4391ac68411923f40a9c, State: Running, Role: LEADER
I20260709 12:27:25.365630 19942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60146dc4d00b4e73a73970070581f90e" candidate_uuid: "d3a31dc990cc4add9dd80576101ce350" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8ddb3044320b43f7b381f52701f76c82"
I20260709 12:27:25.366545 19942 raft_consensus.cc:3060] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:25.366811 19866 consensus_queue.cc:260] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:25.368299 19866 raft_consensus.cc:3060] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:25.375360 19866 raft_consensus.cc:2468] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3a31dc990cc4add9dd80576101ce350 in term 3.
I20260709 12:27:25.375869 19942 raft_consensus.cc:2468] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3a31dc990cc4add9dd80576101ce350 in term 3.
I20260709 12:27:25.376770 19982 leader_election.cc:304] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d3a31dc990cc4add9dd80576101ce350, f530da9a3fdf4391ac68411923f40a9c; no voters: 
I20260709 12:27:25.377815 20114 raft_consensus.cc:2804] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:25.378173 20017 raft_consensus.cc:1275] T ab344f5b13f24784b8ca5136f0ec53e6 P d3a31dc990cc4add9dd80576101ce350 [term 2 FOLLOWER]: Refusing update from remote peer f530da9a3fdf4391ac68411923f40a9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:25.379509 20114 raft_consensus.cc:697] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350 [term 3 LEADER]: Becoming Leader. State: Replica: d3a31dc990cc4add9dd80576101ce350, State: Running, Role: LEADER
I20260709 12:27:25.379940 20113 consensus_queue.cc:1048] T ab344f5b13f24784b8ca5136f0ec53e6 P f530da9a3fdf4391ac68411923f40a9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:25.380508 20114 consensus_queue.cc:237] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } }
I20260709 12:27:25.386552 19942 raft_consensus.cc:1275] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82 [term 2 FOLLOWER]: Refusing update from remote peer f530da9a3fdf4391ac68411923f40a9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:25.388501 20107 consensus_queue.cc:1048] T ab344f5b13f24784b8ca5136f0ec53e6 P f530da9a3fdf4391ac68411923f40a9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:25.392364 19765 catalog_manager.cc:5697] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350 reported cstate change: term changed from 2 to 3, leader changed from f530da9a3fdf4391ac68411923f40a9c (127.9.145.193) to d3a31dc990cc4add9dd80576101ce350 (127.9.145.195). New cstate: current_term: 3 leader_uuid: "d3a31dc990cc4add9dd80576101ce350" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f530da9a3fdf4391ac68411923f40a9c" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 44463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ddb3044320b43f7b381f52701f76c82" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 38193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3a31dc990cc4add9dd80576101ce350" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 44833 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:25.408283  9799 tablet_server.cc:179] TabletServer@127.9.145.193:0 shutting down...
I20260709 12:27:25.431810  9799 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:25.432474  9799 tablet_replica.cc:333] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c: stopping tablet replica
I20260709 12:27:25.433118  9799 raft_consensus.cc:2243] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:25.433632  9799 raft_consensus.cc:2272] T 60146dc4d00b4e73a73970070581f90e P f530da9a3fdf4391ac68411923f40a9c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.436064  9799 tablet_replica.cc:333] T 3b98bd3471c9423baef34361ab05953c P f530da9a3fdf4391ac68411923f40a9c: stopping tablet replica
I20260709 12:27:25.436635  9799 raft_consensus.cc:2243] T 3b98bd3471c9423baef34361ab05953c P f530da9a3fdf4391ac68411923f40a9c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:25.437475  9799 raft_consensus.cc:2272] T 3b98bd3471c9423baef34361ab05953c P f530da9a3fdf4391ac68411923f40a9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.439935  9799 tablet_replica.cc:333] T ab344f5b13f24784b8ca5136f0ec53e6 P f530da9a3fdf4391ac68411923f40a9c: stopping tablet replica
I20260709 12:27:25.440482  9799 raft_consensus.cc:2243] T ab344f5b13f24784b8ca5136f0ec53e6 P f530da9a3fdf4391ac68411923f40a9c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:25.441308  9799 raft_consensus.cc:2272] T ab344f5b13f24784b8ca5136f0ec53e6 P f530da9a3fdf4391ac68411923f40a9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.443678  9799 tablet_replica.cc:333] T d6775a1abf78451bbc3c51f589f4b440 P f530da9a3fdf4391ac68411923f40a9c: stopping tablet replica
I20260709 12:27:25.444269  9799 raft_consensus.cc:2243] T d6775a1abf78451bbc3c51f589f4b440 P f530da9a3fdf4391ac68411923f40a9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:25.444716  9799 raft_consensus.cc:2272] T d6775a1abf78451bbc3c51f589f4b440 P f530da9a3fdf4391ac68411923f40a9c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:25.452044 19908 consensus_peers.cc:597] T d6775a1abf78451bbc3c51f589f4b440 P 8ddb3044320b43f7b381f52701f76c82 -> Peer f530da9a3fdf4391ac68411923f40a9c (127.9.145.193:44463): Couldn't send request to peer f530da9a3fdf4391ac68411923f40a9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:25.469091  9799 tablet_server.cc:196] TabletServer@127.9.145.193:0 shutdown complete.
I20260709 12:27:25.482234  9799 tablet_server.cc:179] TabletServer@127.9.145.194:0 shutting down...
I20260709 12:27:25.500399  9799 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:25.501094  9799 tablet_replica.cc:333] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82: stopping tablet replica
I20260709 12:27:25.501662  9799 raft_consensus.cc:2243] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:25.502177  9799 raft_consensus.cc:2272] T 60146dc4d00b4e73a73970070581f90e P 8ddb3044320b43f7b381f52701f76c82 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.504645  9799 tablet_replica.cc:333] T 3b98bd3471c9423baef34361ab05953c P 8ddb3044320b43f7b381f52701f76c82: stopping tablet replica
I20260709 12:27:25.505206  9799 raft_consensus.cc:2243] T 3b98bd3471c9423baef34361ab05953c P 8ddb3044320b43f7b381f52701f76c82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:25.505648  9799 raft_consensus.cc:2272] T 3b98bd3471c9423baef34361ab05953c P 8ddb3044320b43f7b381f52701f76c82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.508157  9799 tablet_replica.cc:333] T d6775a1abf78451bbc3c51f589f4b440 P 8ddb3044320b43f7b381f52701f76c82: stopping tablet replica
I20260709 12:27:25.508710  9799 raft_consensus.cc:2243] T d6775a1abf78451bbc3c51f589f4b440 P 8ddb3044320b43f7b381f52701f76c82 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:25.509546  9799 raft_consensus.cc:2272] T d6775a1abf78451bbc3c51f589f4b440 P 8ddb3044320b43f7b381f52701f76c82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.511688  9799 tablet_replica.cc:333] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82: stopping tablet replica
I20260709 12:27:25.512189  9799 raft_consensus.cc:2243] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:25.512652  9799 raft_consensus.cc:2272] T ab344f5b13f24784b8ca5136f0ec53e6 P 8ddb3044320b43f7b381f52701f76c82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.525527  9799 tablet_server.cc:196] TabletServer@127.9.145.194:0 shutdown complete.
I20260709 12:27:25.538591  9799 tablet_server.cc:179] TabletServer@127.9.145.195:0 shutting down...
I20260709 12:27:25.556314  9799 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:25.556928  9799 tablet_replica.cc:333] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350: stopping tablet replica
I20260709 12:27:25.557485  9799 raft_consensus.cc:2243] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:25.558182  9799 pending_rounds.cc:70] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350: Trying to abort 1 pending ops.
I20260709 12:27:25.558377  9799 pending_rounds.cc:77] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305625785888260096 op_type: NO_OP noop_request { }
I20260709 12:27:25.558696  9799 raft_consensus.cc:2889] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:25.558943  9799 raft_consensus.cc:2272] T 60146dc4d00b4e73a73970070581f90e P d3a31dc990cc4add9dd80576101ce350 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.561286  9799 tablet_replica.cc:333] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350: stopping tablet replica
I20260709 12:27:25.561811  9799 raft_consensus.cc:2243] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:25.562287  9799 raft_consensus.cc:2272] T 3b98bd3471c9423baef34361ab05953c P d3a31dc990cc4add9dd80576101ce350 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.564832  9799 tablet_replica.cc:333] T d6775a1abf78451bbc3c51f589f4b440 P d3a31dc990cc4add9dd80576101ce350: stopping tablet replica
I20260709 12:27:25.565349  9799 raft_consensus.cc:2243] T d6775a1abf78451bbc3c51f589f4b440 P d3a31dc990cc4add9dd80576101ce350 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:25.565744  9799 raft_consensus.cc:2272] T d6775a1abf78451bbc3c51f589f4b440 P d3a31dc990cc4add9dd80576101ce350 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.567663  9799 tablet_replica.cc:333] T ab344f5b13f24784b8ca5136f0ec53e6 P d3a31dc990cc4add9dd80576101ce350: stopping tablet replica
I20260709 12:27:25.568111  9799 raft_consensus.cc:2243] T ab344f5b13f24784b8ca5136f0ec53e6 P d3a31dc990cc4add9dd80576101ce350 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:25.568509  9799 raft_consensus.cc:2272] T ab344f5b13f24784b8ca5136f0ec53e6 P d3a31dc990cc4add9dd80576101ce350 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.591566  9799 tablet_server.cc:196] TabletServer@127.9.145.195:0 shutdown complete.
I20260709 12:27:25.605106  9799 master.cc:562] Master@127.9.145.254:39507 shutting down...
I20260709 12:27:25.621506  9799 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b25f1711e708473eb33f90ff5f53d4f0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:25.622041  9799 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b25f1711e708473eb33f90ff5f53d4f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.622406  9799 tablet_replica.cc:333] T 00000000000000000000000000000000 P b25f1711e708473eb33f90ff5f53d4f0: stopping tablet replica
I20260709 12:27:25.640918  9799 master.cc:584] Master@127.9.145.254:39507 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2788 ms)
[----------] 6 tests from LeaderRebalancerTest (326020 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:27:25.670054  9799 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.145.254:43257
I20260709 12:27:25.671211  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:25.676379 20121 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:25.676621 20122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:25.678027 20124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:25.678872  9799 server_base.cc:1061] running on GCE node
I20260709 12:27:25.679703  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:25.679879  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:25.680029  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783600045680015 us; error 0 us; skew 500 ppm
I20260709 12:27:25.680579  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:25.682955  9799 webserver.cc:533] Webserver started at http://127.9.145.254:45203/ using document root <none> and password file <none>
I20260709 12:27:25.683446  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:25.683642  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:25.683897  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:25.684978  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599719482688-9799-0/minicluster-data/master-0-root/instance:
uuid: "c808b56815f647bbb9c50fb470b7255a"
format_stamp: "Formatted at 2026-07-09 12:27:25 on dist-test-slave-1sdq"
I20260709 12:27:25.689571  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:27:25.693169 20129 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:25.693924  9799 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:27:25.694286  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599719482688-9799-0/minicluster-data/master-0-root
uuid: "c808b56815f647bbb9c50fb470b7255a"
format_stamp: "Formatted at 2026-07-09 12:27:25 on dist-test-slave-1sdq"
I20260709 12:27:25.694571  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599719482688-9799-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599719482688-9799-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599719482688-9799-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:25.720069  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:25.721159  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:25.757056  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.254:43257
I20260709 12:27:25.757149 20180 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.254:43257 every 8 connection(s)
I20260709 12:27:25.760946 20181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:25.772722 20181 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c808b56815f647bbb9c50fb470b7255a: Bootstrap starting.
I20260709 12:27:25.777382 20181 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c808b56815f647bbb9c50fb470b7255a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:25.781852 20181 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c808b56815f647bbb9c50fb470b7255a: No bootstrap required, opened a new log
I20260709 12:27:25.784060 20181 raft_consensus.cc:359] T 00000000000000000000000000000000 P c808b56815f647bbb9c50fb470b7255a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c808b56815f647bbb9c50fb470b7255a" member_type: VOTER }
I20260709 12:27:25.784478 20181 raft_consensus.cc:385] T 00000000000000000000000000000000 P c808b56815f647bbb9c50fb470b7255a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:25.784657 20181 raft_consensus.cc:740] T 00000000000000000000000000000000 P c808b56815f647bbb9c50fb470b7255a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c808b56815f647bbb9c50fb470b7255a, State: Initialized, Role: FOLLOWER
I20260709 12:27:25.785243 20181 consensus_queue.cc:260] T 00000000000000000000000000000000 P c808b56815f647bbb9c50fb470b7255a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c808b56815f647bbb9c50fb470b7255a" member_type: VOTER }
I20260709 12:27:25.785693 20181 raft_consensus.cc:399] T 00000000000000000000000000000000 P c808b56815f647bbb9c50fb470b7255a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:27:25.785884 20181 raft_consensus.cc:493] T 00000000000000000000000000000000 P c808b56815f647bbb9c50fb470b7255a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:27:25.786159 20181 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c808b56815f647bbb9c50fb470b7255a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:25.791249 20181 raft_consensus.cc:515] T 00000000000000000000000000000000 P c808b56815f647bbb9c50fb470b7255a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c808b56815f647bbb9c50fb470b7255a" member_type: VOTER }
I20260709 12:27:25.791761 20181 leader_election.cc:304] T 00000000000000000000000000000000 P c808b56815f647bbb9c50fb470b7255a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c808b56815f647bbb9c50fb470b7255a; no voters: 
I20260709 12:27:25.792886 20181 leader_election.cc:290] T 00000000000000000000000000000000 P c808b56815f647bbb9c50fb470b7255a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:27:25.793345 20184 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c808b56815f647bbb9c50fb470b7255a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:25.794799 20184 raft_consensus.cc:697] T 00000000000000000000000000000000 P c808b56815f647bbb9c50fb470b7255a [term 1 LEADER]: Becoming Leader. State: Replica: c808b56815f647bbb9c50fb470b7255a, State: Running, Role: LEADER
I20260709 12:27:25.795490 20184 consensus_queue.cc:237] T 00000000000000000000000000000000 P c808b56815f647bbb9c50fb470b7255a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c808b56815f647bbb9c50fb470b7255a" member_type: VOTER }
I20260709 12:27:25.795729 20181 sys_catalog.cc:565] T 00000000000000000000000000000000 P c808b56815f647bbb9c50fb470b7255a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:27:25.798378 20185 sys_catalog.cc:455] T 00000000000000000000000000000000 P c808b56815f647bbb9c50fb470b7255a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c808b56815f647bbb9c50fb470b7255a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c808b56815f647bbb9c50fb470b7255a" member_type: VOTER } }
I20260709 12:27:25.798393 20186 sys_catalog.cc:455] T 00000000000000000000000000000000 P c808b56815f647bbb9c50fb470b7255a [sys.catalog]: SysCatalogTable state changed. Reason: New leader c808b56815f647bbb9c50fb470b7255a. Latest consensus state: current_term: 1 leader_uuid: "c808b56815f647bbb9c50fb470b7255a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c808b56815f647bbb9c50fb470b7255a" member_type: VOTER } }
I20260709 12:27:25.799050 20185 sys_catalog.cc:458] T 00000000000000000000000000000000 P c808b56815f647bbb9c50fb470b7255a [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:25.799072 20186 sys_catalog.cc:458] T 00000000000000000000000000000000 P c808b56815f647bbb9c50fb470b7255a [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:25.801846 20189 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:27:25.808974 20189 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:27:25.810964  9799 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:27:25.818356 20189 catalog_manager.cc:1383] Generated new cluster ID: e301a7b8256d474591dacbd7f0fce41b
I20260709 12:27:25.818691 20189 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:27:25.834131 20189 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:27:25.835456 20189 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:27:25.849779 20189 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c808b56815f647bbb9c50fb470b7255a: Generated new TSK 0
I20260709 12:27:25.850472 20189 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:27:25.877664  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:25.883756 20202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:25.885303 20203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:25.887178 20205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:25.887228  9799 server_base.cc:1061] running on GCE node
I20260709 12:27:25.888548  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:25.888804  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:25.889030  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783600045889010 us; error 0 us; skew 500 ppm
I20260709 12:27:25.889591  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:25.891986  9799 webserver.cc:533] Webserver started at http://127.9.145.193:44219/ using document root <none> and password file <none>
I20260709 12:27:25.892565  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:25.892763  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:25.893045  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:25.894196  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599719482688-9799-0/minicluster-data/ts-0-root/instance:
uuid: "af886ac503354eaa932dd7c2811c64d9"
format_stamp: "Formatted at 2026-07-09 12:27:25 on dist-test-slave-1sdq"
I20260709 12:27:25.899140  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:27:25.902697 20210 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:25.903539  9799 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.002s
I20260709 12:27:25.903903  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599719482688-9799-0/minicluster-data/ts-0-root
uuid: "af886ac503354eaa932dd7c2811c64d9"
format_stamp: "Formatted at 2026-07-09 12:27:25 on dist-test-slave-1sdq"
I20260709 12:27:25.904209  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599719482688-9799-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599719482688-9799-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599719482688-9799-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:25.918730  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:25.920017  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:25.921525  9799 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:25.924018  9799 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:25.924240  9799 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:25.924492  9799 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:25.924650  9799 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:25.965037  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.193:40989
I20260709 12:27:25.965195 20272 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.193:40989 every 8 connection(s)
I20260709 12:27:25.970484  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:25.977794 20277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:25.979472 20278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:25.982491  9799 server_base.cc:1061] running on GCE node
I20260709 12:27:25.983345 20273 heartbeater.cc:344] Connected to a master server at 127.9.145.254:43257
I20260709 12:27:25.983791 20273 heartbeater.cc:461] Registering TS with master...
W20260709 12:27:25.983600 20280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:25.984741 20273 heartbeater.cc:507] Master 127.9.145.254:43257 requested a full tablet report, sending...
I20260709 12:27:25.984863  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:25.985185  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:25.985342  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783600045985326 us; error 0 us; skew 500 ppm
I20260709 12:27:25.985968  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:25.987028 20146 ts_manager.cc:194] Registered new tserver with Master: af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989)
I20260709 12:27:25.988708  9799 webserver.cc:533] Webserver started at http://127.9.145.194:39307/ using document root <none> and password file <none>
I20260709 12:27:25.989167 20146 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42064
I20260709 12:27:25.989276  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:25.989605  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:25.989876  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:25.991037  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599719482688-9799-0/minicluster-data/ts-1-root/instance:
uuid: "96a5d14dc9a9404b9b89c75be639ea96"
format_stamp: "Formatted at 2026-07-09 12:27:25 on dist-test-slave-1sdq"
I20260709 12:27:25.996011  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:27:25.999804 20285 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:26.000785  9799 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:27:26.001138  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599719482688-9799-0/minicluster-data/ts-1-root
uuid: "96a5d14dc9a9404b9b89c75be639ea96"
format_stamp: "Formatted at 2026-07-09 12:27:25 on dist-test-slave-1sdq"
I20260709 12:27:26.001430  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599719482688-9799-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599719482688-9799-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599719482688-9799-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:26.012821  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:26.013922  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:26.015405  9799 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:26.017753  9799 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:26.017957  9799 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:26.018208  9799 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:26.018363  9799 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:26.056352  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.194:40607
I20260709 12:27:26.056509 20347 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.194:40607 every 8 connection(s)
I20260709 12:27:26.061125  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:26.069258 20352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:26.069568 20351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:26.073072 20354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:26.073621 20348 heartbeater.cc:344] Connected to a master server at 127.9.145.254:43257
I20260709 12:27:26.073701  9799 server_base.cc:1061] running on GCE node
I20260709 12:27:26.074211 20348 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:26.074805  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:26.075084  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:26.075029 20348 heartbeater.cc:507] Master 127.9.145.254:43257 requested a full tablet report, sending...
I20260709 12:27:26.075516  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783600046075494 us; error 0 us; skew 500 ppm
I20260709 12:27:26.076196  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:26.077649 20146 ts_manager.cc:194] Registered new tserver with Master: 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607)
I20260709 12:27:26.079281  9799 webserver.cc:533] Webserver started at http://127.9.145.195:32997/ using document root <none> and password file <none>
I20260709 12:27:26.079689 20146 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42068
I20260709 12:27:26.080013  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:26.080314  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:26.080657  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:26.081840  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599719482688-9799-0/minicluster-data/ts-2-root/instance:
uuid: "6aee883f265544bd9c7b9502e590182c"
format_stamp: "Formatted at 2026-07-09 12:27:26 on dist-test-slave-1sdq"
I20260709 12:27:26.086395  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:27:26.089864 20359 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:26.090806  9799 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:27:26.091138  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599719482688-9799-0/minicluster-data/ts-2-root
uuid: "6aee883f265544bd9c7b9502e590182c"
format_stamp: "Formatted at 2026-07-09 12:27:26 on dist-test-slave-1sdq"
I20260709 12:27:26.091425  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599719482688-9799-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599719482688-9799-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599719482688-9799-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:26.137504  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:26.138710  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:26.140182  9799 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:26.142591  9799 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:26.142831  9799 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:26.143070  9799 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:26.143224  9799 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:26.182677  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.195:42747
I20260709 12:27:26.182819 20421 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.195:42747 every 8 connection(s)
I20260709 12:27:26.197077 20422 heartbeater.cc:344] Connected to a master server at 127.9.145.254:43257
I20260709 12:27:26.197584 20422 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:26.198359 20422 heartbeater.cc:507] Master 127.9.145.254:43257 requested a full tablet report, sending...
I20260709 12:27:26.200479 20146 ts_manager.cc:194] Registered new tserver with Master: 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:26.201143  9799 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015216452s
I20260709 12:27:26.201920 20146 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42082
I20260709 12:27:26.227747 20146 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42086:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:27:26.230417 20146 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:27:26.311247 20386 tablet_service.cc:1511] Processing CreateTablet for tablet 71ebebbc467f4437a8f5f7e60eab7173 (DEFAULT_TABLE table=test-workload [id=102e86c074ef4d2cb3f6da9be0408611]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:26.312858 20386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71ebebbc467f4437a8f5f7e60eab7173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.314877 20383 tablet_service.cc:1511] Processing CreateTablet for tablet 29a9241f720a49aa82f440b1beaae093 (DEFAULT_TABLE table=test-workload [id=102e86c074ef4d2cb3f6da9be0408611]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:26.315218 20384 tablet_service.cc:1511] Processing CreateTablet for tablet 11231f3045154727af46352ff967a27e (DEFAULT_TABLE table=test-workload [id=102e86c074ef4d2cb3f6da9be0408611]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:26.316397 20383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29a9241f720a49aa82f440b1beaae093. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.319307 20385 tablet_service.cc:1511] Processing CreateTablet for tablet dcf6239d1db24300aa9c81e0c83e9c59 (DEFAULT_TABLE table=test-workload [id=102e86c074ef4d2cb3f6da9be0408611]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:26.320745 20385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcf6239d1db24300aa9c81e0c83e9c59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.323230 20382 tablet_service.cc:1511] Processing CreateTablet for tablet f05ef6e78f2c4d4c9dbe574db29e502c (DEFAULT_TABLE table=test-workload [id=102e86c074ef4d2cb3f6da9be0408611]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:26.324710 20382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f05ef6e78f2c4d4c9dbe574db29e502c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.325865 20381 tablet_service.cc:1511] Processing CreateTablet for tablet 1c18393b4e564bf1942046af318a06a6 (DEFAULT_TABLE table=test-workload [id=102e86c074ef4d2cb3f6da9be0408611]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:26.309715 20387 tablet_service.cc:1511] Processing CreateTablet for tablet 0aafbdf83f384e9ab7e867e965730667 (DEFAULT_TABLE table=test-workload [id=102e86c074ef4d2cb3f6da9be0408611]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:26.327354 20381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c18393b4e564bf1942046af318a06a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.328003 20384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11231f3045154727af46352ff967a27e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.330401 20387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aafbdf83f384e9ab7e867e965730667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.331830 20380 tablet_service.cc:1511] Processing CreateTablet for tablet 8e4cebfd6a10429ba1a2d1e15c89c0ae (DEFAULT_TABLE table=test-workload [id=102e86c074ef4d2cb3f6da9be0408611]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:26.333339 20380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e4cebfd6a10429ba1a2d1e15c89c0ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.336735 20379 tablet_service.cc:1511] Processing CreateTablet for tablet f47b342aa4e145518e9c44998faf692e (DEFAULT_TABLE table=test-workload [id=102e86c074ef4d2cb3f6da9be0408611]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:26.338332 20379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f47b342aa4e145518e9c44998faf692e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.357338 20313 tablet_service.cc:1511] Processing CreateTablet for tablet 0aafbdf83f384e9ab7e867e965730667 (DEFAULT_TABLE table=test-workload [id=102e86c074ef4d2cb3f6da9be0408611]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:26.358958 20313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aafbdf83f384e9ab7e867e965730667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.359274 20310 tablet_service.cc:1511] Processing CreateTablet for tablet 11231f3045154727af46352ff967a27e (DEFAULT_TABLE table=test-workload [id=102e86c074ef4d2cb3f6da9be0408611]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:26.360694 20310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11231f3045154727af46352ff967a27e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.362016 20312 tablet_service.cc:1511] Processing CreateTablet for tablet 71ebebbc467f4437a8f5f7e60eab7173 (DEFAULT_TABLE table=test-workload [id=102e86c074ef4d2cb3f6da9be0408611]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:26.363533 20312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71ebebbc467f4437a8f5f7e60eab7173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.364856 20308 tablet_service.cc:1511] Processing CreateTablet for tablet f05ef6e78f2c4d4c9dbe574db29e502c (DEFAULT_TABLE table=test-workload [id=102e86c074ef4d2cb3f6da9be0408611]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:26.363194 20309 tablet_service.cc:1511] Processing CreateTablet for tablet 29a9241f720a49aa82f440b1beaae093 (DEFAULT_TABLE table=test-workload [id=102e86c074ef4d2cb3f6da9be0408611]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:26.367182 20311 tablet_service.cc:1511] Processing CreateTablet for tablet dcf6239d1db24300aa9c81e0c83e9c59 (DEFAULT_TABLE table=test-workload [id=102e86c074ef4d2cb3f6da9be0408611]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:26.369549 20307 tablet_service.cc:1511] Processing CreateTablet for tablet 1c18393b4e564bf1942046af318a06a6 (DEFAULT_TABLE table=test-workload [id=102e86c074ef4d2cb3f6da9be0408611]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:26.367182 20306 tablet_service.cc:1511] Processing CreateTablet for tablet 8e4cebfd6a10429ba1a2d1e15c89c0ae (DEFAULT_TABLE table=test-workload [id=102e86c074ef4d2cb3f6da9be0408611]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:26.372192 20308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f05ef6e78f2c4d4c9dbe574db29e502c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.372923 20311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcf6239d1db24300aa9c81e0c83e9c59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.368355 20305 tablet_service.cc:1511] Processing CreateTablet for tablet f47b342aa4e145518e9c44998faf692e (DEFAULT_TABLE table=test-workload [id=102e86c074ef4d2cb3f6da9be0408611]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:26.374980 20306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e4cebfd6a10429ba1a2d1e15c89c0ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.375675 20309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29a9241f720a49aa82f440b1beaae093. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.376415 20238 tablet_service.cc:1511] Processing CreateTablet for tablet 0aafbdf83f384e9ab7e867e965730667 (DEFAULT_TABLE table=test-workload [id=102e86c074ef4d2cb3f6da9be0408611]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:26.377899 20238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aafbdf83f384e9ab7e867e965730667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.379238 20237 tablet_service.cc:1511] Processing CreateTablet for tablet 71ebebbc467f4437a8f5f7e60eab7173 (DEFAULT_TABLE table=test-workload [id=102e86c074ef4d2cb3f6da9be0408611]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:26.382198 20237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71ebebbc467f4437a8f5f7e60eab7173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.380268 20305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f47b342aa4e145518e9c44998faf692e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.384122 20307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c18393b4e564bf1942046af318a06a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.391973 20236 tablet_service.cc:1511] Processing CreateTablet for tablet dcf6239d1db24300aa9c81e0c83e9c59 (DEFAULT_TABLE table=test-workload [id=102e86c074ef4d2cb3f6da9be0408611]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:26.393594 20236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcf6239d1db24300aa9c81e0c83e9c59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.403875 20235 tablet_service.cc:1511] Processing CreateTablet for tablet 11231f3045154727af46352ff967a27e (DEFAULT_TABLE table=test-workload [id=102e86c074ef4d2cb3f6da9be0408611]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:26.405474 20235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11231f3045154727af46352ff967a27e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.423362 20234 tablet_service.cc:1511] Processing CreateTablet for tablet 29a9241f720a49aa82f440b1beaae093 (DEFAULT_TABLE table=test-workload [id=102e86c074ef4d2cb3f6da9be0408611]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:26.424964 20234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29a9241f720a49aa82f440b1beaae093. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.431779 20233 tablet_service.cc:1511] Processing CreateTablet for tablet f05ef6e78f2c4d4c9dbe574db29e502c (DEFAULT_TABLE table=test-workload [id=102e86c074ef4d2cb3f6da9be0408611]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:26.433367 20233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f05ef6e78f2c4d4c9dbe574db29e502c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.439769 20232 tablet_service.cc:1511] Processing CreateTablet for tablet 1c18393b4e564bf1942046af318a06a6 (DEFAULT_TABLE table=test-workload [id=102e86c074ef4d2cb3f6da9be0408611]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:26.441279 20232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c18393b4e564bf1942046af318a06a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.447710 20231 tablet_service.cc:1511] Processing CreateTablet for tablet 8e4cebfd6a10429ba1a2d1e15c89c0ae (DEFAULT_TABLE table=test-workload [id=102e86c074ef4d2cb3f6da9be0408611]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:26.449241 20231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e4cebfd6a10429ba1a2d1e15c89c0ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.455789 20230 tablet_service.cc:1511] Processing CreateTablet for tablet f47b342aa4e145518e9c44998faf692e (DEFAULT_TABLE table=test-workload [id=102e86c074ef4d2cb3f6da9be0408611]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:26.457300 20230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f47b342aa4e145518e9c44998faf692e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.519356 20437 tablet_bootstrap.cc:492] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c: Bootstrap starting.
I20260709 12:27:26.525409 20437 tablet_bootstrap.cc:654] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.563512 20439 tablet_bootstrap.cc:492] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9: Bootstrap starting.
I20260709 12:27:26.587045 20439 tablet_bootstrap.cc:654] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.588884 20438 tablet_bootstrap.cc:492] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 96a5d14dc9a9404b9b89c75be639ea96: Bootstrap starting.
I20260709 12:27:26.595466 20438 tablet_bootstrap.cc:654] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 96a5d14dc9a9404b9b89c75be639ea96: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.603926 20438 tablet_bootstrap.cc:492] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 96a5d14dc9a9404b9b89c75be639ea96: No bootstrap required, opened a new log
I20260709 12:27:26.604140 20437 tablet_bootstrap.cc:492] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c: No bootstrap required, opened a new log
I20260709 12:27:26.604461 20438 ts_tablet_manager.cc:1403] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 96a5d14dc9a9404b9b89c75be639ea96: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.005s
I20260709 12:27:26.604733 20437 ts_tablet_manager.cc:1403] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c: Time spent bootstrapping tablet: real 0.086s	user 0.041s	sys 0.023s
I20260709 12:27:26.605188 20439 tablet_bootstrap.cc:492] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9: No bootstrap required, opened a new log
I20260709 12:27:26.605868 20439 ts_tablet_manager.cc:1403] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9: Time spent bootstrapping tablet: real 0.043s	user 0.000s	sys 0.021s
I20260709 12:27:26.607743 20438 raft_consensus.cc:359] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.608389 20438 raft_consensus.cc:385] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.608057 20437 raft_consensus.cc:359] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.608660 20438 raft_consensus.cc:740] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.608861 20439 raft_consensus.cc:359] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.609494 20439 raft_consensus.cc:385] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.609417 20438 consensus_queue.cc:260] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 96a5d14dc9a9404b9b89c75be639ea96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.609809 20439 raft_consensus.cc:740] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af886ac503354eaa932dd7c2811c64d9, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.608862 20437 raft_consensus.cc:385] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.610435 20437 raft_consensus.cc:740] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.610662 20439 consensus_queue.cc:260] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.611155 20437 consensus_queue.cc:260] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.615530 20273 heartbeater.cc:499] Master 127.9.145.254:43257 was elected leader, sending a full tablet report...
I20260709 12:27:26.616032 20439 ts_tablet_manager.cc:1434] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.005s
I20260709 12:27:26.617358 20439 tablet_bootstrap.cc:492] T 0aafbdf83f384e9ab7e867e965730667 P af886ac503354eaa932dd7c2811c64d9: Bootstrap starting.
I20260709 12:27:26.618669 20438 ts_tablet_manager.cc:1434] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 96a5d14dc9a9404b9b89c75be639ea96: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.004s
I20260709 12:27:26.619498 20348 heartbeater.cc:499] Master 127.9.145.254:43257 was elected leader, sending a full tablet report...
I20260709 12:27:26.623517 20439 tablet_bootstrap.cc:654] T 0aafbdf83f384e9ab7e867e965730667 P af886ac503354eaa932dd7c2811c64d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.628396 20438 tablet_bootstrap.cc:492] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96: Bootstrap starting.
I20260709 12:27:26.635350 20439 tablet_bootstrap.cc:492] T 0aafbdf83f384e9ab7e867e965730667 P af886ac503354eaa932dd7c2811c64d9: No bootstrap required, opened a new log
I20260709 12:27:26.635519 20422 heartbeater.cc:499] Master 127.9.145.254:43257 was elected leader, sending a full tablet report...
I20260709 12:27:26.636040 20437 ts_tablet_manager.cc:1434] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.023s
I20260709 12:27:26.636086 20439 ts_tablet_manager.cc:1403] T 0aafbdf83f384e9ab7e867e965730667 P af886ac503354eaa932dd7c2811c64d9: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 12:27:26.637356 20437 tablet_bootstrap.cc:492] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c: Bootstrap starting.
I20260709 12:27:26.639575 20439 raft_consensus.cc:359] T 0aafbdf83f384e9ab7e867e965730667 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } } peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } }
I20260709 12:27:26.640336 20439 raft_consensus.cc:385] T 0aafbdf83f384e9ab7e867e965730667 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.640647 20439 raft_consensus.cc:740] T 0aafbdf83f384e9ab7e867e965730667 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af886ac503354eaa932dd7c2811c64d9, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.641549 20439 consensus_queue.cc:260] T 0aafbdf83f384e9ab7e867e965730667 P af886ac503354eaa932dd7c2811c64d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } } peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } }
I20260709 12:27:26.643571 20437 tablet_bootstrap.cc:654] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.643786 20439 ts_tablet_manager.cc:1434] T 0aafbdf83f384e9ab7e867e965730667 P af886ac503354eaa932dd7c2811c64d9: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:27:26.644960 20439 tablet_bootstrap.cc:492] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9: Bootstrap starting.
I20260709 12:27:26.646716 20438 tablet_bootstrap.cc:654] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.651379 20439 tablet_bootstrap.cc:654] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.669129 20439 tablet_bootstrap.cc:492] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9: No bootstrap required, opened a new log
I20260709 12:27:26.669735 20439 ts_tablet_manager.cc:1403] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9: Time spent bootstrapping tablet: real 0.025s	user 0.005s	sys 0.012s
I20260709 12:27:26.672668 20439 raft_consensus.cc:359] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.673398 20439 raft_consensus.cc:385] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.673710 20439 raft_consensus.cc:740] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af886ac503354eaa932dd7c2811c64d9, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.674531 20439 consensus_queue.cc:260] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.676772 20439 ts_tablet_manager.cc:1434] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:27:26.677841 20439 tablet_bootstrap.cc:492] T 1c18393b4e564bf1942046af318a06a6 P af886ac503354eaa932dd7c2811c64d9: Bootstrap starting.
I20260709 12:27:26.682976 20437 tablet_bootstrap.cc:492] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c: No bootstrap required, opened a new log
I20260709 12:27:26.683701 20439 tablet_bootstrap.cc:654] T 1c18393b4e564bf1942046af318a06a6 P af886ac503354eaa932dd7c2811c64d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.683728 20437 ts_tablet_manager.cc:1403] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c: Time spent bootstrapping tablet: real 0.047s	user 0.026s	sys 0.020s
I20260709 12:27:26.683969 20438 tablet_bootstrap.cc:492] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96: No bootstrap required, opened a new log
I20260709 12:27:26.684780 20438 ts_tablet_manager.cc:1403] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96: Time spent bootstrapping tablet: real 0.057s	user 0.022s	sys 0.020s
I20260709 12:27:26.687819 20438 raft_consensus.cc:359] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.687922 20437 raft_consensus.cc:359] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } } peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } }
I20260709 12:27:26.688860 20438 raft_consensus.cc:385] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.688891 20437 raft_consensus.cc:385] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.689465 20438 raft_consensus.cc:740] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.689481 20437 raft_consensus.cc:740] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.690610 20438 consensus_queue.cc:260] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.690610 20437 consensus_queue.cc:260] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } } peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } }
I20260709 12:27:26.693327 20438 ts_tablet_manager.cc:1434] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:27:26.693351 20437 ts_tablet_manager.cc:1434] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:27:26.694629 20437 tablet_bootstrap.cc:492] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c: Bootstrap starting.
I20260709 12:27:26.694629 20438 tablet_bootstrap.cc:492] T f05ef6e78f2c4d4c9dbe574db29e502c P 96a5d14dc9a9404b9b89c75be639ea96: Bootstrap starting.
I20260709 12:27:26.704981 20445 raft_consensus.cc:493] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.705646 20445 raft_consensus.cc:515] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } } peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } }
I20260709 12:27:26.706341 20437 tablet_bootstrap.cc:654] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.708290 20439 tablet_bootstrap.cc:492] T 1c18393b4e564bf1942046af318a06a6 P af886ac503354eaa932dd7c2811c64d9: No bootstrap required, opened a new log
I20260709 12:27:26.709723 20439 ts_tablet_manager.cc:1403] T 1c18393b4e564bf1942046af318a06a6 P af886ac503354eaa932dd7c2811c64d9: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.010s
I20260709 12:27:26.712553 20445 leader_election.cc:290] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607)
I20260709 12:27:26.709100 20438 tablet_bootstrap.cc:654] T f05ef6e78f2c4d4c9dbe574db29e502c P 96a5d14dc9a9404b9b89c75be639ea96: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.712832 20439 raft_consensus.cc:359] T 1c18393b4e564bf1942046af318a06a6 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.714869 20439 raft_consensus.cc:385] T 1c18393b4e564bf1942046af318a06a6 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.715267 20439 raft_consensus.cc:740] T 1c18393b4e564bf1942046af318a06a6 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af886ac503354eaa932dd7c2811c64d9, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.716341 20439 consensus_queue.cc:260] T 1c18393b4e564bf1942046af318a06a6 P af886ac503354eaa932dd7c2811c64d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.718950 20439 ts_tablet_manager.cc:1434] T 1c18393b4e564bf1942046af318a06a6 P af886ac503354eaa932dd7c2811c64d9: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:27:26.721036 20439 tablet_bootstrap.cc:492] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P af886ac503354eaa932dd7c2811c64d9: Bootstrap starting.
I20260709 12:27:26.728631 20439 tablet_bootstrap.cc:654] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P af886ac503354eaa932dd7c2811c64d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.730188 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aafbdf83f384e9ab7e867e965730667" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9" is_pre_election: true
I20260709 12:27:26.731009 20248 raft_consensus.cc:2468] T 0aafbdf83f384e9ab7e867e965730667 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 0.
I20260709 12:27:26.732550 20363 leader_election.cc:304] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, af886ac503354eaa932dd7c2811c64d9; no voters: 
I20260709 12:27:26.733680 20445 raft_consensus.cc:2804] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:26.734091 20445 raft_consensus.cc:493] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:26.734455 20445 raft_consensus.cc:3060] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.743618 20443 raft_consensus.cc:493] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.744342 20443 raft_consensus.cc:515] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.743952 20445 raft_consensus.cc:515] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } } peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } }
I20260709 12:27:26.747825 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aafbdf83f384e9ab7e867e965730667" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
I20260709 12:27:26.748446 20248 raft_consensus.cc:3060] T 0aafbdf83f384e9ab7e867e965730667 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.755571 20437 tablet_bootstrap.cc:492] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c: No bootstrap required, opened a new log
I20260709 12:27:26.756225 20437 ts_tablet_manager.cc:1403] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c: Time spent bootstrapping tablet: real 0.062s	user 0.005s	sys 0.012s
I20260709 12:27:26.757236 20248 raft_consensus.cc:2468] T 0aafbdf83f384e9ab7e867e965730667 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 1.
I20260709 12:27:26.757617 20443 leader_election.cc:290] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:26.758838 20363 leader_election.cc:304] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, af886ac503354eaa932dd7c2811c64d9; no voters: 
I20260709 12:27:26.761042 20438 tablet_bootstrap.cc:492] T f05ef6e78f2c4d4c9dbe574db29e502c P 96a5d14dc9a9404b9b89c75be639ea96: No bootstrap required, opened a new log
I20260709 12:27:26.761729 20438 ts_tablet_manager.cc:1403] T f05ef6e78f2c4d4c9dbe574db29e502c P 96a5d14dc9a9404b9b89c75be639ea96: Time spent bootstrapping tablet: real 0.067s	user 0.026s	sys 0.027s
I20260709 12:27:26.762310 20445 leader_election.cc:290] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 election: Requested vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607)
I20260709 12:27:26.764950 20438 raft_consensus.cc:359] T f05ef6e78f2c4d4c9dbe574db29e502c P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.765202 20437 raft_consensus.cc:359] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.765816 20438 raft_consensus.cc:385] T f05ef6e78f2c4d4c9dbe574db29e502c P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.766114 20437 raft_consensus.cc:385] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.766211 20438 raft_consensus.cc:740] T f05ef6e78f2c4d4c9dbe574db29e502c P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.766579 20437 raft_consensus.cc:740] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.767269 20438 consensus_queue.cc:260] T f05ef6e78f2c4d4c9dbe574db29e502c P 96a5d14dc9a9404b9b89c75be639ea96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.765558 20439 tablet_bootstrap.cc:492] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P af886ac503354eaa932dd7c2811c64d9: No bootstrap required, opened a new log
I20260709 12:27:26.769614 20438 ts_tablet_manager.cc:1434] T f05ef6e78f2c4d4c9dbe574db29e502c P 96a5d14dc9a9404b9b89c75be639ea96: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.001s
I20260709 12:27:26.779100 20438 tablet_bootstrap.cc:492] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96: Bootstrap starting.
I20260709 12:27:26.781360 20439 ts_tablet_manager.cc:1403] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P af886ac503354eaa932dd7c2811c64d9: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.010s
I20260709 12:27:26.784960 20439 raft_consensus.cc:359] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.774345 20445 raft_consensus.cc:2804] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:26.767552 20437 consensus_queue.cc:260] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.785735 20439 raft_consensus.cc:385] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.786065 20439 raft_consensus.cc:740] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af886ac503354eaa932dd7c2811c64d9, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.786897 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cebfd6a10429ba1a2d1e15c89c0ae" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9" is_pre_election: true
I20260709 12:27:26.787714 20437 ts_tablet_manager.cc:1434] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c: Time spent starting tablet: real 0.031s	user 0.013s	sys 0.006s
I20260709 12:27:26.789124 20437 tablet_bootstrap.cc:492] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c: Bootstrap starting.
I20260709 12:27:26.787890 20438 tablet_bootstrap.cc:654] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.796083 20437 tablet_bootstrap.cc:654] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.800796 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aafbdf83f384e9ab7e867e965730667" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96" is_pre_election: true
I20260709 12:27:26.802971 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aafbdf83f384e9ab7e867e965730667" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
W20260709 12:27:26.804349 20361 leader_election.cc:343] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:26.805271 20437 tablet_bootstrap.cc:492] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c: No bootstrap required, opened a new log
W20260709 12:27:26.805668 20361 leader_election.cc:343] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:26.806317 20437 ts_tablet_manager.cc:1403] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
W20260709 12:27:26.806301 20194 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:26.809850 20437 raft_consensus.cc:359] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.810288 20444 raft_consensus.cc:493] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.812781 20444 raft_consensus.cc:515] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.814797 20438 tablet_bootstrap.cc:492] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96: No bootstrap required, opened a new log
I20260709 12:27:26.815117 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cebfd6a10429ba1a2d1e15c89c0ae" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aee883f265544bd9c7b9502e590182c" is_pre_election: true
I20260709 12:27:26.815459 20438 ts_tablet_manager.cc:1403] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.006s
I20260709 12:27:26.816991 20444 leader_election.cc:290] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:26.818833 20438 raft_consensus.cc:359] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.810936 20445 raft_consensus.cc:697] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Becoming Leader. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Running, Role: LEADER
I20260709 12:27:26.810243 20439 consensus_queue.cc:260] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P af886ac503354eaa932dd7c2811c64d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.819753 20438 raft_consensus.cc:385] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.823087 20459 raft_consensus.cc:493] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.820544 20248 raft_consensus.cc:2468] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96a5d14dc9a9404b9b89c75be639ea96 in term 0.
W20260709 12:27:26.819480 20288 leader_election.cc:343] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:26.821878 20439 ts_tablet_manager.cc:1434] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P af886ac503354eaa932dd7c2811c64d9: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 12:27:26.829854 20437 raft_consensus.cc:385] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.830271 20437 raft_consensus.cc:740] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.831003 20439 tablet_bootstrap.cc:492] T f05ef6e78f2c4d4c9dbe574db29e502c P af886ac503354eaa932dd7c2811c64d9: Bootstrap starting.
I20260709 12:27:26.831292 20437 consensus_queue.cc:260] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.831410 20459 raft_consensus.cc:515] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.836004 20289 leader_election.cc:304] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96a5d14dc9a9404b9b89c75be639ea96, af886ac503354eaa932dd7c2811c64d9; no voters: 6aee883f265544bd9c7b9502e590182c
I20260709 12:27:26.836347 20459 leader_election.cc:290] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607)
I20260709 12:27:26.833951 20437 ts_tablet_manager.cc:1434] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c: Time spent starting tablet: real 0.027s	user 0.012s	sys 0.000s
I20260709 12:27:26.837423 20443 raft_consensus.cc:2804] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:26.837809 20443 raft_consensus.cc:493] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:26.838503 20443 raft_consensus.cc:3060] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.837800 20437 tablet_bootstrap.cc:492] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c: Bootstrap starting.
I20260709 12:27:26.839658 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05ef6e78f2c4d4c9dbe574db29e502c" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96" is_pre_election: true
I20260709 12:27:26.840380 20323 raft_consensus.cc:2468] T f05ef6e78f2c4d4c9dbe574db29e502c P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 0.
I20260709 12:27:26.841526 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05ef6e78f2c4d4c9dbe574db29e502c" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9" is_pre_election: true
W20260709 12:27:26.843228 20363 leader_election.cc:343] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:26.844432 20361 leader_election.cc:304] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, 96a5d14dc9a9404b9b89c75be639ea96; no voters: af886ac503354eaa932dd7c2811c64d9
I20260709 12:27:26.845957 20439 tablet_bootstrap.cc:654] T f05ef6e78f2c4d4c9dbe574db29e502c P af886ac503354eaa932dd7c2811c64d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.846997 20443 raft_consensus.cc:515] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.847905 20459 raft_consensus.cc:2804] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:26.848377 20459 raft_consensus.cc:493] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:26.850035 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cebfd6a10429ba1a2d1e15c89c0ae" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
I20260709 12:27:26.850818 20247 raft_consensus.cc:3060] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.824383 20445 consensus_queue.cc:237] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } } peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } }
I20260709 12:27:26.850064 20459 raft_consensus.cc:3060] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.849229 20437 tablet_bootstrap.cc:654] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.828775 20438 raft_consensus.cc:740] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.860174 20438 consensus_queue.cc:260] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.861183 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ebebbc467f4437a8f5f7e60eab7173" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96" is_pre_election: true
W20260709 12:27:26.863202 20212 leader_election.cc:343] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:26.863790 20247 raft_consensus.cc:2468] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96a5d14dc9a9404b9b89c75be639ea96 in term 1.
I20260709 12:27:26.864398 20443 leader_election.cc:290] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 election: Requested vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:26.865123 20289 leader_election.cc:304] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96a5d14dc9a9404b9b89c75be639ea96, af886ac503354eaa932dd7c2811c64d9; no voters: 
I20260709 12:27:26.865718 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cebfd6a10429ba1a2d1e15c89c0ae" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aee883f265544bd9c7b9502e590182c"
W20260709 12:27:26.868355 20288 leader_election.cc:343] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:26.869172 20443 raft_consensus.cc:2804] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:26.869801 20443 raft_consensus.cc:697] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 LEADER]: Becoming Leader. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Running, Role: LEADER
I20260709 12:27:26.869706 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ebebbc467f4437a8f5f7e60eab7173" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aee883f265544bd9c7b9502e590182c" is_pre_election: true
I20260709 12:27:26.870954 20443 consensus_queue.cc:237] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 96a5d14dc9a9404b9b89c75be639ea96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
W20260709 12:27:26.871469 20213 leader_election.cc:343] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:26.871956 20213 leader_election.cc:304] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af886ac503354eaa932dd7c2811c64d9; no voters: 6aee883f265544bd9c7b9502e590182c, 96a5d14dc9a9404b9b89c75be639ea96
I20260709 12:27:26.872632 20444 raft_consensus.cc:2749] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:26.874938 20439 tablet_bootstrap.cc:492] T f05ef6e78f2c4d4c9dbe574db29e502c P af886ac503354eaa932dd7c2811c64d9: No bootstrap required, opened a new log
I20260709 12:27:26.875512 20439 ts_tablet_manager.cc:1403] T f05ef6e78f2c4d4c9dbe574db29e502c P af886ac503354eaa932dd7c2811c64d9: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.010s
I20260709 12:27:26.876920 20437 tablet_bootstrap.cc:492] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c: No bootstrap required, opened a new log
I20260709 12:27:26.877502 20437 ts_tablet_manager.cc:1403] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c: Time spent bootstrapping tablet: real 0.040s	user 0.007s	sys 0.005s
I20260709 12:27:26.878168 20439 raft_consensus.cc:359] T f05ef6e78f2c4d4c9dbe574db29e502c P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.879099 20439 raft_consensus.cc:385] T f05ef6e78f2c4d4c9dbe574db29e502c P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.879408 20439 raft_consensus.cc:740] T f05ef6e78f2c4d4c9dbe574db29e502c P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af886ac503354eaa932dd7c2811c64d9, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.880576 20439 consensus_queue.cc:260] T f05ef6e78f2c4d4c9dbe574db29e502c P af886ac503354eaa932dd7c2811c64d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.881438 20437 raft_consensus.cc:359] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.881984 20438 ts_tablet_manager.cc:1434] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96: Time spent starting tablet: real 0.066s	user 0.005s	sys 0.004s
I20260709 12:27:26.882334 20437 raft_consensus.cc:385] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.882678 20437 raft_consensus.cc:740] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.883555 20438 tablet_bootstrap.cc:492] T 11231f3045154727af46352ff967a27e P 96a5d14dc9a9404b9b89c75be639ea96: Bootstrap starting.
I20260709 12:27:26.883476 20437 consensus_queue.cc:260] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.886117 20437 ts_tablet_manager.cc:1434] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
I20260709 12:27:26.887066 20439 ts_tablet_manager.cc:1434] T f05ef6e78f2c4d4c9dbe574db29e502c P af886ac503354eaa932dd7c2811c64d9: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:27:26.887470 20437 tablet_bootstrap.cc:492] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c: Bootstrap starting.
I20260709 12:27:26.888442 20439 tablet_bootstrap.cc:492] T 29a9241f720a49aa82f440b1beaae093 P af886ac503354eaa932dd7c2811c64d9: Bootstrap starting.
I20260709 12:27:26.891072 20438 tablet_bootstrap.cc:654] T 11231f3045154727af46352ff967a27e P 96a5d14dc9a9404b9b89c75be639ea96: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.879370 20459 raft_consensus.cc:515] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.895021 20437 tablet_bootstrap.cc:654] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.901706 20144 catalog_manager.cc:5697] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6aee883f265544bd9c7b9502e590182c (127.9.145.195). New cstate: current_term: 1 leader_uuid: "6aee883f265544bd9c7b9502e590182c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:26.908563 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05ef6e78f2c4d4c9dbe574db29e502c" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
I20260709 12:27:26.908066 20145 catalog_manager.cc:5697] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 96a5d14dc9a9404b9b89c75be639ea96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "96a5d14dc9a9404b9b89c75be639ea96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:26.909407 20247 raft_consensus.cc:3060] T f05ef6e78f2c4d4c9dbe574db29e502c P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.915863 20439 tablet_bootstrap.cc:654] T 29a9241f720a49aa82f440b1beaae093 P af886ac503354eaa932dd7c2811c64d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.916528 20459 leader_election.cc:290] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 election: Requested vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607)
I20260709 12:27:26.918025 20247 raft_consensus.cc:2468] T f05ef6e78f2c4d4c9dbe574db29e502c P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 1.
I20260709 12:27:26.917917 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05ef6e78f2c4d4c9dbe574db29e502c" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
I20260709 12:27:26.918951 20323 raft_consensus.cc:3060] T f05ef6e78f2c4d4c9dbe574db29e502c P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.920969 20437 tablet_bootstrap.cc:492] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c: No bootstrap required, opened a new log
I20260709 12:27:26.921690 20437 ts_tablet_manager.cc:1403] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c: Time spent bootstrapping tablet: real 0.034s	user 0.021s	sys 0.010s
I20260709 12:27:26.923118 20363 leader_election.cc:304] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, af886ac503354eaa932dd7c2811c64d9; no voters: 
I20260709 12:27:26.924254 20459 raft_consensus.cc:2804] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:26.924829 20459 raft_consensus.cc:697] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Becoming Leader. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Running, Role: LEADER
I20260709 12:27:26.925752 20459 consensus_queue.cc:237] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.928404 20438 tablet_bootstrap.cc:492] T 11231f3045154727af46352ff967a27e P 96a5d14dc9a9404b9b89c75be639ea96: No bootstrap required, opened a new log
I20260709 12:27:26.929021 20438 ts_tablet_manager.cc:1403] T 11231f3045154727af46352ff967a27e P 96a5d14dc9a9404b9b89c75be639ea96: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.000s
I20260709 12:27:26.929502 20439 tablet_bootstrap.cc:492] T 29a9241f720a49aa82f440b1beaae093 P af886ac503354eaa932dd7c2811c64d9: No bootstrap required, opened a new log
I20260709 12:27:26.929826 20323 raft_consensus.cc:2468] T f05ef6e78f2c4d4c9dbe574db29e502c P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 1.
I20260709 12:27:26.930184 20439 ts_tablet_manager.cc:1403] T 29a9241f720a49aa82f440b1beaae093 P af886ac503354eaa932dd7c2811c64d9: Time spent bootstrapping tablet: real 0.042s	user 0.005s	sys 0.008s
I20260709 12:27:26.925787 20437 raft_consensus.cc:359] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.931272 20437 raft_consensus.cc:385] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.935707 20439 raft_consensus.cc:359] T 29a9241f720a49aa82f440b1beaae093 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.936877 20439 raft_consensus.cc:385] T 29a9241f720a49aa82f440b1beaae093 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.932008 20437 raft_consensus.cc:740] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.937336 20439 raft_consensus.cc:740] T 29a9241f720a49aa82f440b1beaae093 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af886ac503354eaa932dd7c2811c64d9, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.939168 20437 consensus_queue.cc:260] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.939327 20439 consensus_queue.cc:260] T 29a9241f720a49aa82f440b1beaae093 P af886ac503354eaa932dd7c2811c64d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.943413 20439 ts_tablet_manager.cc:1434] T 29a9241f720a49aa82f440b1beaae093 P af886ac503354eaa932dd7c2811c64d9: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 12:27:26.944695 20439 tablet_bootstrap.cc:492] T 11231f3045154727af46352ff967a27e P af886ac503354eaa932dd7c2811c64d9: Bootstrap starting.
I20260709 12:27:26.945609 20437 ts_tablet_manager.cc:1434] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 12:27:26.947052 20437 tablet_bootstrap.cc:492] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c: Bootstrap starting.
I20260709 12:27:26.951839 20439 tablet_bootstrap.cc:654] T 11231f3045154727af46352ff967a27e P af886ac503354eaa932dd7c2811c64d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.954996 20437 tablet_bootstrap.cc:654] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.966915 20438 raft_consensus.cc:359] T 11231f3045154727af46352ff967a27e P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.968447 20444 raft_consensus.cc:493] T 1c18393b4e564bf1942046af318a06a6 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.969055 20444 raft_consensus.cc:515] T 1c18393b4e564bf1942046af318a06a6 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.973903 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c18393b4e564bf1942046af318a06a6" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aee883f265544bd9c7b9502e590182c" is_pre_election: true
I20260709 12:27:26.975337 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c18393b4e564bf1942046af318a06a6" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96" is_pre_election: true
I20260709 12:27:26.976872 20445 raft_consensus.cc:493] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.977735 20445 raft_consensus.cc:515] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
W20260709 12:27:26.978027 20212 leader_election.cc:343] T 1c18393b4e564bf1942046af318a06a6 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:26.979713 20213 leader_election.cc:343] T 1c18393b4e564bf1942046af318a06a6 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:26.980208 20213 leader_election.cc:304] T 1c18393b4e564bf1942046af318a06a6 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af886ac503354eaa932dd7c2811c64d9; no voters: 6aee883f265544bd9c7b9502e590182c, 96a5d14dc9a9404b9b89c75be639ea96
I20260709 12:27:26.976832 20444 leader_election.cc:290] T 1c18393b4e564bf1942046af318a06a6 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:26.981931 20444 raft_consensus.cc:2749] T 1c18393b4e564bf1942046af318a06a6 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:26.982339 20445 leader_election.cc:290] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607)
I20260709 12:27:26.981987 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11231f3045154727af46352ff967a27e" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96" is_pre_election: true
I20260709 12:27:26.967940 20438 raft_consensus.cc:385] T 11231f3045154727af46352ff967a27e P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.986714 20438 raft_consensus.cc:740] T 11231f3045154727af46352ff967a27e P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.987712 20438 consensus_queue.cc:260] T 11231f3045154727af46352ff967a27e P 96a5d14dc9a9404b9b89c75be639ea96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:26.988817 20323 raft_consensus.cc:2468] T 11231f3045154727af46352ff967a27e P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 0.
I20260709 12:27:26.991201 20361 leader_election.cc:304] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, 96a5d14dc9a9404b9b89c75be639ea96; no voters: 
I20260709 12:27:26.992249 20445 raft_consensus.cc:2804] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:26.992666 20445 raft_consensus.cc:493] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:26.993036 20445 raft_consensus.cc:3060] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:27.003067 20445 raft_consensus.cc:515] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.015414 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11231f3045154727af46352ff967a27e" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
I20260709 12:27:27.010721 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11231f3045154727af46352ff967a27e" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
I20260709 12:27:27.007069 20445 leader_election.cc:290] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 election: Requested vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607)
I20260709 12:27:27.008726 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11231f3045154727af46352ff967a27e" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9" is_pre_election: true
W20260709 12:27:27.021581 20363 leader_election.cc:343] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:27.022346 20323 raft_consensus.cc:3060] T 11231f3045154727af46352ff967a27e P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:27.022552 20363 leader_election.cc:343] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:27.024009 20439 tablet_bootstrap.cc:492] T 11231f3045154727af46352ff967a27e P af886ac503354eaa932dd7c2811c64d9: No bootstrap required, opened a new log
I20260709 12:27:27.024621 20439 ts_tablet_manager.cc:1403] T 11231f3045154727af46352ff967a27e P af886ac503354eaa932dd7c2811c64d9: Time spent bootstrapping tablet: real 0.080s	user 0.030s	sys 0.034s
I20260709 12:27:27.017792 20479 raft_consensus.cc:493] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.026747 20479 raft_consensus.cc:515] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.027523 20439 raft_consensus.cc:359] T 11231f3045154727af46352ff967a27e P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.028311 20439 raft_consensus.cc:385] T 11231f3045154727af46352ff967a27e P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:27.028589 20439 raft_consensus.cc:740] T 11231f3045154727af46352ff967a27e P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af886ac503354eaa932dd7c2811c64d9, State: Initialized, Role: FOLLOWER
I20260709 12:27:27.015951 20143 catalog_manager.cc:5697] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6aee883f265544bd9c7b9502e590182c (127.9.145.195). New cstate: current_term: 1 leader_uuid: "6aee883f265544bd9c7b9502e590182c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:27.029371 20439 consensus_queue.cc:260] T 11231f3045154727af46352ff967a27e P af886ac503354eaa932dd7c2811c64d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.030216 20445 raft_consensus.cc:493] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.030778 20445 raft_consensus.cc:515] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.031442 20437 tablet_bootstrap.cc:492] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c: No bootstrap required, opened a new log
I20260709 12:27:27.005190 20438 ts_tablet_manager.cc:1434] T 11231f3045154727af46352ff967a27e P 96a5d14dc9a9404b9b89c75be639ea96: Time spent starting tablet: real 0.076s	user 0.009s	sys 0.000s
I20260709 12:27:27.032095 20437 ts_tablet_manager.cc:1403] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c: Time spent bootstrapping tablet: real 0.085s	user 0.037s	sys 0.038s
I20260709 12:27:27.034883 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a9241f720a49aa82f440b1beaae093" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96" is_pre_election: true
I20260709 12:27:27.035585 20439 ts_tablet_manager.cc:1434] T 11231f3045154727af46352ff967a27e P af886ac503354eaa932dd7c2811c64d9: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:27:27.035719 20437 raft_consensus.cc:359] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.036755 20439 tablet_bootstrap.cc:492] T f47b342aa4e145518e9c44998faf692e P af886ac503354eaa932dd7c2811c64d9: Bootstrap starting.
W20260709 12:27:27.036626 20361 leader_election.cc:343] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:27.036674 20437 raft_consensus.cc:385] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:27.037535 20437 raft_consensus.cc:740] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Initialized, Role: FOLLOWER
I20260709 12:27:27.038084 20445 leader_election.cc:290] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607)
I20260709 12:27:27.039197 20443 raft_consensus.cc:493] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.038470 20437 consensus_queue.cc:260] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.043514 20443 raft_consensus.cc:515] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.045917 20437 ts_tablet_manager.cc:1434] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.003s
I20260709 12:27:27.047176 20437 tablet_bootstrap.cc:492] T f47b342aa4e145518e9c44998faf692e P 6aee883f265544bd9c7b9502e590182c: Bootstrap starting.
I20260709 12:27:27.048202 20439 tablet_bootstrap.cc:654] T f47b342aa4e145518e9c44998faf692e P af886ac503354eaa932dd7c2811c64d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:27.047955 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf6239d1db24300aa9c81e0c83e9c59" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aee883f265544bd9c7b9502e590182c" is_pre_election: true
I20260709 12:27:27.048834 20397 raft_consensus.cc:2468] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96a5d14dc9a9404b9b89c75be639ea96 in term 0.
I20260709 12:27:27.050312 20288 leader_election.cc:304] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, 96a5d14dc9a9404b9b89c75be639ea96; no voters: 
I20260709 12:27:27.051433 20466 raft_consensus.cc:2804] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:27.051838 20466 raft_consensus.cc:493] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:27.052168 20466 raft_consensus.cc:3060] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:27.052274 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf6239d1db24300aa9c81e0c83e9c59" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9" is_pre_election: true
I20260709 12:27:27.053519 20248 raft_consensus.cc:2468] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96a5d14dc9a9404b9b89c75be639ea96 in term 0.
I20260709 12:27:27.054508 20437 tablet_bootstrap.cc:654] T f47b342aa4e145518e9c44998faf692e P 6aee883f265544bd9c7b9502e590182c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:27.056879 20438 tablet_bootstrap.cc:492] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96: Bootstrap starting.
I20260709 12:27:27.058205 20443 leader_election.cc:290] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:27.038733 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a9241f720a49aa82f440b1beaae093" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9" is_pre_election: true
I20260709 12:27:27.062925 20247 raft_consensus.cc:2468] T 29a9241f720a49aa82f440b1beaae093 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 0.
I20260709 12:27:27.065146 20323 raft_consensus.cc:2468] T 11231f3045154727af46352ff967a27e P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 1.
I20260709 12:27:27.065233 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf6239d1db24300aa9c81e0c83e9c59" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96" is_pre_election: true
I20260709 12:27:27.068650 20361 leader_election.cc:304] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, 96a5d14dc9a9404b9b89c75be639ea96; no voters: af886ac503354eaa932dd7c2811c64d9
I20260709 12:27:27.070676 20363 leader_election.cc:304] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, af886ac503354eaa932dd7c2811c64d9; no voters: 96a5d14dc9a9404b9b89c75be639ea96
I20260709 12:27:27.071786 20459 raft_consensus.cc:2804] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:27.072243 20445 raft_consensus.cc:2804] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:27.072292 20459 raft_consensus.cc:697] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Becoming Leader. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Running, Role: LEADER
I20260709 12:27:27.072870 20445 raft_consensus.cc:493] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:27.073274 20445 raft_consensus.cc:3060] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:27.073629 20459 consensus_queue.cc:237] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.062024 20466 raft_consensus.cc:515] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.076308 20322 raft_consensus.cc:2393] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af886ac503354eaa932dd7c2811c64d9 in current term 1: Already voted for candidate 96a5d14dc9a9404b9b89c75be639ea96 in this term.
I20260709 12:27:27.081274 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf6239d1db24300aa9c81e0c83e9c59" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
I20260709 12:27:27.082023 20247 raft_consensus.cc:3060] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:27.083288 20438 tablet_bootstrap.cc:654] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:27.093269 20479 leader_election.cc:290] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:27.097536 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf6239d1db24300aa9c81e0c83e9c59" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aee883f265544bd9c7b9502e590182c" is_pre_election: true
I20260709 12:27:27.098362 20397 raft_consensus.cc:2468] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af886ac503354eaa932dd7c2811c64d9 in term 0.
I20260709 12:27:27.099397 20437 tablet_bootstrap.cc:492] T f47b342aa4e145518e9c44998faf692e P 6aee883f265544bd9c7b9502e590182c: No bootstrap required, opened a new log
I20260709 12:27:27.099777 20213 leader_election.cc:304] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, af886ac503354eaa932dd7c2811c64d9; no voters: 96a5d14dc9a9404b9b89c75be639ea96
I20260709 12:27:27.100276 20437 ts_tablet_manager.cc:1403] T f47b342aa4e145518e9c44998faf692e P 6aee883f265544bd9c7b9502e590182c: Time spent bootstrapping tablet: real 0.053s	user 0.023s	sys 0.015s
I20260709 12:27:27.099504 20445 raft_consensus.cc:515] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.099400 20439 tablet_bootstrap.cc:492] T f47b342aa4e145518e9c44998faf692e P af886ac503354eaa932dd7c2811c64d9: No bootstrap required, opened a new log
I20260709 12:27:27.101030 20439 ts_tablet_manager.cc:1403] T f47b342aa4e145518e9c44998faf692e P af886ac503354eaa932dd7c2811c64d9: Time spent bootstrapping tablet: real 0.064s	user 0.020s	sys 0.033s
I20260709 12:27:27.103542 20437 raft_consensus.cc:359] T f47b342aa4e145518e9c44998faf692e P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.103956 20466 leader_election.cc:290] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 election: Requested vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:27.103238 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a9241f720a49aa82f440b1beaae093" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
I20260709 12:27:27.104373 20437 raft_consensus.cc:385] T f47b342aa4e145518e9c44998faf692e P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:27.105151 20439 raft_consensus.cc:359] T f47b342aa4e145518e9c44998faf692e P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.105788 20248 raft_consensus.cc:3060] T 29a9241f720a49aa82f440b1beaae093 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:27.105856 20439 raft_consensus.cc:385] T f47b342aa4e145518e9c44998faf692e P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:27.105799 20437 raft_consensus.cc:740] T f47b342aa4e145518e9c44998faf692e P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Initialized, Role: FOLLOWER
I20260709 12:27:27.106627 20439 raft_consensus.cc:740] T f47b342aa4e145518e9c44998faf692e P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af886ac503354eaa932dd7c2811c64d9, State: Initialized, Role: FOLLOWER
I20260709 12:27:27.107144 20437 consensus_queue.cc:260] T f47b342aa4e145518e9c44998faf692e P 6aee883f265544bd9c7b9502e590182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.107630 20439 consensus_queue.cc:260] T f47b342aa4e145518e9c44998faf692e P af886ac503354eaa932dd7c2811c64d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.109647 20437 ts_tablet_manager.cc:1434] T f47b342aa4e145518e9c44998faf692e P 6aee883f265544bd9c7b9502e590182c: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:27:27.110380 20439 ts_tablet_manager.cc:1434] T f47b342aa4e145518e9c44998faf692e P af886ac503354eaa932dd7c2811c64d9: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:27:27.112075 20445 leader_election.cc:290] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 election: Requested vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607)
I20260709 12:27:27.110471 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf6239d1db24300aa9c81e0c83e9c59" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aee883f265544bd9c7b9502e590182c"
I20260709 12:27:27.113200 20397 raft_consensus.cc:3060] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:27.113737 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a9241f720a49aa82f440b1beaae093" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
W20260709 12:27:27.115576 20361 leader_election.cc:343] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:27.121843 20437 tablet_bootstrap.cc:492] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 6aee883f265544bd9c7b9502e590182c: Bootstrap starting.
I20260709 12:27:27.128989 20438 tablet_bootstrap.cc:492] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96: No bootstrap required, opened a new log
I20260709 12:27:27.119158 20145 catalog_manager.cc:5697] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6aee883f265544bd9c7b9502e590182c (127.9.145.195). New cstate: current_term: 1 leader_uuid: "6aee883f265544bd9c7b9502e590182c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:27.130751 20397 raft_consensus.cc:2468] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96a5d14dc9a9404b9b89c75be639ea96 in term 1.
I20260709 12:27:27.131588 20248 raft_consensus.cc:2468] T 29a9241f720a49aa82f440b1beaae093 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 1.
I20260709 12:27:27.130748 20247 raft_consensus.cc:2468] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96a5d14dc9a9404b9b89c75be639ea96 in term 1.
I20260709 12:27:27.132640 20479 raft_consensus.cc:2764] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:27:27.132575 20288 leader_election.cc:304] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, 96a5d14dc9a9404b9b89c75be639ea96; no voters: 
I20260709 12:27:27.133736 20466 raft_consensus.cc:2804] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:27.134259 20466 raft_consensus.cc:697] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 LEADER]: Becoming Leader. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Running, Role: LEADER
I20260709 12:27:27.135118 20466 consensus_queue.cc:237] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.136264 20437 tablet_bootstrap.cc:654] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 6aee883f265544bd9c7b9502e590182c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:27.137194 20443 raft_consensus.cc:493] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.137807 20443 raft_consensus.cc:515] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.140236 20443 leader_election.cc:290] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:27.142807 20363 leader_election.cc:304] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, af886ac503354eaa932dd7c2811c64d9; no voters: 96a5d14dc9a9404b9b89c75be639ea96
I20260709 12:27:27.143775 20445 raft_consensus.cc:2804] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:27.144279 20438 ts_tablet_manager.cc:1403] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96: Time spent bootstrapping tablet: real 0.088s	user 0.016s	sys 0.015s
I20260709 12:27:27.144312 20445 raft_consensus.cc:697] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Becoming Leader. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Running, Role: LEADER
I20260709 12:27:27.145606 20445 consensus_queue.cc:237] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.148028 20438 raft_consensus.cc:359] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.149042 20438 raft_consensus.cc:385] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:27.150522 20438 raft_consensus.cc:740] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Initialized, Role: FOLLOWER
I20260709 12:27:27.151818 20438 consensus_queue.cc:260] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.155121 20438 ts_tablet_manager.cc:1434] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 12:27:27.155686 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47b342aa4e145518e9c44998faf692e" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9" is_pre_election: true
I20260709 12:27:27.156488 20438 tablet_bootstrap.cc:492] T 71ebebbc467f4437a8f5f7e60eab7173 P 96a5d14dc9a9404b9b89c75be639ea96: Bootstrap starting.
I20260709 12:27:27.158640 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47b342aa4e145518e9c44998faf692e" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aee883f265544bd9c7b9502e590182c" is_pre_election: true
I20260709 12:27:27.159483 20397 raft_consensus.cc:2468] T f47b342aa4e145518e9c44998faf692e P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96a5d14dc9a9404b9b89c75be639ea96 in term 0.
I20260709 12:27:27.160939 20288 leader_election.cc:304] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, 96a5d14dc9a9404b9b89c75be639ea96; no voters: 
I20260709 12:27:27.156570 20248 raft_consensus.cc:2468] T f47b342aa4e145518e9c44998faf692e P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96a5d14dc9a9404b9b89c75be639ea96 in term 0.
I20260709 12:27:27.162120 20484 raft_consensus.cc:2804] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:27.164752 20484 raft_consensus.cc:493] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:27.165051 20438 tablet_bootstrap.cc:654] T 71ebebbc467f4437a8f5f7e60eab7173 P 96a5d14dc9a9404b9b89c75be639ea96: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:27.165158 20484 raft_consensus.cc:3060] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:27.167644 20437 tablet_bootstrap.cc:492] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 6aee883f265544bd9c7b9502e590182c: No bootstrap required, opened a new log
I20260709 12:27:27.168128 20437 ts_tablet_manager.cc:1403] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 6aee883f265544bd9c7b9502e590182c: Time spent bootstrapping tablet: real 0.047s	user 0.026s	sys 0.013s
I20260709 12:27:27.170919 20437 raft_consensus.cc:359] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.171602 20437 raft_consensus.cc:385] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:27.172119 20437 raft_consensus.cc:740] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Initialized, Role: FOLLOWER
I20260709 12:27:27.171537 20145 catalog_manager.cc:5697] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6aee883f265544bd9c7b9502e590182c (127.9.145.195). New cstate: current_term: 1 leader_uuid: "6aee883f265544bd9c7b9502e590182c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:27.172935 20437 consensus_queue.cc:260] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 6aee883f265544bd9c7b9502e590182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.173262 20143 catalog_manager.cc:5697] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "96a5d14dc9a9404b9b89c75be639ea96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:27.174219 20484 raft_consensus.cc:515] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.175525 20437 ts_tablet_manager.cc:1434] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 6aee883f265544bd9c7b9502e590182c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:27:27.177383 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47b342aa4e145518e9c44998faf692e" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
I20260709 12:27:27.177831 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47b342aa4e145518e9c44998faf692e" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aee883f265544bd9c7b9502e590182c"
I20260709 12:27:27.178012 20248 raft_consensus.cc:3060] T f47b342aa4e145518e9c44998faf692e P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:27.178548 20397 raft_consensus.cc:3060] T f47b342aa4e145518e9c44998faf692e P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:27.186403 20248 raft_consensus.cc:2468] T f47b342aa4e145518e9c44998faf692e P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96a5d14dc9a9404b9b89c75be639ea96 in term 1.
I20260709 12:27:27.187316 20397 raft_consensus.cc:2468] T f47b342aa4e145518e9c44998faf692e P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96a5d14dc9a9404b9b89c75be639ea96 in term 1.
I20260709 12:27:27.187701 20289 leader_election.cc:304] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96a5d14dc9a9404b9b89c75be639ea96, af886ac503354eaa932dd7c2811c64d9; no voters: 
I20260709 12:27:27.188671 20466 raft_consensus.cc:2804] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:27.189272 20466 raft_consensus.cc:697] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 LEADER]: Becoming Leader. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Running, Role: LEADER
I20260709 12:27:27.190440 20438 tablet_bootstrap.cc:492] T 71ebebbc467f4437a8f5f7e60eab7173 P 96a5d14dc9a9404b9b89c75be639ea96: No bootstrap required, opened a new log
I20260709 12:27:27.191082 20438 ts_tablet_manager.cc:1403] T 71ebebbc467f4437a8f5f7e60eab7173 P 96a5d14dc9a9404b9b89c75be639ea96: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.007s
I20260709 12:27:27.192977 20466 consensus_queue.cc:237] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.194375 20438 raft_consensus.cc:359] T 71ebebbc467f4437a8f5f7e60eab7173 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.195188 20438 raft_consensus.cc:385] T 71ebebbc467f4437a8f5f7e60eab7173 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:27.195490 20438 raft_consensus.cc:740] T 71ebebbc467f4437a8f5f7e60eab7173 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Initialized, Role: FOLLOWER
I20260709 12:27:27.196242 20438 consensus_queue.cc:260] T 71ebebbc467f4437a8f5f7e60eab7173 P 96a5d14dc9a9404b9b89c75be639ea96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.199416 20438 ts_tablet_manager.cc:1434] T 71ebebbc467f4437a8f5f7e60eab7173 P 96a5d14dc9a9404b9b89c75be639ea96: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.007s
I20260709 12:27:27.188686 20484 leader_election.cc:290] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 election: Requested vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:27.201788 20438 tablet_bootstrap.cc:492] T 29a9241f720a49aa82f440b1beaae093 P 96a5d14dc9a9404b9b89c75be639ea96: Bootstrap starting.
I20260709 12:27:27.203707 20445 raft_consensus.cc:493] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.204308 20445 raft_consensus.cc:515] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.206001 20145 catalog_manager.cc:5697] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "96a5d14dc9a9404b9b89c75be639ea96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:27.208238 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ebebbc467f4437a8f5f7e60eab7173" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96" is_pre_election: true
I20260709 12:27:27.208575 20438 tablet_bootstrap.cc:654] T 29a9241f720a49aa82f440b1beaae093 P 96a5d14dc9a9404b9b89c75be639ea96: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:27.209322 20445 leader_election.cc:290] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607)
I20260709 12:27:27.210144 20322 raft_consensus.cc:2468] T 71ebebbc467f4437a8f5f7e60eab7173 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 0.
I20260709 12:27:27.210578 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ebebbc467f4437a8f5f7e60eab7173" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9" is_pre_election: true
I20260709 12:27:27.211331 20248 raft_consensus.cc:2468] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 0.
I20260709 12:27:27.211627 20361 leader_election.cc:304] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, 96a5d14dc9a9404b9b89c75be639ea96; no voters: 
I20260709 12:27:27.213392 20445 raft_consensus.cc:2804] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:27.213830 20445 raft_consensus.cc:493] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:27.214208 20445 raft_consensus.cc:3060] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:27.220292 20438 tablet_bootstrap.cc:492] T 29a9241f720a49aa82f440b1beaae093 P 96a5d14dc9a9404b9b89c75be639ea96: No bootstrap required, opened a new log
I20260709 12:27:27.220826 20438 ts_tablet_manager.cc:1403] T 29a9241f720a49aa82f440b1beaae093 P 96a5d14dc9a9404b9b89c75be639ea96: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.006s
I20260709 12:27:27.222500 20445 raft_consensus.cc:515] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.223132 20438 raft_consensus.cc:359] T 29a9241f720a49aa82f440b1beaae093 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.223726 20438 raft_consensus.cc:385] T 29a9241f720a49aa82f440b1beaae093 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:27.223933 20438 raft_consensus.cc:740] T 29a9241f720a49aa82f440b1beaae093 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Initialized, Role: FOLLOWER
I20260709 12:27:27.224512 20438 consensus_queue.cc:260] T 29a9241f720a49aa82f440b1beaae093 P 96a5d14dc9a9404b9b89c75be639ea96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.225581 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ebebbc467f4437a8f5f7e60eab7173" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
I20260709 12:27:27.226287 20322 raft_consensus.cc:3060] T 71ebebbc467f4437a8f5f7e60eab7173 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:27.226440 20438 ts_tablet_manager.cc:1434] T 29a9241f720a49aa82f440b1beaae093 P 96a5d14dc9a9404b9b89c75be639ea96: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:27:27.227535 20438 tablet_bootstrap.cc:492] T 0aafbdf83f384e9ab7e867e965730667 P 96a5d14dc9a9404b9b89c75be639ea96: Bootstrap starting.
I20260709 12:27:27.230252 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ebebbc467f4437a8f5f7e60eab7173" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
I20260709 12:27:27.230985 20248 raft_consensus.cc:3060] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:27.233037 20438 tablet_bootstrap.cc:654] T 0aafbdf83f384e9ab7e867e965730667 P 96a5d14dc9a9404b9b89c75be639ea96: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:27.234380 20322 raft_consensus.cc:2468] T 71ebebbc467f4437a8f5f7e60eab7173 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 1.
I20260709 12:27:27.235754 20361 leader_election.cc:304] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, 96a5d14dc9a9404b9b89c75be639ea96; no voters: 
I20260709 12:27:27.236680 20459 raft_consensus.cc:2804] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:27.241815 20458 consensus_queue.cc:1048] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Connected to new peer: Peer: permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:27.242615 20445 leader_election.cc:290] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 election: Requested vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607)
I20260709 12:27:27.247128 20248 raft_consensus.cc:2468] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 1.
I20260709 12:27:27.249848 20459 raft_consensus.cc:697] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Becoming Leader. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Running, Role: LEADER
I20260709 12:27:27.251045 20459 consensus_queue.cc:237] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.261718 20438 tablet_bootstrap.cc:492] T 0aafbdf83f384e9ab7e867e965730667 P 96a5d14dc9a9404b9b89c75be639ea96: No bootstrap required, opened a new log
I20260709 12:27:27.262420 20438 ts_tablet_manager.cc:1403] T 0aafbdf83f384e9ab7e867e965730667 P 96a5d14dc9a9404b9b89c75be639ea96: Time spent bootstrapping tablet: real 0.035s	user 0.003s	sys 0.022s
I20260709 12:27:27.263820 20484 raft_consensus.cc:493] T 29a9241f720a49aa82f440b1beaae093 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.266255 20438 raft_consensus.cc:359] T 0aafbdf83f384e9ab7e867e965730667 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } } peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } }
I20260709 12:27:27.267156 20438 raft_consensus.cc:385] T 0aafbdf83f384e9ab7e867e965730667 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:27.267452 20438 raft_consensus.cc:740] T 0aafbdf83f384e9ab7e867e965730667 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Initialized, Role: FOLLOWER
I20260709 12:27:27.265673 20484 raft_consensus.cc:515] T 29a9241f720a49aa82f440b1beaae093 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.281735 20438 consensus_queue.cc:260] T 0aafbdf83f384e9ab7e867e965730667 P 96a5d14dc9a9404b9b89c75be639ea96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } } peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } }
I20260709 12:27:27.283246 20322 raft_consensus.cc:3060] T 0aafbdf83f384e9ab7e867e965730667 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:27.283993 20438 ts_tablet_manager.cc:1434] T 0aafbdf83f384e9ab7e867e965730667 P 96a5d14dc9a9404b9b89c75be639ea96: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.002s
I20260709 12:27:27.286051 20145 catalog_manager.cc:5697] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6aee883f265544bd9c7b9502e590182c (127.9.145.195). New cstate: current_term: 1 leader_uuid: "6aee883f265544bd9c7b9502e590182c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:27.290904 20484 leader_election.cc:290] T 29a9241f720a49aa82f440b1beaae093 P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:27.291703 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a9241f720a49aa82f440b1beaae093" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9" is_pre_election: true
I20260709 12:27:27.292482 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a9241f720a49aa82f440b1beaae093" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aee883f265544bd9c7b9502e590182c" is_pre_election: true
I20260709 12:27:27.292604 20248 raft_consensus.cc:2393] T 29a9241f720a49aa82f440b1beaae093 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96a5d14dc9a9404b9b89c75be639ea96 in current term 1: Already voted for candidate 6aee883f265544bd9c7b9502e590182c in this term.
I20260709 12:27:27.295495 20289 leader_election.cc:304] T 29a9241f720a49aa82f440b1beaae093 P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96a5d14dc9a9404b9b89c75be639ea96; no voters: 6aee883f265544bd9c7b9502e590182c, af886ac503354eaa932dd7c2811c64d9
I20260709 12:27:27.296311 20484 raft_consensus.cc:3060] T 29a9241f720a49aa82f440b1beaae093 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:27.297614 20445 consensus_queue.cc:1048] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Connected to new peer: Peer: permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:27.304256 20484 raft_consensus.cc:2749] T 29a9241f720a49aa82f440b1beaae093 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:27.309226 20484 consensus_queue.cc:1048] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 96a5d14dc9a9404b9b89c75be639ea96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:27.334967 20397 raft_consensus.cc:3060] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:27.343931 20484 consensus_queue.cc:1048] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 96a5d14dc9a9404b9b89c75be639ea96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:27.408270 20479 raft_consensus.cc:493] T 11231f3045154727af46352ff967a27e P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.408881 20479 raft_consensus.cc:515] T 11231f3045154727af46352ff967a27e P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.410694 20479 leader_election.cc:290] T 11231f3045154727af46352ff967a27e P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:27.411571 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11231f3045154727af46352ff967a27e" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96" is_pre_election: true
I20260709 12:27:27.411867 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11231f3045154727af46352ff967a27e" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aee883f265544bd9c7b9502e590182c" is_pre_election: true
I20260709 12:27:27.412469 20323 raft_consensus.cc:2393] T 11231f3045154727af46352ff967a27e P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af886ac503354eaa932dd7c2811c64d9 in current term 1: Already voted for candidate 6aee883f265544bd9c7b9502e590182c in this term.
I20260709 12:27:27.413465 20212 leader_election.cc:304] T 11231f3045154727af46352ff967a27e P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af886ac503354eaa932dd7c2811c64d9; no voters: 6aee883f265544bd9c7b9502e590182c, 96a5d14dc9a9404b9b89c75be639ea96
I20260709 12:27:27.414219 20479 raft_consensus.cc:3060] T 11231f3045154727af46352ff967a27e P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:27.419605 20479 raft_consensus.cc:2749] T 11231f3045154727af46352ff967a27e P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:27.484254 20458 raft_consensus.cc:493] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.484786 20458 raft_consensus.cc:515] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.486521 20458 leader_election.cc:290] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607)
I20260709 12:27:27.487270 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c18393b4e564bf1942046af318a06a6" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9" is_pre_election: true
I20260709 12:27:27.487670 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c18393b4e564bf1942046af318a06a6" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96" is_pre_election: true
I20260709 12:27:27.487917 20247 raft_consensus.cc:2468] T 1c18393b4e564bf1942046af318a06a6 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 0.
I20260709 12:27:27.488380 20323 raft_consensus.cc:2468] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 0.
I20260709 12:27:27.489137 20363 leader_election.cc:304] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, af886ac503354eaa932dd7c2811c64d9; no voters: 
I20260709 12:27:27.489964 20458 raft_consensus.cc:2804] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:27.490381 20458 raft_consensus.cc:493] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:27.490716 20458 raft_consensus.cc:3060] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:27.491348 20459 consensus_queue.cc:1048] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c [LEADER]: Connected to new peer: Peer: permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:27.497515 20458 raft_consensus.cc:515] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.497917 20459 consensus_queue.cc:1048] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [LEADER]: Connected to new peer: Peer: permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:27.501258 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c18393b4e564bf1942046af318a06a6" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
I20260709 12:27:27.502033 20322 raft_consensus.cc:3060] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:27.503103 20246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c18393b4e564bf1942046af318a06a6" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
I20260709 12:27:27.503897 20246 raft_consensus.cc:3060] T 1c18393b4e564bf1942046af318a06a6 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:27.508285 20458 leader_election.cc:290] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 election: Requested vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607)
I20260709 12:27:27.511458 20459 consensus_queue.cc:1048] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c [LEADER]: Connected to new peer: Peer: permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:27.514775 20322 raft_consensus.cc:2468] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 1.
I20260709 12:27:27.516247 20361 leader_election.cc:304] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, 96a5d14dc9a9404b9b89c75be639ea96; no voters: 
I20260709 12:27:27.517205 20459 raft_consensus.cc:2804] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:27.518838 20459 raft_consensus.cc:697] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Becoming Leader. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Running, Role: LEADER
I20260709 12:27:27.519968 20246 raft_consensus.cc:2468] T 1c18393b4e564bf1942046af318a06a6 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 1.
I20260709 12:27:27.519968 20459 consensus_queue.cc:237] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.532819 20459 consensus_queue.cc:1048] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [LEADER]: Connected to new peer: Peer: permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:27.537616 20145 catalog_manager.cc:5697] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6aee883f265544bd9c7b9502e590182c (127.9.145.195). New cstate: current_term: 1 leader_uuid: "6aee883f265544bd9c7b9502e590182c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:27.630860 20443 consensus_queue.cc:1048] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:27.631577 20484 consensus_queue.cc:1048] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:27.649807 20459 consensus_queue.cc:1048] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Connected to new peer: Peer: permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:27.652869 20484 consensus_queue.cc:1048] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:27.668233 20492 consensus_queue.cc:1048] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Connected to new peer: Peer: permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:27.674826 20443 consensus_queue.cc:1048] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:27.690722 20492 consensus_queue.cc:1048] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Connected to new peer: Peer: permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:27.702929 20445 consensus_queue.cc:1048] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Connected to new peer: Peer: permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:27.764436 20397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0aafbdf83f384e9ab7e867e965730667"
dest_uuid: "6aee883f265544bd9c7b9502e590182c"
mode: GRACEFUL
new_leader_uuid: "af886ac503354eaa932dd7c2811c64d9"
 from {username='slave'} at 127.0.0.1:55256
I20260709 12:27:27.765009 20397 raft_consensus.cc:606] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Received request to transfer leadership to TS af886ac503354eaa932dd7c2811c64d9
I20260709 12:27:27.770435 20397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71ebebbc467f4437a8f5f7e60eab7173"
dest_uuid: "6aee883f265544bd9c7b9502e590182c"
mode: GRACEFUL
new_leader_uuid: "af886ac503354eaa932dd7c2811c64d9"
 from {username='slave'} at 127.0.0.1:55256
I20260709 12:27:27.771080 20397 raft_consensus.cc:606] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Received request to transfer leadership to TS af886ac503354eaa932dd7c2811c64d9
I20260709 12:27:27.771155 20459 raft_consensus.cc:993] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c: : Instructing follower af886ac503354eaa932dd7c2811c64d9 to start an election
I20260709 12:27:27.771742 20445 raft_consensus.cc:1081] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Signalling peer af886ac503354eaa932dd7c2811c64d9 to start an election
I20260709 12:27:27.773447 20247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0aafbdf83f384e9ab7e867e965730667"
dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
 from {username='slave'} at 127.0.0.1:50156
I20260709 12:27:27.774004 20247 raft_consensus.cc:493] T 0aafbdf83f384e9ab7e867e965730667 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:27.774380 20247 raft_consensus.cc:3060] T 0aafbdf83f384e9ab7e867e965730667 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:27.780684 20247 raft_consensus.cc:515] T 0aafbdf83f384e9ab7e867e965730667 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } } peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } }
I20260709 12:27:27.782425 20247 leader_election.cc:290] T 0aafbdf83f384e9ab7e867e965730667 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 2 election: Requested vote from peers 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747), 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607)
I20260709 12:27:27.783329 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aafbdf83f384e9ab7e867e965730667" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6aee883f265544bd9c7b9502e590182c"
I20260709 12:27:27.783589 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aafbdf83f384e9ab7e867e965730667" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
I20260709 12:27:27.784085 20397 raft_consensus.cc:3055] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:27.784271 20322 raft_consensus.cc:3060] T 0aafbdf83f384e9ab7e867e965730667 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:27.784477 20397 raft_consensus.cc:740] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Running, Role: LEADER
I20260709 12:27:27.785547 20397 consensus_queue.cc:260] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } } peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } }
I20260709 12:27:27.788709 20397 raft_consensus.cc:3060] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:27.788627 20323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dcf6239d1db24300aa9c81e0c83e9c59"
dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
mode: GRACEFUL
new_leader_uuid: "af886ac503354eaa932dd7c2811c64d9"
 from {username='slave'} at 127.0.0.1:52714
I20260709 12:27:27.789510 20323 raft_consensus.cc:606] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 LEADER]: Received request to transfer leadership to TS af886ac503354eaa932dd7c2811c64d9
I20260709 12:27:27.793244 20322 raft_consensus.cc:2468] T 0aafbdf83f384e9ab7e867e965730667 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af886ac503354eaa932dd7c2811c64d9 in term 2.
I20260709 12:27:27.794524 20212 leader_election.cc:304] T 0aafbdf83f384e9ab7e867e965730667 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96a5d14dc9a9404b9b89c75be639ea96, af886ac503354eaa932dd7c2811c64d9; no voters: 
I20260709 12:27:27.794888 20397 raft_consensus.cc:2468] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af886ac503354eaa932dd7c2811c64d9 in term 2.
I20260709 12:27:27.795410 20479 raft_consensus.cc:2804] T 0aafbdf83f384e9ab7e867e965730667 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:27.796231 20397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11231f3045154727af46352ff967a27e"
dest_uuid: "6aee883f265544bd9c7b9502e590182c"
mode: GRACEFUL
new_leader_uuid: "af886ac503354eaa932dd7c2811c64d9"
 from {username='slave'} at 127.0.0.1:55256
I20260709 12:27:27.796640 20479 raft_consensus.cc:697] T 0aafbdf83f384e9ab7e867e965730667 P af886ac503354eaa932dd7c2811c64d9 [term 2 LEADER]: Becoming Leader. State: Replica: af886ac503354eaa932dd7c2811c64d9, State: Running, Role: LEADER
I20260709 12:27:27.797025 20397 raft_consensus.cc:606] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Received request to transfer leadership to TS af886ac503354eaa932dd7c2811c64d9
I20260709 12:27:27.797544 20479 consensus_queue.cc:237] T 0aafbdf83f384e9ab7e867e965730667 P af886ac503354eaa932dd7c2811c64d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } } peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } }
I20260709 12:27:27.802657 20397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29a9241f720a49aa82f440b1beaae093"
dest_uuid: "6aee883f265544bd9c7b9502e590182c"
mode: GRACEFUL
new_leader_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
 from {username='slave'} at 127.0.0.1:55256
I20260709 12:27:27.803432 20397 raft_consensus.cc:606] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Received request to transfer leadership to TS 96a5d14dc9a9404b9b89c75be639ea96
I20260709 12:27:27.804804 20145 catalog_manager.cc:5697] T 0aafbdf83f384e9ab7e867e965730667 P af886ac503354eaa932dd7c2811c64d9 reported cstate change: term changed from 1 to 2, leader changed from 6aee883f265544bd9c7b9502e590182c (127.9.145.195) to af886ac503354eaa932dd7c2811c64d9 (127.9.145.193). New cstate: current_term: 2 leader_uuid: "af886ac503354eaa932dd7c2811c64d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:27.811635 20397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f05ef6e78f2c4d4c9dbe574db29e502c"
dest_uuid: "6aee883f265544bd9c7b9502e590182c"
mode: GRACEFUL
new_leader_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
 from {username='slave'} at 127.0.0.1:55256
I20260709 12:27:27.812389 20397 raft_consensus.cc:606] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Received request to transfer leadership to TS 96a5d14dc9a9404b9b89c75be639ea96
I20260709 12:27:27.818385 20397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c18393b4e564bf1942046af318a06a6"
dest_uuid: "6aee883f265544bd9c7b9502e590182c"
mode: GRACEFUL
new_leader_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
 from {username='slave'} at 127.0.0.1:55256
I20260709 12:27:27.818921 20397 raft_consensus.cc:606] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Received request to transfer leadership to TS 96a5d14dc9a9404b9b89c75be639ea96
I20260709 12:27:27.827237 20322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f47b342aa4e145518e9c44998faf692e"
dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
mode: GRACEFUL
new_leader_uuid: "6aee883f265544bd9c7b9502e590182c"
 from {username='slave'} at 127.0.0.1:52714
I20260709 12:27:27.827778 20322 raft_consensus.cc:606] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 LEADER]: Received request to transfer leadership to TS 6aee883f265544bd9c7b9502e590182c
I20260709 12:27:27.931694 20445 consensus_queue.cc:1048] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Connected to new peer: Peer: permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:27.942273 20459 consensus_queue.cc:1048] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Connected to new peer: Peer: permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:27.950173 20445 raft_consensus.cc:993] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c: : Instructing follower 96a5d14dc9a9404b9b89c75be639ea96 to start an election
I20260709 12:27:27.950632 20445 raft_consensus.cc:1081] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Signalling peer 96a5d14dc9a9404b9b89c75be639ea96 to start an election
I20260709 12:27:27.952121 20322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c18393b4e564bf1942046af318a06a6"
dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
 from {username='slave'} at 127.0.0.1:52696
I20260709 12:27:27.952620 20322 raft_consensus.cc:493] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:27.952908 20322 raft_consensus.cc:3060] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:27.958381 20322 raft_consensus.cc:515] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.960505 20322 leader_election.cc:290] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 2 election: Requested vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:27.961449 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c18393b4e564bf1942046af318a06a6" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
I20260709 12:27:27.962215 20247 raft_consensus.cc:3060] T 1c18393b4e564bf1942046af318a06a6 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:27.962460 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c18393b4e564bf1942046af318a06a6" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6aee883f265544bd9c7b9502e590182c"
I20260709 12:27:27.963138 20397 raft_consensus.cc:3055] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:27.963470 20397 raft_consensus.cc:740] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Running, Role: LEADER
I20260709 12:27:27.964334 20397 consensus_queue.cc:260] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.965678 20397 raft_consensus.cc:3060] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:27.969890 20247 raft_consensus.cc:2468] T 1c18393b4e564bf1942046af318a06a6 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96a5d14dc9a9404b9b89c75be639ea96 in term 2.
I20260709 12:27:27.971333 20289 leader_election.cc:304] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96a5d14dc9a9404b9b89c75be639ea96, af886ac503354eaa932dd7c2811c64d9; no voters: 
I20260709 12:27:27.972055 20466 raft_consensus.cc:2804] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:27.972559 20466 raft_consensus.cc:697] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 LEADER]: Becoming Leader. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Running, Role: LEADER
I20260709 12:27:27.972855 20397 raft_consensus.cc:2468] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96a5d14dc9a9404b9b89c75be639ea96 in term 2.
I20260709 12:27:27.973384 20466 consensus_queue.cc:237] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:27.979936 20145 catalog_manager.cc:5697] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96 reported cstate change: term changed from 1 to 2, leader changed from 6aee883f265544bd9c7b9502e590182c (127.9.145.195) to 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194). New cstate: current_term: 2 leader_uuid: "96a5d14dc9a9404b9b89c75be639ea96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:28.064561 20459 raft_consensus.cc:993] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c: : Instructing follower 96a5d14dc9a9404b9b89c75be639ea96 to start an election
I20260709 12:27:28.065038 20445 raft_consensus.cc:1081] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Signalling peer 96a5d14dc9a9404b9b89c75be639ea96 to start an election
I20260709 12:27:28.066653 20322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f05ef6e78f2c4d4c9dbe574db29e502c"
dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
 from {username='slave'} at 127.0.0.1:52696
I20260709 12:27:28.067152 20322 raft_consensus.cc:493] T f05ef6e78f2c4d4c9dbe574db29e502c P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:28.067448 20322 raft_consensus.cc:3060] T f05ef6e78f2c4d4c9dbe574db29e502c P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:28.072832 20322 raft_consensus.cc:515] T f05ef6e78f2c4d4c9dbe574db29e502c P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:28.074561 20322 leader_election.cc:290] T f05ef6e78f2c4d4c9dbe574db29e502c P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 2 election: Requested vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:28.075440 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05ef6e78f2c4d4c9dbe574db29e502c" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
I20260709 12:27:28.075577 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05ef6e78f2c4d4c9dbe574db29e502c" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6aee883f265544bd9c7b9502e590182c"
I20260709 12:27:28.076313 20247 raft_consensus.cc:3060] T f05ef6e78f2c4d4c9dbe574db29e502c P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:28.076371 20397 raft_consensus.cc:3055] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:28.076812 20397 raft_consensus.cc:740] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Running, Role: LEADER
I20260709 12:27:28.077931 20397 consensus_queue.cc:260] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:28.079571 20397 raft_consensus.cc:3060] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:28.084378 20247 raft_consensus.cc:2468] T f05ef6e78f2c4d4c9dbe574db29e502c P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96a5d14dc9a9404b9b89c75be639ea96 in term 2.
I20260709 12:27:28.085745 20289 leader_election.cc:304] T f05ef6e78f2c4d4c9dbe574db29e502c P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96a5d14dc9a9404b9b89c75be639ea96, af886ac503354eaa932dd7c2811c64d9; no voters: 
I20260709 12:27:28.085875 20397 raft_consensus.cc:2468] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96a5d14dc9a9404b9b89c75be639ea96 in term 2.
I20260709 12:27:28.086526 20466 raft_consensus.cc:2804] T f05ef6e78f2c4d4c9dbe574db29e502c P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:28.086990 20466 raft_consensus.cc:697] T f05ef6e78f2c4d4c9dbe574db29e502c P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 LEADER]: Becoming Leader. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Running, Role: LEADER
I20260709 12:27:28.087731 20466 consensus_queue.cc:237] T f05ef6e78f2c4d4c9dbe574db29e502c P 96a5d14dc9a9404b9b89c75be639ea96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:28.092157 20458 raft_consensus.cc:993] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c: : Instructing follower af886ac503354eaa932dd7c2811c64d9 to start an election
I20260709 12:27:28.092739 20445 raft_consensus.cc:1081] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Signalling peer af886ac503354eaa932dd7c2811c64d9 to start an election
I20260709 12:27:28.094389 20247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11231f3045154727af46352ff967a27e"
dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
 from {username='slave'} at 127.0.0.1:50156
I20260709 12:27:28.094888 20247 raft_consensus.cc:493] T 11231f3045154727af46352ff967a27e P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:28.095278 20247 raft_consensus.cc:3060] T 11231f3045154727af46352ff967a27e P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:28.094727 20145 catalog_manager.cc:5697] T f05ef6e78f2c4d4c9dbe574db29e502c P 96a5d14dc9a9404b9b89c75be639ea96 reported cstate change: term changed from 1 to 2, leader changed from 6aee883f265544bd9c7b9502e590182c (127.9.145.195) to 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194). New cstate: current_term: 2 leader_uuid: "96a5d14dc9a9404b9b89c75be639ea96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:28.102159 20247 raft_consensus.cc:515] T 11231f3045154727af46352ff967a27e P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:28.104370 20247 leader_election.cc:290] T 11231f3045154727af46352ff967a27e P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 2 election: Requested vote from peers 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:28.105091 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11231f3045154727af46352ff967a27e" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
I20260709 12:27:28.105297 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11231f3045154727af46352ff967a27e" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6aee883f265544bd9c7b9502e590182c"
I20260709 12:27:28.105780 20322 raft_consensus.cc:3060] T 11231f3045154727af46352ff967a27e P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:28.105937 20397 raft_consensus.cc:3055] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:28.106465 20397 raft_consensus.cc:740] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Running, Role: LEADER
I20260709 12:27:28.107133 20397 consensus_queue.cc:260] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:28.108152 20397 raft_consensus.cc:3060] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:28.111564 20322 raft_consensus.cc:2468] T 11231f3045154727af46352ff967a27e P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af886ac503354eaa932dd7c2811c64d9 in term 2.
I20260709 12:27:28.112800 20212 leader_election.cc:304] T 11231f3045154727af46352ff967a27e P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96a5d14dc9a9404b9b89c75be639ea96, af886ac503354eaa932dd7c2811c64d9; no voters: 
I20260709 12:27:28.113663 20479 raft_consensus.cc:2804] T 11231f3045154727af46352ff967a27e P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:28.113691 20397 raft_consensus.cc:2468] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af886ac503354eaa932dd7c2811c64d9 in term 2.
I20260709 12:27:28.114217 20479 raft_consensus.cc:697] T 11231f3045154727af46352ff967a27e P af886ac503354eaa932dd7c2811c64d9 [term 2 LEADER]: Becoming Leader. State: Replica: af886ac503354eaa932dd7c2811c64d9, State: Running, Role: LEADER
I20260709 12:27:28.115056 20479 consensus_queue.cc:237] T 11231f3045154727af46352ff967a27e P af886ac503354eaa932dd7c2811c64d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:28.121726 20145 catalog_manager.cc:5697] T 11231f3045154727af46352ff967a27e P af886ac503354eaa932dd7c2811c64d9 reported cstate change: term changed from 1 to 2, leader changed from 6aee883f265544bd9c7b9502e590182c (127.9.145.195) to af886ac503354eaa932dd7c2811c64d9 (127.9.145.193). New cstate: current_term: 2 leader_uuid: "af886ac503354eaa932dd7c2811c64d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:28.132095 20484 raft_consensus.cc:993] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96: : Instructing follower af886ac503354eaa932dd7c2811c64d9 to start an election
I20260709 12:27:28.132521 20466 raft_consensus.cc:1081] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 LEADER]: Signalling peer af886ac503354eaa932dd7c2811c64d9 to start an election
I20260709 12:27:28.133975 20247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dcf6239d1db24300aa9c81e0c83e9c59"
dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
 from {username='slave'} at 127.0.0.1:50164
I20260709 12:27:28.134495 20247 raft_consensus.cc:493] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:28.134766 20247 raft_consensus.cc:3060] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:28.140153 20247 raft_consensus.cc:515] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:28.141830 20247 leader_election.cc:290] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 2 election: Requested vote from peers 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:28.142728 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf6239d1db24300aa9c81e0c83e9c59" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
I20260709 12:27:28.142908 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf6239d1db24300aa9c81e0c83e9c59" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6aee883f265544bd9c7b9502e590182c"
I20260709 12:27:28.143462 20322 raft_consensus.cc:3055] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:28.143599 20397 raft_consensus.cc:3060] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:28.143882 20322 raft_consensus.cc:740] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Running, Role: LEADER
I20260709 12:27:28.144806 20322 consensus_queue.cc:260] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:28.146190 20322 raft_consensus.cc:3060] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:28.151026 20458 raft_consensus.cc:993] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c: : Instructing follower af886ac503354eaa932dd7c2811c64d9 to start an election
I20260709 12:27:28.151564 20445 raft_consensus.cc:1081] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Signalling peer af886ac503354eaa932dd7c2811c64d9 to start an election
I20260709 12:27:28.151568 20397 raft_consensus.cc:2468] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af886ac503354eaa932dd7c2811c64d9 in term 2.
I20260709 12:27:28.153471 20247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71ebebbc467f4437a8f5f7e60eab7173"
dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
 from {username='slave'} at 127.0.0.1:50156
I20260709 12:27:28.153561 20322 raft_consensus.cc:2468] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af886ac503354eaa932dd7c2811c64d9 in term 2.
I20260709 12:27:28.153620 20213 leader_election.cc:304] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, af886ac503354eaa932dd7c2811c64d9; no voters: 
I20260709 12:27:28.154202 20247 raft_consensus.cc:493] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:28.154672 20247 raft_consensus.cc:3060] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:28.154860 20479 raft_consensus.cc:2804] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:28.155405 20479 raft_consensus.cc:697] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [term 2 LEADER]: Becoming Leader. State: Replica: af886ac503354eaa932dd7c2811c64d9, State: Running, Role: LEADER
I20260709 12:27:28.156252 20479 consensus_queue.cc:237] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:28.161676 20247 raft_consensus.cc:515] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:28.163996 20247 leader_election.cc:290] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 2 election: Requested vote from peers 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:28.163965 20145 catalog_manager.cc:5697] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 reported cstate change: term changed from 1 to 2, leader changed from 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194) to af886ac503354eaa932dd7c2811c64d9 (127.9.145.193). New cstate: current_term: 2 leader_uuid: "af886ac503354eaa932dd7c2811c64d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:28.164682 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ebebbc467f4437a8f5f7e60eab7173" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
I20260709 12:27:28.165433 20322 raft_consensus.cc:3060] T 71ebebbc467f4437a8f5f7e60eab7173 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:28.165063 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ebebbc467f4437a8f5f7e60eab7173" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6aee883f265544bd9c7b9502e590182c"
I20260709 12:27:28.166210 20397 raft_consensus.cc:3055] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:28.166561 20397 raft_consensus.cc:740] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Running, Role: LEADER
I20260709 12:27:28.167412 20397 consensus_queue.cc:260] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:28.168761 20397 raft_consensus.cc:3060] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:28.173394 20322 raft_consensus.cc:2468] T 71ebebbc467f4437a8f5f7e60eab7173 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af886ac503354eaa932dd7c2811c64d9 in term 2.
I20260709 12:27:28.174851 20212 leader_election.cc:304] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96a5d14dc9a9404b9b89c75be639ea96, af886ac503354eaa932dd7c2811c64d9; no voters: 
I20260709 12:27:28.175555 20479 raft_consensus.cc:2804] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:28.175953 20479 raft_consensus.cc:697] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9 [term 2 LEADER]: Becoming Leader. State: Replica: af886ac503354eaa932dd7c2811c64d9, State: Running, Role: LEADER
I20260709 12:27:28.176103 20397 raft_consensus.cc:2468] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af886ac503354eaa932dd7c2811c64d9 in term 2.
I20260709 12:27:28.176709 20479 consensus_queue.cc:237] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:28.181079 20484 raft_consensus.cc:993] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96: : Instructing follower 6aee883f265544bd9c7b9502e590182c to start an election
I20260709 12:27:28.181625 20466 raft_consensus.cc:1081] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 LEADER]: Signalling peer 6aee883f265544bd9c7b9502e590182c to start an election
I20260709 12:27:28.183210 20397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f47b342aa4e145518e9c44998faf692e"
dest_uuid: "6aee883f265544bd9c7b9502e590182c"
 from {username='slave'} at 127.0.0.1:55246
I20260709 12:27:28.183710 20397 raft_consensus.cc:493] T f47b342aa4e145518e9c44998faf692e P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:28.184003 20397 raft_consensus.cc:3060] T f47b342aa4e145518e9c44998faf692e P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:28.183979 20145 catalog_manager.cc:5697] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9 reported cstate change: term changed from 1 to 2, leader changed from 6aee883f265544bd9c7b9502e590182c (127.9.145.195) to af886ac503354eaa932dd7c2811c64d9 (127.9.145.193). New cstate: current_term: 2 leader_uuid: "af886ac503354eaa932dd7c2811c64d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:28.189550 20397 raft_consensus.cc:515] T f47b342aa4e145518e9c44998faf692e P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:28.191622 20397 leader_election.cc:290] T f47b342aa4e145518e9c44998faf692e P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 2 election: Requested vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607)
I20260709 12:27:28.192287 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47b342aa4e145518e9c44998faf692e" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
I20260709 12:27:28.192998 20247 raft_consensus.cc:3060] T f47b342aa4e145518e9c44998faf692e P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:28.192890 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47b342aa4e145518e9c44998faf692e" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
I20260709 12:27:28.194305 20322 raft_consensus.cc:3055] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:28.194574 20322 raft_consensus.cc:740] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Running, Role: LEADER
I20260709 12:27:28.195364 20322 consensus_queue.cc:260] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:28.196465 20322 raft_consensus.cc:3060] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:28.198959 20247 raft_consensus.cc:2468] T f47b342aa4e145518e9c44998faf692e P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 2.
I20260709 12:27:28.200070 20363 leader_election.cc:304] T f47b342aa4e145518e9c44998faf692e P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, af886ac503354eaa932dd7c2811c64d9; no voters: 
I20260709 12:27:28.200773 20445 raft_consensus.cc:2804] T f47b342aa4e145518e9c44998faf692e P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:28.201174 20445 raft_consensus.cc:697] T f47b342aa4e145518e9c44998faf692e P 6aee883f265544bd9c7b9502e590182c [term 2 LEADER]: Becoming Leader. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Running, Role: LEADER
I20260709 12:27:28.201941 20445 consensus_queue.cc:237] T f47b342aa4e145518e9c44998faf692e P 6aee883f265544bd9c7b9502e590182c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:28.202198 20322 raft_consensus.cc:2468] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 2.
I20260709 12:27:28.208925 20145 catalog_manager.cc:5697] T f47b342aa4e145518e9c44998faf692e P 6aee883f265544bd9c7b9502e590182c reported cstate change: term changed from 1 to 2, leader changed from 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194) to 6aee883f265544bd9c7b9502e590182c (127.9.145.195). New cstate: current_term: 2 leader_uuid: "6aee883f265544bd9c7b9502e590182c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:28.209693 20459 raft_consensus.cc:993] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c: : Instructing follower 96a5d14dc9a9404b9b89c75be639ea96 to start an election
I20260709 12:27:28.212239 20459 raft_consensus.cc:1081] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Signalling peer 96a5d14dc9a9404b9b89c75be639ea96 to start an election
I20260709 12:27:28.214013 20322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29a9241f720a49aa82f440b1beaae093"
dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
 from {username='slave'} at 127.0.0.1:52696
I20260709 12:27:28.214754 20322 raft_consensus.cc:493] T 29a9241f720a49aa82f440b1beaae093 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:28.215162 20322 raft_consensus.cc:3060] T 29a9241f720a49aa82f440b1beaae093 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:28.224552 20322 raft_consensus.cc:515] T 29a9241f720a49aa82f440b1beaae093 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:28.226346 20322 leader_election.cc:290] T 29a9241f720a49aa82f440b1beaae093 P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 2 election: Requested vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:28.227210 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a9241f720a49aa82f440b1beaae093" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
I20260709 12:27:28.227411 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a9241f720a49aa82f440b1beaae093" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6aee883f265544bd9c7b9502e590182c"
I20260709 12:27:28.227802 20247 raft_consensus.cc:3060] T 29a9241f720a49aa82f440b1beaae093 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:28.228036 20397 raft_consensus.cc:3055] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:28.228356 20397 raft_consensus.cc:740] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Running, Role: LEADER
I20260709 12:27:28.229035 20397 consensus_queue.cc:260] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:28.230010 20397 raft_consensus.cc:3060] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:28.233536 20247 raft_consensus.cc:2468] T 29a9241f720a49aa82f440b1beaae093 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96a5d14dc9a9404b9b89c75be639ea96 in term 2.
I20260709 12:27:28.234753 20289 leader_election.cc:304] T 29a9241f720a49aa82f440b1beaae093 P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96a5d14dc9a9404b9b89c75be639ea96, af886ac503354eaa932dd7c2811c64d9; no voters: 
I20260709 12:27:28.235496 20466 raft_consensus.cc:2804] T 29a9241f720a49aa82f440b1beaae093 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:28.236003 20466 raft_consensus.cc:697] T 29a9241f720a49aa82f440b1beaae093 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 LEADER]: Becoming Leader. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Running, Role: LEADER
I20260709 12:27:28.236186 20397 raft_consensus.cc:2468] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96a5d14dc9a9404b9b89c75be639ea96 in term 2.
I20260709 12:27:28.236893 20466 consensus_queue.cc:237] T 29a9241f720a49aa82f440b1beaae093 P 96a5d14dc9a9404b9b89c75be639ea96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:28.243458 20145 catalog_manager.cc:5697] T 29a9241f720a49aa82f440b1beaae093 P 96a5d14dc9a9404b9b89c75be639ea96 reported cstate change: term changed from 1 to 2, leader changed from 6aee883f265544bd9c7b9502e590182c (127.9.145.195) to 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194). New cstate: current_term: 2 leader_uuid: "96a5d14dc9a9404b9b89c75be639ea96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:28.266505 20322 raft_consensus.cc:1275] T 0aafbdf83f384e9ab7e867e965730667 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Refusing update from remote peer af886ac503354eaa932dd7c2811c64d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:28.267799 20479 consensus_queue.cc:1048] T 0aafbdf83f384e9ab7e867e965730667 P af886ac503354eaa932dd7c2811c64d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:28.275790 20397 raft_consensus.cc:1275] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Refusing update from remote peer af886ac503354eaa932dd7c2811c64d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:28.277680 20479 consensus_queue.cc:1048] T 0aafbdf83f384e9ab7e867e965730667 P af886ac503354eaa932dd7c2811c64d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:28.358522 20247 raft_consensus.cc:1275] T 1c18393b4e564bf1942046af318a06a6 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Refusing update from remote peer 96a5d14dc9a9404b9b89c75be639ea96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:28.360091 20466 consensus_queue.cc:1048] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:28.368060 20397 raft_consensus.cc:1275] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Refusing update from remote peer 96a5d14dc9a9404b9b89c75be639ea96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:28.369765 20466 consensus_queue.cc:1048] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:28.532661 20247 raft_consensus.cc:1275] T f05ef6e78f2c4d4c9dbe574db29e502c P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Refusing update from remote peer 96a5d14dc9a9404b9b89c75be639ea96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:28.533982 20466 consensus_queue.cc:1048] T f05ef6e78f2c4d4c9dbe574db29e502c P 96a5d14dc9a9404b9b89c75be639ea96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:28.542168 20397 raft_consensus.cc:1275] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Refusing update from remote peer af886ac503354eaa932dd7c2811c64d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:28.544157 20396 raft_consensus.cc:1275] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Refusing update from remote peer 96a5d14dc9a9404b9b89c75be639ea96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:28.545339 20479 consensus_queue.cc:1048] T 11231f3045154727af46352ff967a27e P af886ac503354eaa932dd7c2811c64d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:28.546054 20466 consensus_queue.cc:1048] T f05ef6e78f2c4d4c9dbe574db29e502c P 96a5d14dc9a9404b9b89c75be639ea96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:28.557538 20322 raft_consensus.cc:1275] T 11231f3045154727af46352ff967a27e P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Refusing update from remote peer af886ac503354eaa932dd7c2811c64d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:28.561255 20518 consensus_queue.cc:1048] T 11231f3045154727af46352ff967a27e P af886ac503354eaa932dd7c2811c64d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:28.580080 20322 raft_consensus.cc:1275] T 71ebebbc467f4437a8f5f7e60eab7173 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Refusing update from remote peer af886ac503354eaa932dd7c2811c64d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:28.581375 20518 consensus_queue.cc:1048] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:28.590032 20247 raft_consensus.cc:1275] T f47b342aa4e145518e9c44998faf692e P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Refusing update from remote peer 6aee883f265544bd9c7b9502e590182c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:28.590034 20397 raft_consensus.cc:1275] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Refusing update from remote peer af886ac503354eaa932dd7c2811c64d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:28.593055 20445 consensus_queue.cc:1048] T f47b342aa4e145518e9c44998faf692e P 6aee883f265544bd9c7b9502e590182c [LEADER]: Connected to new peer: Peer: permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:28.594154 20518 consensus_queue.cc:1048] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:28.610631 20322 raft_consensus.cc:1275] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Refusing update from remote peer 6aee883f265544bd9c7b9502e590182c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:28.612885 20445 consensus_queue.cc:1048] T f47b342aa4e145518e9c44998faf692e P 6aee883f265544bd9c7b9502e590182c [LEADER]: Connected to new peer: Peer: permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:28.653698 20247 raft_consensus.cc:1275] T 29a9241f720a49aa82f440b1beaae093 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Refusing update from remote peer 96a5d14dc9a9404b9b89c75be639ea96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:28.655136 20522 consensus_queue.cc:1048] T 29a9241f720a49aa82f440b1beaae093 P 96a5d14dc9a9404b9b89c75be639ea96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:28.662568 20397 raft_consensus.cc:1275] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Refusing update from remote peer 96a5d14dc9a9404b9b89c75be639ea96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:28.664253 20522 consensus_queue.cc:1048] T 29a9241f720a49aa82f440b1beaae093 P 96a5d14dc9a9404b9b89c75be639ea96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:28.677151 20322 raft_consensus.cc:1275] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Refusing update from remote peer af886ac503354eaa932dd7c2811c64d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:28.678627 20518 consensus_queue.cc:1048] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:28.687175 20397 raft_consensus.cc:1275] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Refusing update from remote peer af886ac503354eaa932dd7c2811c64d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:28.688860 20521 consensus_queue.cc:1048] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:30.860532 20142 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45070:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:27:30.863816 20142 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:27:30.926851 20230 tablet_service.cc:1511] Processing CreateTablet for tablet 16c22ea0116a4af0b3e16931acab8e68 (DEFAULT_TABLE table=soft_deleted_table [id=3b770ba369194800bea0896803e65088]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:30.928756 20230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16c22ea0116a4af0b3e16931acab8e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:30.929913 20309 tablet_service.cc:1511] Processing CreateTablet for tablet 16c22ea0116a4af0b3e16931acab8e68 (DEFAULT_TABLE table=soft_deleted_table [id=3b770ba369194800bea0896803e65088]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:30.931777 20309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16c22ea0116a4af0b3e16931acab8e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:30.931362 20380 tablet_service.cc:1511] Processing CreateTablet for tablet 16c22ea0116a4af0b3e16931acab8e68 (DEFAULT_TABLE table=soft_deleted_table [id=3b770ba369194800bea0896803e65088]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:30.933262 20380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16c22ea0116a4af0b3e16931acab8e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:30.938649 20379 tablet_service.cc:1511] Processing CreateTablet for tablet 1e3e7383d2d9471c8e3042879c895f2d (DEFAULT_TABLE table=soft_deleted_table [id=3b770ba369194800bea0896803e65088]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:30.940364 20379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e3e7383d2d9471c8e3042879c895f2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:30.944742 20383 tablet_service.cc:1511] Processing CreateTablet for tablet 136d326496ce4211bf0879ec5c0e9705 (DEFAULT_TABLE table=soft_deleted_table [id=3b770ba369194800bea0896803e65088]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:30.945726 20381 tablet_service.cc:1511] Processing CreateTablet for tablet fa9bbb303135401db12c664b196ac0d9 (DEFAULT_TABLE table=soft_deleted_table [id=3b770ba369194800bea0896803e65088]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:30.946411 20383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 136d326496ce4211bf0879ec5c0e9705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:30.952020 20235 tablet_service.cc:1511] Processing CreateTablet for tablet 1e3e7383d2d9471c8e3042879c895f2d (DEFAULT_TABLE table=soft_deleted_table [id=3b770ba369194800bea0896803e65088]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:30.953805 20235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e3e7383d2d9471c8e3042879c895f2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:30.955649 20234 tablet_service.cc:1511] Processing CreateTablet for tablet 136d326496ce4211bf0879ec5c0e9705 (DEFAULT_TABLE table=soft_deleted_table [id=3b770ba369194800bea0896803e65088]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:30.958544 20232 tablet_service.cc:1511] Processing CreateTablet for tablet fa9bbb303135401db12c664b196ac0d9 (DEFAULT_TABLE table=soft_deleted_table [id=3b770ba369194800bea0896803e65088]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:30.960232 20543 tablet_bootstrap.cc:492] T 16c22ea0116a4af0b3e16931acab8e68 P af886ac503354eaa932dd7c2811c64d9: Bootstrap starting.
I20260709 12:27:30.961300 20233 tablet_service.cc:1511] Processing CreateTablet for tablet ef120bbec38f41ac88a0bdcc328a1b57 (DEFAULT_TABLE table=soft_deleted_table [id=3b770ba369194800bea0896803e65088]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:30.963240 20544 tablet_bootstrap.cc:492] T 16c22ea0116a4af0b3e16931acab8e68 P 96a5d14dc9a9404b9b89c75be639ea96: Bootstrap starting.
I20260709 12:27:30.963658 20381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa9bbb303135401db12c664b196ac0d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:30.964066 20384 tablet_service.cc:1511] Processing CreateTablet for tablet ef120bbec38f41ac88a0bdcc328a1b57 (DEFAULT_TABLE table=soft_deleted_table [id=3b770ba369194800bea0896803e65088]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:30.966293 20384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef120bbec38f41ac88a0bdcc328a1b57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:30.965006 20233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef120bbec38f41ac88a0bdcc328a1b57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:30.970479 20234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 136d326496ce4211bf0879ec5c0e9705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:30.973245 20544 tablet_bootstrap.cc:654] T 16c22ea0116a4af0b3e16931acab8e68 P 96a5d14dc9a9404b9b89c75be639ea96: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:30.975251 20230 tablet_service.cc:1511] Processing CreateTablet for tablet 8e47cc0287004854afd0e484250aa77b (DEFAULT_TABLE table=soft_deleted_table [id=3b770ba369194800bea0896803e65088]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:30.976694 20230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e47cc0287004854afd0e484250aa77b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:30.978497 20232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa9bbb303135401db12c664b196ac0d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:30.978936 20386 tablet_service.cc:1511] Processing CreateTablet for tablet 8e47cc0287004854afd0e484250aa77b (DEFAULT_TABLE table=soft_deleted_table [id=3b770ba369194800bea0896803e65088]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:30.980367 20386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e47cc0287004854afd0e484250aa77b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:30.984439 20309 tablet_service.cc:1511] Processing CreateTablet for tablet 1e3e7383d2d9471c8e3042879c895f2d (DEFAULT_TABLE table=soft_deleted_table [id=3b770ba369194800bea0896803e65088]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:30.984972 20231 tablet_service.cc:1511] Processing CreateTablet for tablet 2a404c53991240b7a421b0109c15e4e8 (DEFAULT_TABLE table=soft_deleted_table [id=3b770ba369194800bea0896803e65088]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:30.985373 20385 tablet_service.cc:1511] Processing CreateTablet for tablet 2a404c53991240b7a421b0109c15e4e8 (DEFAULT_TABLE table=soft_deleted_table [id=3b770ba369194800bea0896803e65088]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:30.986068 20309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e3e7383d2d9471c8e3042879c895f2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:30.986902 20385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a404c53991240b7a421b0109c15e4e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:30.987671 20236 tablet_service.cc:1511] Processing CreateTablet for tablet 2117b13035b64ae495334d59cd083a34 (DEFAULT_TABLE table=soft_deleted_table [id=3b770ba369194800bea0896803e65088]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:30.986413 20231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a404c53991240b7a421b0109c15e4e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:30.992668 20236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2117b13035b64ae495334d59cd083a34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:30.996423 20313 tablet_service.cc:1511] Processing CreateTablet for tablet 136d326496ce4211bf0879ec5c0e9705 (DEFAULT_TABLE table=soft_deleted_table [id=3b770ba369194800bea0896803e65088]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:30.998044 20313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 136d326496ce4211bf0879ec5c0e9705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:30.998157 20382 tablet_service.cc:1511] Processing CreateTablet for tablet 2117b13035b64ae495334d59cd083a34 (DEFAULT_TABLE table=soft_deleted_table [id=3b770ba369194800bea0896803e65088]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:30.999797 20382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2117b13035b64ae495334d59cd083a34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.004475 20237 tablet_service.cc:1511] Processing CreateTablet for tablet 5a8684f3955d41d1bd701a5f93b4d8d0 (DEFAULT_TABLE table=soft_deleted_table [id=3b770ba369194800bea0896803e65088]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:31.006305 20237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a8684f3955d41d1bd701a5f93b4d8d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.006400 20544 tablet_bootstrap.cc:492] T 16c22ea0116a4af0b3e16931acab8e68 P 96a5d14dc9a9404b9b89c75be639ea96: No bootstrap required, opened a new log
I20260709 12:27:31.007161 20544 ts_tablet_manager.cc:1403] T 16c22ea0116a4af0b3e16931acab8e68 P 96a5d14dc9a9404b9b89c75be639ea96: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.004s
I20260709 12:27:31.012550 20312 tablet_service.cc:1511] Processing CreateTablet for tablet fa9bbb303135401db12c664b196ac0d9 (DEFAULT_TABLE table=soft_deleted_table [id=3b770ba369194800bea0896803e65088]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:31.013396 20306 tablet_service.cc:1511] Processing CreateTablet for tablet ef120bbec38f41ac88a0bdcc328a1b57 (DEFAULT_TABLE table=soft_deleted_table [id=3b770ba369194800bea0896803e65088]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:31.014210 20312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa9bbb303135401db12c664b196ac0d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.010955 20544 raft_consensus.cc:359] T 16c22ea0116a4af0b3e16931acab8e68 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.015094 20306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef120bbec38f41ac88a0bdcc328a1b57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.017367 20310 tablet_service.cc:1511] Processing CreateTablet for tablet 8e47cc0287004854afd0e484250aa77b (DEFAULT_TABLE table=soft_deleted_table [id=3b770ba369194800bea0896803e65088]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:31.019986 20307 tablet_service.cc:1511] Processing CreateTablet for tablet 2a404c53991240b7a421b0109c15e4e8 (DEFAULT_TABLE table=soft_deleted_table [id=3b770ba369194800bea0896803e65088]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:31.022574 20305 tablet_service.cc:1511] Processing CreateTablet for tablet 2117b13035b64ae495334d59cd083a34 (DEFAULT_TABLE table=soft_deleted_table [id=3b770ba369194800bea0896803e65088]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:31.030484 20544 raft_consensus.cc:385] T 16c22ea0116a4af0b3e16931acab8e68 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.030629 20310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e47cc0287004854afd0e484250aa77b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.030932 20544 raft_consensus.cc:740] T 16c22ea0116a4af0b3e16931acab8e68 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.033144 20544 consensus_queue.cc:260] T 16c22ea0116a4af0b3e16931acab8e68 P 96a5d14dc9a9404b9b89c75be639ea96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.034475 20307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a404c53991240b7a421b0109c15e4e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.038573 20305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2117b13035b64ae495334d59cd083a34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.040500 20544 ts_tablet_manager.cc:1434] T 16c22ea0116a4af0b3e16931acab8e68 P 96a5d14dc9a9404b9b89c75be639ea96: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:27:31.047897 20387 tablet_service.cc:1511] Processing CreateTablet for tablet 5a8684f3955d41d1bd701a5f93b4d8d0 (DEFAULT_TABLE table=soft_deleted_table [id=3b770ba369194800bea0896803e65088]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:31.048247 20308 tablet_service.cc:1511] Processing CreateTablet for tablet 5a8684f3955d41d1bd701a5f93b4d8d0 (DEFAULT_TABLE table=soft_deleted_table [id=3b770ba369194800bea0896803e65088]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:31.049657 20308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a8684f3955d41d1bd701a5f93b4d8d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.049623 20387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a8684f3955d41d1bd701a5f93b4d8d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.053507 20544 tablet_bootstrap.cc:492] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96: Bootstrap starting.
I20260709 12:27:31.060495 20544 tablet_bootstrap.cc:654] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.096385 20543 tablet_bootstrap.cc:654] T 16c22ea0116a4af0b3e16931acab8e68 P af886ac503354eaa932dd7c2811c64d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.118927 20544 tablet_bootstrap.cc:492] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96: No bootstrap required, opened a new log
I20260709 12:27:31.119601 20544 ts_tablet_manager.cc:1403] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.020s
I20260709 12:27:31.123040 20544 raft_consensus.cc:359] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.123781 20544 raft_consensus.cc:385] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.124082 20544 raft_consensus.cc:740] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.129873 20544 consensus_queue.cc:260] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.133563 20544 ts_tablet_manager.cc:1434] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:27:31.143419 20544 tablet_bootstrap.cc:492] T 136d326496ce4211bf0879ec5c0e9705 P 96a5d14dc9a9404b9b89c75be639ea96: Bootstrap starting.
I20260709 12:27:31.170446 20546 tablet_bootstrap.cc:492] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c: Bootstrap starting.
I20260709 12:27:31.183243 20544 tablet_bootstrap.cc:654] T 136d326496ce4211bf0879ec5c0e9705 P 96a5d14dc9a9404b9b89c75be639ea96: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.198822 20546 tablet_bootstrap.cc:654] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.200598 20543 tablet_bootstrap.cc:492] T 16c22ea0116a4af0b3e16931acab8e68 P af886ac503354eaa932dd7c2811c64d9: No bootstrap required, opened a new log
I20260709 12:27:31.201215 20543 ts_tablet_manager.cc:1403] T 16c22ea0116a4af0b3e16931acab8e68 P af886ac503354eaa932dd7c2811c64d9: Time spent bootstrapping tablet: real 0.241s	user 0.013s	sys 0.014s
I20260709 12:27:31.204514 20543 raft_consensus.cc:359] T 16c22ea0116a4af0b3e16931acab8e68 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.205271 20543 raft_consensus.cc:385] T 16c22ea0116a4af0b3e16931acab8e68 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.205565 20543 raft_consensus.cc:740] T 16c22ea0116a4af0b3e16931acab8e68 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af886ac503354eaa932dd7c2811c64d9, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.206314 20543 consensus_queue.cc:260] T 16c22ea0116a4af0b3e16931acab8e68 P af886ac503354eaa932dd7c2811c64d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.208726 20543 ts_tablet_manager.cc:1434] T 16c22ea0116a4af0b3e16931acab8e68 P af886ac503354eaa932dd7c2811c64d9: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:27:31.212236 20546 tablet_bootstrap.cc:492] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c: No bootstrap required, opened a new log
I20260709 12:27:31.212477 20544 tablet_bootstrap.cc:492] T 136d326496ce4211bf0879ec5c0e9705 P 96a5d14dc9a9404b9b89c75be639ea96: No bootstrap required, opened a new log
I20260709 12:27:31.212707 20543 tablet_bootstrap.cc:492] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9: Bootstrap starting.
I20260709 12:27:31.213028 20546 ts_tablet_manager.cc:1403] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.008s
I20260709 12:27:31.213110 20544 ts_tablet_manager.cc:1403] T 136d326496ce4211bf0879ec5c0e9705 P 96a5d14dc9a9404b9b89c75be639ea96: Time spent bootstrapping tablet: real 0.070s	user 0.016s	sys 0.004s
I20260709 12:27:31.216842 20546 raft_consensus.cc:359] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.217765 20546 raft_consensus.cc:385] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.217296 20544 raft_consensus.cc:359] T 136d326496ce4211bf0879ec5c0e9705 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.218324 20544 raft_consensus.cc:385] T 136d326496ce4211bf0879ec5c0e9705 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.218659 20544 raft_consensus.cc:740] T 136d326496ce4211bf0879ec5c0e9705 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.219659 20544 consensus_queue.cc:260] T 136d326496ce4211bf0879ec5c0e9705 P 96a5d14dc9a9404b9b89c75be639ea96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.220170 20546 raft_consensus.cc:740] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.221244 20546 consensus_queue.cc:260] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.223860 20546 ts_tablet_manager.cc:1434] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:27:31.225015 20546 tablet_bootstrap.cc:492] T fa9bbb303135401db12c664b196ac0d9 P 6aee883f265544bd9c7b9502e590182c: Bootstrap starting.
I20260709 12:27:31.226701 20543 tablet_bootstrap.cc:654] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.231262 20544 ts_tablet_manager.cc:1434] T 136d326496ce4211bf0879ec5c0e9705 P 96a5d14dc9a9404b9b89c75be639ea96: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 12:27:31.232165 20546 tablet_bootstrap.cc:654] T fa9bbb303135401db12c664b196ac0d9 P 6aee883f265544bd9c7b9502e590182c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.236456 20544 tablet_bootstrap.cc:492] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96: Bootstrap starting.
I20260709 12:27:31.246009 20544 tablet_bootstrap.cc:654] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.249222 20543 tablet_bootstrap.cc:492] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9: No bootstrap required, opened a new log
I20260709 12:27:31.249888 20543 ts_tablet_manager.cc:1403] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.011s
I20260709 12:27:31.251478 20546 tablet_bootstrap.cc:492] T fa9bbb303135401db12c664b196ac0d9 P 6aee883f265544bd9c7b9502e590182c: No bootstrap required, opened a new log
I20260709 12:27:31.252025 20546 ts_tablet_manager.cc:1403] T fa9bbb303135401db12c664b196ac0d9 P 6aee883f265544bd9c7b9502e590182c: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.007s
I20260709 12:27:31.252676 20544 tablet_bootstrap.cc:492] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96: No bootstrap required, opened a new log
I20260709 12:27:31.253297 20544 ts_tablet_manager.cc:1403] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 12:27:31.253206 20543 raft_consensus.cc:359] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.254244 20543 raft_consensus.cc:385] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.254571 20543 raft_consensus.cc:740] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af886ac503354eaa932dd7c2811c64d9, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.254702 20546 raft_consensus.cc:359] T fa9bbb303135401db12c664b196ac0d9 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.255424 20546 raft_consensus.cc:385] T fa9bbb303135401db12c664b196ac0d9 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.255957 20546 raft_consensus.cc:740] T fa9bbb303135401db12c664b196ac0d9 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.255416 20543 consensus_queue.cc:260] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.256671 20546 consensus_queue.cc:260] T fa9bbb303135401db12c664b196ac0d9 P 6aee883f265544bd9c7b9502e590182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.256836 20544 raft_consensus.cc:359] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.257634 20544 raft_consensus.cc:385] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.257926 20544 raft_consensus.cc:740] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.259757 20544 consensus_queue.cc:260] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.262173 20544 ts_tablet_manager.cc:1434] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:27:31.263237 20546 ts_tablet_manager.cc:1434] T fa9bbb303135401db12c664b196ac0d9 P 6aee883f265544bd9c7b9502e590182c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:27:31.264267 20543 ts_tablet_manager.cc:1434] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:27:31.264326 20546 tablet_bootstrap.cc:492] T 16c22ea0116a4af0b3e16931acab8e68 P 6aee883f265544bd9c7b9502e590182c: Bootstrap starting.
I20260709 12:27:31.265511 20543 tablet_bootstrap.cc:492] T 2117b13035b64ae495334d59cd083a34 P af886ac503354eaa932dd7c2811c64d9: Bootstrap starting.
I20260709 12:27:31.263286 20544 tablet_bootstrap.cc:492] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 96a5d14dc9a9404b9b89c75be639ea96: Bootstrap starting.
I20260709 12:27:31.271775 20546 tablet_bootstrap.cc:654] T 16c22ea0116a4af0b3e16931acab8e68 P 6aee883f265544bd9c7b9502e590182c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.277088 20544 tablet_bootstrap.cc:654] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 96a5d14dc9a9404b9b89c75be639ea96: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.284076 20546 tablet_bootstrap.cc:492] T 16c22ea0116a4af0b3e16931acab8e68 P 6aee883f265544bd9c7b9502e590182c: No bootstrap required, opened a new log
I20260709 12:27:31.284631 20546 ts_tablet_manager.cc:1403] T 16c22ea0116a4af0b3e16931acab8e68 P 6aee883f265544bd9c7b9502e590182c: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 12:27:31.287922 20546 raft_consensus.cc:359] T 16c22ea0116a4af0b3e16931acab8e68 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.288672 20546 raft_consensus.cc:385] T 16c22ea0116a4af0b3e16931acab8e68 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.288975 20546 raft_consensus.cc:740] T 16c22ea0116a4af0b3e16931acab8e68 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.289763 20546 consensus_queue.cc:260] T 16c22ea0116a4af0b3e16931acab8e68 P 6aee883f265544bd9c7b9502e590182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.291258 20543 tablet_bootstrap.cc:654] T 2117b13035b64ae495334d59cd083a34 P af886ac503354eaa932dd7c2811c64d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.292184 20546 ts_tablet_manager.cc:1434] T 16c22ea0116a4af0b3e16931acab8e68 P 6aee883f265544bd9c7b9502e590182c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:27:31.293606 20546 tablet_bootstrap.cc:492] T ef120bbec38f41ac88a0bdcc328a1b57 P 6aee883f265544bd9c7b9502e590182c: Bootstrap starting.
I20260709 12:27:31.298223 20544 tablet_bootstrap.cc:492] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 96a5d14dc9a9404b9b89c75be639ea96: No bootstrap required, opened a new log
I20260709 12:27:31.299116 20544 ts_tablet_manager.cc:1403] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 96a5d14dc9a9404b9b89c75be639ea96: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.012s
I20260709 12:27:31.300524 20546 tablet_bootstrap.cc:654] T ef120bbec38f41ac88a0bdcc328a1b57 P 6aee883f265544bd9c7b9502e590182c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.303495 20544 raft_consensus.cc:359] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.304590 20544 raft_consensus.cc:385] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.304983 20544 raft_consensus.cc:740] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.311537 20544 consensus_queue.cc:260] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 96a5d14dc9a9404b9b89c75be639ea96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.318845 20546 tablet_bootstrap.cc:492] T ef120bbec38f41ac88a0bdcc328a1b57 P 6aee883f265544bd9c7b9502e590182c: No bootstrap required, opened a new log
I20260709 12:27:31.319540 20546 ts_tablet_manager.cc:1403] T ef120bbec38f41ac88a0bdcc328a1b57 P 6aee883f265544bd9c7b9502e590182c: Time spent bootstrapping tablet: real 0.026s	user 0.004s	sys 0.013s
I20260709 12:27:31.322813 20546 raft_consensus.cc:359] T ef120bbec38f41ac88a0bdcc328a1b57 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.323589 20546 raft_consensus.cc:385] T ef120bbec38f41ac88a0bdcc328a1b57 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.326742 20544 ts_tablet_manager.cc:1434] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 96a5d14dc9a9404b9b89c75be639ea96: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.001s
I20260709 12:27:31.327411 20546 raft_consensus.cc:740] T ef120bbec38f41ac88a0bdcc328a1b57 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.328408 20546 consensus_queue.cc:260] T ef120bbec38f41ac88a0bdcc328a1b57 P 6aee883f265544bd9c7b9502e590182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.330071 20544 tablet_bootstrap.cc:492] T 2a404c53991240b7a421b0109c15e4e8 P 96a5d14dc9a9404b9b89c75be639ea96: Bootstrap starting.
I20260709 12:27:31.331076 20546 ts_tablet_manager.cc:1434] T ef120bbec38f41ac88a0bdcc328a1b57 P 6aee883f265544bd9c7b9502e590182c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 12:27:31.332252 20546 tablet_bootstrap.cc:492] T 1e3e7383d2d9471c8e3042879c895f2d P 6aee883f265544bd9c7b9502e590182c: Bootstrap starting.
I20260709 12:27:31.337044 20543 tablet_bootstrap.cc:492] T 2117b13035b64ae495334d59cd083a34 P af886ac503354eaa932dd7c2811c64d9: No bootstrap required, opened a new log
I20260709 12:27:31.337626 20543 ts_tablet_manager.cc:1403] T 2117b13035b64ae495334d59cd083a34 P af886ac503354eaa932dd7c2811c64d9: Time spent bootstrapping tablet: real 0.072s	user 0.017s	sys 0.026s
I20260709 12:27:31.339167 20546 tablet_bootstrap.cc:654] T 1e3e7383d2d9471c8e3042879c895f2d P 6aee883f265544bd9c7b9502e590182c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.340444 20543 raft_consensus.cc:359] T 2117b13035b64ae495334d59cd083a34 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.341279 20543 raft_consensus.cc:385] T 2117b13035b64ae495334d59cd083a34 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.341614 20543 raft_consensus.cc:740] T 2117b13035b64ae495334d59cd083a34 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af886ac503354eaa932dd7c2811c64d9, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.343683 20544 tablet_bootstrap.cc:654] T 2a404c53991240b7a421b0109c15e4e8 P 96a5d14dc9a9404b9b89c75be639ea96: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.344726 20546 tablet_bootstrap.cc:492] T 1e3e7383d2d9471c8e3042879c895f2d P 6aee883f265544bd9c7b9502e590182c: No bootstrap required, opened a new log
I20260709 12:27:31.345340 20546 ts_tablet_manager.cc:1403] T 1e3e7383d2d9471c8e3042879c895f2d P 6aee883f265544bd9c7b9502e590182c: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 12:27:31.346479 20543 consensus_queue.cc:260] T 2117b13035b64ae495334d59cd083a34 P af886ac503354eaa932dd7c2811c64d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.348474 20546 raft_consensus.cc:359] T 1e3e7383d2d9471c8e3042879c895f2d P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.349275 20546 raft_consensus.cc:385] T 1e3e7383d2d9471c8e3042879c895f2d P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.349587 20546 raft_consensus.cc:740] T 1e3e7383d2d9471c8e3042879c895f2d P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.349789 20543 ts_tablet_manager.cc:1434] T 2117b13035b64ae495334d59cd083a34 P af886ac503354eaa932dd7c2811c64d9: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:27:31.351411 20546 consensus_queue.cc:260] T 1e3e7383d2d9471c8e3042879c895f2d P 6aee883f265544bd9c7b9502e590182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.352819 20543 tablet_bootstrap.cc:492] T 8e47cc0287004854afd0e484250aa77b P af886ac503354eaa932dd7c2811c64d9: Bootstrap starting.
I20260709 12:27:31.355244 20546 ts_tablet_manager.cc:1434] T 1e3e7383d2d9471c8e3042879c895f2d P 6aee883f265544bd9c7b9502e590182c: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:27:31.355829 20479 raft_consensus.cc:493] T 16c22ea0116a4af0b3e16931acab8e68 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.356420 20546 tablet_bootstrap.cc:492] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 6aee883f265544bd9c7b9502e590182c: Bootstrap starting.
I20260709 12:27:31.356459 20479 raft_consensus.cc:515] T 16c22ea0116a4af0b3e16931acab8e68 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.361168 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16c22ea0116a4af0b3e16931acab8e68" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96" is_pre_election: true
I20260709 12:27:31.362054 20323 raft_consensus.cc:2468] T 16c22ea0116a4af0b3e16931acab8e68 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af886ac503354eaa932dd7c2811c64d9 in term 0.
I20260709 12:27:31.363994 20546 tablet_bootstrap.cc:654] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 6aee883f265544bd9c7b9502e590182c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.363965 20543 tablet_bootstrap.cc:654] T 8e47cc0287004854afd0e484250aa77b P af886ac503354eaa932dd7c2811c64d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.369592 20212 leader_election.cc:304] T 16c22ea0116a4af0b3e16931acab8e68 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96a5d14dc9a9404b9b89c75be639ea96, af886ac503354eaa932dd7c2811c64d9; no voters: 
I20260709 12:27:31.374648 20563 raft_consensus.cc:2804] T 16c22ea0116a4af0b3e16931acab8e68 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:31.374888 20479 leader_election.cc:290] T 16c22ea0116a4af0b3e16931acab8e68 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:31.375838 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16c22ea0116a4af0b3e16931acab8e68" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aee883f265544bd9c7b9502e590182c" is_pre_election: true
I20260709 12:27:31.376658 20397 raft_consensus.cc:2468] T 16c22ea0116a4af0b3e16931acab8e68 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af886ac503354eaa932dd7c2811c64d9 in term 0.
I20260709 12:27:31.377588 20563 raft_consensus.cc:493] T 16c22ea0116a4af0b3e16931acab8e68 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:31.378010 20563 raft_consensus.cc:3060] T 16c22ea0116a4af0b3e16931acab8e68 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.382431 20546 tablet_bootstrap.cc:492] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 6aee883f265544bd9c7b9502e590182c: No bootstrap required, opened a new log
I20260709 12:27:31.383116 20546 ts_tablet_manager.cc:1403] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 6aee883f265544bd9c7b9502e590182c: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.004s
I20260709 12:27:31.384405 20544 tablet_bootstrap.cc:492] T 2a404c53991240b7a421b0109c15e4e8 P 96a5d14dc9a9404b9b89c75be639ea96: No bootstrap required, opened a new log
I20260709 12:27:31.385126 20544 ts_tablet_manager.cc:1403] T 2a404c53991240b7a421b0109c15e4e8 P 96a5d14dc9a9404b9b89c75be639ea96: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.007s
I20260709 12:27:31.387665 20546 raft_consensus.cc:359] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.388533 20546 raft_consensus.cc:385] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.388252 20563 raft_consensus.cc:515] T 16c22ea0116a4af0b3e16931acab8e68 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.388972 20546 raft_consensus.cc:740] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.388691 20544 raft_consensus.cc:359] T 2a404c53991240b7a421b0109c15e4e8 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.389919 20544 raft_consensus.cc:385] T 2a404c53991240b7a421b0109c15e4e8 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.390486 20544 raft_consensus.cc:740] T 2a404c53991240b7a421b0109c15e4e8 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.390040 20546 consensus_queue.cc:260] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 6aee883f265544bd9c7b9502e590182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.391661 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16c22ea0116a4af0b3e16931acab8e68" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
I20260709 12:27:31.391553 20544 consensus_queue.cc:260] T 2a404c53991240b7a421b0109c15e4e8 P 96a5d14dc9a9404b9b89c75be639ea96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.392421 20323 raft_consensus.cc:3060] T 16c22ea0116a4af0b3e16931acab8e68 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.392760 20546 ts_tablet_manager.cc:1434] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 6aee883f265544bd9c7b9502e590182c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:27:31.394168 20546 tablet_bootstrap.cc:492] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c: Bootstrap starting.
I20260709 12:27:31.400292 20543 tablet_bootstrap.cc:492] T 8e47cc0287004854afd0e484250aa77b P af886ac503354eaa932dd7c2811c64d9: No bootstrap required, opened a new log
I20260709 12:27:31.400923 20543 ts_tablet_manager.cc:1403] T 8e47cc0287004854afd0e484250aa77b P af886ac503354eaa932dd7c2811c64d9: Time spent bootstrapping tablet: real 0.048s	user 0.021s	sys 0.006s
I20260709 12:27:31.401158 20546 tablet_bootstrap.cc:654] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.403052 20563 leader_election.cc:290] T 16c22ea0116a4af0b3e16931acab8e68 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 election: Requested vote from peers 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:31.403308 20396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16c22ea0116a4af0b3e16931acab8e68" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aee883f265544bd9c7b9502e590182c"
I20260709 12:27:31.401294 20323 raft_consensus.cc:2468] T 16c22ea0116a4af0b3e16931acab8e68 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af886ac503354eaa932dd7c2811c64d9 in term 1.
I20260709 12:27:31.403940 20396 raft_consensus.cc:3060] T 16c22ea0116a4af0b3e16931acab8e68 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.404875 20212 leader_election.cc:304] T 16c22ea0116a4af0b3e16931acab8e68 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96a5d14dc9a9404b9b89c75be639ea96, af886ac503354eaa932dd7c2811c64d9; no voters: 
I20260709 12:27:31.412901 20396 raft_consensus.cc:2468] T 16c22ea0116a4af0b3e16931acab8e68 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af886ac503354eaa932dd7c2811c64d9 in term 1.
I20260709 12:27:31.415305 20544 ts_tablet_manager.cc:1434] T 2a404c53991240b7a421b0109c15e4e8 P 96a5d14dc9a9404b9b89c75be639ea96: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:27:31.415565 20563 raft_consensus.cc:2804] T 16c22ea0116a4af0b3e16931acab8e68 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:31.415557 20543 raft_consensus.cc:359] T 8e47cc0287004854afd0e484250aa77b P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.416591 20543 raft_consensus.cc:385] T 8e47cc0287004854afd0e484250aa77b P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.416909 20543 raft_consensus.cc:740] T 8e47cc0287004854afd0e484250aa77b P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af886ac503354eaa932dd7c2811c64d9, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.417074 20563 raft_consensus.cc:697] T 16c22ea0116a4af0b3e16931acab8e68 P af886ac503354eaa932dd7c2811c64d9 [term 1 LEADER]: Becoming Leader. State: Replica: af886ac503354eaa932dd7c2811c64d9, State: Running, Role: LEADER
I20260709 12:27:31.417732 20543 consensus_queue.cc:260] T 8e47cc0287004854afd0e484250aa77b P af886ac503354eaa932dd7c2811c64d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.418244 20563 consensus_queue.cc:237] T 16c22ea0116a4af0b3e16931acab8e68 P af886ac503354eaa932dd7c2811c64d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.420305 20543 ts_tablet_manager.cc:1434] T 8e47cc0287004854afd0e484250aa77b P af886ac503354eaa932dd7c2811c64d9: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.002s
I20260709 12:27:31.421483 20543 tablet_bootstrap.cc:492] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9: Bootstrap starting.
I20260709 12:27:31.424116 20546 tablet_bootstrap.cc:492] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c: No bootstrap required, opened a new log
I20260709 12:27:31.425943 20546 ts_tablet_manager.cc:1403] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.012s
I20260709 12:27:31.430786 20544 tablet_bootstrap.cc:492] T fa9bbb303135401db12c664b196ac0d9 P 96a5d14dc9a9404b9b89c75be639ea96: Bootstrap starting.
I20260709 12:27:31.431645 20543 tablet_bootstrap.cc:654] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.432520 20546 raft_consensus.cc:359] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.433437 20546 raft_consensus.cc:385] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.433755 20546 raft_consensus.cc:740] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.434621 20546 consensus_queue.cc:260] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.436542 20531 raft_consensus.cc:493] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.437188 20546 ts_tablet_manager.cc:1434] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:27:31.437083 20531 raft_consensus.cc:515] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.438380 20546 tablet_bootstrap.cc:492] T 2a404c53991240b7a421b0109c15e4e8 P 6aee883f265544bd9c7b9502e590182c: Bootstrap starting.
I20260709 12:27:31.439535 20531 leader_election.cc:290] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:31.440083 20143 catalog_manager.cc:5697] T 16c22ea0116a4af0b3e16931acab8e68 P af886ac503354eaa932dd7c2811c64d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to af886ac503354eaa932dd7c2811c64d9 (127.9.145.193). New cstate: current_term: 1 leader_uuid: "af886ac503354eaa932dd7c2811c64d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:31.445801 20546 tablet_bootstrap.cc:654] T 2a404c53991240b7a421b0109c15e4e8 P 6aee883f265544bd9c7b9502e590182c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.446537 20543 tablet_bootstrap.cc:492] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9: No bootstrap required, opened a new log
I20260709 12:27:31.447295 20543 ts_tablet_manager.cc:1403] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.004s
I20260709 12:27:31.454557 20544 tablet_bootstrap.cc:654] T fa9bbb303135401db12c664b196ac0d9 P 96a5d14dc9a9404b9b89c75be639ea96: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.446543 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef120bbec38f41ac88a0bdcc328a1b57" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9" is_pre_election: true
I20260709 12:27:31.448505 20396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef120bbec38f41ac88a0bdcc328a1b57" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aee883f265544bd9c7b9502e590182c" is_pre_election: true
I20260709 12:27:31.457470 20543 raft_consensus.cc:359] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.458118 20396 raft_consensus.cc:2468] T ef120bbec38f41ac88a0bdcc328a1b57 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96a5d14dc9a9404b9b89c75be639ea96 in term 0.
W20260709 12:27:31.457405 20289 leader_election.cc:343] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:31.459828 20288 leader_election.cc:304] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, 96a5d14dc9a9404b9b89c75be639ea96; no voters: af886ac503354eaa932dd7c2811c64d9
I20260709 12:27:31.460625 20543 raft_consensus.cc:385] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.460856 20531 raft_consensus.cc:2804] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:31.461404 20531 raft_consensus.cc:493] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:31.461748 20531 raft_consensus.cc:3060] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.463936 20445 raft_consensus.cc:493] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.464645 20445 raft_consensus.cc:515] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.465423 20563 raft_consensus.cc:493] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.466162 20563 raft_consensus.cc:515] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.468665 20563 leader_election.cc:290] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:31.470733 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136d326496ce4211bf0879ec5c0e9705" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9" is_pre_election: true
I20260709 12:27:31.470773 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3e7383d2d9471c8e3042879c895f2d" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96" is_pre_election: true
W20260709 12:27:31.474237 20212 leader_election.cc:343] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:31.474939 20396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3e7383d2d9471c8e3042879c895f2d" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aee883f265544bd9c7b9502e590182c" is_pre_election: true
I20260709 12:27:31.475782 20396 raft_consensus.cc:2468] T 1e3e7383d2d9471c8e3042879c895f2d P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af886ac503354eaa932dd7c2811c64d9 in term 0.
I20260709 12:27:31.477622 20213 leader_election.cc:304] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, af886ac503354eaa932dd7c2811c64d9; no voters: 96a5d14dc9a9404b9b89c75be639ea96
I20260709 12:27:31.478681 20563 raft_consensus.cc:2804] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:31.479166 20563 raft_consensus.cc:493] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:31.479518 20563 raft_consensus.cc:3060] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.480088 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136d326496ce4211bf0879ec5c0e9705" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96" is_pre_election: true
I20260709 12:27:31.480953 20323 raft_consensus.cc:2468] T 136d326496ce4211bf0879ec5c0e9705 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 0.
W20260709 12:27:31.482353 20363 leader_election.cc:343] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:31.484089 20361 leader_election.cc:304] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, 96a5d14dc9a9404b9b89c75be639ea96; no voters: af886ac503354eaa932dd7c2811c64d9
I20260709 12:27:31.485738 20445 leader_election.cc:290] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607)
I20260709 12:27:31.486825 20570 raft_consensus.cc:2804] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:31.488086 20570 raft_consensus.cc:493] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:31.488696 20563 raft_consensus.cc:515] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.488989 20570 raft_consensus.cc:3060] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.490062 20445 raft_consensus.cc:493] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.490705 20445 raft_consensus.cc:515] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.460960 20543 raft_consensus.cc:740] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af886ac503354eaa932dd7c2811c64d9, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.490921 20531 raft_consensus.cc:515] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.493002 20445 leader_election.cc:290] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607)
I20260709 12:27:31.494815 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef120bbec38f41ac88a0bdcc328a1b57" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
I20260709 12:27:31.495725 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2117b13035b64ae495334d59cd083a34" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96" is_pre_election: true
W20260709 12:27:31.496466 20289 leader_election.cc:343] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:31.497488 20361 leader_election.cc:343] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:31.499010 20531 leader_election.cc:290] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 election: Requested vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:31.499442 20396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef120bbec38f41ac88a0bdcc328a1b57" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aee883f265544bd9c7b9502e590182c"
I20260709 12:27:31.500150 20396 raft_consensus.cc:3060] T ef120bbec38f41ac88a0bdcc328a1b57 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.500378 20445 raft_consensus.cc:493] T fa9bbb303135401db12c664b196ac0d9 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.497303 20543 consensus_queue.cc:260] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.501070 20445 raft_consensus.cc:515] T fa9bbb303135401db12c664b196ac0d9 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.504333 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2117b13035b64ae495334d59cd083a34" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9" is_pre_election: true
I20260709 12:27:31.504611 20543 ts_tablet_manager.cc:1434] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 12:27:31.505098 20248 raft_consensus.cc:2468] T 2117b13035b64ae495334d59cd083a34 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 0.
I20260709 12:27:31.505290 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9bbb303135401db12c664b196ac0d9" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9" is_pre_election: true
I20260709 12:27:31.506690 20543 tablet_bootstrap.cc:492] T 2a404c53991240b7a421b0109c15e4e8 P af886ac503354eaa932dd7c2811c64d9: Bootstrap starting.
I20260709 12:27:31.506850 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9bbb303135401db12c664b196ac0d9" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96" is_pre_election: true
W20260709 12:27:31.508587 20361 leader_election.cc:343] T fa9bbb303135401db12c664b196ac0d9 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:31.508760 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3e7383d2d9471c8e3042879c895f2d" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aee883f265544bd9c7b9502e590182c"
I20260709 12:27:31.509420 20397 raft_consensus.cc:3060] T 1e3e7383d2d9471c8e3042879c895f2d P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.509853 20546 tablet_bootstrap.cc:492] T 2a404c53991240b7a421b0109c15e4e8 P 6aee883f265544bd9c7b9502e590182c: No bootstrap required, opened a new log
I20260709 12:27:31.510488 20546 ts_tablet_manager.cc:1403] T 2a404c53991240b7a421b0109c15e4e8 P 6aee883f265544bd9c7b9502e590182c: Time spent bootstrapping tablet: real 0.072s	user 0.026s	sys 0.025s
I20260709 12:27:31.514772 20543 tablet_bootstrap.cc:654] T 2a404c53991240b7a421b0109c15e4e8 P af886ac503354eaa932dd7c2811c64d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.516532 20544 tablet_bootstrap.cc:492] T fa9bbb303135401db12c664b196ac0d9 P 96a5d14dc9a9404b9b89c75be639ea96: No bootstrap required, opened a new log
I20260709 12:27:31.509348 20445 leader_election.cc:290] T fa9bbb303135401db12c664b196ac0d9 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607)
I20260709 12:27:31.516835 20546 raft_consensus.cc:359] T 2a404c53991240b7a421b0109c15e4e8 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.518142 20546 raft_consensus.cc:385] T 2a404c53991240b7a421b0109c15e4e8 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.518453 20546 raft_consensus.cc:740] T 2a404c53991240b7a421b0109c15e4e8 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.517287 20563 leader_election.cc:290] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 election: Requested vote from peers 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:31.515048 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3e7383d2d9471c8e3042879c895f2d" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
I20260709 12:27:31.517235 20544 ts_tablet_manager.cc:1403] T fa9bbb303135401db12c664b196ac0d9 P 96a5d14dc9a9404b9b89c75be639ea96: Time spent bootstrapping tablet: real 0.087s	user 0.014s	sys 0.010s
W20260709 12:27:31.520908 20212 leader_election.cc:343] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:31.522871 20543 tablet_bootstrap.cc:492] T 2a404c53991240b7a421b0109c15e4e8 P af886ac503354eaa932dd7c2811c64d9: No bootstrap required, opened a new log
I20260709 12:27:31.523524 20543 ts_tablet_manager.cc:1403] T 2a404c53991240b7a421b0109c15e4e8 P af886ac503354eaa932dd7c2811c64d9: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.002s
I20260709 12:27:31.524106 20544 raft_consensus.cc:359] T fa9bbb303135401db12c664b196ac0d9 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.524910 20544 raft_consensus.cc:385] T fa9bbb303135401db12c664b196ac0d9 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.525221 20544 raft_consensus.cc:740] T fa9bbb303135401db12c664b196ac0d9 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.519145 20546 consensus_queue.cc:260] T 2a404c53991240b7a421b0109c15e4e8 P 6aee883f265544bd9c7b9502e590182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.527928 20546 ts_tablet_manager.cc:1434] T 2a404c53991240b7a421b0109c15e4e8 P 6aee883f265544bd9c7b9502e590182c: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:27:31.527545 20543 raft_consensus.cc:359] T 2a404c53991240b7a421b0109c15e4e8 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.517204 20363 leader_election.cc:304] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, af886ac503354eaa932dd7c2811c64d9; no voters: 96a5d14dc9a9404b9b89c75be639ea96
I20260709 12:27:31.528496 20543 raft_consensus.cc:385] T 2a404c53991240b7a421b0109c15e4e8 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.529043 20546 tablet_bootstrap.cc:492] T 8e47cc0287004854afd0e484250aa77b P 6aee883f265544bd9c7b9502e590182c: Bootstrap starting.
I20260709 12:27:31.529024 20445 raft_consensus.cc:2804] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:31.525055 20570 raft_consensus.cc:515] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.529763 20445 raft_consensus.cc:493] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:31.530308 20445 raft_consensus.cc:3060] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.529995 20544 consensus_queue.cc:260] T fa9bbb303135401db12c664b196ac0d9 P 96a5d14dc9a9404b9b89c75be639ea96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.532456 20570 leader_election.cc:290] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 election: Requested vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607)
W20260709 12:27:31.529811 20363 leader_election.cc:343] T fa9bbb303135401db12c664b196ac0d9 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:31.533259 20363 leader_election.cc:304] T fa9bbb303135401db12c664b196ac0d9 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c; no voters: 96a5d14dc9a9404b9b89c75be639ea96, af886ac503354eaa932dd7c2811c64d9
I20260709 12:27:31.533831 20531 raft_consensus.cc:493] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.534373 20531 raft_consensus.cc:515] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.536427 20546 tablet_bootstrap.cc:654] T 8e47cc0287004854afd0e484250aa77b P 6aee883f265544bd9c7b9502e590182c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.537252 20531 leader_election.cc:290] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:31.538029 20395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e47cc0287004854afd0e484250aa77b" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aee883f265544bd9c7b9502e590182c" is_pre_election: true
I20260709 12:27:31.538769 20570 raft_consensus.cc:2749] T fa9bbb303135401db12c664b196ac0d9 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:31.538748 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e47cc0287004854afd0e484250aa77b" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9" is_pre_election: true
I20260709 12:27:31.539568 20247 raft_consensus.cc:2468] T 8e47cc0287004854afd0e484250aa77b P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96a5d14dc9a9404b9b89c75be639ea96 in term 0.
W20260709 12:27:31.539980 20288 leader_election.cc:343] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:31.538266 20563 raft_consensus.cc:493] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.540782 20289 leader_election.cc:304] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96a5d14dc9a9404b9b89c75be639ea96, af886ac503354eaa932dd7c2811c64d9; no voters: 6aee883f265544bd9c7b9502e590182c
I20260709 12:27:31.541150 20563 raft_consensus.cc:515] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.541937 20531 raft_consensus.cc:2804] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:31.532689 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136d326496ce4211bf0879ec5c0e9705" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
I20260709 12:27:31.542366 20531 raft_consensus.cc:493] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:31.542752 20531 raft_consensus.cc:3060] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.543610 20563 leader_election.cc:290] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:31.545493 20544 ts_tablet_manager.cc:1434] T fa9bbb303135401db12c664b196ac0d9 P 96a5d14dc9a9404b9b89c75be639ea96: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:27:31.546814 20544 tablet_bootstrap.cc:492] T 1e3e7383d2d9471c8e3042879c895f2d P 96a5d14dc9a9404b9b89c75be639ea96: Bootstrap starting.
I20260709 12:27:31.547230 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8684f3955d41d1bd701a5f93b4d8d0" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96" is_pre_election: true
I20260709 12:27:31.547887 20322 raft_consensus.cc:2468] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af886ac503354eaa932dd7c2811c64d9 in term 0.
I20260709 12:27:31.549101 20212 leader_election.cc:304] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96a5d14dc9a9404b9b89c75be639ea96, af886ac503354eaa932dd7c2811c64d9; no voters: 
I20260709 12:27:31.549973 20563 raft_consensus.cc:2804] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:31.550381 20563 raft_consensus.cc:493] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:31.550720 20563 raft_consensus.cc:3060] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.552345 20466 raft_consensus.cc:493] T 2a404c53991240b7a421b0109c15e4e8 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.552932 20466 raft_consensus.cc:515] T 2a404c53991240b7a421b0109c15e4e8 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.554595 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136d326496ce4211bf0879ec5c0e9705" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
I20260709 12:27:31.556689 20466 leader_election.cc:290] T 2a404c53991240b7a421b0109c15e4e8 P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:31.542760 20323 raft_consensus.cc:3060] T 136d326496ce4211bf0879ec5c0e9705 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.559154 20394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a404c53991240b7a421b0109c15e4e8" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aee883f265544bd9c7b9502e590182c" is_pre_election: true
I20260709 12:27:31.560097 20394 raft_consensus.cc:2468] T 2a404c53991240b7a421b0109c15e4e8 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96a5d14dc9a9404b9b89c75be639ea96 in term 0.
I20260709 12:27:31.561312 20395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8684f3955d41d1bd701a5f93b4d8d0" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aee883f265544bd9c7b9502e590182c" is_pre_election: true
I20260709 12:27:31.562088 20395 raft_consensus.cc:2468] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af886ac503354eaa932dd7c2811c64d9 in term 0.
I20260709 12:27:31.567214 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a404c53991240b7a421b0109c15e4e8" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9" is_pre_election: true
I20260709 12:27:31.567622 20288 leader_election.cc:304] T 2a404c53991240b7a421b0109c15e4e8 P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, 96a5d14dc9a9404b9b89c75be639ea96; no voters: 
I20260709 12:27:31.572758 20396 raft_consensus.cc:2468] T ef120bbec38f41ac88a0bdcc328a1b57 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96a5d14dc9a9404b9b89c75be639ea96 in term 1.
I20260709 12:27:31.573652 20531 raft_consensus.cc:515] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.574997 20288 leader_election.cc:304] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, 96a5d14dc9a9404b9b89c75be639ea96; no voters: af886ac503354eaa932dd7c2811c64d9
I20260709 12:27:31.571938 20563 raft_consensus.cc:515] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.576512 20466 raft_consensus.cc:2804] T 2a404c53991240b7a421b0109c15e4e8 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:31.576807 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e47cc0287004854afd0e484250aa77b" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
I20260709 12:27:31.577601 20248 raft_consensus.cc:3060] T 8e47cc0287004854afd0e484250aa77b P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.578769 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8684f3955d41d1bd701a5f93b4d8d0" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
I20260709 12:27:31.579377 20322 raft_consensus.cc:3060] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.576875 20466 raft_consensus.cc:493] T 2a404c53991240b7a421b0109c15e4e8 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:31.582753 20466 raft_consensus.cc:3060] T 2a404c53991240b7a421b0109c15e4e8 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.587178 20322 raft_consensus.cc:2468] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af886ac503354eaa932dd7c2811c64d9 in term 1.
I20260709 12:27:31.588609 20212 leader_election.cc:304] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96a5d14dc9a9404b9b89c75be639ea96, af886ac503354eaa932dd7c2811c64d9; no voters: 
I20260709 12:27:31.589680 20560 raft_consensus.cc:2804] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:31.590209 20560 raft_consensus.cc:697] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9 [term 1 LEADER]: Becoming Leader. State: Replica: af886ac503354eaa932dd7c2811c64d9, State: Running, Role: LEADER
I20260709 12:27:31.591054 20560 consensus_queue.cc:237] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.529031 20543 raft_consensus.cc:740] T 2a404c53991240b7a421b0109c15e4e8 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af886ac503354eaa932dd7c2811c64d9, State: Initialized, Role: FOLLOWER
W20260709 12:27:31.593999 20363 leader_election.cc:343] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:31.595288 20531 leader_election.cc:290] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 election: Requested vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:31.595775 20563 leader_election.cc:290] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 election: Requested vote from peers 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:31.550585 20397 raft_consensus.cc:2468] T 1e3e7383d2d9471c8e3042879c895f2d P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af886ac503354eaa932dd7c2811c64d9 in term 1.
I20260709 12:27:31.573167 20323 raft_consensus.cc:2468] T 136d326496ce4211bf0879ec5c0e9705 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 1.
I20260709 12:27:31.596807 20531 raft_consensus.cc:2804] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:31.598361 20531 raft_consensus.cc:697] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 LEADER]: Becoming Leader. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Running, Role: LEADER
I20260709 12:27:31.600733 20531 consensus_queue.cc:237] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.597437 20543 consensus_queue.cc:260] T 2a404c53991240b7a421b0109c15e4e8 P af886ac503354eaa932dd7c2811c64d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.593904 20396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8684f3955d41d1bd701a5f93b4d8d0" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aee883f265544bd9c7b9502e590182c"
I20260709 12:27:31.596283 20445 raft_consensus.cc:515] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.599586 20213 leader_election.cc:304] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, af886ac503354eaa932dd7c2811c64d9; no voters: 96a5d14dc9a9404b9b89c75be639ea96
I20260709 12:27:31.602718 20361 leader_election.cc:304] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, 96a5d14dc9a9404b9b89c75be639ea96; no voters: af886ac503354eaa932dd7c2811c64d9
I20260709 12:27:31.604045 20563 raft_consensus.cc:2804] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:31.604297 20570 raft_consensus.cc:2804] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:31.604743 20563 raft_consensus.cc:697] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [term 1 LEADER]: Becoming Leader. State: Replica: af886ac503354eaa932dd7c2811c64d9, State: Running, Role: LEADER
I20260709 12:27:31.602842 20247 raft_consensus.cc:2468] T 2a404c53991240b7a421b0109c15e4e8 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96a5d14dc9a9404b9b89c75be639ea96 in term 0.
I20260709 12:27:31.605778 20563 consensus_queue.cc:237] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.607877 20570 raft_consensus.cc:697] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Becoming Leader. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Running, Role: LEADER
I20260709 12:27:31.608999 20570 consensus_queue.cc:237] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.611083 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2117b13035b64ae495334d59cd083a34" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
I20260709 12:27:31.611531 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2117b13035b64ae495334d59cd083a34" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
I20260709 12:27:31.612180 20247 raft_consensus.cc:3060] T 2117b13035b64ae495334d59cd083a34 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:31.612676 20361 leader_election.cc:343] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:31.614320 20543 ts_tablet_manager.cc:1434] T 2a404c53991240b7a421b0109c15e4e8 P af886ac503354eaa932dd7c2811c64d9: Time spent starting tablet: real 0.090s	user 0.009s	sys 0.002s
I20260709 12:27:31.615604 20543 tablet_bootstrap.cc:492] T ef120bbec38f41ac88a0bdcc328a1b57 P af886ac503354eaa932dd7c2811c64d9: Bootstrap starting.
I20260709 12:27:31.602669 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e47cc0287004854afd0e484250aa77b" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aee883f265544bd9c7b9502e590182c"
I20260709 12:27:31.620559 20247 raft_consensus.cc:2468] T 2117b13035b64ae495334d59cd083a34 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 1.
W20260709 12:27:31.621945 20288 leader_election.cc:343] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:31.624593 20445 leader_election.cc:290] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 election: Requested vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607)
I20260709 12:27:31.626263 20363 leader_election.cc:304] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, af886ac503354eaa932dd7c2811c64d9; no voters: 96a5d14dc9a9404b9b89c75be639ea96
I20260709 12:27:31.627691 20445 raft_consensus.cc:2804] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:31.634825 20543 tablet_bootstrap.cc:654] T ef120bbec38f41ac88a0bdcc328a1b57 P af886ac503354eaa932dd7c2811c64d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.635516 20145 catalog_manager.cc:5697] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "96a5d14dc9a9404b9b89c75be639ea96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:31.639599 20466 raft_consensus.cc:515] T 2a404c53991240b7a421b0109c15e4e8 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.635720 20396 raft_consensus.cc:3060] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.643210 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a404c53991240b7a421b0109c15e4e8" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
I20260709 12:27:31.644112 20247 raft_consensus.cc:3060] T 2a404c53991240b7a421b0109c15e4e8 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.636224 20142 catalog_manager.cc:5697] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6aee883f265544bd9c7b9502e590182c (127.9.145.195). New cstate: current_term: 1 leader_uuid: "6aee883f265544bd9c7b9502e590182c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:31.649470 20543 tablet_bootstrap.cc:492] T ef120bbec38f41ac88a0bdcc328a1b57 P af886ac503354eaa932dd7c2811c64d9: No bootstrap required, opened a new log
I20260709 12:27:31.650230 20543 ts_tablet_manager.cc:1403] T ef120bbec38f41ac88a0bdcc328a1b57 P af886ac503354eaa932dd7c2811c64d9: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.001s
I20260709 12:27:31.655128 20543 raft_consensus.cc:359] T ef120bbec38f41ac88a0bdcc328a1b57 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.655980 20543 raft_consensus.cc:385] T ef120bbec38f41ac88a0bdcc328a1b57 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.656349 20543 raft_consensus.cc:740] T ef120bbec38f41ac88a0bdcc328a1b57 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af886ac503354eaa932dd7c2811c64d9, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.657166 20543 consensus_queue.cc:260] T ef120bbec38f41ac88a0bdcc328a1b57 P af886ac503354eaa932dd7c2811c64d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.628213 20445 raft_consensus.cc:697] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Becoming Leader. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Running, Role: LEADER
I20260709 12:27:31.662774 20445 consensus_queue.cc:237] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.661053 20145 catalog_manager.cc:5697] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to af886ac503354eaa932dd7c2811c64d9 (127.9.145.193). New cstate: current_term: 1 leader_uuid: "af886ac503354eaa932dd7c2811c64d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:31.664883 20543 ts_tablet_manager.cc:1434] T ef120bbec38f41ac88a0bdcc328a1b57 P af886ac503354eaa932dd7c2811c64d9: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:27:31.590992 20248 raft_consensus.cc:2468] T 8e47cc0287004854afd0e484250aa77b P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96a5d14dc9a9404b9b89c75be639ea96 in term 1.
I20260709 12:27:31.667572 20543 tablet_bootstrap.cc:492] T 136d326496ce4211bf0879ec5c0e9705 P af886ac503354eaa932dd7c2811c64d9: Bootstrap starting.
I20260709 12:27:31.668619 20289 leader_election.cc:304] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96a5d14dc9a9404b9b89c75be639ea96, af886ac503354eaa932dd7c2811c64d9; no voters: 6aee883f265544bd9c7b9502e590182c
I20260709 12:27:31.670034 20531 raft_consensus.cc:2804] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:31.670634 20531 raft_consensus.cc:697] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 LEADER]: Becoming Leader. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Running, Role: LEADER
I20260709 12:27:31.671533 20531 consensus_queue.cc:237] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.677461 20543 tablet_bootstrap.cc:654] T 136d326496ce4211bf0879ec5c0e9705 P af886ac503354eaa932dd7c2811c64d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.677563 20546 tablet_bootstrap.cc:492] T 8e47cc0287004854afd0e484250aa77b P 6aee883f265544bd9c7b9502e590182c: No bootstrap required, opened a new log
I20260709 12:27:31.678324 20546 ts_tablet_manager.cc:1403] T 8e47cc0287004854afd0e484250aa77b P 6aee883f265544bd9c7b9502e590182c: Time spent bootstrapping tablet: real 0.150s	user 0.043s	sys 0.090s
I20260709 12:27:31.680289 20247 raft_consensus.cc:2468] T 2a404c53991240b7a421b0109c15e4e8 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96a5d14dc9a9404b9b89c75be639ea96 in term 1.
I20260709 12:27:31.681739 20396 raft_consensus.cc:2468] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af886ac503354eaa932dd7c2811c64d9 in term 1.
I20260709 12:27:31.681869 20546 raft_consensus.cc:359] T 8e47cc0287004854afd0e484250aa77b P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.682627 20546 raft_consensus.cc:385] T 8e47cc0287004854afd0e484250aa77b P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.682926 20546 raft_consensus.cc:740] T 8e47cc0287004854afd0e484250aa77b P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.683712 20546 consensus_queue.cc:260] T 8e47cc0287004854afd0e484250aa77b P 6aee883f265544bd9c7b9502e590182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.686272 20546 ts_tablet_manager.cc:1434] T 8e47cc0287004854afd0e484250aa77b P 6aee883f265544bd9c7b9502e590182c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:27:31.686811 20544 tablet_bootstrap.cc:654] T 1e3e7383d2d9471c8e3042879c895f2d P 96a5d14dc9a9404b9b89c75be639ea96: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.690806 20289 leader_election.cc:304] T 2a404c53991240b7a421b0109c15e4e8 P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96a5d14dc9a9404b9b89c75be639ea96, af886ac503354eaa932dd7c2811c64d9; no voters: 
I20260709 12:27:31.695279 20466 leader_election.cc:290] T 2a404c53991240b7a421b0109c15e4e8 P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 election: Requested vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:31.696656 20396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a404c53991240b7a421b0109c15e4e8" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aee883f265544bd9c7b9502e590182c"
I20260709 12:27:31.694603 20531 raft_consensus.cc:2804] T 2a404c53991240b7a421b0109c15e4e8 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:31.698724 20531 raft_consensus.cc:697] T 2a404c53991240b7a421b0109c15e4e8 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 LEADER]: Becoming Leader. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Running, Role: LEADER
I20260709 12:27:31.700469 20531 consensus_queue.cc:237] T 2a404c53991240b7a421b0109c15e4e8 P 96a5d14dc9a9404b9b89c75be639ea96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.700564 20396 raft_consensus.cc:3060] T 2a404c53991240b7a421b0109c15e4e8 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.710247 20145 catalog_manager.cc:5697] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to af886ac503354eaa932dd7c2811c64d9 (127.9.145.193). New cstate: current_term: 1 leader_uuid: "af886ac503354eaa932dd7c2811c64d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:31.712293 20396 raft_consensus.cc:2468] T 2a404c53991240b7a421b0109c15e4e8 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96a5d14dc9a9404b9b89c75be639ea96 in term 1.
I20260709 12:27:31.714669 20142 catalog_manager.cc:5697] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "96a5d14dc9a9404b9b89c75be639ea96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:31.723536 20543 tablet_bootstrap.cc:492] T 136d326496ce4211bf0879ec5c0e9705 P af886ac503354eaa932dd7c2811c64d9: No bootstrap required, opened a new log
I20260709 12:27:31.724195 20543 ts_tablet_manager.cc:1403] T 136d326496ce4211bf0879ec5c0e9705 P af886ac503354eaa932dd7c2811c64d9: Time spent bootstrapping tablet: real 0.057s	user 0.009s	sys 0.014s
I20260709 12:27:31.724643 20143 catalog_manager.cc:5697] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6aee883f265544bd9c7b9502e590182c (127.9.145.195). New cstate: current_term: 1 leader_uuid: "6aee883f265544bd9c7b9502e590182c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:31.726784 20543 raft_consensus.cc:359] T 136d326496ce4211bf0879ec5c0e9705 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.727465 20543 raft_consensus.cc:385] T 136d326496ce4211bf0879ec5c0e9705 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.727738 20543 raft_consensus.cc:740] T 136d326496ce4211bf0879ec5c0e9705 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af886ac503354eaa932dd7c2811c64d9, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.728978 20543 consensus_queue.cc:260] T 136d326496ce4211bf0879ec5c0e9705 P af886ac503354eaa932dd7c2811c64d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.730998 20543 ts_tablet_manager.cc:1434] T 136d326496ce4211bf0879ec5c0e9705 P af886ac503354eaa932dd7c2811c64d9: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:27:31.732302 20543 tablet_bootstrap.cc:492] T fa9bbb303135401db12c664b196ac0d9 P af886ac503354eaa932dd7c2811c64d9: Bootstrap starting.
I20260709 12:27:31.739243 20543 tablet_bootstrap.cc:654] T fa9bbb303135401db12c664b196ac0d9 P af886ac503354eaa932dd7c2811c64d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.739321 20544 tablet_bootstrap.cc:492] T 1e3e7383d2d9471c8e3042879c895f2d P 96a5d14dc9a9404b9b89c75be639ea96: No bootstrap required, opened a new log
I20260709 12:27:31.740017 20544 ts_tablet_manager.cc:1403] T 1e3e7383d2d9471c8e3042879c895f2d P 96a5d14dc9a9404b9b89c75be639ea96: Time spent bootstrapping tablet: real 0.193s	user 0.012s	sys 0.007s
I20260709 12:27:31.740571 20145 catalog_manager.cc:5697] T 2a404c53991240b7a421b0109c15e4e8 P 96a5d14dc9a9404b9b89c75be639ea96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194). New cstate: current_term: 1 leader_uuid: "96a5d14dc9a9404b9b89c75be639ea96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:31.742796 20544 raft_consensus.cc:359] T 1e3e7383d2d9471c8e3042879c895f2d P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.743546 20544 raft_consensus.cc:385] T 1e3e7383d2d9471c8e3042879c895f2d P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.743834 20544 raft_consensus.cc:740] T 1e3e7383d2d9471c8e3042879c895f2d P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.744661 20544 consensus_queue.cc:260] T 1e3e7383d2d9471c8e3042879c895f2d P 96a5d14dc9a9404b9b89c75be639ea96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.747066 20544 ts_tablet_manager.cc:1434] T 1e3e7383d2d9471c8e3042879c895f2d P 96a5d14dc9a9404b9b89c75be639ea96: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:27:31.732290 20560 raft_consensus.cc:493] T ef120bbec38f41ac88a0bdcc328a1b57 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.748111 20544 tablet_bootstrap.cc:492] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96: Bootstrap starting.
I20260709 12:27:31.747963 20560 raft_consensus.cc:515] T ef120bbec38f41ac88a0bdcc328a1b57 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.751892 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef120bbec38f41ac88a0bdcc328a1b57" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96" is_pre_election: true
I20260709 12:27:31.753525 20543 tablet_bootstrap.cc:492] T fa9bbb303135401db12c664b196ac0d9 P af886ac503354eaa932dd7c2811c64d9: No bootstrap required, opened a new log
I20260709 12:27:31.753782 20560 leader_election.cc:290] T ef120bbec38f41ac88a0bdcc328a1b57 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:31.754146 20543 ts_tablet_manager.cc:1403] T fa9bbb303135401db12c664b196ac0d9 P af886ac503354eaa932dd7c2811c64d9: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.005s
I20260709 12:27:31.753477 20396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef120bbec38f41ac88a0bdcc328a1b57" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aee883f265544bd9c7b9502e590182c" is_pre_election: true
I20260709 12:27:31.754918 20544 tablet_bootstrap.cc:654] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.756431 20543 raft_consensus.cc:359] T fa9bbb303135401db12c664b196ac0d9 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.757040 20543 raft_consensus.cc:385] T fa9bbb303135401db12c664b196ac0d9 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.757310 20543 raft_consensus.cc:740] T fa9bbb303135401db12c664b196ac0d9 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af886ac503354eaa932dd7c2811c64d9, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.755002 20396 raft_consensus.cc:2393] T ef120bbec38f41ac88a0bdcc328a1b57 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af886ac503354eaa932dd7c2811c64d9 in current term 1: Already voted for candidate 96a5d14dc9a9404b9b89c75be639ea96 in this term.
I20260709 12:27:31.758000 20543 consensus_queue.cc:260] T fa9bbb303135401db12c664b196ac0d9 P af886ac503354eaa932dd7c2811c64d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.759222 20213 leader_election.cc:304] T ef120bbec38f41ac88a0bdcc328a1b57 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af886ac503354eaa932dd7c2811c64d9; no voters: 6aee883f265544bd9c7b9502e590182c, 96a5d14dc9a9404b9b89c75be639ea96
I20260709 12:27:31.760293 20543 ts_tablet_manager.cc:1434] T fa9bbb303135401db12c664b196ac0d9 P af886ac503354eaa932dd7c2811c64d9: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 12:27:31.760721 20479 raft_consensus.cc:3060] T ef120bbec38f41ac88a0bdcc328a1b57 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.766353 20544 tablet_bootstrap.cc:492] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96: No bootstrap required, opened a new log
I20260709 12:27:31.766973 20544 ts_tablet_manager.cc:1403] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 12:27:31.768689 20445 raft_consensus.cc:493] T 8e47cc0287004854afd0e484250aa77b P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.769361 20445 raft_consensus.cc:515] T 8e47cc0287004854afd0e484250aa77b P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.769930 20544 raft_consensus.cc:359] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.770761 20544 raft_consensus.cc:385] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.771039 20544 raft_consensus.cc:740] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.771946 20445 leader_election.cc:290] T 8e47cc0287004854afd0e484250aa77b P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607)
I20260709 12:27:31.773048 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e47cc0287004854afd0e484250aa77b" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96" is_pre_election: true
I20260709 12:27:31.771793 20544 consensus_queue.cc:260] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.772970 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e47cc0287004854afd0e484250aa77b" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9" is_pre_election: true
I20260709 12:27:31.775223 20247 raft_consensus.cc:2393] T 8e47cc0287004854afd0e484250aa77b P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6aee883f265544bd9c7b9502e590182c in current term 1: Already voted for candidate 96a5d14dc9a9404b9b89c75be639ea96 in this term.
I20260709 12:27:31.775741 20544 ts_tablet_manager.cc:1434] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:27:31.776562 20363 leader_election.cc:304] T 8e47cc0287004854afd0e484250aa77b P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c; no voters: 96a5d14dc9a9404b9b89c75be639ea96, af886ac503354eaa932dd7c2811c64d9
I20260709 12:27:31.778190 20445 raft_consensus.cc:3060] T 8e47cc0287004854afd0e484250aa77b P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.778623 20479 raft_consensus.cc:2749] T ef120bbec38f41ac88a0bdcc328a1b57 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:31.784196 20560 raft_consensus.cc:493] T fa9bbb303135401db12c664b196ac0d9 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.784917 20560 raft_consensus.cc:515] T fa9bbb303135401db12c664b196ac0d9 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.786644 20445 raft_consensus.cc:2749] T 8e47cc0287004854afd0e484250aa77b P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:31.788257 20396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9bbb303135401db12c664b196ac0d9" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aee883f265544bd9c7b9502e590182c" is_pre_election: true
I20260709 12:27:31.788203 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9bbb303135401db12c664b196ac0d9" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96" is_pre_election: true
I20260709 12:27:31.790313 20396 raft_consensus.cc:2468] T fa9bbb303135401db12c664b196ac0d9 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af886ac503354eaa932dd7c2811c64d9 in term 0.
I20260709 12:27:31.790354 20323 raft_consensus.cc:2468] T fa9bbb303135401db12c664b196ac0d9 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af886ac503354eaa932dd7c2811c64d9 in term 0.
I20260709 12:27:31.791865 20213 leader_election.cc:304] T fa9bbb303135401db12c664b196ac0d9 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, af886ac503354eaa932dd7c2811c64d9; no voters: 
I20260709 12:27:31.792446 20560 leader_election.cc:290] T fa9bbb303135401db12c664b196ac0d9 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:31.792898 20563 raft_consensus.cc:2804] T fa9bbb303135401db12c664b196ac0d9 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:31.793354 20563 raft_consensus.cc:493] T fa9bbb303135401db12c664b196ac0d9 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:31.793700 20563 raft_consensus.cc:3060] T fa9bbb303135401db12c664b196ac0d9 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.799778 20563 raft_consensus.cc:515] T fa9bbb303135401db12c664b196ac0d9 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.801766 20563 leader_election.cc:290] T fa9bbb303135401db12c664b196ac0d9 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 election: Requested vote from peers 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:31.802477 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9bbb303135401db12c664b196ac0d9" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
I20260709 12:27:31.802821 20396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9bbb303135401db12c664b196ac0d9" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aee883f265544bd9c7b9502e590182c"
I20260709 12:27:31.803196 20323 raft_consensus.cc:3060] T fa9bbb303135401db12c664b196ac0d9 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.803551 20396 raft_consensus.cc:3060] T fa9bbb303135401db12c664b196ac0d9 P 6aee883f265544bd9c7b9502e590182c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.811355 20396 raft_consensus.cc:2468] T fa9bbb303135401db12c664b196ac0d9 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af886ac503354eaa932dd7c2811c64d9 in term 1.
I20260709 12:27:31.811355 20323 raft_consensus.cc:2468] T fa9bbb303135401db12c664b196ac0d9 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af886ac503354eaa932dd7c2811c64d9 in term 1.
I20260709 12:27:31.812775 20213 leader_election.cc:304] T fa9bbb303135401db12c664b196ac0d9 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, af886ac503354eaa932dd7c2811c64d9; no voters: 
I20260709 12:27:31.813009 20563 consensus_queue.cc:1048] T 16c22ea0116a4af0b3e16931acab8e68 P af886ac503354eaa932dd7c2811c64d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:31.813483 20479 raft_consensus.cc:2804] T fa9bbb303135401db12c664b196ac0d9 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:31.813941 20479 raft_consensus.cc:697] T fa9bbb303135401db12c664b196ac0d9 P af886ac503354eaa932dd7c2811c64d9 [term 1 LEADER]: Becoming Leader. State: Replica: af886ac503354eaa932dd7c2811c64d9, State: Running, Role: LEADER
I20260709 12:27:31.814733 20479 consensus_queue.cc:237] T fa9bbb303135401db12c664b196ac0d9 P af886ac503354eaa932dd7c2811c64d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:31.835137 20479 consensus_queue.cc:1048] T 16c22ea0116a4af0b3e16931acab8e68 P af886ac503354eaa932dd7c2811c64d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:31.839134 20142 catalog_manager.cc:5697] T fa9bbb303135401db12c664b196ac0d9 P af886ac503354eaa932dd7c2811c64d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to af886ac503354eaa932dd7c2811c64d9 (127.9.145.193). New cstate: current_term: 1 leader_uuid: "af886ac503354eaa932dd7c2811c64d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:31.939172 20397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "136d326496ce4211bf0879ec5c0e9705"
dest_uuid: "6aee883f265544bd9c7b9502e590182c"
mode: GRACEFUL
new_leader_uuid: "af886ac503354eaa932dd7c2811c64d9"
 from {username='slave'} at 127.0.0.1:55256
I20260709 12:27:31.939757 20397 raft_consensus.cc:606] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Received request to transfer leadership to TS af886ac503354eaa932dd7c2811c64d9
I20260709 12:27:31.956022 20397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2117b13035b64ae495334d59cd083a34"
dest_uuid: "6aee883f265544bd9c7b9502e590182c"
mode: GRACEFUL
new_leader_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
 from {username='slave'} at 127.0.0.1:55256
I20260709 12:27:31.956522 20397 raft_consensus.cc:606] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Received request to transfer leadership to TS 96a5d14dc9a9404b9b89c75be639ea96
I20260709 12:27:31.970686 20247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a8684f3955d41d1bd701a5f93b4d8d0"
dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
mode: GRACEFUL
new_leader_uuid: "6aee883f265544bd9c7b9502e590182c"
 from {username='slave'} at 127.0.0.1:57504
I20260709 12:27:31.971204 20247 raft_consensus.cc:606] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9 [term 1 LEADER]: Received request to transfer leadership to TS 6aee883f265544bd9c7b9502e590182c
I20260709 12:27:31.986963 20466 consensus_queue.cc:1048] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:31.998402 20531 consensus_queue.cc:1048] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:32.012322 20531 raft_consensus.cc:493] T 1e3e7383d2d9471c8e3042879c895f2d P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.012818 20531 raft_consensus.cc:515] T 1e3e7383d2d9471c8e3042879c895f2d P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:32.014951 20531 leader_election.cc:290] T 1e3e7383d2d9471c8e3042879c895f2d P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:32.015544 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3e7383d2d9471c8e3042879c895f2d" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9" is_pre_election: true
I20260709 12:27:32.016186 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3e7383d2d9471c8e3042879c895f2d" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aee883f265544bd9c7b9502e590182c" is_pre_election: true
I20260709 12:27:32.016899 20397 raft_consensus.cc:2393] T 1e3e7383d2d9471c8e3042879c895f2d P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96a5d14dc9a9404b9b89c75be639ea96 in current term 1: Already voted for candidate af886ac503354eaa932dd7c2811c64d9 in this term.
I20260709 12:27:32.017849 20288 leader_election.cc:304] T 1e3e7383d2d9471c8e3042879c895f2d P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96a5d14dc9a9404b9b89c75be639ea96; no voters: 6aee883f265544bd9c7b9502e590182c, af886ac503354eaa932dd7c2811c64d9
I20260709 12:27:32.018558 20531 raft_consensus.cc:3060] T 1e3e7383d2d9471c8e3042879c895f2d P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:32.020464 20479 consensus_queue.cc:1048] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:32.021312 20601 raft_consensus.cc:493] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.021780 20601 raft_consensus.cc:515] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:32.024765 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2117b13035b64ae495334d59cd083a34" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af886ac503354eaa932dd7c2811c64d9" is_pre_election: true
I20260709 12:27:32.025383 20247 raft_consensus.cc:2393] T 2117b13035b64ae495334d59cd083a34 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96a5d14dc9a9404b9b89c75be639ea96 in current term 1: Already voted for candidate 6aee883f265544bd9c7b9502e590182c in this term.
I20260709 12:27:32.026283 20531 raft_consensus.cc:2749] T 1e3e7383d2d9471c8e3042879c895f2d P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:32.027338 20601 leader_election.cc:290] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:32.027599 20396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2117b13035b64ae495334d59cd083a34" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aee883f265544bd9c7b9502e590182c" is_pre_election: true
I20260709 12:27:32.029271 20288 leader_election.cc:304] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96a5d14dc9a9404b9b89c75be639ea96; no voters: 6aee883f265544bd9c7b9502e590182c, af886ac503354eaa932dd7c2811c64d9
I20260709 12:27:32.030223 20575 raft_consensus.cc:3060] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:32.030571 20592 raft_consensus.cc:993] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9: : Instructing follower 6aee883f265544bd9c7b9502e590182c to start an election
I20260709 12:27:32.031083 20592 raft_consensus.cc:1081] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9 [term 1 LEADER]: Signalling peer 6aee883f265544bd9c7b9502e590182c to start an election
I20260709 12:27:32.033241 20395 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a8684f3955d41d1bd701a5f93b4d8d0"
dest_uuid: "6aee883f265544bd9c7b9502e590182c"
 from {username='slave'} at 127.0.0.1:55250
I20260709 12:27:32.033903 20395 raft_consensus.cc:493] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:32.034322 20395 raft_consensus.cc:3060] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:32.038623 20575 raft_consensus.cc:2749] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:32.043885 20479 consensus_queue.cc:1048] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:32.044485 20395 raft_consensus.cc:515] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:32.048434 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8684f3955d41d1bd701a5f93b4d8d0" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
I20260709 12:27:32.049522 20247 raft_consensus.cc:3055] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:32.049875 20247 raft_consensus.cc:740] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af886ac503354eaa932dd7c2811c64d9, State: Running, Role: LEADER
I20260709 12:27:32.050827 20247 consensus_queue.cc:260] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:32.051842 20247 raft_consensus.cc:3060] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:32.056118 20395 leader_election.cc:290] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 2 election: Requested vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607)
I20260709 12:27:32.058439 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8684f3955d41d1bd701a5f93b4d8d0" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
I20260709 12:27:32.059026 20322 raft_consensus.cc:3060] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:32.061808 20247 raft_consensus.cc:2468] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 2.
I20260709 12:27:32.063148 20363 leader_election.cc:304] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, af886ac503354eaa932dd7c2811c64d9; no voters: 
I20260709 12:27:32.063905 20445 raft_consensus.cc:2804] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:32.064363 20445 raft_consensus.cc:697] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 6aee883f265544bd9c7b9502e590182c [term 2 LEADER]: Becoming Leader. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Running, Role: LEADER
I20260709 12:27:32.065092 20445 consensus_queue.cc:237] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:32.067572 20322 raft_consensus.cc:2468] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 2.
I20260709 12:27:32.072324 20143 catalog_manager.cc:5697] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 6aee883f265544bd9c7b9502e590182c reported cstate change: term changed from 1 to 2, leader changed from af886ac503354eaa932dd7c2811c64d9 (127.9.145.193) to 6aee883f265544bd9c7b9502e590182c (127.9.145.195). New cstate: current_term: 2 leader_uuid: "6aee883f265544bd9c7b9502e590182c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:32.101251 20575 consensus_queue.cc:1048] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:32.103931 20479 consensus_queue.cc:1048] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:32.104105 20577 consensus_queue.cc:1048] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Connected to new peer: Peer: permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:32.122308 20560 consensus_queue.cc:1048] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:32.128582 20601 consensus_queue.cc:1048] T 2a404c53991240b7a421b0109c15e4e8 P 96a5d14dc9a9404b9b89c75be639ea96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:32.125602 20575 consensus_queue.cc:1048] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:27:32.135521 20570 raft_consensus.cc:993] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c: : Instructing follower 96a5d14dc9a9404b9b89c75be639ea96 to start an election
I20260709 12:27:32.136041 20570 raft_consensus.cc:1081] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Signalling peer 96a5d14dc9a9404b9b89c75be639ea96 to start an election
I20260709 12:27:32.142441 20445 consensus_queue.cc:1048] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Connected to new peer: Peer: permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:32.144568 20321 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2117b13035b64ae495334d59cd083a34"
dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
 from {username='slave'} at 127.0.0.1:52696
I20260709 12:27:32.145529 20321 raft_consensus.cc:493] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:32.145952 20321 raft_consensus.cc:3060] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:32.169134 20247 raft_consensus.cc:3060] T 136d326496ce4211bf0879ec5c0e9705 P af886ac503354eaa932dd7c2811c64d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:32.172377 20321 raft_consensus.cc:515] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:32.176141 20466 consensus_queue.cc:1048] T 2a404c53991240b7a421b0109c15e4e8 P 96a5d14dc9a9404b9b89c75be639ea96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:32.179000 20321 leader_election.cc:290] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 2 election: Requested vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:32.180271 20395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2117b13035b64ae495334d59cd083a34" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6aee883f265544bd9c7b9502e590182c"
I20260709 12:27:32.181000 20395 raft_consensus.cc:3055] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:32.179000 20246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2117b13035b64ae495334d59cd083a34" candidate_uuid: "96a5d14dc9a9404b9b89c75be639ea96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
I20260709 12:27:32.181325 20395 raft_consensus.cc:740] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Running, Role: LEADER
I20260709 12:27:32.185168 20395 consensus_queue.cc:260] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:32.186463 20395 raft_consensus.cc:3060] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:32.194532 20445 consensus_queue.cc:1048] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Connected to new peer: Peer: permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:32.202693 20395 raft_consensus.cc:2468] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96a5d14dc9a9404b9b89c75be639ea96 in term 2.
I20260709 12:27:32.204176 20288 leader_election.cc:304] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, 96a5d14dc9a9404b9b89c75be639ea96; no voters: af886ac503354eaa932dd7c2811c64d9
I20260709 12:27:32.204998 20601 raft_consensus.cc:2804] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:32.205511 20601 raft_consensus.cc:697] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 LEADER]: Becoming Leader. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Running, Role: LEADER
I20260709 12:27:32.206372 20601 consensus_queue.cc:237] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:32.213533 20143 catalog_manager.cc:5697] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96 reported cstate change: term changed from 1 to 2, leader changed from 6aee883f265544bd9c7b9502e590182c (127.9.145.195) to 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194). New cstate: current_term: 2 leader_uuid: "96a5d14dc9a9404b9b89c75be639ea96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:32.215119 20577 raft_consensus.cc:993] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c: : Instructing follower af886ac503354eaa932dd7c2811c64d9 to start an election
I20260709 12:27:32.215658 20577 raft_consensus.cc:1081] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Signalling peer af886ac503354eaa932dd7c2811c64d9 to start an election
I20260709 12:27:32.220662 20248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "136d326496ce4211bf0879ec5c0e9705"
dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
 from {username='slave'} at 127.0.0.1:50156
I20260709 12:27:32.221295 20248 raft_consensus.cc:493] T 136d326496ce4211bf0879ec5c0e9705 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:32.221701 20248 raft_consensus.cc:3060] T 136d326496ce4211bf0879ec5c0e9705 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:32.222321 20577 consensus_queue.cc:1048] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Connected to new peer: Peer: permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:32.233750 20248 raft_consensus.cc:515] T 136d326496ce4211bf0879ec5c0e9705 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:32.234933 20247 raft_consensus.cc:1240] T 136d326496ce4211bf0879ec5c0e9705 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Rejecting Update request from peer 6aee883f265544bd9c7b9502e590182c for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:32.237008 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136d326496ce4211bf0879ec5c0e9705" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
I20260709 12:27:32.237329 20395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136d326496ce4211bf0879ec5c0e9705" candidate_uuid: "af886ac503354eaa932dd7c2811c64d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6aee883f265544bd9c7b9502e590182c"
I20260709 12:27:32.237732 20321 raft_consensus.cc:3060] T 136d326496ce4211bf0879ec5c0e9705 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:32.238700 20577 consensus_queue.cc:1059] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:32.239643 20395 raft_consensus.cc:3055] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:32.240017 20395 raft_consensus.cc:740] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Running, Role: LEADER
I20260709 12:27:32.240886 20395 consensus_queue.cc:260] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:32.242084 20395 raft_consensus.cc:3060] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:32.238876 20248 leader_election.cc:290] T 136d326496ce4211bf0879ec5c0e9705 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 2 election: Requested vote from peers 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607), 6aee883f265544bd9c7b9502e590182c (127.9.145.195:42747)
I20260709 12:27:32.246043 20321 raft_consensus.cc:2468] T 136d326496ce4211bf0879ec5c0e9705 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af886ac503354eaa932dd7c2811c64d9 in term 2.
I20260709 12:27:32.247247 20212 leader_election.cc:304] T 136d326496ce4211bf0879ec5c0e9705 P af886ac503354eaa932dd7c2811c64d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96a5d14dc9a9404b9b89c75be639ea96, af886ac503354eaa932dd7c2811c64d9; no voters: 
I20260709 12:27:32.247972 20592 raft_consensus.cc:2804] T 136d326496ce4211bf0879ec5c0e9705 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:32.248474 20592 raft_consensus.cc:697] T 136d326496ce4211bf0879ec5c0e9705 P af886ac503354eaa932dd7c2811c64d9 [term 2 LEADER]: Becoming Leader. State: Replica: af886ac503354eaa932dd7c2811c64d9, State: Running, Role: LEADER
I20260709 12:27:32.249302 20592 consensus_queue.cc:237] T 136d326496ce4211bf0879ec5c0e9705 P af886ac503354eaa932dd7c2811c64d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:32.249967 20395 raft_consensus.cc:2468] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af886ac503354eaa932dd7c2811c64d9 in term 2.
W20260709 12:27:32.250706 20577 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:27:32.257792 20142 catalog_manager.cc:5697] T 136d326496ce4211bf0879ec5c0e9705 P af886ac503354eaa932dd7c2811c64d9 reported cstate change: term changed from 1 to 2, leader changed from 6aee883f265544bd9c7b9502e590182c (127.9.145.195) to af886ac503354eaa932dd7c2811c64d9 (127.9.145.193). New cstate: current_term: 2 leader_uuid: "af886ac503354eaa932dd7c2811c64d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:32.363353 20592 consensus_queue.cc:1048] T fa9bbb303135401db12c664b196ac0d9 P af886ac503354eaa932dd7c2811c64d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:32.374886 20592 consensus_queue.cc:1048] T fa9bbb303135401db12c664b196ac0d9 P af886ac503354eaa932dd7c2811c64d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:32.524034 20321 raft_consensus.cc:1275] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Refusing update from remote peer 6aee883f265544bd9c7b9502e590182c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:32.525375 20577 consensus_queue.cc:1048] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Connected to new peer: Peer: permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:32.533566 20248 raft_consensus.cc:1275] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Refusing update from remote peer 6aee883f265544bd9c7b9502e590182c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:32.535835 20570 consensus_queue.cc:1048] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Connected to new peer: Peer: permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:32.622576 20395 raft_consensus.cc:1275] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Refusing update from remote peer 96a5d14dc9a9404b9b89c75be639ea96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:32.623914 20601 consensus_queue.cc:1048] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:32.631804 20247 raft_consensus.cc:3060] T 2117b13035b64ae495334d59cd083a34 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:32.639437 20247 raft_consensus.cc:1275] T 2117b13035b64ae495334d59cd083a34 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Refusing update from remote peer 96a5d14dc9a9404b9b89c75be639ea96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:32.640769 20575 consensus_queue.cc:1048] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:32.748335 20321 raft_consensus.cc:1275] T 136d326496ce4211bf0879ec5c0e9705 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Refusing update from remote peer af886ac503354eaa932dd7c2811c64d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:32.749692 20592 consensus_queue.cc:1048] T 136d326496ce4211bf0879ec5c0e9705 P af886ac503354eaa932dd7c2811c64d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:32.760371 20395 raft_consensus.cc:1275] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Refusing update from remote peer af886ac503354eaa932dd7c2811c64d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:32.762074 20560 consensus_queue.cc:1048] T 136d326496ce4211bf0879ec5c0e9705 P af886ac503354eaa932dd7c2811c64d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:34.974531 20145 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45070:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:27:34.997673 20145 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45070:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:27:35.037535  9799 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 12:27:35.182031 20637 log.cc:927] Time spent T 136d326496ce4211bf0879ec5c0e9705 P af886ac503354eaa932dd7c2811c64d9: Append to log took a long time: real 0.131s	user 0.004s	sys 0.000s
W20260709 12:27:35.229688 20646 log.cc:927] Time spent T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96: Append to log took a long time: real 0.091s	user 0.002s	sys 0.000s
W20260709 12:27:35.261080 20640 log.cc:927] Time spent T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c: Append to log took a long time: real 0.120s	user 0.002s	sys 0.000s
W20260709 12:27:35.285903 20648 log.cc:927] Time spent T 1e3e7383d2d9471c8e3042879c895f2d P 96a5d14dc9a9404b9b89c75be639ea96: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:27:35.299116 20247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e3e7383d2d9471c8e3042879c895f2d"
dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
mode: GRACEFUL
new_leader_uuid: "6aee883f265544bd9c7b9502e590182c"
 from {username='slave'} at 127.0.0.1:57512
I20260709 12:27:35.303464 20247 raft_consensus.cc:606] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [term 1 LEADER]: Received request to transfer leadership to TS 6aee883f265544bd9c7b9502e590182c
W20260709 12:27:35.312036 20644 log.cc:927] Time spent T fa9bbb303135401db12c664b196ac0d9 P af886ac503354eaa932dd7c2811c64d9: Append to log took a long time: real 0.173s	user 0.003s	sys 0.000s
W20260709 12:27:35.381146 20289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:40989, user_credentials={real_user=slave}} blocked reactor thread for 93910.3us
W20260709 12:27:35.380299 20213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:42747, user_credentials={real_user=slave}} blocked reactor thread for 88558.8us
W20260709 12:27:35.397936 20649 log.cc:927] Time spent T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
W20260709 12:27:35.399173 20661 log.cc:927] Time spent T 1e3e7383d2d9471c8e3042879c895f2d P 6aee883f265544bd9c7b9502e590182c: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:27:35.419247 20669 tablet.cc:1724] T 2a404c53991240b7a421b0109c15e4e8 P 96a5d14dc9a9404b9b89c75be639ea96: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:35.430225 20665 tablet.cc:1724] T 136d326496ce4211bf0879ec5c0e9705 P af886ac503354eaa932dd7c2811c64d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:35.433578 20670 raft_consensus.cc:993] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9: : Instructing follower 6aee883f265544bd9c7b9502e590182c to start an election
I20260709 12:27:35.435020 20668 tablet.cc:1724] T 136d326496ce4211bf0879ec5c0e9705 P 96a5d14dc9a9404b9b89c75be639ea96: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:35.436905 20349 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:136d326496ce4211bf0879ec5c0e9705)
I20260709 12:27:35.435376 20670 raft_consensus.cc:1081] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [term 1 LEADER]: Signalling peer 6aee883f265544bd9c7b9502e590182c to start an election
W20260709 12:27:35.438681 20349 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:136d326496ce4211bf0879ec5c0e9705)
I20260709 12:27:35.449826 20674 tablet.cc:1724] T 16c22ea0116a4af0b3e16931acab8e68 P af886ac503354eaa932dd7c2811c64d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:35.456507 20671 tablet.cc:1724] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:35.459604 20389 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e3e7383d2d9471c8e3042879c895f2d"
dest_uuid: "6aee883f265544bd9c7b9502e590182c"
 from {username='slave'} at 127.0.0.1:55250
W20260709 12:27:35.479605 20663 log.cc:927] Time spent T 16c22ea0116a4af0b3e16931acab8e68 P 96a5d14dc9a9404b9b89c75be639ea96: Append to log took a long time: real 0.168s	user 0.002s	sys 0.000s
W20260709 12:27:35.486886 20660 log.cc:927] Time spent T fa9bbb303135401db12c664b196ac0d9 P 6aee883f265544bd9c7b9502e590182c: Append to log took a long time: real 0.174s	user 0.005s	sys 0.005s
I20260709 12:27:35.489938 20674 tablet.cc:1724] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:35.518209 20674 tablet.cc:1724] T fa9bbb303135401db12c664b196ac0d9 P af886ac503354eaa932dd7c2811c64d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:35.476758 20676 tablet.cc:1724] T 2a404c53991240b7a421b0109c15e4e8 P 6aee883f265544bd9c7b9502e590182c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:35.584524 20680 tablet.cc:1724] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:35.599879 20681 tablet.cc:1724] T 1e3e7383d2d9471c8e3042879c895f2d P 6aee883f265544bd9c7b9502e590182c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:35.582841 20668 tablet.cc:1724] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:35.596805 20389 raft_consensus.cc:493] T 1e3e7383d2d9471c8e3042879c895f2d P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:35.614722 20683 tablet.cc:1724] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:35.614790 20389 raft_consensus.cc:3060] T 1e3e7383d2d9471c8e3042879c895f2d P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:35.624729 20423 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:136d326496ce4211bf0879ec5c0e9705)
I20260709 12:27:35.632906 20674 tablet.cc:1724] T 8e47cc0287004854afd0e484250aa77b P af886ac503354eaa932dd7c2811c64d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:35.637908 20665 tablet.cc:1724] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:35.655321 20669 tablet.cc:1724] T 1e3e7383d2d9471c8e3042879c895f2d P 96a5d14dc9a9404b9b89c75be639ea96: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:35.657655 20322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef120bbec38f41ac88a0bdcc328a1b57"
dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
mode: GRACEFUL
new_leader_uuid: "6aee883f265544bd9c7b9502e590182c"
 from {username='slave'} at 127.0.0.1:48338
I20260709 12:27:35.658514 20322 raft_consensus.cc:606] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 LEADER]: Received request to transfer leadership to TS 6aee883f265544bd9c7b9502e590182c
I20260709 12:27:35.660262  9799 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:27:35.661065  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:35.660753 20685 tablet.cc:1724] T 16c22ea0116a4af0b3e16931acab8e68 P 6aee883f265544bd9c7b9502e590182c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:35.670843 20617 raft_consensus.cc:993] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96: : Instructing follower 6aee883f265544bd9c7b9502e590182c to start an election
I20260709 12:27:35.672442 20617 raft_consensus.cc:1081] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 LEADER]: Signalling peer 6aee883f265544bd9c7b9502e590182c to start an election
I20260709 12:27:35.677286 20322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c18393b4e564bf1942046af318a06a6"
dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
mode: GRACEFUL
new_leader_uuid: "6aee883f265544bd9c7b9502e590182c"
 from {username='slave'} at 127.0.0.1:48338
I20260709 12:27:35.677987 20322 raft_consensus.cc:606] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 LEADER]: Received request to transfer leadership to TS 6aee883f265544bd9c7b9502e590182c
I20260709 12:27:35.677768 20389 raft_consensus.cc:515] T 1e3e7383d2d9471c8e3042879c895f2d P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:35.677599 20679 tablet.cc:1724] T ef120bbec38f41ac88a0bdcc328a1b57 P af886ac503354eaa932dd7c2811c64d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:35.681502 20674 tablet.cc:1724] T 2117b13035b64ae495334d59cd083a34 P af886ac503354eaa932dd7c2811c64d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:35.688097 20246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dcf6239d1db24300aa9c81e0c83e9c59"
dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
mode: GRACEFUL
new_leader_uuid: "6aee883f265544bd9c7b9502e590182c"
 from {username='slave'} at 127.0.0.1:57512
I20260709 12:27:35.688841 20246 raft_consensus.cc:606] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [term 2 LEADER]: Received request to transfer leadership to TS 6aee883f265544bd9c7b9502e590182c
I20260709 12:27:35.688706 20245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3e7383d2d9471c8e3042879c895f2d" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
I20260709 12:27:35.689594 20245 raft_consensus.cc:3055] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:35.689945 20245 raft_consensus.cc:740] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af886ac503354eaa932dd7c2811c64d9, State: Running, Role: LEADER
I20260709 12:27:35.690975  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:27:35.690840 20245 consensus_queue.cc:260] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:35.691708  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:35.692106 20245 raft_consensus.cc:3060] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:35.694736 20671 tablet.cc:1724] T 16c22ea0116a4af0b3e16931acab8e68 P 96a5d14dc9a9404b9b89c75be639ea96: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:35.699779 20680 tablet.cc:1724] T fa9bbb303135401db12c664b196ac0d9 P 6aee883f265544bd9c7b9502e590182c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:35.702225 20245 raft_consensus.cc:2468] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 2.
I20260709 12:27:35.706030 20676 tablet.cc:1724] T ef120bbec38f41ac88a0bdcc328a1b57 P 6aee883f265544bd9c7b9502e590182c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:35.720465 20685 tablet.cc:1724] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 6aee883f265544bd9c7b9502e590182c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:35.722429 20389 leader_election.cc:290] T 1e3e7383d2d9471c8e3042879c895f2d P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 2 election: Requested vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607)
I20260709 12:27:35.723598 20681 tablet.cc:1724] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:35.727741 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3e7383d2d9471c8e3042879c895f2d" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
I20260709 12:27:35.747447 20322 raft_consensus.cc:3060] T 1e3e7383d2d9471c8e3042879c895f2d P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:35.750084 20680 tablet.cc:1724] T 8e47cc0287004854afd0e484250aa77b P 6aee883f265544bd9c7b9502e590182c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:35.729058 20396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef120bbec38f41ac88a0bdcc328a1b57"
dest_uuid: "6aee883f265544bd9c7b9502e590182c"
 from {username='slave'} at 127.0.0.1:55246
I20260709 12:27:35.753700 20396 raft_consensus.cc:493] T ef120bbec38f41ac88a0bdcc328a1b57 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:35.754206 20396 raft_consensus.cc:3060] T ef120bbec38f41ac88a0bdcc328a1b57 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:35.755122 20665 tablet.cc:1724] T 2a404c53991240b7a421b0109c15e4e8 P af886ac503354eaa932dd7c2811c64d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:35.735661 20363 leader_election.cc:304] T 1e3e7383d2d9471c8e3042879c895f2d P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, af886ac503354eaa932dd7c2811c64d9; no voters: 
I20260709 12:27:35.758769 20621 raft_consensus.cc:2804] T 1e3e7383d2d9471c8e3042879c895f2d P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:35.759310 20621 raft_consensus.cc:697] T 1e3e7383d2d9471c8e3042879c895f2d P 6aee883f265544bd9c7b9502e590182c [term 2 LEADER]: Becoming Leader. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Running, Role: LEADER
I20260709 12:27:35.760188 20621 consensus_queue.cc:237] T 1e3e7383d2d9471c8e3042879c895f2d P 6aee883f265544bd9c7b9502e590182c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:35.765614 20396 raft_consensus.cc:515] T ef120bbec38f41ac88a0bdcc328a1b57 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:35.744270 20668 tablet.cc:1724] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 96a5d14dc9a9404b9b89c75be639ea96: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:35.769922 20322 raft_consensus.cc:2468] T 1e3e7383d2d9471c8e3042879c895f2d P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 2.
I20260709 12:27:35.740862 20683 tablet.cc:1724] T fa9bbb303135401db12c664b196ac0d9 P 96a5d14dc9a9404b9b89c75be639ea96: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:35.793967 20396 leader_election.cc:290] T ef120bbec38f41ac88a0bdcc328a1b57 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 2 election: Requested vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607)
I20260709 12:27:35.794890 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef120bbec38f41ac88a0bdcc328a1b57" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
I20260709 12:27:35.795603 20247 raft_consensus.cc:3060] T ef120bbec38f41ac88a0bdcc328a1b57 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:35.796037 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef120bbec38f41ac88a0bdcc328a1b57" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
I20260709 12:27:35.796693 20322 raft_consensus.cc:3055] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:35.796980 20322 raft_consensus.cc:740] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Running, Role: LEADER
I20260709 12:27:35.797772 20322 consensus_queue.cc:260] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:35.799034 20322 raft_consensus.cc:3060] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:35.799172 20143 catalog_manager.cc:6242] T 00000000000000000000000000000000 P c808b56815f647bbb9c50fb470b7255a: soft_deleted_table [id=3b770ba369194800bea0896803e65088] alter complete (version 1)
I20260709 12:27:35.803875 20247 raft_consensus.cc:2468] T ef120bbec38f41ac88a0bdcc328a1b57 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 2.
I20260709 12:27:35.805164 20363 leader_election.cc:304] T ef120bbec38f41ac88a0bdcc328a1b57 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, af886ac503354eaa932dd7c2811c64d9; no voters: 
I20260709 12:27:35.806320 20621 raft_consensus.cc:2804] T ef120bbec38f41ac88a0bdcc328a1b57 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:35.806809 20621 raft_consensus.cc:697] T ef120bbec38f41ac88a0bdcc328a1b57 P 6aee883f265544bd9c7b9502e590182c [term 2 LEADER]: Becoming Leader. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Running, Role: LEADER
I20260709 12:27:35.807613 20621 consensus_queue.cc:237] T ef120bbec38f41ac88a0bdcc328a1b57 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:35.811193 20322 raft_consensus.cc:2468] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 2.
I20260709 12:27:35.817946 20145 catalog_manager.cc:5697] T 1e3e7383d2d9471c8e3042879c895f2d P 6aee883f265544bd9c7b9502e590182c reported cstate change: term changed from 1 to 2, leader changed from af886ac503354eaa932dd7c2811c64d9 (127.9.145.193) to 6aee883f265544bd9c7b9502e590182c (127.9.145.195). New cstate: current_term: 2 leader_uuid: "6aee883f265544bd9c7b9502e590182c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:35.833168 20145 catalog_manager.cc:5697] T ef120bbec38f41ac88a0bdcc328a1b57 P 6aee883f265544bd9c7b9502e590182c reported cstate change: term changed from 1 to 2, leader changed from 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194) to 6aee883f265544bd9c7b9502e590182c (127.9.145.195). New cstate: current_term: 2 leader_uuid: "6aee883f265544bd9c7b9502e590182c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:35.962917 20667 raft_consensus.cc:993] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96: : Instructing follower 6aee883f265544bd9c7b9502e590182c to start an election
I20260709 12:27:35.963465 20667 raft_consensus.cc:1081] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 LEADER]: Signalling peer 6aee883f265544bd9c7b9502e590182c to start an election
I20260709 12:27:35.965154 20389 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c18393b4e564bf1942046af318a06a6"
dest_uuid: "6aee883f265544bd9c7b9502e590182c"
 from {username='slave'} at 127.0.0.1:55246
I20260709 12:27:35.965793 20389 raft_consensus.cc:493] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:35.966220 20389 raft_consensus.cc:3060] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:35.972802 20389 raft_consensus.cc:515] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:35.974598 20389 leader_election.cc:290] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 3 election: Requested vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607)
I20260709 12:27:35.975419 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c18393b4e564bf1942046af318a06a6" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
I20260709 12:27:35.975641 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c18393b4e564bf1942046af318a06a6" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
I20260709 12:27:35.976119 20247 raft_consensus.cc:3060] T 1c18393b4e564bf1942046af318a06a6 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:35.976277 20322 raft_consensus.cc:3055] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:35.976646 20322 raft_consensus.cc:740] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 96a5d14dc9a9404b9b89c75be639ea96, State: Running, Role: LEADER
I20260709 12:27:35.977298 20322 consensus_queue.cc:260] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:35.978304 20322 raft_consensus.cc:3060] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:35.981070 20247 raft_consensus.cc:2468] T 1c18393b4e564bf1942046af318a06a6 P af886ac503354eaa932dd7c2811c64d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 3.
I20260709 12:27:35.982328 20363 leader_election.cc:304] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, af886ac503354eaa932dd7c2811c64d9; no voters: 
I20260709 12:27:35.983179 20621 raft_consensus.cc:2804] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:35.983412 20322 raft_consensus.cc:2468] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 3.
I20260709 12:27:35.983695 20621 raft_consensus.cc:697] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [term 3 LEADER]: Becoming Leader. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Running, Role: LEADER
I20260709 12:27:35.984748 20621 consensus_queue.cc:237] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:35.986068 20560 raft_consensus.cc:993] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9: : Instructing follower 6aee883f265544bd9c7b9502e590182c to start an election
I20260709 12:27:35.986733 20619 raft_consensus.cc:1081] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [term 2 LEADER]: Signalling peer 6aee883f265544bd9c7b9502e590182c to start an election
I20260709 12:27:35.988392 20389 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dcf6239d1db24300aa9c81e0c83e9c59"
dest_uuid: "6aee883f265544bd9c7b9502e590182c"
 from {username='slave'} at 127.0.0.1:55250
I20260709 12:27:35.989010 20389 raft_consensus.cc:493] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:35.989473 20389 raft_consensus.cc:3060] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:35.994475 20145 catalog_manager.cc:5697] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c reported cstate change: term changed from 2 to 3, leader changed from 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194) to 6aee883f265544bd9c7b9502e590182c (127.9.145.195). New cstate: current_term: 3 leader_uuid: "6aee883f265544bd9c7b9502e590182c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:35.997517 20389 raft_consensus.cc:515] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:35.999353 20389 leader_election.cc:290] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 3 election: Requested vote from peers af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989), 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607)
I20260709 12:27:36.000118 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf6239d1db24300aa9c81e0c83e9c59" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "af886ac503354eaa932dd7c2811c64d9"
I20260709 12:27:36.000700 20247 raft_consensus.cc:3055] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:36.000963 20247 raft_consensus.cc:740] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: af886ac503354eaa932dd7c2811c64d9, State: Running, Role: LEADER
I20260709 12:27:36.001538 20247 consensus_queue.cc:260] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:36.001884 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf6239d1db24300aa9c81e0c83e9c59" candidate_uuid: "6aee883f265544bd9c7b9502e590182c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "96a5d14dc9a9404b9b89c75be639ea96"
I20260709 12:27:36.002501 20322 raft_consensus.cc:3060] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:36.002800 20247 raft_consensus.cc:3060] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:36.009537 20322 raft_consensus.cc:2468] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 3.
I20260709 12:27:36.009531 20247 raft_consensus.cc:2468] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6aee883f265544bd9c7b9502e590182c in term 3.
I20260709 12:27:36.010927 20361 leader_election.cc:304] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6aee883f265544bd9c7b9502e590182c, 96a5d14dc9a9404b9b89c75be639ea96; no voters: 
I20260709 12:27:36.011698 20621 raft_consensus.cc:2804] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:36.012111 20621 raft_consensus.cc:697] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c [term 3 LEADER]: Becoming Leader. State: Replica: 6aee883f265544bd9c7b9502e590182c, State: Running, Role: LEADER
I20260709 12:27:36.012738 20621 consensus_queue.cc:237] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } }
I20260709 12:27:36.020120 20145 catalog_manager.cc:5697] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c reported cstate change: term changed from 2 to 3, leader changed from af886ac503354eaa932dd7c2811c64d9 (127.9.145.193) to 6aee883f265544bd9c7b9502e590182c (127.9.145.195). New cstate: current_term: 3 leader_uuid: "6aee883f265544bd9c7b9502e590182c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6aee883f265544bd9c7b9502e590182c" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 42747 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:36.250619 20322 raft_consensus.cc:1275] T 1e3e7383d2d9471c8e3042879c895f2d P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Refusing update from remote peer 6aee883f265544bd9c7b9502e590182c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:27:36.252048 20621 consensus_queue.cc:1048] T 1e3e7383d2d9471c8e3042879c895f2d P 6aee883f265544bd9c7b9502e590182c [LEADER]: Connected to new peer: Peer: permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:36.262938 20247 raft_consensus.cc:1275] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Refusing update from remote peer 6aee883f265544bd9c7b9502e590182c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:27:36.264513 20695 consensus_queue.cc:1048] T 1e3e7383d2d9471c8e3042879c895f2d P 6aee883f265544bd9c7b9502e590182c [LEADER]: Connected to new peer: Peer: permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:36.341254 20247 raft_consensus.cc:1275] T ef120bbec38f41ac88a0bdcc328a1b57 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Refusing update from remote peer 6aee883f265544bd9c7b9502e590182c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:27:36.342779 20695 consensus_queue.cc:1048] T ef120bbec38f41ac88a0bdcc328a1b57 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Connected to new peer: Peer: permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:36.350489 20318 raft_consensus.cc:1275] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Refusing update from remote peer 6aee883f265544bd9c7b9502e590182c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:27:36.351920 20570 consensus_queue.cc:1048] T ef120bbec38f41ac88a0bdcc328a1b57 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Connected to new peer: Peer: permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:36.411922 20318 raft_consensus.cc:1275] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96 [term 3 FOLLOWER]: Refusing update from remote peer 6aee883f265544bd9c7b9502e590182c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:36.413336 20570 consensus_queue.cc:1048] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Connected to new peer: Peer: permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:36.423604 20247 raft_consensus.cc:1275] T 1c18393b4e564bf1942046af318a06a6 P af886ac503354eaa932dd7c2811c64d9 [term 3 FOLLOWER]: Refusing update from remote peer 6aee883f265544bd9c7b9502e590182c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:36.425611 20695 consensus_queue.cc:1048] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Connected to new peer: Peer: permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:36.466365 20247 raft_consensus.cc:1275] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [term 3 FOLLOWER]: Refusing update from remote peer 6aee883f265544bd9c7b9502e590182c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:36.467811 20695 consensus_queue.cc:1048] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Connected to new peer: Peer: permanent_uuid: "af886ac503354eaa932dd7c2811c64d9" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 40989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:36.477212 20318 raft_consensus.cc:1275] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [term 3 FOLLOWER]: Refusing update from remote peer 6aee883f265544bd9c7b9502e590182c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:36.478951 20701 consensus_queue.cc:1048] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c [LEADER]: Connected to new peer: Peer: permanent_uuid: "96a5d14dc9a9404b9b89c75be639ea96" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 40607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:36.693001  9799 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:36.698915  9799 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:36.699477  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:36.706530  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:36.706957  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:37.707968  9799 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:37.713214  9799 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:37.713677  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:37.718546  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:37.718982  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:38.720010  9799 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:38.725226  9799 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:38.725697  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:38.730652  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:38.731117  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:39.732347  9799 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:39.738631  9799 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:39.739208  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:39.743876  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:39.744277  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:40.745371  9799 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:40.751298  9799 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:40.751757  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:40.756983  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:40.757468  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:41.758487  9799 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:41.763581  9799 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:41.764024  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:41.768733  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:41.769295  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:42.770334  9799 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:42.775312  9799 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:42.775763  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:42.780416  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:42.780957  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:43.781944  9799 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:43.787101  9799 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:43.787541  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:43.792407  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:43.792913  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:44.793862  9799 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:44.799256  9799 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:44.799661  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:44.804450  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:44.804842  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:45.867861  9799 tablet_server.cc:179] TabletServer@127.9.145.193:0 shutting down...
I20260709 12:27:45.907050  9799 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:45.907986  9799 tablet_replica.cc:333] T ef120bbec38f41ac88a0bdcc328a1b57 P af886ac503354eaa932dd7c2811c64d9: stopping tablet replica
I20260709 12:27:45.908845  9799 raft_consensus.cc:2243] T ef120bbec38f41ac88a0bdcc328a1b57 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.909847  9799 raft_consensus.cc:2272] T ef120bbec38f41ac88a0bdcc328a1b57 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.913386  9799 tablet_replica.cc:333] T 2a404c53991240b7a421b0109c15e4e8 P af886ac503354eaa932dd7c2811c64d9: stopping tablet replica
I20260709 12:27:45.914228  9799 raft_consensus.cc:2243] T 2a404c53991240b7a421b0109c15e4e8 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.914805  9799 raft_consensus.cc:2272] T 2a404c53991240b7a421b0109c15e4e8 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.917403  9799 tablet_replica.cc:333] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9: stopping tablet replica
I20260709 12:27:45.918044  9799 raft_consensus.cc:2243] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.918692  9799 raft_consensus.cc:2272] T 5a8684f3955d41d1bd701a5f93b4d8d0 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.921273  9799 tablet_replica.cc:333] T 8e47cc0287004854afd0e484250aa77b P af886ac503354eaa932dd7c2811c64d9: stopping tablet replica
I20260709 12:27:45.921929  9799 raft_consensus.cc:2243] T 8e47cc0287004854afd0e484250aa77b P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.922545  9799 raft_consensus.cc:2272] T 8e47cc0287004854afd0e484250aa77b P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.925117  9799 tablet_replica.cc:333] T 16c22ea0116a4af0b3e16931acab8e68 P af886ac503354eaa932dd7c2811c64d9: stopping tablet replica
I20260709 12:27:45.926057  9799 raft_consensus.cc:2243] T 16c22ea0116a4af0b3e16931acab8e68 P af886ac503354eaa932dd7c2811c64d9 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:27:45.926877 20363 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
I20260709 12:27:45.927410  9799 raft_consensus.cc:2272] T 16c22ea0116a4af0b3e16931acab8e68 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:45.930626 20363 consensus_peers.cc:597] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c -> Peer af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989): Couldn't send request to peer af886ac503354eaa932dd7c2811c64d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:45.931566  9799 tablet_replica.cc:333] T f47b342aa4e145518e9c44998faf692e P af886ac503354eaa932dd7c2811c64d9: stopping tablet replica
I20260709 12:27:45.932677  9799 raft_consensus.cc:2243] T f47b342aa4e145518e9c44998faf692e P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.933954  9799 raft_consensus.cc:2272] T f47b342aa4e145518e9c44998faf692e P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.937309  9799 tablet_replica.cc:333] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9: stopping tablet replica
I20260709 12:27:45.937909  9799 raft_consensus.cc:2243] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.938457  9799 raft_consensus.cc:2272] T 1e3e7383d2d9471c8e3042879c895f2d P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.940953  9799 tablet_replica.cc:333] T fa9bbb303135401db12c664b196ac0d9 P af886ac503354eaa932dd7c2811c64d9: stopping tablet replica
I20260709 12:27:45.941612  9799 raft_consensus.cc:2243] T fa9bbb303135401db12c664b196ac0d9 P af886ac503354eaa932dd7c2811c64d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:45.942559  9799 raft_consensus.cc:2272] T fa9bbb303135401db12c664b196ac0d9 P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.945011  9799 tablet_replica.cc:333] T 136d326496ce4211bf0879ec5c0e9705 P af886ac503354eaa932dd7c2811c64d9: stopping tablet replica
I20260709 12:27:45.945693  9799 raft_consensus.cc:2243] T 136d326496ce4211bf0879ec5c0e9705 P af886ac503354eaa932dd7c2811c64d9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:45.946694  9799 raft_consensus.cc:2272] T 136d326496ce4211bf0879ec5c0e9705 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.949232  9799 tablet_replica.cc:333] T 11231f3045154727af46352ff967a27e P af886ac503354eaa932dd7c2811c64d9: stopping tablet replica
I20260709 12:27:45.949820  9799 raft_consensus.cc:2243] T 11231f3045154727af46352ff967a27e P af886ac503354eaa932dd7c2811c64d9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:45.950999  9799 raft_consensus.cc:2272] T 11231f3045154727af46352ff967a27e P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.954196  9799 tablet_replica.cc:333] T 2117b13035b64ae495334d59cd083a34 P af886ac503354eaa932dd7c2811c64d9: stopping tablet replica
I20260709 12:27:45.954869  9799 raft_consensus.cc:2243] T 2117b13035b64ae495334d59cd083a34 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.955425  9799 raft_consensus.cc:2272] T 2117b13035b64ae495334d59cd083a34 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:45.955680 20289 consensus_peers.cc:597] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96 -> Peer af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989): Couldn't send request to peer af886ac503354eaa932dd7c2811c64d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:45.958135  9799 tablet_replica.cc:333] T 29a9241f720a49aa82f440b1beaae093 P af886ac503354eaa932dd7c2811c64d9: stopping tablet replica
I20260709 12:27:45.958858  9799 raft_consensus.cc:2243] T 29a9241f720a49aa82f440b1beaae093 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.959408  9799 raft_consensus.cc:2272] T 29a9241f720a49aa82f440b1beaae093 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.962003  9799 tablet_replica.cc:333] T 0aafbdf83f384e9ab7e867e965730667 P af886ac503354eaa932dd7c2811c64d9: stopping tablet replica
I20260709 12:27:45.962666  9799 raft_consensus.cc:2243] T 0aafbdf83f384e9ab7e867e965730667 P af886ac503354eaa932dd7c2811c64d9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:45.963595  9799 raft_consensus.cc:2272] T 0aafbdf83f384e9ab7e867e965730667 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.966262  9799 tablet_replica.cc:333] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P af886ac503354eaa932dd7c2811c64d9: stopping tablet replica
I20260709 12:27:45.966889  9799 raft_consensus.cc:2243] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.967389  9799 raft_consensus.cc:2272] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P af886ac503354eaa932dd7c2811c64d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.969739  9799 tablet_replica.cc:333] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9: stopping tablet replica
I20260709 12:27:45.970413  9799 raft_consensus.cc:2243] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:45.971352  9799 raft_consensus.cc:2272] T 71ebebbc467f4437a8f5f7e60eab7173 P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.973866  9799 tablet_replica.cc:333] T 1c18393b4e564bf1942046af318a06a6 P af886ac503354eaa932dd7c2811c64d9: stopping tablet replica
I20260709 12:27:45.974423  9799 raft_consensus.cc:2243] T 1c18393b4e564bf1942046af318a06a6 P af886ac503354eaa932dd7c2811c64d9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.974972  9799 raft_consensus.cc:2272] T 1c18393b4e564bf1942046af318a06a6 P af886ac503354eaa932dd7c2811c64d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.977432  9799 tablet_replica.cc:333] T f05ef6e78f2c4d4c9dbe574db29e502c P af886ac503354eaa932dd7c2811c64d9: stopping tablet replica
I20260709 12:27:45.977958  9799 raft_consensus.cc:2243] T f05ef6e78f2c4d4c9dbe574db29e502c P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.978499  9799 raft_consensus.cc:2272] T f05ef6e78f2c4d4c9dbe574db29e502c P af886ac503354eaa932dd7c2811c64d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.980949  9799 tablet_replica.cc:333] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9: stopping tablet replica
I20260709 12:27:45.981417  9799 raft_consensus.cc:2243] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.981885  9799 raft_consensus.cc:2272] T dcf6239d1db24300aa9c81e0c83e9c59 P af886ac503354eaa932dd7c2811c64d9 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:46.001719 20363 consensus_peers.cc:597] T ef120bbec38f41ac88a0bdcc328a1b57 P 6aee883f265544bd9c7b9502e590182c -> Peer af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989): Couldn't send request to peer af886ac503354eaa932dd7c2811c64d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:46.033376  9799 tablet_server.cc:196] TabletServer@127.9.145.193:0 shutdown complete.
W20260709 12:27:46.035790 20363 consensus_peers.cc:597] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c -> Peer af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989): Couldn't send request to peer af886ac503354eaa932dd7c2811c64d9. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:40989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:46.039275 20363 consensus_peers.cc:597] T f47b342aa4e145518e9c44998faf692e P 6aee883f265544bd9c7b9502e590182c -> Peer af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989): Couldn't send request to peer af886ac503354eaa932dd7c2811c64d9. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:40989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:46.051995 20289 consensus_peers.cc:597] T f05ef6e78f2c4d4c9dbe574db29e502c P 96a5d14dc9a9404b9b89c75be639ea96 -> Peer af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989): Couldn't send request to peer af886ac503354eaa932dd7c2811c64d9. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:40989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:46.083860  9799 tablet_server.cc:179] TabletServer@127.9.145.194:0 shutting down...
W20260709 12:27:46.092036 20363 consensus_peers.cc:597] T 1e3e7383d2d9471c8e3042879c895f2d P 6aee883f265544bd9c7b9502e590182c -> Peer af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989): Couldn't send request to peer af886ac503354eaa932dd7c2811c64d9. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:40989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:46.119692  9799 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:46.120551  9799 tablet_replica.cc:333] T 1e3e7383d2d9471c8e3042879c895f2d P 96a5d14dc9a9404b9b89c75be639ea96: stopping tablet replica
I20260709 12:27:46.121435  9799 raft_consensus.cc:2243] T 1e3e7383d2d9471c8e3042879c895f2d P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.122056  9799 raft_consensus.cc:2272] T 1e3e7383d2d9471c8e3042879c895f2d P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.124630  9799 tablet_replica.cc:333] T 2a404c53991240b7a421b0109c15e4e8 P 96a5d14dc9a9404b9b89c75be639ea96: stopping tablet replica
I20260709 12:27:46.125290  9799 raft_consensus.cc:2243] T 2a404c53991240b7a421b0109c15e4e8 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:46.126246  9799 raft_consensus.cc:2272] T 2a404c53991240b7a421b0109c15e4e8 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.128556  9799 tablet_replica.cc:333] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 96a5d14dc9a9404b9b89c75be639ea96: stopping tablet replica
I20260709 12:27:46.129132  9799 raft_consensus.cc:2243] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.129629  9799 raft_consensus.cc:2272] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.131878  9799 tablet_replica.cc:333] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96: stopping tablet replica
I20260709 12:27:46.132457  9799 raft_consensus.cc:2243] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:46.133411  9799 raft_consensus.cc:2272] T 8e47cc0287004854afd0e484250aa77b P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.135890  9799 tablet_replica.cc:333] T 16c22ea0116a4af0b3e16931acab8e68 P 96a5d14dc9a9404b9b89c75be639ea96: stopping tablet replica
I20260709 12:27:46.136490  9799 raft_consensus.cc:2243] T 16c22ea0116a4af0b3e16931acab8e68 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.137122  9799 raft_consensus.cc:2272] T 16c22ea0116a4af0b3e16931acab8e68 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.140600  9799 tablet_replica.cc:333] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 96a5d14dc9a9404b9b89c75be639ea96: stopping tablet replica
I20260709 12:27:46.141515  9799 raft_consensus.cc:2243] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:46.142831  9799 raft_consensus.cc:2272] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.146262  9799 tablet_replica.cc:333] T 0aafbdf83f384e9ab7e867e965730667 P 96a5d14dc9a9404b9b89c75be639ea96: stopping tablet replica
I20260709 12:27:46.147245  9799 raft_consensus.cc:2243] T 0aafbdf83f384e9ab7e867e965730667 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.147960  9799 raft_consensus.cc:2272] T 0aafbdf83f384e9ab7e867e965730667 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.152002  9799 tablet_replica.cc:333] T 71ebebbc467f4437a8f5f7e60eab7173 P 96a5d14dc9a9404b9b89c75be639ea96: stopping tablet replica
W20260709 12:27:46.152045 20361 consensus_peers.cc:597] T f47b342aa4e145518e9c44998faf692e P 6aee883f265544bd9c7b9502e590182c -> Peer 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607): Couldn't send request to peer 96a5d14dc9a9404b9b89c75be639ea96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:46.153002  9799 raft_consensus.cc:2243] T 71ebebbc467f4437a8f5f7e60eab7173 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.153730  9799 raft_consensus.cc:2272] T 71ebebbc467f4437a8f5f7e60eab7173 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.157094  9799 tablet_replica.cc:333] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96: stopping tablet replica
I20260709 12:27:46.157972  9799 raft_consensus.cc:2243] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.158639  9799 raft_consensus.cc:2272] T 1c18393b4e564bf1942046af318a06a6 P 96a5d14dc9a9404b9b89c75be639ea96 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:46.161541 20361 consensus_peers.cc:597] T ef120bbec38f41ac88a0bdcc328a1b57 P 6aee883f265544bd9c7b9502e590182c -> Peer 96a5d14dc9a9404b9b89c75be639ea96 (127.9.145.194:40607): Couldn't send request to peer 96a5d14dc9a9404b9b89c75be639ea96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:46.162302  9799 tablet_replica.cc:333] T fa9bbb303135401db12c664b196ac0d9 P 96a5d14dc9a9404b9b89c75be639ea96: stopping tablet replica
I20260709 12:27:46.163234  9799 raft_consensus.cc:2243] T fa9bbb303135401db12c664b196ac0d9 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.163816  9799 raft_consensus.cc:2272] T fa9bbb303135401db12c664b196ac0d9 P 96a5d14dc9a9404b9b89c75be639ea96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.166067  9799 tablet_replica.cc:333] T 136d326496ce4211bf0879ec5c0e9705 P 96a5d14dc9a9404b9b89c75be639ea96: stopping tablet replica
I20260709 12:27:46.166682  9799 raft_consensus.cc:2243] T 136d326496ce4211bf0879ec5c0e9705 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.167196  9799 raft_consensus.cc:2272] T 136d326496ce4211bf0879ec5c0e9705 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.169554  9799 tablet_replica.cc:333] T 11231f3045154727af46352ff967a27e P 96a5d14dc9a9404b9b89c75be639ea96: stopping tablet replica
I20260709 12:27:46.170148  9799 raft_consensus.cc:2243] T 11231f3045154727af46352ff967a27e P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.170651  9799 raft_consensus.cc:2272] T 11231f3045154727af46352ff967a27e P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.173436  9799 tablet_replica.cc:333] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96: stopping tablet replica
I20260709 12:27:46.173964  9799 raft_consensus.cc:2243] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.174492  9799 raft_consensus.cc:2272] T f47b342aa4e145518e9c44998faf692e P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.176793  9799 tablet_replica.cc:333] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96: stopping tablet replica
I20260709 12:27:46.177321  9799 raft_consensus.cc:2243] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.177819  9799 raft_consensus.cc:2272] T ef120bbec38f41ac88a0bdcc328a1b57 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.180212  9799 tablet_replica.cc:333] T f05ef6e78f2c4d4c9dbe574db29e502c P 96a5d14dc9a9404b9b89c75be639ea96: stopping tablet replica
I20260709 12:27:46.180744  9799 raft_consensus.cc:2243] T f05ef6e78f2c4d4c9dbe574db29e502c P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:46.181660  9799 raft_consensus.cc:2272] T f05ef6e78f2c4d4c9dbe574db29e502c P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.184001  9799 tablet_replica.cc:333] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96: stopping tablet replica
I20260709 12:27:46.184592  9799 raft_consensus.cc:2243] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.185096  9799 raft_consensus.cc:2272] T dcf6239d1db24300aa9c81e0c83e9c59 P 96a5d14dc9a9404b9b89c75be639ea96 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.187417  9799 tablet_replica.cc:333] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96: stopping tablet replica
I20260709 12:27:46.187950  9799 raft_consensus.cc:2243] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:46.188869  9799 raft_consensus.cc:2272] T 2117b13035b64ae495334d59cd083a34 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.191242  9799 tablet_replica.cc:333] T 29a9241f720a49aa82f440b1beaae093 P 96a5d14dc9a9404b9b89c75be639ea96: stopping tablet replica
I20260709 12:27:46.191887  9799 raft_consensus.cc:2243] T 29a9241f720a49aa82f440b1beaae093 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:46.193009  9799 raft_consensus.cc:2272] T 29a9241f720a49aa82f440b1beaae093 P 96a5d14dc9a9404b9b89c75be639ea96 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:46.196563 20363 consensus_peers.cc:597] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 6aee883f265544bd9c7b9502e590182c -> Peer af886ac503354eaa932dd7c2811c64d9 (127.9.145.193:40989): Couldn't send request to peer af886ac503354eaa932dd7c2811c64d9. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:40989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:46.237144  9799 tablet_server.cc:196] TabletServer@127.9.145.194:0 shutdown complete.
I20260709 12:27:46.276861  9799 tablet_server.cc:179] TabletServer@127.9.145.195:0 shutting down...
I20260709 12:27:46.307150  9799 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:46.307899  9799 tablet_replica.cc:333] T 8e47cc0287004854afd0e484250aa77b P 6aee883f265544bd9c7b9502e590182c: stopping tablet replica
I20260709 12:27:46.308632  9799 raft_consensus.cc:2243] T 8e47cc0287004854afd0e484250aa77b P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.309266  9799 raft_consensus.cc:2272] T 8e47cc0287004854afd0e484250aa77b P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.311712  9799 tablet_replica.cc:333] T 2a404c53991240b7a421b0109c15e4e8 P 6aee883f265544bd9c7b9502e590182c: stopping tablet replica
I20260709 12:27:46.312326  9799 raft_consensus.cc:2243] T 2a404c53991240b7a421b0109c15e4e8 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.312844  9799 raft_consensus.cc:2272] T 2a404c53991240b7a421b0109c15e4e8 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.315248  9799 tablet_replica.cc:333] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 6aee883f265544bd9c7b9502e590182c: stopping tablet replica
I20260709 12:27:46.315819  9799 raft_consensus.cc:2243] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 6aee883f265544bd9c7b9502e590182c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:46.316802  9799 raft_consensus.cc:2272] T 5a8684f3955d41d1bd701a5f93b4d8d0 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.319209  9799 tablet_replica.cc:333] T 1e3e7383d2d9471c8e3042879c895f2d P 6aee883f265544bd9c7b9502e590182c: stopping tablet replica
I20260709 12:27:46.319896  9799 raft_consensus.cc:2243] T 1e3e7383d2d9471c8e3042879c895f2d P 6aee883f265544bd9c7b9502e590182c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:46.320777  9799 raft_consensus.cc:2272] T 1e3e7383d2d9471c8e3042879c895f2d P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.323184  9799 tablet_replica.cc:333] T ef120bbec38f41ac88a0bdcc328a1b57 P 6aee883f265544bd9c7b9502e590182c: stopping tablet replica
I20260709 12:27:46.323860  9799 raft_consensus.cc:2243] T ef120bbec38f41ac88a0bdcc328a1b57 P 6aee883f265544bd9c7b9502e590182c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:46.324738  9799 raft_consensus.cc:2272] T ef120bbec38f41ac88a0bdcc328a1b57 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.327085  9799 tablet_replica.cc:333] T 16c22ea0116a4af0b3e16931acab8e68 P 6aee883f265544bd9c7b9502e590182c: stopping tablet replica
I20260709 12:27:46.327687  9799 raft_consensus.cc:2243] T 16c22ea0116a4af0b3e16931acab8e68 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.328225  9799 raft_consensus.cc:2272] T 16c22ea0116a4af0b3e16931acab8e68 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.330624  9799 tablet_replica.cc:333] T fa9bbb303135401db12c664b196ac0d9 P 6aee883f265544bd9c7b9502e590182c: stopping tablet replica
I20260709 12:27:46.331272  9799 raft_consensus.cc:2243] T fa9bbb303135401db12c664b196ac0d9 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.331805  9799 raft_consensus.cc:2272] T fa9bbb303135401db12c664b196ac0d9 P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.334198  9799 tablet_replica.cc:333] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c: stopping tablet replica
I20260709 12:27:46.334802  9799 raft_consensus.cc:2243] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.335337  9799 raft_consensus.cc:2272] T 11231f3045154727af46352ff967a27e P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.337671  9799 tablet_replica.cc:333] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c: stopping tablet replica
I20260709 12:27:46.338297  9799 raft_consensus.cc:2243] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.338804  9799 raft_consensus.cc:2272] T 136d326496ce4211bf0879ec5c0e9705 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.341121  9799 tablet_replica.cc:333] T f47b342aa4e145518e9c44998faf692e P 6aee883f265544bd9c7b9502e590182c: stopping tablet replica
I20260709 12:27:46.341727  9799 raft_consensus.cc:2243] T f47b342aa4e145518e9c44998faf692e P 6aee883f265544bd9c7b9502e590182c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:46.342694  9799 raft_consensus.cc:2272] T f47b342aa4e145518e9c44998faf692e P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.344982  9799 tablet_replica.cc:333] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c: stopping tablet replica
I20260709 12:27:46.345574  9799 raft_consensus.cc:2243] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:46.346503  9799 raft_consensus.cc:2272] T 1c18393b4e564bf1942046af318a06a6 P 6aee883f265544bd9c7b9502e590182c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.349010  9799 tablet_replica.cc:333] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c: stopping tablet replica
I20260709 12:27:46.349547  9799 raft_consensus.cc:2243] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.350005  9799 raft_consensus.cc:2272] T 71ebebbc467f4437a8f5f7e60eab7173 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.352273  9799 tablet_replica.cc:333] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c: stopping tablet replica
I20260709 12:27:46.352794  9799 raft_consensus.cc:2243] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:46.353655  9799 raft_consensus.cc:2272] T dcf6239d1db24300aa9c81e0c83e9c59 P 6aee883f265544bd9c7b9502e590182c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.355921  9799 tablet_replica.cc:333] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c: stopping tablet replica
I20260709 12:27:46.356415  9799 raft_consensus.cc:2243] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.356881  9799 raft_consensus.cc:2272] T f05ef6e78f2c4d4c9dbe574db29e502c P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.359138  9799 tablet_replica.cc:333] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c: stopping tablet replica
I20260709 12:27:46.359612  9799 raft_consensus.cc:2243] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.360040  9799 raft_consensus.cc:2272] T 0aafbdf83f384e9ab7e867e965730667 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.362327  9799 tablet_replica.cc:333] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 6aee883f265544bd9c7b9502e590182c: stopping tablet replica
I20260709 12:27:46.362874  9799 raft_consensus.cc:2243] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.363305  9799 raft_consensus.cc:2272] T 8e4cebfd6a10429ba1a2d1e15c89c0ae P 6aee883f265544bd9c7b9502e590182c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.365423  9799 tablet_replica.cc:333] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c: stopping tablet replica
I20260709 12:27:46.365912  9799 raft_consensus.cc:2243] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.366456  9799 raft_consensus.cc:2272] T 2117b13035b64ae495334d59cd083a34 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.368549  9799 tablet_replica.cc:333] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c: stopping tablet replica
I20260709 12:27:46.369025  9799 raft_consensus.cc:2243] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.369444  9799 raft_consensus.cc:2272] T 29a9241f720a49aa82f440b1beaae093 P 6aee883f265544bd9c7b9502e590182c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.412611  9799 tablet_server.cc:196] TabletServer@127.9.145.195:0 shutdown complete.
I20260709 12:27:46.452790  9799 master.cc:562] Master@127.9.145.254:43257 shutting down...
I20260709 12:27:46.474155  9799 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c808b56815f647bbb9c50fb470b7255a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:46.474792  9799 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c808b56815f647bbb9c50fb470b7255a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.475104  9799 tablet_replica.cc:333] T 00000000000000000000000000000000 P c808b56815f647bbb9c50fb470b7255a: stopping tablet replica
I20260709 12:27:46.495846  9799 master.cc:584] Master@127.9.145.254:43257 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (20876 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:27:46.546540  9799 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.145.254:35769
I20260709 12:27:46.547647  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:46.553817 20728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:46.554060 20729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:46.554754 20731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:46.555135  9799 server_base.cc:1061] running on GCE node
I20260709 12:27:46.556164  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:46.556349  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:46.556510  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783600066556492 us; error 0 us; skew 500 ppm
I20260709 12:27:46.557050  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:46.559532  9799 webserver.cc:533] Webserver started at http://127.9.145.254:42433/ using document root <none> and password file <none>
I20260709 12:27:46.560024  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:46.560225  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:46.560496  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:46.561700  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599719482688-9799-0/minicluster-data/master-0-root/instance:
uuid: "48f47eb857e846c3a511db95a9f56aca"
format_stamp: "Formatted at 2026-07-09 12:27:46 on dist-test-slave-1sdq"
I20260709 12:27:46.566382  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:27:46.569911 20736 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:46.570845  9799 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:27:46.571153  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599719482688-9799-0/minicluster-data/master-0-root
uuid: "48f47eb857e846c3a511db95a9f56aca"
format_stamp: "Formatted at 2026-07-09 12:27:46 on dist-test-slave-1sdq"
I20260709 12:27:46.571422  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599719482688-9799-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599719482688-9799-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599719482688-9799-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:46.591696  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:46.592972  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:46.631559  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.254:35769
I20260709 12:27:46.631706 20787 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.254:35769 every 8 connection(s)
I20260709 12:27:46.635620 20788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:46.648313 20788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48f47eb857e846c3a511db95a9f56aca: Bootstrap starting.
I20260709 12:27:46.653502 20788 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 48f47eb857e846c3a511db95a9f56aca: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:46.658247 20788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48f47eb857e846c3a511db95a9f56aca: No bootstrap required, opened a new log
I20260709 12:27:46.660656 20788 raft_consensus.cc:359] T 00000000000000000000000000000000 P 48f47eb857e846c3a511db95a9f56aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48f47eb857e846c3a511db95a9f56aca" member_type: VOTER }
I20260709 12:27:46.661132 20788 raft_consensus.cc:385] T 00000000000000000000000000000000 P 48f47eb857e846c3a511db95a9f56aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:46.661371 20788 raft_consensus.cc:740] T 00000000000000000000000000000000 P 48f47eb857e846c3a511db95a9f56aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48f47eb857e846c3a511db95a9f56aca, State: Initialized, Role: FOLLOWER
I20260709 12:27:46.661988 20788 consensus_queue.cc:260] T 00000000000000000000000000000000 P 48f47eb857e846c3a511db95a9f56aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48f47eb857e846c3a511db95a9f56aca" member_type: VOTER }
I20260709 12:27:46.662516 20788 raft_consensus.cc:399] T 00000000000000000000000000000000 P 48f47eb857e846c3a511db95a9f56aca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:27:46.662735 20788 raft_consensus.cc:493] T 00000000000000000000000000000000 P 48f47eb857e846c3a511db95a9f56aca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:27:46.662988 20788 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 48f47eb857e846c3a511db95a9f56aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:46.668116 20788 raft_consensus.cc:515] T 00000000000000000000000000000000 P 48f47eb857e846c3a511db95a9f56aca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48f47eb857e846c3a511db95a9f56aca" member_type: VOTER }
I20260709 12:27:46.668661 20788 leader_election.cc:304] T 00000000000000000000000000000000 P 48f47eb857e846c3a511db95a9f56aca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 48f47eb857e846c3a511db95a9f56aca; no voters: 
I20260709 12:27:46.669799 20788 leader_election.cc:290] T 00000000000000000000000000000000 P 48f47eb857e846c3a511db95a9f56aca [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:27:46.670200 20791 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 48f47eb857e846c3a511db95a9f56aca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:46.671701 20791 raft_consensus.cc:697] T 00000000000000000000000000000000 P 48f47eb857e846c3a511db95a9f56aca [term 1 LEADER]: Becoming Leader. State: Replica: 48f47eb857e846c3a511db95a9f56aca, State: Running, Role: LEADER
I20260709 12:27:46.672385 20791 consensus_queue.cc:237] T 00000000000000000000000000000000 P 48f47eb857e846c3a511db95a9f56aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48f47eb857e846c3a511db95a9f56aca" member_type: VOTER }
I20260709 12:27:46.672915 20788 sys_catalog.cc:565] T 00000000000000000000000000000000 P 48f47eb857e846c3a511db95a9f56aca [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:27:46.677095 20793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48f47eb857e846c3a511db95a9f56aca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48f47eb857e846c3a511db95a9f56aca. Latest consensus state: current_term: 1 leader_uuid: "48f47eb857e846c3a511db95a9f56aca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48f47eb857e846c3a511db95a9f56aca" member_type: VOTER } }
I20260709 12:27:46.677858 20793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48f47eb857e846c3a511db95a9f56aca [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:46.678759 20792 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48f47eb857e846c3a511db95a9f56aca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "48f47eb857e846c3a511db95a9f56aca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48f47eb857e846c3a511db95a9f56aca" member_type: VOTER } }
I20260709 12:27:46.679454 20792 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48f47eb857e846c3a511db95a9f56aca [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:46.681025 20797 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:27:46.688460 20797 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:27:46.689505  9799 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:27:46.698058 20797 catalog_manager.cc:1383] Generated new cluster ID: 056a5550bfb346d68459095f23cee563
I20260709 12:27:46.698418 20797 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:27:46.718691 20797 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:27:46.720213 20797 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:27:46.733456 20797 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 48f47eb857e846c3a511db95a9f56aca: Generated new TSK 0
I20260709 12:27:46.734076 20797 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:27:46.756422  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:46.762856 20809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:46.764650 20810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:46.765847  9799 server_base.cc:1061] running on GCE node
W20260709 12:27:46.765949 20812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:46.767108  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:46.767333  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:46.767498  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783600066767481 us; error 0 us; skew 500 ppm
I20260709 12:27:46.768042  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:46.770427  9799 webserver.cc:533] Webserver started at http://127.9.145.193:34281/ using document root <none> and password file <none>
I20260709 12:27:46.770905  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:46.771116  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:46.771363  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:46.772511  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599719482688-9799-0/minicluster-data/ts-0-root/instance:
uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
format_stamp: "Formatted at 2026-07-09 12:27:46 on dist-test-slave-1sdq"
I20260709 12:27:46.777490  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 12:27:46.781198 20817 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:46.781993  9799 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:27:46.782336  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599719482688-9799-0/minicluster-data/ts-0-root
uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
format_stamp: "Formatted at 2026-07-09 12:27:46 on dist-test-slave-1sdq"
I20260709 12:27:46.782646  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599719482688-9799-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599719482688-9799-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599719482688-9799-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:46.793511  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:46.794831  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:46.796370  9799 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:46.798774  9799 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:46.799000  9799 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:46.799220  9799 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:46.799389  9799 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:46.841848  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.193:36867
I20260709 12:27:46.842011 20879 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.193:36867 every 8 connection(s)
I20260709 12:27:46.846937  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:46.854364 20884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:46.855582 20885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:46.857380 20887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:46.858958  9799 server_base.cc:1061] running on GCE node
I20260709 12:27:46.860152  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:46.860368  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:46.860512  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783600066860500 us; error 0 us; skew 500 ppm
I20260709 12:27:46.861030  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:46.863931  9799 webserver.cc:533] Webserver started at http://127.9.145.194:34117/ using document root <none> and password file <none>
I20260709 12:27:46.864584  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:46.864850  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:46.865146  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:46.865482 20880 heartbeater.cc:344] Connected to a master server at 127.9.145.254:35769
I20260709 12:27:46.865911 20880 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:46.866569  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599719482688-9799-0/minicluster-data/ts-1-root/instance:
uuid: "d19688849fc44393bbf88cb3589a1d3a"
format_stamp: "Formatted at 2026-07-09 12:27:46 on dist-test-slave-1sdq"
I20260709 12:27:46.866684 20880 heartbeater.cc:507] Master 127.9.145.254:35769 requested a full tablet report, sending...
I20260709 12:27:46.869038 20753 ts_manager.cc:194] Registered new tserver with Master: 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867)
I20260709 12:27:46.870975 20753 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53766
I20260709 12:27:46.872473  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:27:46.876519 20892 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:46.877297  9799 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:27:46.877620  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599719482688-9799-0/minicluster-data/ts-1-root
uuid: "d19688849fc44393bbf88cb3589a1d3a"
format_stamp: "Formatted at 2026-07-09 12:27:46 on dist-test-slave-1sdq"
I20260709 12:27:46.877909  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599719482688-9799-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599719482688-9799-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599719482688-9799-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:46.894631  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:46.895969  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:46.897490  9799 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:46.899968  9799 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:46.900194  9799 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:46.900446  9799 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:46.900630  9799 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:46.943496  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.194:42331
I20260709 12:27:46.943655 20954 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.194:42331 every 8 connection(s)
I20260709 12:27:46.948364  9799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:46.956019 20958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:46.958199 20959 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:46.959955  9799 server_base.cc:1061] running on GCE node
I20260709 12:27:46.961051 20955 heartbeater.cc:344] Connected to a master server at 127.9.145.254:35769
I20260709 12:27:46.961592 20955 heartbeater.cc:461] Registering TS with master...
W20260709 12:27:46.961952 20962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:46.962672 20955 heartbeater.cc:507] Master 127.9.145.254:35769 requested a full tablet report, sending...
I20260709 12:27:46.963364  9799 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:46.963698  9799 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:46.963877  9799 hybrid_clock.cc:648] HybridClock initialized: now 1783600066963859 us; error 0 us; skew 500 ppm
I20260709 12:27:46.964506  9799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:46.964862 20753 ts_manager.cc:194] Registered new tserver with Master: d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331)
I20260709 12:27:46.966616 20753 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53774
I20260709 12:27:46.967156  9799 webserver.cc:533] Webserver started at http://127.9.145.195:45077/ using document root <none> and password file <none>
I20260709 12:27:46.967739  9799 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:46.967931  9799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:46.968185  9799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:46.969359  9799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599719482688-9799-0/minicluster-data/ts-2-root/instance:
uuid: "69b3b0ee0bdb42b39768623d8444232a"
format_stamp: "Formatted at 2026-07-09 12:27:46 on dist-test-slave-1sdq"
I20260709 12:27:46.974169  9799 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:27:46.977767 20966 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:46.978623  9799 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:27:46.978955  9799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599719482688-9799-0/minicluster-data/ts-2-root
uuid: "69b3b0ee0bdb42b39768623d8444232a"
format_stamp: "Formatted at 2026-07-09 12:27:46 on dist-test-slave-1sdq"
I20260709 12:27:46.979233  9799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599719482688-9799-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599719482688-9799-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskCSCUL0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599719482688-9799-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:47.012472  9799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:47.013891  9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:47.015565  9799 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:47.018270  9799 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:47.018489  9799 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:47.018754  9799 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:47.018903  9799 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:47.059379  9799 rpc_server.cc:307] RPC server started. Bound to: 127.9.145.195:33581
I20260709 12:27:47.059489 21028 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.145.195:33581 every 8 connection(s)
I20260709 12:27:47.073921 21029 heartbeater.cc:344] Connected to a master server at 127.9.145.254:35769
I20260709 12:27:47.074478 21029 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:47.075280 21029 heartbeater.cc:507] Master 127.9.145.254:35769 requested a full tablet report, sending...
I20260709 12:27:47.077395 20753 ts_manager.cc:194] Registered new tserver with Master: 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:47.077659  9799 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015097178s
I20260709 12:27:47.078881 20753 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53784
I20260709 12:27:47.104121 20753 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53788:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:27:47.107029 20753 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:27:47.177795 20920 tablet_service.cc:1511] Processing CreateTablet for tablet fb866cd22e194cbabbe70fd7b3464ff2 (DEFAULT_TABLE table=test-workload [id=7b0fe35bc05b4280896b3f97f65e5840]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:47.178684 20918 tablet_service.cc:1511] Processing CreateTablet for tablet 31700e88bf154c04bf1ea79652e72042 (DEFAULT_TABLE table=test-workload [id=7b0fe35bc05b4280896b3f97f65e5840]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:47.181123 20919 tablet_service.cc:1511] Processing CreateTablet for tablet 3c498679415641cbb2970d4c4f71930a (DEFAULT_TABLE table=test-workload [id=7b0fe35bc05b4280896b3f97f65e5840]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:47.183235 20993 tablet_service.cc:1511] Processing CreateTablet for tablet 3c498679415641cbb2970d4c4f71930a (DEFAULT_TABLE table=test-workload [id=7b0fe35bc05b4280896b3f97f65e5840]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:47.184238 20917 tablet_service.cc:1511] Processing CreateTablet for tablet 14928e2dd87f43abb72a0cecdcf24c54 (DEFAULT_TABLE table=test-workload [id=7b0fe35bc05b4280896b3f97f65e5840]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:47.184439 20992 tablet_service.cc:1511] Processing CreateTablet for tablet 31700e88bf154c04bf1ea79652e72042 (DEFAULT_TABLE table=test-workload [id=7b0fe35bc05b4280896b3f97f65e5840]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:47.186048 20991 tablet_service.cc:1511] Processing CreateTablet for tablet 14928e2dd87f43abb72a0cecdcf24c54 (DEFAULT_TABLE table=test-workload [id=7b0fe35bc05b4280896b3f97f65e5840]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:47.179332 20920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb866cd22e194cbabbe70fd7b3464ff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:47.186849 20994 tablet_service.cc:1511] Processing CreateTablet for tablet fb866cd22e194cbabbe70fd7b3464ff2 (DEFAULT_TABLE table=test-workload [id=7b0fe35bc05b4280896b3f97f65e5840]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:47.184813 20993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c498679415641cbb2970d4c4f71930a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:47.188287 20994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb866cd22e194cbabbe70fd7b3464ff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:47.189008 20991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14928e2dd87f43abb72a0cecdcf24c54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:47.189627 20992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31700e88bf154c04bf1ea79652e72042. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:47.192168 20918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31700e88bf154c04bf1ea79652e72042. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:47.197798 20917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14928e2dd87f43abb72a0cecdcf24c54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:47.202548 20919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c498679415641cbb2970d4c4f71930a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:47.203776 20916 tablet_service.cc:1511] Processing CreateTablet for tablet 982cee52faae499e8f087e106b51bbd9 (DEFAULT_TABLE table=test-workload [id=7b0fe35bc05b4280896b3f97f65e5840]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:47.205447 20916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 982cee52faae499e8f087e106b51bbd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:47.216331 20990 tablet_service.cc:1511] Processing CreateTablet for tablet 982cee52faae499e8f087e106b51bbd9 (DEFAULT_TABLE table=test-workload [id=7b0fe35bc05b4280896b3f97f65e5840]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:47.218039 20990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 982cee52faae499e8f087e106b51bbd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:47.221140 20844 tablet_service.cc:1511] Processing CreateTablet for tablet 3c498679415641cbb2970d4c4f71930a (DEFAULT_TABLE table=test-workload [id=7b0fe35bc05b4280896b3f97f65e5840]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:47.222416 20845 tablet_service.cc:1511] Processing CreateTablet for tablet fb866cd22e194cbabbe70fd7b3464ff2 (DEFAULT_TABLE table=test-workload [id=7b0fe35bc05b4280896b3f97f65e5840]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:47.224303 20843 tablet_service.cc:1511] Processing CreateTablet for tablet 31700e88bf154c04bf1ea79652e72042 (DEFAULT_TABLE table=test-workload [id=7b0fe35bc05b4280896b3f97f65e5840]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:47.226920 20842 tablet_service.cc:1511] Processing CreateTablet for tablet 14928e2dd87f43abb72a0cecdcf24c54 (DEFAULT_TABLE table=test-workload [id=7b0fe35bc05b4280896b3f97f65e5840]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:47.229441 20841 tablet_service.cc:1511] Processing CreateTablet for tablet 982cee52faae499e8f087e106b51bbd9 (DEFAULT_TABLE table=test-workload [id=7b0fe35bc05b4280896b3f97f65e5840]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:47.222843 20844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c498679415641cbb2970d4c4f71930a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:47.233810 20845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb866cd22e194cbabbe70fd7b3464ff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:47.238710 20840 tablet_service.cc:1511] Processing CreateTablet for tablet 81f0c796981141c48241e102703807b9 (DEFAULT_TABLE table=test-workload [id=7b0fe35bc05b4280896b3f97f65e5840]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:47.240252 20840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f0c796981141c48241e102703807b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:47.241775 20915 tablet_service.cc:1511] Processing CreateTablet for tablet 81f0c796981141c48241e102703807b9 (DEFAULT_TABLE table=test-workload [id=7b0fe35bc05b4280896b3f97f65e5840]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:47.243619 20915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f0c796981141c48241e102703807b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:47.244598 20989 tablet_service.cc:1511] Processing CreateTablet for tablet 81f0c796981141c48241e102703807b9 (DEFAULT_TABLE table=test-workload [id=7b0fe35bc05b4280896b3f97f65e5840]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:47.246153 20989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f0c796981141c48241e102703807b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:47.246527 20842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14928e2dd87f43abb72a0cecdcf24c54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:47.249651 20841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 982cee52faae499e8f087e106b51bbd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:47.252264 20839 tablet_service.cc:1511] Processing CreateTablet for tablet 85248b50821b406ca1571b018430b9f5 (DEFAULT_TABLE table=test-workload [id=7b0fe35bc05b4280896b3f97f65e5840]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:47.253235 20914 tablet_service.cc:1511] Processing CreateTablet for tablet 85248b50821b406ca1571b018430b9f5 (DEFAULT_TABLE table=test-workload [id=7b0fe35bc05b4280896b3f97f65e5840]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:47.253902 20839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85248b50821b406ca1571b018430b9f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:47.254748 20914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85248b50821b406ca1571b018430b9f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:47.256469 20843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31700e88bf154c04bf1ea79652e72042. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:47.284969 21045 tablet_bootstrap.cc:492] T 14928e2dd87f43abb72a0cecdcf24c54 P 69b3b0ee0bdb42b39768623d8444232a: Bootstrap starting.
I20260709 12:27:47.290721 20989 tablet_service.cc:1511] Processing CreateTablet for tablet 85248b50821b406ca1571b018430b9f5 (DEFAULT_TABLE table=test-workload [id=7b0fe35bc05b4280896b3f97f65e5840]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:47.293390 20989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85248b50821b406ca1571b018430b9f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:47.295536 20838 tablet_service.cc:1511] Processing CreateTablet for tablet 8c6b02b11e4d46939d1da88c9b12d062 (DEFAULT_TABLE table=test-workload [id=7b0fe35bc05b4280896b3f97f65e5840]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:47.297091 20838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c6b02b11e4d46939d1da88c9b12d062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:47.299358 21044 tablet_bootstrap.cc:492] T 31700e88bf154c04bf1ea79652e72042 P d19688849fc44393bbf88cb3589a1d3a: Bootstrap starting.
I20260709 12:27:47.308382 20918 tablet_service.cc:1511] Processing CreateTablet for tablet 8c6b02b11e4d46939d1da88c9b12d062 (DEFAULT_TABLE table=test-workload [id=7b0fe35bc05b4280896b3f97f65e5840]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:47.309926 20918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c6b02b11e4d46939d1da88c9b12d062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:47.310997 20991 tablet_service.cc:1511] Processing CreateTablet for tablet 8c6b02b11e4d46939d1da88c9b12d062 (DEFAULT_TABLE table=test-workload [id=7b0fe35bc05b4280896b3f97f65e5840]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:47.312484 20991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c6b02b11e4d46939d1da88c9b12d062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:47.317272 21045 tablet_bootstrap.cc:654] T 14928e2dd87f43abb72a0cecdcf24c54 P 69b3b0ee0bdb42b39768623d8444232a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.326761 21044 tablet_bootstrap.cc:654] T 31700e88bf154c04bf1ea79652e72042 P d19688849fc44393bbf88cb3589a1d3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.330411 20837 tablet_service.cc:1511] Processing CreateTablet for tablet d0a1fdfc30754de192891e2312d5c020 (DEFAULT_TABLE table=test-workload [id=7b0fe35bc05b4280896b3f97f65e5840]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:47.349978 20837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a1fdfc30754de192891e2312d5c020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:47.335323 20920 tablet_service.cc:1511] Processing CreateTablet for tablet d0a1fdfc30754de192891e2312d5c020 (DEFAULT_TABLE table=test-workload [id=7b0fe35bc05b4280896b3f97f65e5840]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:47.352656 20920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a1fdfc30754de192891e2312d5c020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:47.336242 20990 tablet_service.cc:1511] Processing CreateTablet for tablet d0a1fdfc30754de192891e2312d5c020 (DEFAULT_TABLE table=test-workload [id=7b0fe35bc05b4280896b3f97f65e5840]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:47.355021 20990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a1fdfc30754de192891e2312d5c020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:47.368765 21046 tablet_bootstrap.cc:492] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Bootstrap starting.
I20260709 12:27:47.385890 21046 tablet_bootstrap.cc:654] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.397447 21045 tablet_bootstrap.cc:492] T 14928e2dd87f43abb72a0cecdcf24c54 P 69b3b0ee0bdb42b39768623d8444232a: No bootstrap required, opened a new log
I20260709 12:27:47.398025 21045 ts_tablet_manager.cc:1403] T 14928e2dd87f43abb72a0cecdcf24c54 P 69b3b0ee0bdb42b39768623d8444232a: Time spent bootstrapping tablet: real 0.113s	user 0.018s	sys 0.014s
I20260709 12:27:47.401261 21045 raft_consensus.cc:359] T 14928e2dd87f43abb72a0cecdcf24c54 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.402030 21045 raft_consensus.cc:385] T 14928e2dd87f43abb72a0cecdcf24c54 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.402390 21045 raft_consensus.cc:740] T 14928e2dd87f43abb72a0cecdcf24c54 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69b3b0ee0bdb42b39768623d8444232a, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.404433 21045 consensus_queue.cc:260] T 14928e2dd87f43abb72a0cecdcf24c54 P 69b3b0ee0bdb42b39768623d8444232a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.405809 21044 tablet_bootstrap.cc:492] T 31700e88bf154c04bf1ea79652e72042 P d19688849fc44393bbf88cb3589a1d3a: No bootstrap required, opened a new log
I20260709 12:27:47.406486 21044 ts_tablet_manager.cc:1403] T 31700e88bf154c04bf1ea79652e72042 P d19688849fc44393bbf88cb3589a1d3a: Time spent bootstrapping tablet: real 0.107s	user 0.031s	sys 0.007s
I20260709 12:27:47.409016 21044 raft_consensus.cc:359] T 31700e88bf154c04bf1ea79652e72042 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.409533 21044 raft_consensus.cc:385] T 31700e88bf154c04bf1ea79652e72042 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.409776 21044 raft_consensus.cc:740] T 31700e88bf154c04bf1ea79652e72042 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.410845 21046 tablet_bootstrap.cc:492] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f: No bootstrap required, opened a new log
I20260709 12:27:47.410548 21044 consensus_queue.cc:260] T 31700e88bf154c04bf1ea79652e72042 P d19688849fc44393bbf88cb3589a1d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.411579 21046 ts_tablet_manager.cc:1403] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.008s
I20260709 12:27:47.414945 21046 raft_consensus.cc:359] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.415767 21046 raft_consensus.cc:385] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.416075 21046 raft_consensus.cc:740] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.417071 21029 heartbeater.cc:499] Master 127.9.145.254:35769 was elected leader, sending a full tablet report...
I20260709 12:27:47.417539 21045 ts_tablet_manager.cc:1434] T 14928e2dd87f43abb72a0cecdcf24c54 P 69b3b0ee0bdb42b39768623d8444232a: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.012s
I20260709 12:27:47.417052 21046 consensus_queue.cc:260] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.418658 21045 tablet_bootstrap.cc:492] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a: Bootstrap starting.
I20260709 12:27:47.423801 20955 heartbeater.cc:499] Master 127.9.145.254:35769 was elected leader, sending a full tablet report...
I20260709 12:27:47.424324 21044 ts_tablet_manager.cc:1434] T 31700e88bf154c04bf1ea79652e72042 P d19688849fc44393bbf88cb3589a1d3a: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.011s
I20260709 12:27:47.425364 21045 tablet_bootstrap.cc:654] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.425508 21044 tablet_bootstrap.cc:492] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a: Bootstrap starting.
I20260709 12:27:47.432343 21044 tablet_bootstrap.cc:654] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.444437 21044 tablet_bootstrap.cc:492] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a: No bootstrap required, opened a new log
I20260709 12:27:47.445053 21044 ts_tablet_manager.cc:1403] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
W20260709 12:27:47.447834 20956 tablet.cc:2406] T 31700e88bf154c04bf1ea79652e72042 P d19688849fc44393bbf88cb3589a1d3a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:27:47.448109 21044 raft_consensus.cc:359] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.449131 21044 raft_consensus.cc:385] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.449448 21044 raft_consensus.cc:740] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.450336 21044 consensus_queue.cc:260] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.452745 21044 ts_tablet_manager.cc:1434] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:27:47.453778 21044 tablet_bootstrap.cc:492] T fb866cd22e194cbabbe70fd7b3464ff2 P d19688849fc44393bbf88cb3589a1d3a: Bootstrap starting.
I20260709 12:27:47.460384 21044 tablet_bootstrap.cc:654] T fb866cd22e194cbabbe70fd7b3464ff2 P d19688849fc44393bbf88cb3589a1d3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.472373 20880 heartbeater.cc:499] Master 127.9.145.254:35769 was elected leader, sending a full tablet report...
I20260709 12:27:47.472930 21045 tablet_bootstrap.cc:492] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a: No bootstrap required, opened a new log
I20260709 12:27:47.473071 21046 ts_tablet_manager.cc:1434] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent starting tablet: real 0.061s	user 0.019s	sys 0.031s
I20260709 12:27:47.473670 21045 ts_tablet_manager.cc:1403] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a: Time spent bootstrapping tablet: real 0.055s	user 0.034s	sys 0.019s
I20260709 12:27:47.474450 21046 tablet_bootstrap.cc:492] T 81f0c796981141c48241e102703807b9 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Bootstrap starting.
I20260709 12:27:47.476123 21051 raft_consensus.cc:493] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.476684 21051 raft_consensus.cc:515] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.477530 21045 raft_consensus.cc:359] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } }
I20260709 12:27:47.478397 21045 raft_consensus.cc:385] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.478768 21045 raft_consensus.cc:740] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69b3b0ee0bdb42b39768623d8444232a, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.479496 21051 leader_election.cc:290] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:47.481336 21046 tablet_bootstrap.cc:654] T 81f0c796981141c48241e102703807b9 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.472036 21044 tablet_bootstrap.cc:492] T fb866cd22e194cbabbe70fd7b3464ff2 P d19688849fc44393bbf88cb3589a1d3a: No bootstrap required, opened a new log
I20260709 12:27:47.484396 21044 ts_tablet_manager.cc:1403] T fb866cd22e194cbabbe70fd7b3464ff2 P d19688849fc44393bbf88cb3589a1d3a: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.008s
I20260709 12:27:47.486671 21045 consensus_queue.cc:260] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } }
I20260709 12:27:47.487681 21044 raft_consensus.cc:359] T fb866cd22e194cbabbe70fd7b3464ff2 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } }
I20260709 12:27:47.488549 21044 raft_consensus.cc:385] T fb866cd22e194cbabbe70fd7b3464ff2 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.488864 21044 raft_consensus.cc:740] T fb866cd22e194cbabbe70fd7b3464ff2 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.489238 21045 ts_tablet_manager.cc:1434] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:27:47.494357 21045 tablet_bootstrap.cc:492] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a: Bootstrap starting.
I20260709 12:27:47.494946 21044 consensus_queue.cc:260] T fb866cd22e194cbabbe70fd7b3464ff2 P d19688849fc44393bbf88cb3589a1d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } }
I20260709 12:27:47.496917 21046 tablet_bootstrap.cc:492] T 81f0c796981141c48241e102703807b9 P 2ba42136bb0e4a0293c4a2f617a5ec6f: No bootstrap required, opened a new log
I20260709 12:27:47.497550 21046 ts_tablet_manager.cc:1403] T 81f0c796981141c48241e102703807b9 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.005s
I20260709 12:27:47.497756 21044 ts_tablet_manager.cc:1434] T fb866cd22e194cbabbe70fd7b3464ff2 P d19688849fc44393bbf88cb3589a1d3a: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:27:47.498908 21044 tablet_bootstrap.cc:492] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a: Bootstrap starting.
I20260709 12:27:47.500821 21046 raft_consensus.cc:359] T 81f0c796981141c48241e102703807b9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.501591 21046 raft_consensus.cc:385] T 81f0c796981141c48241e102703807b9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.501885 21046 raft_consensus.cc:740] T 81f0c796981141c48241e102703807b9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.502923 21046 consensus_queue.cc:260] T 81f0c796981141c48241e102703807b9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.505053 21046 ts_tablet_manager.cc:1434] T 81f0c796981141c48241e102703807b9 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:27:47.505594 21044 tablet_bootstrap.cc:654] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.508970 21045 tablet_bootstrap.cc:654] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.506070 21046 tablet_bootstrap.cc:492] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Bootstrap starting.
I20260709 12:27:47.517639 21044 tablet_bootstrap.cc:492] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a: No bootstrap required, opened a new log
I20260709 12:27:47.518422 21044 ts_tablet_manager.cc:1403] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 12:27:47.518810 21004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982cee52faae499e8f087e106b51bbd9" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a" is_pre_election: true
W20260709 12:27:47.521097 20895 leader_election.cc:343] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.521760 21044 raft_consensus.cc:359] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.522680 21044 raft_consensus.cc:385] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.522998 21044 raft_consensus.cc:740] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.523828 21044 consensus_queue.cc:260] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.526149 21044 ts_tablet_manager.cc:1434] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 12:27:47.527364 21044 tablet_bootstrap.cc:492] T 81f0c796981141c48241e102703807b9 P d19688849fc44393bbf88cb3589a1d3a: Bootstrap starting.
I20260709 12:27:47.517714 21046 tablet_bootstrap.cc:654] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.533918 21044 tablet_bootstrap.cc:654] T 81f0c796981141c48241e102703807b9 P d19688849fc44393bbf88cb3589a1d3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.541456 21046 tablet_bootstrap.cc:492] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f: No bootstrap required, opened a new log
I20260709 12:27:47.542162 21046 ts_tablet_manager.cc:1403] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.005s
I20260709 12:27:47.545660 21046 raft_consensus.cc:359] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } }
I20260709 12:27:47.546727 21046 raft_consensus.cc:385] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.547055 21046 raft_consensus.cc:740] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.549573 21046 consensus_queue.cc:260] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } }
I20260709 12:27:47.551018 21044 tablet_bootstrap.cc:492] T 81f0c796981141c48241e102703807b9 P d19688849fc44393bbf88cb3589a1d3a: No bootstrap required, opened a new log
I20260709 12:27:47.551651 21044 ts_tablet_manager.cc:1403] T 81f0c796981141c48241e102703807b9 P d19688849fc44393bbf88cb3589a1d3a: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.016s
I20260709 12:27:47.554795 21044 raft_consensus.cc:359] T 81f0c796981141c48241e102703807b9 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.555509 21046 ts_tablet_manager.cc:1434] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:27:47.555567 21044 raft_consensus.cc:385] T 81f0c796981141c48241e102703807b9 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.556237 21044 raft_consensus.cc:740] T 81f0c796981141c48241e102703807b9 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.557062 21046 tablet_bootstrap.cc:492] T 3c498679415641cbb2970d4c4f71930a P 2ba42136bb0e4a0293c4a2f617a5ec6f: Bootstrap starting.
I20260709 12:27:47.557031 21044 consensus_queue.cc:260] T 81f0c796981141c48241e102703807b9 P d19688849fc44393bbf88cb3589a1d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.561761 21044 ts_tablet_manager.cc:1434] T 81f0c796981141c48241e102703807b9 P d19688849fc44393bbf88cb3589a1d3a: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:27:47.563004 21044 tablet_bootstrap.cc:492] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a: Bootstrap starting.
I20260709 12:27:47.565510 21046 tablet_bootstrap.cc:654] T 3c498679415641cbb2970d4c4f71930a P 2ba42136bb0e4a0293c4a2f617a5ec6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.569790 20855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982cee52faae499e8f087e106b51bbd9" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" is_pre_election: true
I20260709 12:27:47.570936 21044 tablet_bootstrap.cc:654] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.572043 21050 raft_consensus.cc:493] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.572744 21050 raft_consensus.cc:515] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } }
W20260709 12:27:47.575459 20894 leader_election.cc:343] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.576184 20894 leader_election.cc:304] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d19688849fc44393bbf88cb3589a1d3a; no voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, 69b3b0ee0bdb42b39768623d8444232a
I20260709 12:27:47.578414 21051 raft_consensus.cc:2749] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:47.584903 21050 leader_election.cc:290] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331), 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867)
I20260709 12:27:47.617715 21045 tablet_bootstrap.cc:492] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a: No bootstrap required, opened a new log
I20260709 12:27:47.618295 21046 tablet_bootstrap.cc:492] T 3c498679415641cbb2970d4c4f71930a P 2ba42136bb0e4a0293c4a2f617a5ec6f: No bootstrap required, opened a new log
I20260709 12:27:47.618441 21045 ts_tablet_manager.cc:1403] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a: Time spent bootstrapping tablet: real 0.124s	user 0.038s	sys 0.061s
I20260709 12:27:47.619212 21046 ts_tablet_manager.cc:1403] T 3c498679415641cbb2970d4c4f71930a P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent bootstrapping tablet: real 0.062s	user 0.014s	sys 0.043s
I20260709 12:27:47.619838 21044 tablet_bootstrap.cc:492] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a: No bootstrap required, opened a new log
I20260709 12:27:47.620472 21044 ts_tablet_manager.cc:1403] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a: Time spent bootstrapping tablet: real 0.058s	user 0.019s	sys 0.021s
I20260709 12:27:47.622073 21045 raft_consensus.cc:359] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.623014 21045 raft_consensus.cc:385] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.622570 21046 raft_consensus.cc:359] T 3c498679415641cbb2970d4c4f71930a P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.623355 21045 raft_consensus.cc:740] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69b3b0ee0bdb42b39768623d8444232a, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.623631 21046 raft_consensus.cc:385] T 3c498679415641cbb2970d4c4f71930a P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.623626 21044 raft_consensus.cc:359] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.624285 21046 raft_consensus.cc:740] T 3c498679415641cbb2970d4c4f71930a P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.624563 21044 raft_consensus.cc:385] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.624369 21045 consensus_queue.cc:260] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.625218 21044 raft_consensus.cc:740] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.625526 21046 consensus_queue.cc:260] T 3c498679415641cbb2970d4c4f71930a P 2ba42136bb0e4a0293c4a2f617a5ec6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.626411 21044 consensus_queue.cc:260] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.629244 21044 ts_tablet_manager.cc:1434] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:27:47.629474 21045 ts_tablet_manager.cc:1434] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:27:47.630730 21045 tablet_bootstrap.cc:492] T 982cee52faae499e8f087e106b51bbd9 P 69b3b0ee0bdb42b39768623d8444232a: Bootstrap starting.
I20260709 12:27:47.632915 21044 tablet_bootstrap.cc:492] T 3c498679415641cbb2970d4c4f71930a P d19688849fc44393bbf88cb3589a1d3a: Bootstrap starting.
I20260709 12:27:47.634842 21046 ts_tablet_manager.cc:1434] T 3c498679415641cbb2970d4c4f71930a P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.003s
I20260709 12:27:47.636263 21046 tablet_bootstrap.cc:492] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Bootstrap starting.
I20260709 12:27:47.637565 21045 tablet_bootstrap.cc:654] T 982cee52faae499e8f087e106b51bbd9 P 69b3b0ee0bdb42b39768623d8444232a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.640452 21044 tablet_bootstrap.cc:654] T 3c498679415641cbb2970d4c4f71930a P d19688849fc44393bbf88cb3589a1d3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.643503 21046 tablet_bootstrap.cc:654] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.645362 20930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb866cd22e194cbabbe70fd7b3464ff2" candidate_uuid: "69b3b0ee0bdb42b39768623d8444232a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a" is_pre_election: true
I20260709 12:27:47.646241 20930 raft_consensus.cc:2468] T fb866cd22e194cbabbe70fd7b3464ff2 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69b3b0ee0bdb42b39768623d8444232a in term 0.
I20260709 12:27:47.647737 20969 leader_election.cc:304] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69b3b0ee0bdb42b39768623d8444232a, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:47.648701 21050 raft_consensus.cc:2804] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:47.649097 21050 raft_consensus.cc:493] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:47.649430 21050 raft_consensus.cc:3060] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.650471 21051 raft_consensus.cc:493] T 31700e88bf154c04bf1ea79652e72042 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.651036 21051 raft_consensus.cc:515] T 31700e88bf154c04bf1ea79652e72042 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.654719 21004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31700e88bf154c04bf1ea79652e72042" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a" is_pre_election: true
I20260709 12:27:47.655757 21051 leader_election.cc:290] T 31700e88bf154c04bf1ea79652e72042 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
W20260709 12:27:47.656980 20895 leader_election.cc:343] T 31700e88bf154c04bf1ea79652e72042 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.658694 21050 raft_consensus.cc:515] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } }
I20260709 12:27:47.659287 20855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31700e88bf154c04bf1ea79652e72042" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" is_pre_election: true
W20260709 12:27:47.660895 20894 leader_election.cc:343] T 31700e88bf154c04bf1ea79652e72042 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.661365 20894 leader_election.cc:304] T 31700e88bf154c04bf1ea79652e72042 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d19688849fc44393bbf88cb3589a1d3a; no voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, 69b3b0ee0bdb42b39768623d8444232a
I20260709 12:27:47.663793 21051 raft_consensus.cc:2749] T 31700e88bf154c04bf1ea79652e72042 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:47.667618 20930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb866cd22e194cbabbe70fd7b3464ff2" candidate_uuid: "69b3b0ee0bdb42b39768623d8444232a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
I20260709 12:27:47.668267 20930 raft_consensus.cc:3060] T fb866cd22e194cbabbe70fd7b3464ff2 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.673233 21053 raft_consensus.cc:493] T 81f0c796981141c48241e102703807b9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.673959 21053 raft_consensus.cc:515] T 81f0c796981141c48241e102703807b9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.676919 21053 leader_election.cc:290] T 81f0c796981141c48241e102703807b9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:47.677490 21050 leader_election.cc:290] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a [CANDIDATE]: Term 1 election: Requested vote from peers d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331), 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867)
I20260709 12:27:47.678251 21050 raft_consensus.cc:493] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.678719 21050 raft_consensus.cc:515] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
W20260709 12:27:47.684747 20801 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:47.686213 20929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f0c796981141c48241e102703807b9" candidate_uuid: "69b3b0ee0bdb42b39768623d8444232a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a" is_pre_election: true
I20260709 12:27:47.676916 20930 raft_consensus.cc:2468] T fb866cd22e194cbabbe70fd7b3464ff2 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69b3b0ee0bdb42b39768623d8444232a in term 1.
I20260709 12:27:47.687116 20929 raft_consensus.cc:2468] T 81f0c796981141c48241e102703807b9 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69b3b0ee0bdb42b39768623d8444232a in term 0.
I20260709 12:27:47.687758 21050 leader_election.cc:290] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331)
I20260709 12:27:47.689113 20969 leader_election.cc:304] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69b3b0ee0bdb42b39768623d8444232a, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:47.690937 20969 leader_election.cc:304] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69b3b0ee0bdb42b39768623d8444232a, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:47.691879 21050 raft_consensus.cc:2804] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:47.694880 21053 raft_consensus.cc:493] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.695639 21053 raft_consensus.cc:515] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } }
I20260709 12:27:47.695246 21073 raft_consensus.cc:2804] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:47.697316 21073 raft_consensus.cc:493] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:47.697683 21073 raft_consensus.cc:3060] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.698271 21050 raft_consensus.cc:697] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a [term 1 LEADER]: Becoming Leader. State: Replica: 69b3b0ee0bdb42b39768623d8444232a, State: Running, Role: LEADER
I20260709 12:27:47.697830 21053 leader_election.cc:290] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581), d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331)
I20260709 12:27:47.698840 21044 tablet_bootstrap.cc:492] T 3c498679415641cbb2970d4c4f71930a P d19688849fc44393bbf88cb3589a1d3a: No bootstrap required, opened a new log
I20260709 12:27:47.700961 21044 ts_tablet_manager.cc:1403] T 3c498679415641cbb2970d4c4f71930a P d19688849fc44393bbf88cb3589a1d3a: Time spent bootstrapping tablet: real 0.068s	user 0.007s	sys 0.010s
I20260709 12:27:47.702194 21050 consensus_queue.cc:237] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } }
I20260709 12:27:47.702996 20855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb866cd22e194cbabbe70fd7b3464ff2" candidate_uuid: "69b3b0ee0bdb42b39768623d8444232a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" is_pre_election: true
I20260709 12:27:47.703718 20855 raft_consensus.cc:2468] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69b3b0ee0bdb42b39768623d8444232a in term 0.
I20260709 12:27:47.705152 21044 raft_consensus.cc:359] T 3c498679415641cbb2970d4c4f71930a P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.706537 20855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb866cd22e194cbabbe70fd7b3464ff2" candidate_uuid: "69b3b0ee0bdb42b39768623d8444232a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
I20260709 12:27:47.707315 20855 raft_consensus.cc:3060] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.706022 21044 raft_consensus.cc:385] T 3c498679415641cbb2970d4c4f71930a P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.708820 21044 raft_consensus.cc:740] T 3c498679415641cbb2970d4c4f71930a P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.709853 21044 consensus_queue.cc:260] T 3c498679415641cbb2970d4c4f71930a P d19688849fc44393bbf88cb3589a1d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.715994 20855 raft_consensus.cc:2468] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69b3b0ee0bdb42b39768623d8444232a in term 1.
I20260709 12:27:47.719242 21073 raft_consensus.cc:515] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.720099 21044 ts_tablet_manager.cc:1434] T 3c498679415641cbb2970d4c4f71930a P d19688849fc44393bbf88cb3589a1d3a: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:27:47.720654 20855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f0c796981141c48241e102703807b9" candidate_uuid: "69b3b0ee0bdb42b39768623d8444232a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" is_pre_election: true
I20260709 12:27:47.721369 20855 raft_consensus.cc:2468] T 81f0c796981141c48241e102703807b9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69b3b0ee0bdb42b39768623d8444232a in term 0.
I20260709 12:27:47.722543 20854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f0c796981141c48241e102703807b9" candidate_uuid: "69b3b0ee0bdb42b39768623d8444232a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
I20260709 12:27:47.723373 20854 raft_consensus.cc:3060] T 81f0c796981141c48241e102703807b9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.724426 21073 leader_election.cc:290] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a [CANDIDATE]: Term 1 election: Requested vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331)
I20260709 12:27:47.726158 20929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f0c796981141c48241e102703807b9" candidate_uuid: "69b3b0ee0bdb42b39768623d8444232a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
I20260709 12:27:47.726817 20929 raft_consensus.cc:3060] T 81f0c796981141c48241e102703807b9 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.722529 21045 tablet_bootstrap.cc:492] T 982cee52faae499e8f087e106b51bbd9 P 69b3b0ee0bdb42b39768623d8444232a: No bootstrap required, opened a new log
I20260709 12:27:47.729071 21045 ts_tablet_manager.cc:1403] T 982cee52faae499e8f087e106b51bbd9 P 69b3b0ee0bdb42b39768623d8444232a: Time spent bootstrapping tablet: real 0.099s	user 0.026s	sys 0.034s
I20260709 12:27:47.730882 20930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f0c796981141c48241e102703807b9" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a" is_pre_election: true
I20260709 12:27:47.730671 20752 catalog_manager.cc:5697] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a reported cstate change: term changed from 0 to 1, leader changed from <none> to 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195). New cstate: current_term: 1 leader_uuid: "69b3b0ee0bdb42b39768623d8444232a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:47.732244 21045 raft_consensus.cc:359] T 982cee52faae499e8f087e106b51bbd9 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.733103 21045 raft_consensus.cc:385] T 982cee52faae499e8f087e106b51bbd9 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.733412 21045 raft_consensus.cc:740] T 982cee52faae499e8f087e106b51bbd9 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69b3b0ee0bdb42b39768623d8444232a, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.732542 20928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb866cd22e194cbabbe70fd7b3464ff2" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a" is_pre_election: true
I20260709 12:27:47.734283 21045 consensus_queue.cc:260] T 982cee52faae499e8f087e106b51bbd9 P 69b3b0ee0bdb42b39768623d8444232a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.734299 20928 raft_consensus.cc:2393] T fb866cd22e194cbabbe70fd7b3464ff2 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in current term 1: Already voted for candidate 69b3b0ee0bdb42b39768623d8444232a in this term.
I20260709 12:27:47.736078 21004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f0c796981141c48241e102703807b9" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a" is_pre_election: true
I20260709 12:27:47.734308 21046 tablet_bootstrap.cc:492] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f: No bootstrap required, opened a new log
I20260709 12:27:47.736915 21004 raft_consensus.cc:2393] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in current term 1: Already voted for candidate 69b3b0ee0bdb42b39768623d8444232a in this term.
I20260709 12:27:47.737115 21046 ts_tablet_manager.cc:1403] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent bootstrapping tablet: real 0.101s	user 0.022s	sys 0.026s
I20260709 12:27:47.738402 21045 ts_tablet_manager.cc:1434] T 982cee52faae499e8f087e106b51bbd9 P 69b3b0ee0bdb42b39768623d8444232a: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:27:47.740417 21046 raft_consensus.cc:359] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.741271 21046 raft_consensus.cc:385] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.741591 21046 raft_consensus.cc:740] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.738605 20820 leader_election.cc:304] T 81f0c796981141c48241e102703807b9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f; no voters: 69b3b0ee0bdb42b39768623d8444232a, d19688849fc44393bbf88cb3589a1d3a
I20260709 12:27:47.739981 21004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb866cd22e194cbabbe70fd7b3464ff2" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a" is_pre_election: true
I20260709 12:27:47.740633 20929 raft_consensus.cc:2468] T 81f0c796981141c48241e102703807b9 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69b3b0ee0bdb42b39768623d8444232a in term 1.
I20260709 12:27:47.745676 20969 leader_election.cc:304] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69b3b0ee0bdb42b39768623d8444232a, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:47.745397 21046 consensus_queue.cc:260] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.745534 20820 leader_election.cc:304] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f; no voters: 69b3b0ee0bdb42b39768623d8444232a, d19688849fc44393bbf88cb3589a1d3a
I20260709 12:27:47.744563 21044 tablet_bootstrap.cc:492] T 8c6b02b11e4d46939d1da88c9b12d062 P d19688849fc44393bbf88cb3589a1d3a: Bootstrap starting.
I20260709 12:27:47.742141 21045 tablet_bootstrap.cc:492] T 3c498679415641cbb2970d4c4f71930a P 69b3b0ee0bdb42b39768623d8444232a: Bootstrap starting.
I20260709 12:27:47.746644 21050 raft_consensus.cc:2804] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:47.747129 21051 raft_consensus.cc:493] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.748160 21050 raft_consensus.cc:697] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a [term 1 LEADER]: Becoming Leader. State: Replica: 69b3b0ee0bdb42b39768623d8444232a, State: Running, Role: LEADER
I20260709 12:27:47.748201 21051 raft_consensus.cc:515] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.749421 21050 consensus_queue.cc:237] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.750945 21051 leader_election.cc:290] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:47.757969 20854 raft_consensus.cc:2468] T 81f0c796981141c48241e102703807b9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69b3b0ee0bdb42b39768623d8444232a in term 1.
I20260709 12:27:47.758805 21053 raft_consensus.cc:2749] T 81f0c796981141c48241e102703807b9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:47.762308 21004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14928e2dd87f43abb72a0cecdcf24c54" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a" is_pre_election: true
I20260709 12:27:47.763278 21004 raft_consensus.cc:2468] T 14928e2dd87f43abb72a0cecdcf24c54 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 0.
I20260709 12:27:47.764824 20895 leader_election.cc:304] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69b3b0ee0bdb42b39768623d8444232a, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:47.765937 21051 raft_consensus.cc:2804] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:47.766407 21051 raft_consensus.cc:493] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:47.766752 21051 raft_consensus.cc:3060] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.771291 21053 raft_consensus.cc:2749] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:47.778894 21044 tablet_bootstrap.cc:654] T 8c6b02b11e4d46939d1da88c9b12d062 P d19688849fc44393bbf88cb3589a1d3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.782990 21045 tablet_bootstrap.cc:654] T 3c498679415641cbb2970d4c4f71930a P 69b3b0ee0bdb42b39768623d8444232a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.787967 21046 ts_tablet_manager.cc:1434] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent starting tablet: real 0.050s	user 0.029s	sys 0.011s
I20260709 12:27:47.788606 20854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14928e2dd87f43abb72a0cecdcf24c54" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" is_pre_election: true
I20260709 12:27:47.789780 21046 tablet_bootstrap.cc:492] T 31700e88bf154c04bf1ea79652e72042 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Bootstrap starting.
I20260709 12:27:47.791258 20854 raft_consensus.cc:2468] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 0.
I20260709 12:27:47.792652 21051 raft_consensus.cc:515] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.797186 21004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14928e2dd87f43abb72a0cecdcf24c54" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
I20260709 12:27:47.797885 21004 raft_consensus.cc:3060] T 14928e2dd87f43abb72a0cecdcf24c54 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.797809 21046 tablet_bootstrap.cc:654] T 31700e88bf154c04bf1ea79652e72042 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.802304 21051 leader_election.cc:290] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 1 election: Requested vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:47.806303 21046 tablet_bootstrap.cc:492] T 31700e88bf154c04bf1ea79652e72042 P 2ba42136bb0e4a0293c4a2f617a5ec6f: No bootstrap required, opened a new log
I20260709 12:27:47.806854 21046 ts_tablet_manager.cc:1403] T 31700e88bf154c04bf1ea79652e72042 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.003s
I20260709 12:27:47.809242 21046 raft_consensus.cc:359] T 31700e88bf154c04bf1ea79652e72042 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.809850 21046 raft_consensus.cc:385] T 31700e88bf154c04bf1ea79652e72042 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.810204 21046 raft_consensus.cc:740] T 31700e88bf154c04bf1ea79652e72042 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.809507 20752 catalog_manager.cc:5697] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a reported cstate change: term changed from 0 to 1, leader changed from <none> to 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195). New cstate: current_term: 1 leader_uuid: "69b3b0ee0bdb42b39768623d8444232a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:47.797525 20854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14928e2dd87f43abb72a0cecdcf24c54" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
I20260709 12:27:47.811163 21046 consensus_queue.cc:260] T 31700e88bf154c04bf1ea79652e72042 P 2ba42136bb0e4a0293c4a2f617a5ec6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.812111 20854 raft_consensus.cc:3060] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.813547 21044 tablet_bootstrap.cc:492] T 8c6b02b11e4d46939d1da88c9b12d062 P d19688849fc44393bbf88cb3589a1d3a: No bootstrap required, opened a new log
I20260709 12:27:47.814005 21046 ts_tablet_manager.cc:1434] T 31700e88bf154c04bf1ea79652e72042 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:27:47.814155 21044 ts_tablet_manager.cc:1403] T 8c6b02b11e4d46939d1da88c9b12d062 P d19688849fc44393bbf88cb3589a1d3a: Time spent bootstrapping tablet: real 0.071s	user 0.018s	sys 0.001s
I20260709 12:27:47.815243 21046 tablet_bootstrap.cc:492] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Bootstrap starting.
I20260709 12:27:47.817203 21044 raft_consensus.cc:359] T 8c6b02b11e4d46939d1da88c9b12d062 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.811031 21004 raft_consensus.cc:2468] T 14928e2dd87f43abb72a0cecdcf24c54 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 1.
I20260709 12:27:47.821024 20895 leader_election.cc:304] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69b3b0ee0bdb42b39768623d8444232a, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:47.821950 21051 raft_consensus.cc:2804] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:47.824400 20854 raft_consensus.cc:2468] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 1.
I20260709 12:27:47.826309 21046 tablet_bootstrap.cc:654] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.817889 21044 raft_consensus.cc:385] T 8c6b02b11e4d46939d1da88c9b12d062 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.827139 21044 raft_consensus.cc:740] T 8c6b02b11e4d46939d1da88c9b12d062 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.828161 21044 consensus_queue.cc:260] T 8c6b02b11e4d46939d1da88c9b12d062 P d19688849fc44393bbf88cb3589a1d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.829522 21051 raft_consensus.cc:697] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [term 1 LEADER]: Becoming Leader. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Running, Role: LEADER
I20260709 12:27:47.830648 21051 consensus_queue.cc:237] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.832788 21045 tablet_bootstrap.cc:492] T 3c498679415641cbb2970d4c4f71930a P 69b3b0ee0bdb42b39768623d8444232a: No bootstrap required, opened a new log
I20260709 12:27:47.833416 21045 ts_tablet_manager.cc:1403] T 3c498679415641cbb2970d4c4f71930a P 69b3b0ee0bdb42b39768623d8444232a: Time spent bootstrapping tablet: real 0.092s	user 0.019s	sys 0.002s
I20260709 12:27:47.833675 21046 tablet_bootstrap.cc:492] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f: No bootstrap required, opened a new log
I20260709 12:27:47.834308 21078 raft_consensus.cc:493] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.834859 21078 raft_consensus.cc:515] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.836716 21045 raft_consensus.cc:359] T 3c498679415641cbb2970d4c4f71930a P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.837563 21045 raft_consensus.cc:385] T 3c498679415641cbb2970d4c4f71930a P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.837898 21045 raft_consensus.cc:740] T 3c498679415641cbb2970d4c4f71930a P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69b3b0ee0bdb42b39768623d8444232a, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.837080 21078 leader_election.cc:290] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:47.838737 21045 consensus_queue.cc:260] T 3c498679415641cbb2970d4c4f71930a P 69b3b0ee0bdb42b39768623d8444232a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.839169 20929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85248b50821b406ca1571b018430b9f5" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a" is_pre_election: true
I20260709 12:27:47.839771 21046 ts_tablet_manager.cc:1403] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.004s
I20260709 12:27:47.840077 20929 raft_consensus.cc:2468] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 0.
I20260709 12:27:47.841602 20820 leader_election.cc:304] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:47.841789 21044 ts_tablet_manager.cc:1434] T 8c6b02b11e4d46939d1da88c9b12d062 P d19688849fc44393bbf88cb3589a1d3a: Time spent starting tablet: real 0.027s	user 0.012s	sys 0.001s
I20260709 12:27:47.842525 21078 raft_consensus.cc:2804] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:47.839171 21004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85248b50821b406ca1571b018430b9f5" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a" is_pre_election: true
I20260709 12:27:47.843142 21044 tablet_bootstrap.cc:492] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a: Bootstrap starting.
W20260709 12:27:47.844290 20820 leader_election.cc:343] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.842945 21078 raft_consensus.cc:493] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:47.845613 21078 raft_consensus.cc:3060] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.850282 21044 tablet_bootstrap.cc:654] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.851681 21077 raft_consensus.cc:493] T 31700e88bf154c04bf1ea79652e72042 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.852264 21077 raft_consensus.cc:515] T 31700e88bf154c04bf1ea79652e72042 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.841595 21045 ts_tablet_manager.cc:1434] T 3c498679415641cbb2970d4c4f71930a P 69b3b0ee0bdb42b39768623d8444232a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:27:47.854089 21078 raft_consensus.cc:515] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.855777 20929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31700e88bf154c04bf1ea79652e72042" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a" is_pre_election: true
I20260709 12:27:47.856501 20929 raft_consensus.cc:2468] T 31700e88bf154c04bf1ea79652e72042 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 0.
I20260709 12:27:47.857293 21078 leader_election.cc:290] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 election: Requested vote from peers d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:47.858404 21004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31700e88bf154c04bf1ea79652e72042" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a" is_pre_election: true
I20260709 12:27:47.854562 21077 leader_election.cc:290] T 31700e88bf154c04bf1ea79652e72042 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:47.855075 21046 raft_consensus.cc:359] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.860117 21046 raft_consensus.cc:385] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.857765 20752 catalog_manager.cc:5697] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a reported cstate change: term changed from 0 to 1, leader changed from <none> to d19688849fc44393bbf88cb3589a1d3a (127.9.145.194). New cstate: current_term: 1 leader_uuid: "d19688849fc44393bbf88cb3589a1d3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:47.860432 21004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85248b50821b406ca1571b018430b9f5" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
I20260709 12:27:47.862185 21045 tablet_bootstrap.cc:492] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a: Bootstrap starting.
I20260709 12:27:47.861060 20820 leader_election.cc:304] T 31700e88bf154c04bf1ea79652e72042 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:47.863420 21077 raft_consensus.cc:2804] T 31700e88bf154c04bf1ea79652e72042 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:27:47.863631 20820 leader_election.cc:343] T 31700e88bf154c04bf1ea79652e72042 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.863813 21077 raft_consensus.cc:493] T 31700e88bf154c04bf1ea79652e72042 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:47.864220 21077 raft_consensus.cc:3060] T 31700e88bf154c04bf1ea79652e72042 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:47.864709 20820 leader_election.cc:343] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.860853 20929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85248b50821b406ca1571b018430b9f5" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
I20260709 12:27:47.865744 20929 raft_consensus.cc:3060] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.860448 21046 raft_consensus.cc:740] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.867328 21046 consensus_queue.cc:260] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.870244 21046 ts_tablet_manager.cc:1434] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.003s
I20260709 12:27:47.871462 21046 tablet_bootstrap.cc:492] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Bootstrap starting.
I20260709 12:27:47.872423 21077 raft_consensus.cc:515] T 31700e88bf154c04bf1ea79652e72042 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.873728 20929 raft_consensus.cc:2468] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 1.
I20260709 12:27:47.874953 21077 leader_election.cc:290] T 31700e88bf154c04bf1ea79652e72042 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 election: Requested vote from peers d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:47.876073 20928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31700e88bf154c04bf1ea79652e72042" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
I20260709 12:27:47.876845 20928 raft_consensus.cc:3060] T 31700e88bf154c04bf1ea79652e72042 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.878357 21046 tablet_bootstrap.cc:654] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.880367 21045 tablet_bootstrap.cc:654] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.881129 21004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31700e88bf154c04bf1ea79652e72042" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
I20260709 12:27:47.882776 20820 leader_election.cc:304] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, d19688849fc44393bbf88cb3589a1d3a; no voters: 69b3b0ee0bdb42b39768623d8444232a
W20260709 12:27:47.884231 20820 leader_election.cc:343] T 31700e88bf154c04bf1ea79652e72042 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.889003 21077 raft_consensus.cc:493] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.889997 21077 raft_consensus.cc:515] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.892269 21077 leader_election.cc:290] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:47.893168 21044 tablet_bootstrap.cc:492] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a: No bootstrap required, opened a new log
I20260709 12:27:47.893781 21044 ts_tablet_manager.cc:1403] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a: Time spent bootstrapping tablet: real 0.051s	user 0.008s	sys 0.009s
I20260709 12:27:47.894745 21004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6b02b11e4d46939d1da88c9b12d062" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a" is_pre_election: true
W20260709 12:27:47.896546 20820 leader_election.cc:343] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.896831 21044 raft_consensus.cc:359] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.897470 20929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6b02b11e4d46939d1da88c9b12d062" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a" is_pre_election: true
I20260709 12:27:47.898227 20929 raft_consensus.cc:2468] T 8c6b02b11e4d46939d1da88c9b12d062 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 0.
I20260709 12:27:47.899466 20820 leader_election.cc:304] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, d19688849fc44393bbf88cb3589a1d3a; no voters: 69b3b0ee0bdb42b39768623d8444232a
I20260709 12:27:47.900732 21077 raft_consensus.cc:2804] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:47.900985 20928 raft_consensus.cc:2468] T 31700e88bf154c04bf1ea79652e72042 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 1.
I20260709 12:27:47.901144 21077 raft_consensus.cc:493] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:47.888913 21078 raft_consensus.cc:2804] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:47.902406 21078 raft_consensus.cc:697] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Becoming Leader. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Running, Role: LEADER
I20260709 12:27:47.902525 20820 leader_election.cc:304] T 31700e88bf154c04bf1ea79652e72042 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, d19688849fc44393bbf88cb3589a1d3a; no voters: 69b3b0ee0bdb42b39768623d8444232a
I20260709 12:27:47.903731 21053 raft_consensus.cc:2804] T 31700e88bf154c04bf1ea79652e72042 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:47.903353 21078 consensus_queue.cc:237] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.904685 21044 raft_consensus.cc:385] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.905012 21044 raft_consensus.cc:740] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.903251 21077 raft_consensus.cc:3060] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.906652 21053 raft_consensus.cc:697] T 31700e88bf154c04bf1ea79652e72042 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Becoming Leader. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Running, Role: LEADER
I20260709 12:27:47.908941 21053 consensus_queue.cc:237] T 31700e88bf154c04bf1ea79652e72042 P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.907207 21044 consensus_queue.cc:260] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.915716 21044 ts_tablet_manager.cc:1434] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 12:27:47.918821 21077 raft_consensus.cc:515] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.921366 21077 leader_election.cc:290] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 election: Requested vote from peers d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:47.922082 21046 tablet_bootstrap.cc:492] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f: No bootstrap required, opened a new log
I20260709 12:27:47.922770 21046 ts_tablet_manager.cc:1403] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent bootstrapping tablet: real 0.052s	user 0.033s	sys 0.009s
I20260709 12:27:47.923800 21045 tablet_bootstrap.cc:492] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a: No bootstrap required, opened a new log
I20260709 12:27:47.924446 21045 ts_tablet_manager.cc:1403] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a: Time spent bootstrapping tablet: real 0.063s	user 0.007s	sys 0.007s
I20260709 12:27:47.925587 21046 raft_consensus.cc:359] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.926383 21046 raft_consensus.cc:385] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.926664 21046 raft_consensus.cc:740] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.926738 21004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6b02b11e4d46939d1da88c9b12d062" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
I20260709 12:27:47.927385 21046 consensus_queue.cc:260] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.927718 21045 raft_consensus.cc:359] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
W20260709 12:27:47.928457 20820 leader_election.cc:343] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.929353 21046 ts_tablet_manager.cc:1434] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:27:47.923990 20751 catalog_manager.cc:5697] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193). New cstate: current_term: 1 leader_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:47.930346 21046 tablet_bootstrap.cc:492] T d0a1fdfc30754de192891e2312d5c020 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Bootstrap starting.
I20260709 12:27:47.928485 21045 raft_consensus.cc:385] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.930954 21045 raft_consensus.cc:740] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69b3b0ee0bdb42b39768623d8444232a, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.931737 21045 consensus_queue.cc:260] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.934157 21045 ts_tablet_manager.cc:1434] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:27:47.935246 21045 tablet_bootstrap.cc:492] T 31700e88bf154c04bf1ea79652e72042 P 69b3b0ee0bdb42b39768623d8444232a: Bootstrap starting.
I20260709 12:27:47.935357 20928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6b02b11e4d46939d1da88c9b12d062" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
I20260709 12:27:47.936117 21046 tablet_bootstrap.cc:654] T d0a1fdfc30754de192891e2312d5c020 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.936056 20928 raft_consensus.cc:3060] T 8c6b02b11e4d46939d1da88c9b12d062 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.942554 21045 tablet_bootstrap.cc:654] T 31700e88bf154c04bf1ea79652e72042 P 69b3b0ee0bdb42b39768623d8444232a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.946707 20928 raft_consensus.cc:2468] T 8c6b02b11e4d46939d1da88c9b12d062 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 1.
I20260709 12:27:47.948422 20820 leader_election.cc:304] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, d19688849fc44393bbf88cb3589a1d3a; no voters: 69b3b0ee0bdb42b39768623d8444232a
I20260709 12:27:47.950491 21077 raft_consensus.cc:2804] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:47.951341 21077 raft_consensus.cc:697] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Becoming Leader. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Running, Role: LEADER
I20260709 12:27:47.952303 21077 consensus_queue.cc:237] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.960652 21078 raft_consensus.cc:493] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.961315 21078 raft_consensus.cc:515] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.962239 20753 catalog_manager.cc:5697] T 31700e88bf154c04bf1ea79652e72042 P 2ba42136bb0e4a0293c4a2f617a5ec6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193). New cstate: current_term: 1 leader_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:47.963387 21078 leader_election.cc:290] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:47.964644 20928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982cee52faae499e8f087e106b51bbd9" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a" is_pre_election: true
I20260709 12:27:47.965157 21004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982cee52faae499e8f087e106b51bbd9" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a" is_pre_election: true
I20260709 12:27:47.965374 20928 raft_consensus.cc:2468] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 0.
I20260709 12:27:47.965855 21004 raft_consensus.cc:2468] T 982cee52faae499e8f087e106b51bbd9 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 0.
I20260709 12:27:47.966689 20820 leader_election.cc:304] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:47.967682 21053 raft_consensus.cc:493] T 3c498679415641cbb2970d4c4f71930a P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.968215 21053 raft_consensus.cc:515] T 3c498679415641cbb2970d4c4f71930a P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.967511 21078 raft_consensus.cc:2804] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:47.975235 21045 tablet_bootstrap.cc:492] T 31700e88bf154c04bf1ea79652e72042 P 69b3b0ee0bdb42b39768623d8444232a: No bootstrap required, opened a new log
I20260709 12:27:47.976109 21045 ts_tablet_manager.cc:1403] T 31700e88bf154c04bf1ea79652e72042 P 69b3b0ee0bdb42b39768623d8444232a: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.012s
I20260709 12:27:47.980104 21045 raft_consensus.cc:359] T 31700e88bf154c04bf1ea79652e72042 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.981076 21045 raft_consensus.cc:385] T 31700e88bf154c04bf1ea79652e72042 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.981614 21045 raft_consensus.cc:740] T 31700e88bf154c04bf1ea79652e72042 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69b3b0ee0bdb42b39768623d8444232a, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.982745 21045 consensus_queue.cc:260] T 31700e88bf154c04bf1ea79652e72042 P 69b3b0ee0bdb42b39768623d8444232a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:47.986016 21045 ts_tablet_manager.cc:1434] T 31700e88bf154c04bf1ea79652e72042 P 69b3b0ee0bdb42b39768623d8444232a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:27:47.987481 21045 tablet_bootstrap.cc:492] T 8c6b02b11e4d46939d1da88c9b12d062 P 69b3b0ee0bdb42b39768623d8444232a: Bootstrap starting.
I20260709 12:27:47.970605 21053 leader_election.cc:290] T 3c498679415641cbb2970d4c4f71930a P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:47.971232 21078 raft_consensus.cc:493] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:47.988848 21004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c498679415641cbb2970d4c4f71930a" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a" is_pre_election: true
I20260709 12:27:47.990726 21004 raft_consensus.cc:2468] T 3c498679415641cbb2970d4c4f71930a P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 0.
I20260709 12:27:47.988880 20928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c498679415641cbb2970d4c4f71930a" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a" is_pre_election: true
I20260709 12:27:47.994776 20928 raft_consensus.cc:2468] T 3c498679415641cbb2970d4c4f71930a P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 0.
I20260709 12:27:47.996454 21078 raft_consensus.cc:3060] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.996904 21046 tablet_bootstrap.cc:492] T d0a1fdfc30754de192891e2312d5c020 P 2ba42136bb0e4a0293c4a2f617a5ec6f: No bootstrap required, opened a new log
I20260709 12:27:47.997552 21046 ts_tablet_manager.cc:1403] T d0a1fdfc30754de192891e2312d5c020 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent bootstrapping tablet: real 0.067s	user 0.030s	sys 0.034s
I20260709 12:27:48.000535 21046 raft_consensus.cc:359] T d0a1fdfc30754de192891e2312d5c020 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.000558 20820 leader_election.cc:304] T 3c498679415641cbb2970d4c4f71930a P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:48.001310 21046 raft_consensus.cc:385] T d0a1fdfc30754de192891e2312d5c020 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:48.001629 21046 raft_consensus.cc:740] T d0a1fdfc30754de192891e2312d5c020 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Initialized, Role: FOLLOWER
I20260709 12:27:48.002328 21053 raft_consensus.cc:2804] T 3c498679415641cbb2970d4c4f71930a P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:48.002460 21046 consensus_queue.cc:260] T d0a1fdfc30754de192891e2312d5c020 P 2ba42136bb0e4a0293c4a2f617a5ec6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.003567 21053 raft_consensus.cc:493] T 3c498679415641cbb2970d4c4f71930a P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:48.003976 21053 raft_consensus.cc:3060] T 3c498679415641cbb2970d4c4f71930a P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:48.005528 21046 ts_tablet_manager.cc:1434] T d0a1fdfc30754de192891e2312d5c020 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.008s
I20260709 12:27:48.011531 21045 tablet_bootstrap.cc:654] T 8c6b02b11e4d46939d1da88c9b12d062 P 69b3b0ee0bdb42b39768623d8444232a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:48.013226 21053 raft_consensus.cc:515] T 3c498679415641cbb2970d4c4f71930a P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.013738 21078 raft_consensus.cc:515] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.016413 21078 leader_election.cc:290] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 election: Requested vote from peers d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:48.015713 20753 catalog_manager.cc:5697] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193). New cstate: current_term: 1 leader_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:48.017868 21053 leader_election.cc:290] T 3c498679415641cbb2970d4c4f71930a P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 election: Requested vote from peers d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:48.018697 21004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982cee52faae499e8f087e106b51bbd9" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
I20260709 12:27:48.019358 21004 raft_consensus.cc:3060] T 982cee52faae499e8f087e106b51bbd9 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:48.019829 21045 tablet_bootstrap.cc:492] T 8c6b02b11e4d46939d1da88c9b12d062 P 69b3b0ee0bdb42b39768623d8444232a: No bootstrap required, opened a new log
I20260709 12:27:48.016749 20928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c498679415641cbb2970d4c4f71930a" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
I20260709 12:27:48.020445 20928 raft_consensus.cc:3060] T 3c498679415641cbb2970d4c4f71930a P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:48.020454 21045 ts_tablet_manager.cc:1403] T 8c6b02b11e4d46939d1da88c9b12d062 P 69b3b0ee0bdb42b39768623d8444232a: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.000s
I20260709 12:27:48.022251 20929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982cee52faae499e8f087e106b51bbd9" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
I20260709 12:27:48.022878 20929 raft_consensus.cc:3060] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:48.023550 21045 raft_consensus.cc:359] T 8c6b02b11e4d46939d1da88c9b12d062 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.024246 21045 raft_consensus.cc:385] T 8c6b02b11e4d46939d1da88c9b12d062 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:48.024516 21045 raft_consensus.cc:740] T 8c6b02b11e4d46939d1da88c9b12d062 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69b3b0ee0bdb42b39768623d8444232a, State: Initialized, Role: FOLLOWER
I20260709 12:27:48.025390 21045 consensus_queue.cc:260] T 8c6b02b11e4d46939d1da88c9b12d062 P 69b3b0ee0bdb42b39768623d8444232a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.027427 21004 raft_consensus.cc:2468] T 982cee52faae499e8f087e106b51bbd9 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 1.
I20260709 12:27:48.028249 20928 raft_consensus.cc:2468] T 3c498679415641cbb2970d4c4f71930a P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 1.
I20260709 12:27:48.027443 21045 ts_tablet_manager.cc:1434] T 8c6b02b11e4d46939d1da88c9b12d062 P 69b3b0ee0bdb42b39768623d8444232a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:27:48.030593 21045 tablet_bootstrap.cc:492] T d0a1fdfc30754de192891e2312d5c020 P 69b3b0ee0bdb42b39768623d8444232a: Bootstrap starting.
I20260709 12:27:48.029443 20820 leader_election.cc:304] T 3c498679415641cbb2970d4c4f71930a P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:48.031602 20820 leader_election.cc:304] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, 69b3b0ee0bdb42b39768623d8444232a; no voters: 
I20260709 12:27:48.032419 21077 raft_consensus.cc:2804] T 3c498679415641cbb2970d4c4f71930a P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:48.032505 21053 raft_consensus.cc:2804] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:48.032989 21077 raft_consensus.cc:697] T 3c498679415641cbb2970d4c4f71930a P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Becoming Leader. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Running, Role: LEADER
I20260709 12:27:48.033881 21077 consensus_queue.cc:237] T 3c498679415641cbb2970d4c4f71930a P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.035828 20929 raft_consensus.cc:2468] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 1.
I20260709 12:27:48.037360 21045 tablet_bootstrap.cc:654] T d0a1fdfc30754de192891e2312d5c020 P 69b3b0ee0bdb42b39768623d8444232a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:48.040863 21004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c498679415641cbb2970d4c4f71930a" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
I20260709 12:27:48.041440 21053 raft_consensus.cc:697] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Becoming Leader. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Running, Role: LEADER
I20260709 12:27:48.041667 21004 raft_consensus.cc:3060] T 3c498679415641cbb2970d4c4f71930a P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:48.042518 21053 consensus_queue.cc:237] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.050902 21004 raft_consensus.cc:2468] T 3c498679415641cbb2970d4c4f71930a P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 1.
I20260709 12:27:48.056872 21045 tablet_bootstrap.cc:492] T d0a1fdfc30754de192891e2312d5c020 P 69b3b0ee0bdb42b39768623d8444232a: No bootstrap required, opened a new log
I20260709 12:27:48.057408 21045 ts_tablet_manager.cc:1403] T d0a1fdfc30754de192891e2312d5c020 P 69b3b0ee0bdb42b39768623d8444232a: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.005s
I20260709 12:27:48.059656 21045 raft_consensus.cc:359] T d0a1fdfc30754de192891e2312d5c020 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.060164 21045 raft_consensus.cc:385] T d0a1fdfc30754de192891e2312d5c020 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:48.060391 21045 raft_consensus.cc:740] T d0a1fdfc30754de192891e2312d5c020 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69b3b0ee0bdb42b39768623d8444232a, State: Initialized, Role: FOLLOWER
I20260709 12:27:48.060949 21045 consensus_queue.cc:260] T d0a1fdfc30754de192891e2312d5c020 P 69b3b0ee0bdb42b39768623d8444232a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.061023 20752 catalog_manager.cc:5697] T 3c498679415641cbb2970d4c4f71930a P 2ba42136bb0e4a0293c4a2f617a5ec6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193). New cstate: current_term: 1 leader_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:48.062846 21045 ts_tablet_manager.cc:1434] T d0a1fdfc30754de192891e2312d5c020 P 69b3b0ee0bdb42b39768623d8444232a: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.003s
I20260709 12:27:48.062677 20752 catalog_manager.cc:5697] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193). New cstate: current_term: 1 leader_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:48.104357 21051 raft_consensus.cc:493] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:48.104934 21051 raft_consensus.cc:515] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.107007 21051 leader_election.cc:290] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:48.107738 20854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a1fdfc30754de192891e2312d5c020" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" is_pre_election: true
I20260709 12:27:48.108084 21004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a1fdfc30754de192891e2312d5c020" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a" is_pre_election: true
I20260709 12:27:48.108568 20854 raft_consensus.cc:2468] T d0a1fdfc30754de192891e2312d5c020 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 0.
I20260709 12:27:48.108771 21004 raft_consensus.cc:2468] T d0a1fdfc30754de192891e2312d5c020 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 0.
I20260709 12:27:48.109748 20894 leader_election.cc:304] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:48.110538 21051 raft_consensus.cc:2804] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:48.110843 21051 raft_consensus.cc:493] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:48.111218 21051 raft_consensus.cc:3060] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:48.116042 21050 consensus_queue.cc:1048] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:48.117340 21051 raft_consensus.cc:515] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.120401 20854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a1fdfc30754de192891e2312d5c020" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
I20260709 12:27:48.121104 20854 raft_consensus.cc:3060] T d0a1fdfc30754de192891e2312d5c020 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:48.121279 21004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a1fdfc30754de192891e2312d5c020" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
I20260709 12:27:48.121955 21004 raft_consensus.cc:3060] T d0a1fdfc30754de192891e2312d5c020 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:48.125874 21051 leader_election.cc:290] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 1 election: Requested vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:48.128793 21004 raft_consensus.cc:2468] T d0a1fdfc30754de192891e2312d5c020 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 1.
I20260709 12:27:48.130281 20895 leader_election.cc:304] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69b3b0ee0bdb42b39768623d8444232a, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:48.131383 21051 raft_consensus.cc:2804] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:48.131930 20854 raft_consensus.cc:2468] T d0a1fdfc30754de192891e2312d5c020 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 1.
I20260709 12:27:48.132129 21051 raft_consensus.cc:697] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a [term 1 LEADER]: Becoming Leader. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Running, Role: LEADER
I20260709 12:27:48.133124 21050 consensus_queue.cc:1048] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:48.133096 21051 consensus_queue.cc:237] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.145946 20753 catalog_manager.cc:5697] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a reported cstate change: term changed from 0 to 1, leader changed from <none> to d19688849fc44393bbf88cb3589a1d3a (127.9.145.194). New cstate: current_term: 1 leader_uuid: "d19688849fc44393bbf88cb3589a1d3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:48.156836 21050 raft_consensus.cc:493] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:48.157450 21050 raft_consensus.cc:515] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.159170 21050 leader_election.cc:290] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331)
I20260709 12:27:48.160135 20854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85248b50821b406ca1571b018430b9f5" candidate_uuid: "69b3b0ee0bdb42b39768623d8444232a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" is_pre_election: true
I20260709 12:27:48.160346 20929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85248b50821b406ca1571b018430b9f5" candidate_uuid: "69b3b0ee0bdb42b39768623d8444232a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a" is_pre_election: true
I20260709 12:27:48.161126 20929 raft_consensus.cc:2393] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 69b3b0ee0bdb42b39768623d8444232a in current term 1: Already voted for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in this term.
I20260709 12:27:48.162156 20969 leader_election.cc:304] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69b3b0ee0bdb42b39768623d8444232a; no voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, d19688849fc44393bbf88cb3589a1d3a
I20260709 12:27:48.162858 21050 raft_consensus.cc:3060] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:48.168658 21050 raft_consensus.cc:2749] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:48.174494 21050 raft_consensus.cc:493] T 8c6b02b11e4d46939d1da88c9b12d062 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:48.174954 21050 raft_consensus.cc:515] T 8c6b02b11e4d46939d1da88c9b12d062 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.176671 21050 leader_election.cc:290] T 8c6b02b11e4d46939d1da88c9b12d062 P 69b3b0ee0bdb42b39768623d8444232a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331)
I20260709 12:27:48.177536 20854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6b02b11e4d46939d1da88c9b12d062" candidate_uuid: "69b3b0ee0bdb42b39768623d8444232a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" is_pre_election: true
I20260709 12:27:48.177786 20929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6b02b11e4d46939d1da88c9b12d062" candidate_uuid: "69b3b0ee0bdb42b39768623d8444232a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a" is_pre_election: true
I20260709 12:27:48.178615 20929 raft_consensus.cc:2393] T 8c6b02b11e4d46939d1da88c9b12d062 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 69b3b0ee0bdb42b39768623d8444232a in current term 1: Already voted for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in this term.
I20260709 12:27:48.179562 20969 leader_election.cc:304] T 8c6b02b11e4d46939d1da88c9b12d062 P 69b3b0ee0bdb42b39768623d8444232a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69b3b0ee0bdb42b39768623d8444232a; no voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, d19688849fc44393bbf88cb3589a1d3a
I20260709 12:27:48.180245 21050 raft_consensus.cc:3060] T 8c6b02b11e4d46939d1da88c9b12d062 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:48.186242 21050 raft_consensus.cc:2749] T 8c6b02b11e4d46939d1da88c9b12d062 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:48.226011 21050 consensus_queue.cc:1048] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:48.237993 21073 consensus_queue.cc:1048] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:48.281344 21051 consensus_queue.cc:1048] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:48.292958 21086 consensus_queue.cc:1048] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:48.336493 21004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb866cd22e194cbabbe70fd7b3464ff2"
dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
mode: GRACEFUL
new_leader_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
 from {username='slave'} at 127.0.0.1:45968
I20260709 12:27:48.337257 21004 raft_consensus.cc:606] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a [term 1 LEADER]: Received request to transfer leadership to TS 2ba42136bb0e4a0293c4a2f617a5ec6f
I20260709 12:27:48.338932 21053 consensus_queue.cc:1048] T 31700e88bf154c04bf1ea79652e72042 P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:48.349401 21004 raft_consensus.cc:3060] T 31700e88bf154c04bf1ea79652e72042 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:48.361342 21053 consensus_queue.cc:1048] T 31700e88bf154c04bf1ea79652e72042 P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:48.376327 20929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14928e2dd87f43abb72a0cecdcf24c54"
dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
mode: GRACEFUL
new_leader_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
 from {username='slave'} at 127.0.0.1:44488
I20260709 12:27:48.377031 20929 raft_consensus.cc:606] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [term 1 LEADER]: Received request to transfer leadership to TS 2ba42136bb0e4a0293c4a2f617a5ec6f
I20260709 12:27:48.392521 20854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "982cee52faae499e8f087e106b51bbd9"
dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
mode: GRACEFUL
new_leader_uuid: "d19688849fc44393bbf88cb3589a1d3a"
 from {username='slave'} at 127.0.0.1:52614
I20260709 12:27:48.393096 20854 raft_consensus.cc:606] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Received request to transfer leadership to TS d19688849fc44393bbf88cb3589a1d3a
I20260709 12:27:48.398854 21004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81f0c796981141c48241e102703807b9"
dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
mode: GRACEFUL
new_leader_uuid: "d19688849fc44393bbf88cb3589a1d3a"
 from {username='slave'} at 127.0.0.1:45968
I20260709 12:27:48.399425 21004 raft_consensus.cc:606] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a [term 1 LEADER]: Received request to transfer leadership to TS d19688849fc44393bbf88cb3589a1d3a
I20260709 12:27:48.404763 20854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85248b50821b406ca1571b018430b9f5"
dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
mode: GRACEFUL
new_leader_uuid: "d19688849fc44393bbf88cb3589a1d3a"
 from {username='slave'} at 127.0.0.1:52614
I20260709 12:27:48.405344 20854 raft_consensus.cc:606] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Received request to transfer leadership to TS d19688849fc44393bbf88cb3589a1d3a
I20260709 12:27:48.410637 20854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c6b02b11e4d46939d1da88c9b12d062"
dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
mode: GRACEFUL
new_leader_uuid: "d19688849fc44393bbf88cb3589a1d3a"
 from {username='slave'} at 127.0.0.1:52614
I20260709 12:27:48.411325 20854 raft_consensus.cc:606] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Received request to transfer leadership to TS d19688849fc44393bbf88cb3589a1d3a
I20260709 12:27:48.416742 20929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0a1fdfc30754de192891e2312d5c020"
dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
mode: GRACEFUL
new_leader_uuid: "69b3b0ee0bdb42b39768623d8444232a"
 from {username='slave'} at 127.0.0.1:44488
I20260709 12:27:48.417331 20929 raft_consensus.cc:606] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a [term 1 LEADER]: Received request to transfer leadership to TS 69b3b0ee0bdb42b39768623d8444232a
I20260709 12:27:48.430495 21053 consensus_queue.cc:1048] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:48.439018 21078 consensus_queue.cc:1048] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:48.439750 21053 consensus_queue.cc:1048] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:48.449985 21053 consensus_queue.cc:1048] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:48.456717 21077 raft_consensus.cc:993] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f: : Instructing follower d19688849fc44393bbf88cb3589a1d3a to start an election
I20260709 12:27:48.457245 21077 raft_consensus.cc:1081] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Signalling peer d19688849fc44393bbf88cb3589a1d3a to start an election
I20260709 12:27:48.460696 20929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85248b50821b406ca1571b018430b9f5"
dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
 from {username='slave'} at 127.0.0.1:44476
I20260709 12:27:48.461421 20929 raft_consensus.cc:493] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:48.461834 20929 raft_consensus.cc:3060] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.471486 20929 raft_consensus.cc:515] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.471946 21078 raft_consensus.cc:993] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f: : Instructing follower d19688849fc44393bbf88cb3589a1d3a to start an election
I20260709 12:27:48.472618 21078 raft_consensus.cc:1081] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Signalling peer d19688849fc44393bbf88cb3589a1d3a to start an election
I20260709 12:27:48.473732 20930 raft_consensus.cc:1240] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Rejecting Update request from peer 2ba42136bb0e4a0293c4a2f617a5ec6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:48.475457 20929 leader_election.cc:290] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 2 election: Requested vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:48.476631 21003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85248b50821b406ca1571b018430b9f5" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
I20260709 12:27:48.477370 21003 raft_consensus.cc:3060] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.478224 20854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85248b50821b406ca1571b018430b9f5" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
I20260709 12:27:48.478058 20928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "982cee52faae499e8f087e106b51bbd9"
dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
 from {username='slave'} at 127.0.0.1:44476
I20260709 12:27:48.478433 21078 consensus_queue.cc:1059] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:27:48.480643 20928 raft_consensus.cc:493] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:48.481316 20928 raft_consensus.cc:3060] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.485018 20854 raft_consensus.cc:3055] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:48.485431 20854 raft_consensus.cc:740] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Running, Role: LEADER
I20260709 12:27:48.486316 21003 raft_consensus.cc:2468] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 2.
I20260709 12:27:48.487648 20895 leader_election.cc:304] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69b3b0ee0bdb42b39768623d8444232a, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:48.486275 20854 consensus_queue.cc:260] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.488557 21086 raft_consensus.cc:2804] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:48.488955 20854 raft_consensus.cc:3060] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.489074 21086 raft_consensus.cc:697] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a [term 2 LEADER]: Becoming Leader. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Running, Role: LEADER
I20260709 12:27:48.489691 20928 raft_consensus.cc:515] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.490309 21086 consensus_queue.cc:237] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.492216 20928 leader_election.cc:290] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 2 election: Requested vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:48.493202 20855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982cee52faae499e8f087e106b51bbd9" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
I20260709 12:27:48.493885 20855 raft_consensus.cc:3055] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:48.494316 20855 raft_consensus.cc:740] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Running, Role: LEADER
I20260709 12:27:48.495038 21003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982cee52faae499e8f087e106b51bbd9" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
I20260709 12:27:48.495152 20855 consensus_queue.cc:260] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.495939 21003 raft_consensus.cc:3060] T 982cee52faae499e8f087e106b51bbd9 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.496723 20855 raft_consensus.cc:3060] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.498875 20854 raft_consensus.cc:2468] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 2.
W20260709 12:27:48.500587 21090 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:27:48.504086 21003 raft_consensus.cc:2468] T 982cee52faae499e8f087e106b51bbd9 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 2.
I20260709 12:27:48.505448 20895 leader_election.cc:304] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69b3b0ee0bdb42b39768623d8444232a, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:48.505301 20750 catalog_manager.cc:5697] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a reported cstate change: term changed from 1 to 2, leader changed from 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193) to d19688849fc44393bbf88cb3589a1d3a (127.9.145.194). New cstate: current_term: 2 leader_uuid: "d19688849fc44393bbf88cb3589a1d3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:48.506467 21086 raft_consensus.cc:2804] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:48.507177 21086 raft_consensus.cc:697] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a [term 2 LEADER]: Becoming Leader. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Running, Role: LEADER
I20260709 12:27:48.507833 20855 raft_consensus.cc:2468] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 2.
I20260709 12:27:48.508061 21086 consensus_queue.cc:237] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.519644 20750 catalog_manager.cc:5697] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a reported cstate change: term changed from 1 to 2, leader changed from 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193) to d19688849fc44393bbf88cb3589a1d3a (127.9.145.194). New cstate: current_term: 2 leader_uuid: "d19688849fc44393bbf88cb3589a1d3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:48.550666 21090 consensus_queue.cc:1048] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:48.557427 21078 raft_consensus.cc:993] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f: : Instructing follower d19688849fc44393bbf88cb3589a1d3a to start an election
I20260709 12:27:48.557961 21053 raft_consensus.cc:1081] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Signalling peer d19688849fc44393bbf88cb3589a1d3a to start an election
I20260709 12:27:48.560108 20929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c6b02b11e4d46939d1da88c9b12d062"
dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
 from {username='slave'} at 127.0.0.1:44476
I20260709 12:27:48.560743 20929 raft_consensus.cc:493] T 8c6b02b11e4d46939d1da88c9b12d062 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:48.561167 20929 raft_consensus.cc:3060] T 8c6b02b11e4d46939d1da88c9b12d062 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.565378 21053 consensus_queue.cc:1048] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:48.567274 21086 consensus_queue.cc:1048] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:48.572186 20929 raft_consensus.cc:515] T 8c6b02b11e4d46939d1da88c9b12d062 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.576363 20929 leader_election.cc:290] T 8c6b02b11e4d46939d1da88c9b12d062 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 2 election: Requested vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:48.576452 21003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6b02b11e4d46939d1da88c9b12d062" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
I20260709 12:27:48.577307 21003 raft_consensus.cc:3060] T 8c6b02b11e4d46939d1da88c9b12d062 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.586050 21084 consensus_queue.cc:1048] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:48.587993 20855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6b02b11e4d46939d1da88c9b12d062" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
I20260709 12:27:48.588739 20855 raft_consensus.cc:3055] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:48.589083 20855 raft_consensus.cc:740] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Running, Role: LEADER
I20260709 12:27:48.589886 20855 consensus_queue.cc:260] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.591393 20855 raft_consensus.cc:3060] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.594875 21003 raft_consensus.cc:2468] T 8c6b02b11e4d46939d1da88c9b12d062 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 2.
I20260709 12:27:48.596472 20895 leader_election.cc:304] T 8c6b02b11e4d46939d1da88c9b12d062 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69b3b0ee0bdb42b39768623d8444232a, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:48.597470 21084 raft_consensus.cc:2804] T 8c6b02b11e4d46939d1da88c9b12d062 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:48.597978 21084 raft_consensus.cc:697] T 8c6b02b11e4d46939d1da88c9b12d062 P d19688849fc44393bbf88cb3589a1d3a [term 2 LEADER]: Becoming Leader. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Running, Role: LEADER
I20260709 12:27:48.598839 21084 consensus_queue.cc:237] T 8c6b02b11e4d46939d1da88c9b12d062 P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.599994 20855 raft_consensus.cc:2468] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 2.
I20260709 12:27:48.607688 20752 catalog_manager.cc:5697] T 8c6b02b11e4d46939d1da88c9b12d062 P d19688849fc44393bbf88cb3589a1d3a reported cstate change: term changed from 1 to 2, leader changed from 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193) to d19688849fc44393bbf88cb3589a1d3a (127.9.145.194). New cstate: current_term: 2 leader_uuid: "d19688849fc44393bbf88cb3589a1d3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:48.609695 21050 raft_consensus.cc:993] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a: : Instructing follower 2ba42136bb0e4a0293c4a2f617a5ec6f to start an election
I20260709 12:27:48.609733 21086 raft_consensus.cc:993] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a: : Instructing follower 69b3b0ee0bdb42b39768623d8444232a to start an election
I20260709 12:27:48.610426 21050 raft_consensus.cc:1081] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a [term 1 LEADER]: Signalling peer 2ba42136bb0e4a0293c4a2f617a5ec6f to start an election
I20260709 12:27:48.610536 21086 raft_consensus.cc:1081] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a [term 1 LEADER]: Signalling peer 69b3b0ee0bdb42b39768623d8444232a to start an election
I20260709 12:27:48.612383 20855 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb866cd22e194cbabbe70fd7b3464ff2"
dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
 from {username='slave'} at 127.0.0.1:52610
I20260709 12:27:48.612826 21004 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0a1fdfc30754de192891e2312d5c020"
dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
 from {username='slave'} at 127.0.0.1:45962
I20260709 12:27:48.612998 20855 raft_consensus.cc:493] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:48.613487 21004 raft_consensus.cc:493] T d0a1fdfc30754de192891e2312d5c020 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:48.613530 20855 raft_consensus.cc:3060] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.614030 21004 raft_consensus.cc:3060] T d0a1fdfc30754de192891e2312d5c020 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.620178 21053 consensus_queue.cc:1048] T 3c498679415641cbb2970d4c4f71930a P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:48.621479 20855 raft_consensus.cc:515] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } }
I20260709 12:27:48.622464 21004 raft_consensus.cc:515] T d0a1fdfc30754de192891e2312d5c020 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.623750 20855 leader_election.cc:290] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 2 election: Requested vote from peers 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581), d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331)
I20260709 12:27:48.625238 21002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb866cd22e194cbabbe70fd7b3464ff2" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
I20260709 12:27:48.625676 20929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb866cd22e194cbabbe70fd7b3464ff2" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
I20260709 12:27:48.626073 21002 raft_consensus.cc:3055] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:48.626431 20929 raft_consensus.cc:3060] T fb866cd22e194cbabbe70fd7b3464ff2 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.627861 21002 raft_consensus.cc:740] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 69b3b0ee0bdb42b39768623d8444232a, State: Running, Role: LEADER
I20260709 12:27:48.628223 20928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a1fdfc30754de192891e2312d5c020" candidate_uuid: "69b3b0ee0bdb42b39768623d8444232a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
I20260709 12:27:48.628873 20928 raft_consensus.cc:3055] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:48.629303 20928 raft_consensus.cc:740] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Running, Role: LEADER
I20260709 12:27:48.628757 21002 consensus_queue.cc:260] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } }
I20260709 12:27:48.630162 20928 consensus_queue.cc:260] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.630617 21002 raft_consensus.cc:3060] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.631358 20928 raft_consensus.cc:3060] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.633795 20855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a1fdfc30754de192891e2312d5c020" candidate_uuid: "69b3b0ee0bdb42b39768623d8444232a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
I20260709 12:27:48.634639 20855 raft_consensus.cc:3060] T d0a1fdfc30754de192891e2312d5c020 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.638325 21004 leader_election.cc:290] T d0a1fdfc30754de192891e2312d5c020 P 69b3b0ee0bdb42b39768623d8444232a [CANDIDATE]: Term 2 election: Requested vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331)
I20260709 12:27:48.638505 21053 consensus_queue.cc:1048] T 3c498679415641cbb2970d4c4f71930a P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:48.640612 20929 raft_consensus.cc:2468] T fb866cd22e194cbabbe70fd7b3464ff2 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 2.
I20260709 12:27:48.641330 20928 raft_consensus.cc:2468] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69b3b0ee0bdb42b39768623d8444232a in term 2.
I20260709 12:27:48.642715 20969 leader_election.cc:304] T d0a1fdfc30754de192891e2312d5c020 P 69b3b0ee0bdb42b39768623d8444232a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69b3b0ee0bdb42b39768623d8444232a, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:48.643657 21050 raft_consensus.cc:2804] T d0a1fdfc30754de192891e2312d5c020 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:48.644217 21050 raft_consensus.cc:697] T d0a1fdfc30754de192891e2312d5c020 P 69b3b0ee0bdb42b39768623d8444232a [term 2 LEADER]: Becoming Leader. State: Replica: 69b3b0ee0bdb42b39768623d8444232a, State: Running, Role: LEADER
I20260709 12:27:48.645138 21050 consensus_queue.cc:237] T d0a1fdfc30754de192891e2312d5c020 P 69b3b0ee0bdb42b39768623d8444232a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.646798 20820 leader_election.cc:304] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:48.649011 21053 raft_consensus.cc:2804] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:48.650041 20855 raft_consensus.cc:2468] T d0a1fdfc30754de192891e2312d5c020 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69b3b0ee0bdb42b39768623d8444232a in term 2.
I20260709 12:27:48.650730 21053 raft_consensus.cc:697] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 LEADER]: Becoming Leader. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Running, Role: LEADER
I20260709 12:27:48.652266 21053 consensus_queue.cc:237] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } }
I20260709 12:27:48.654742 21002 raft_consensus.cc:2468] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 2.
I20260709 12:27:48.663246 20753 catalog_manager.cc:5697] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f reported cstate change: term changed from 1 to 2, leader changed from 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195) to 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193). New cstate: current_term: 2 leader_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:48.665004 21050 raft_consensus.cc:993] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a: : Instructing follower d19688849fc44393bbf88cb3589a1d3a to start an election
I20260709 12:27:48.665614 21073 raft_consensus.cc:1081] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a [term 1 LEADER]: Signalling peer d19688849fc44393bbf88cb3589a1d3a to start an election
I20260709 12:27:48.667647 20928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81f0c796981141c48241e102703807b9"
dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
 from {username='slave'} at 127.0.0.1:44464
I20260709 12:27:48.668304 20928 raft_consensus.cc:493] T 81f0c796981141c48241e102703807b9 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:48.668766 20928 raft_consensus.cc:3060] T 81f0c796981141c48241e102703807b9 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.668031 20750 catalog_manager.cc:5697] T d0a1fdfc30754de192891e2312d5c020 P 69b3b0ee0bdb42b39768623d8444232a reported cstate change: term changed from 1 to 2, leader changed from d19688849fc44393bbf88cb3589a1d3a (127.9.145.194) to 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195). New cstate: current_term: 2 leader_uuid: "69b3b0ee0bdb42b39768623d8444232a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:48.676646 20928 raft_consensus.cc:515] T 81f0c796981141c48241e102703807b9 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.678982 20928 leader_election.cc:290] T 81f0c796981141c48241e102703807b9 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 2 election: Requested vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:48.679597 20855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f0c796981141c48241e102703807b9" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
I20260709 12:27:48.680438 21003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f0c796981141c48241e102703807b9" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
I20260709 12:27:48.680955 20855 raft_consensus.cc:3060] T 81f0c796981141c48241e102703807b9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.681381 21003 raft_consensus.cc:3055] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:48.681823 21003 raft_consensus.cc:740] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 69b3b0ee0bdb42b39768623d8444232a, State: Running, Role: LEADER
I20260709 12:27:48.682806 21003 consensus_queue.cc:260] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.684651 21003 raft_consensus.cc:3060] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.698987 21003 raft_consensus.cc:2468] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 2.
I20260709 12:27:48.700347 20895 leader_election.cc:304] T 81f0c796981141c48241e102703807b9 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69b3b0ee0bdb42b39768623d8444232a, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:48.701359 21086 raft_consensus.cc:2804] T 81f0c796981141c48241e102703807b9 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:48.701884 21086 raft_consensus.cc:697] T 81f0c796981141c48241e102703807b9 P d19688849fc44393bbf88cb3589a1d3a [term 2 LEADER]: Becoming Leader. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Running, Role: LEADER
I20260709 12:27:48.702757 21086 consensus_queue.cc:237] T 81f0c796981141c48241e102703807b9 P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.709643 20855 raft_consensus.cc:2468] T 81f0c796981141c48241e102703807b9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 2.
I20260709 12:27:48.715633 20753 catalog_manager.cc:5697] T 81f0c796981141c48241e102703807b9 P d19688849fc44393bbf88cb3589a1d3a reported cstate change: term changed from 1 to 2, leader changed from 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195) to d19688849fc44393bbf88cb3589a1d3a (127.9.145.194). New cstate: current_term: 2 leader_uuid: "d19688849fc44393bbf88cb3589a1d3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:48.748193 21084 raft_consensus.cc:993] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a: : Instructing follower 2ba42136bb0e4a0293c4a2f617a5ec6f to start an election
I20260709 12:27:48.748646 21086 raft_consensus.cc:1081] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [term 1 LEADER]: Signalling peer 2ba42136bb0e4a0293c4a2f617a5ec6f to start an election
I20260709 12:27:48.750255 20855 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14928e2dd87f43abb72a0cecdcf24c54"
dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
 from {username='slave'} at 127.0.0.1:52602
I20260709 12:27:48.750748 20855 raft_consensus.cc:493] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:48.751017 20855 raft_consensus.cc:3060] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.756561 20855 raft_consensus.cc:515] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.758332 20855 leader_election.cc:290] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 2 election: Requested vote from peers d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:48.759321 20928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14928e2dd87f43abb72a0cecdcf24c54" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
I20260709 12:27:48.759567 21003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14928e2dd87f43abb72a0cecdcf24c54" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
I20260709 12:27:48.760200 20928 raft_consensus.cc:3055] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:48.760280 21003 raft_consensus.cc:3060] T 14928e2dd87f43abb72a0cecdcf24c54 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.760573 20928 raft_consensus.cc:740] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Running, Role: LEADER
I20260709 12:27:48.761554 20928 consensus_queue.cc:260] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.762763 20928 raft_consensus.cc:3060] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.766314 21003 raft_consensus.cc:2468] T 14928e2dd87f43abb72a0cecdcf24c54 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 2.
I20260709 12:27:48.767624 20820 leader_election.cc:304] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, 69b3b0ee0bdb42b39768623d8444232a; no voters: 
I20260709 12:27:48.768353 21090 raft_consensus.cc:2804] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:48.768390 20928 raft_consensus.cc:2468] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 2.
I20260709 12:27:48.768819 21090 raft_consensus.cc:697] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 LEADER]: Becoming Leader. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Running, Role: LEADER
I20260709 12:27:48.769755 21090 consensus_queue.cc:237] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:48.776849 20753 catalog_manager.cc:5697] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f reported cstate change: term changed from 1 to 2, leader changed from d19688849fc44393bbf88cb3589a1d3a (127.9.145.194) to 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193). New cstate: current_term: 2 leader_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:48.909525 20855 raft_consensus.cc:1275] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Refusing update from remote peer d19688849fc44393bbf88cb3589a1d3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:48.910458 21003 raft_consensus.cc:1275] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Refusing update from remote peer d19688849fc44393bbf88cb3589a1d3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:48.911056 21086 consensus_queue.cc:1048] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:48.911890 21084 consensus_queue.cc:1048] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:48.932585 21003 raft_consensus.cc:1275] T 982cee52faae499e8f087e106b51bbd9 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Refusing update from remote peer d19688849fc44393bbf88cb3589a1d3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:48.933786 21051 consensus_queue.cc:1048] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:48.941413 20855 raft_consensus.cc:1275] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Refusing update from remote peer d19688849fc44393bbf88cb3589a1d3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:48.943694 21128 consensus_queue.cc:1048] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:49.047399 21003 raft_consensus.cc:1275] T 8c6b02b11e4d46939d1da88c9b12d062 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Refusing update from remote peer d19688849fc44393bbf88cb3589a1d3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:49.049343 21128 consensus_queue.cc:1048] T 8c6b02b11e4d46939d1da88c9b12d062 P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:49.063398 20855 raft_consensus.cc:1275] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Refusing update from remote peer d19688849fc44393bbf88cb3589a1d3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:49.065331 21128 consensus_queue.cc:1048] T 8c6b02b11e4d46939d1da88c9b12d062 P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:49.104765 21003 raft_consensus.cc:1275] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Refusing update from remote peer d19688849fc44393bbf88cb3589a1d3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:49.106488 21128 consensus_queue.cc:1048] T 81f0c796981141c48241e102703807b9 P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:49.116875 20855 raft_consensus.cc:1275] T 81f0c796981141c48241e102703807b9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Refusing update from remote peer d19688849fc44393bbf88cb3589a1d3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:49.118800 21086 consensus_queue.cc:1048] T 81f0c796981141c48241e102703807b9 P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:49.143491 20928 raft_consensus.cc:1275] T fb866cd22e194cbabbe70fd7b3464ff2 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Refusing update from remote peer 2ba42136bb0e4a0293c4a2f617a5ec6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:49.145087 21090 consensus_queue.cc:1048] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:49.156239 21003 raft_consensus.cc:1275] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Refusing update from remote peer 2ba42136bb0e4a0293c4a2f617a5ec6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:49.158161 21090 consensus_queue.cc:1048] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:49.180574 20928 raft_consensus.cc:1275] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Refusing update from remote peer 69b3b0ee0bdb42b39768623d8444232a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:49.182024 21073 consensus_queue.cc:1048] T d0a1fdfc30754de192891e2312d5c020 P 69b3b0ee0bdb42b39768623d8444232a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:49.193966 20855 raft_consensus.cc:1275] T d0a1fdfc30754de192891e2312d5c020 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Refusing update from remote peer 69b3b0ee0bdb42b39768623d8444232a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:49.196353 21132 consensus_queue.cc:1048] T d0a1fdfc30754de192891e2312d5c020 P 69b3b0ee0bdb42b39768623d8444232a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:49.208981 21003 raft_consensus.cc:1275] T 14928e2dd87f43abb72a0cecdcf24c54 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Refusing update from remote peer 2ba42136bb0e4a0293c4a2f617a5ec6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:49.210330 21090 consensus_queue.cc:1048] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:49.220588 20928 raft_consensus.cc:1275] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Refusing update from remote peer 2ba42136bb0e4a0293c4a2f617a5ec6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:49.222682 21098 consensus_queue.cc:1048] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:51.456916 20753 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36294:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:27:51.459664 20753 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:27:51.516734 20837 tablet_service.cc:1511] Processing CreateTablet for tablet 3c6cb33ab8ff47aa81ee0ba714a80cb5 (DEFAULT_TABLE table=soft_deleted_table [id=e6f6ffa2064a44db8b743b096295bd0c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:51.519289 20837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6cb33ab8ff47aa81ee0ba714a80cb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.519558 20920 tablet_service.cc:1511] Processing CreateTablet for tablet 3c6cb33ab8ff47aa81ee0ba714a80cb5 (DEFAULT_TABLE table=soft_deleted_table [id=e6f6ffa2064a44db8b743b096295bd0c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:51.520718 20990 tablet_service.cc:1511] Processing CreateTablet for tablet 3c6cb33ab8ff47aa81ee0ba714a80cb5 (DEFAULT_TABLE table=soft_deleted_table [id=e6f6ffa2064a44db8b743b096295bd0c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:51.521287 20920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6cb33ab8ff47aa81ee0ba714a80cb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.522522 20990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6cb33ab8ff47aa81ee0ba714a80cb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.525753 20992 tablet_service.cc:1511] Processing CreateTablet for tablet 56b11efee3c940f8b0cb5dda5ae9028f (DEFAULT_TABLE table=soft_deleted_table [id=e6f6ffa2064a44db8b743b096295bd0c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:51.526480 20918 tablet_service.cc:1511] Processing CreateTablet for tablet 56b11efee3c940f8b0cb5dda5ae9028f (DEFAULT_TABLE table=soft_deleted_table [id=e6f6ffa2064a44db8b743b096295bd0c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:51.527362 20992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b11efee3c940f8b0cb5dda5ae9028f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.528012 20918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b11efee3c940f8b0cb5dda5ae9028f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.521258 20841 tablet_service.cc:1511] Processing CreateTablet for tablet 56b11efee3c940f8b0cb5dda5ae9028f (DEFAULT_TABLE table=soft_deleted_table [id=e6f6ffa2064a44db8b743b096295bd0c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:51.534121 20841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b11efee3c940f8b0cb5dda5ae9028f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.537920 20838 tablet_service.cc:1511] Processing CreateTablet for tablet a06a663278614fc9b3522a016587d87d (DEFAULT_TABLE table=soft_deleted_table [id=e6f6ffa2064a44db8b743b096295bd0c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:51.539594 20838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a06a663278614fc9b3522a016587d87d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.568261 20919 tablet_service.cc:1511] Processing CreateTablet for tablet a06a663278614fc9b3522a016587d87d (DEFAULT_TABLE table=soft_deleted_table [id=e6f6ffa2064a44db8b743b096295bd0c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:51.568674 20843 tablet_service.cc:1511] Processing CreateTablet for tablet 21e6a6037d0942f38ea7f29a5e2a73b8 (DEFAULT_TABLE table=soft_deleted_table [id=e6f6ffa2064a44db8b743b096295bd0c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:51.569849 20919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a06a663278614fc9b3522a016587d87d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.570464 20843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e6a6037d0942f38ea7f29a5e2a73b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.575045 20991 tablet_service.cc:1511] Processing CreateTablet for tablet a06a663278614fc9b3522a016587d87d (DEFAULT_TABLE table=soft_deleted_table [id=e6f6ffa2064a44db8b743b096295bd0c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:51.576815 20991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a06a663278614fc9b3522a016587d87d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.587183 20917 tablet_service.cc:1511] Processing CreateTablet for tablet 21e6a6037d0942f38ea7f29a5e2a73b8 (DEFAULT_TABLE table=soft_deleted_table [id=e6f6ffa2064a44db8b743b096295bd0c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:51.589036 20917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e6a6037d0942f38ea7f29a5e2a73b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.595347 21149 tablet_bootstrap.cc:492] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 69b3b0ee0bdb42b39768623d8444232a: Bootstrap starting.
I20260709 12:27:51.599786 20992 tablet_service.cc:1511] Processing CreateTablet for tablet 21e6a6037d0942f38ea7f29a5e2a73b8 (DEFAULT_TABLE table=soft_deleted_table [id=e6f6ffa2064a44db8b743b096295bd0c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:51.601444 20992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e6a6037d0942f38ea7f29a5e2a73b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.604024 21149 tablet_bootstrap.cc:654] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 69b3b0ee0bdb42b39768623d8444232a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:51.611812 20837 tablet_service.cc:1511] Processing CreateTablet for tablet 47722b2045fd40febe80064f4553c763 (DEFAULT_TABLE table=soft_deleted_table [id=e6f6ffa2064a44db8b743b096295bd0c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:51.613505 20837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47722b2045fd40febe80064f4553c763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.623255 21148 tablet_bootstrap.cc:492] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a: Bootstrap starting.
I20260709 12:27:51.630195 20920 tablet_service.cc:1511] Processing CreateTablet for tablet 47722b2045fd40febe80064f4553c763 (DEFAULT_TABLE table=soft_deleted_table [id=e6f6ffa2064a44db8b743b096295bd0c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:51.630584 20990 tablet_service.cc:1511] Processing CreateTablet for tablet 47722b2045fd40febe80064f4553c763 (DEFAULT_TABLE table=soft_deleted_table [id=e6f6ffa2064a44db8b743b096295bd0c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:51.631894 20920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47722b2045fd40febe80064f4553c763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.632108 20990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47722b2045fd40febe80064f4553c763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.634451 20838 tablet_service.cc:1511] Processing CreateTablet for tablet b10c3331582b4158b0b8b913d8f32557 (DEFAULT_TABLE table=soft_deleted_table [id=e6f6ffa2064a44db8b743b096295bd0c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:51.635892 20838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b10c3331582b4158b0b8b913d8f32557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.641939 20919 tablet_service.cc:1511] Processing CreateTablet for tablet b10c3331582b4158b0b8b913d8f32557 (DEFAULT_TABLE table=soft_deleted_table [id=e6f6ffa2064a44db8b743b096295bd0c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:51.643457 20919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b10c3331582b4158b0b8b913d8f32557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.646339 20989 tablet_service.cc:1511] Processing CreateTablet for tablet b10c3331582b4158b0b8b913d8f32557 (DEFAULT_TABLE table=soft_deleted_table [id=e6f6ffa2064a44db8b743b096295bd0c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:51.647925 20989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b10c3331582b4158b0b8b913d8f32557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.674748 21148 tablet_bootstrap.cc:654] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:51.677047 21150 tablet_bootstrap.cc:492] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f: Bootstrap starting.
I20260709 12:27:51.694837 20837 tablet_service.cc:1511] Processing CreateTablet for tablet 4dff16a162ef45a6bca0f8d57b68b5cf (DEFAULT_TABLE table=soft_deleted_table [id=e6f6ffa2064a44db8b743b096295bd0c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:51.699698 20837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dff16a162ef45a6bca0f8d57b68b5cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.699998 21150 tablet_bootstrap.cc:654] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:51.701105 20917 tablet_service.cc:1511] Processing CreateTablet for tablet 4dff16a162ef45a6bca0f8d57b68b5cf (DEFAULT_TABLE table=soft_deleted_table [id=e6f6ffa2064a44db8b743b096295bd0c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:51.702695 20917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dff16a162ef45a6bca0f8d57b68b5cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.705322 20991 tablet_service.cc:1511] Processing CreateTablet for tablet 4dff16a162ef45a6bca0f8d57b68b5cf (DEFAULT_TABLE table=soft_deleted_table [id=e6f6ffa2064a44db8b743b096295bd0c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:51.706877 20991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dff16a162ef45a6bca0f8d57b68b5cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.706590 20843 tablet_service.cc:1511] Processing CreateTablet for tablet 622f187c34ed45d2b3c17e391f150a49 (DEFAULT_TABLE table=soft_deleted_table [id=e6f6ffa2064a44db8b743b096295bd0c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:51.707973 20843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 622f187c34ed45d2b3c17e391f150a49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.713819 20919 tablet_service.cc:1511] Processing CreateTablet for tablet 622f187c34ed45d2b3c17e391f150a49 (DEFAULT_TABLE table=soft_deleted_table [id=e6f6ffa2064a44db8b743b096295bd0c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:51.715389 20919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 622f187c34ed45d2b3c17e391f150a49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.716398 21148 tablet_bootstrap.cc:492] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a: No bootstrap required, opened a new log
I20260709 12:27:51.717057 21148 ts_tablet_manager.cc:1403] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a: Time spent bootstrapping tablet: real 0.094s	user 0.014s	sys 0.000s
I20260709 12:27:51.705314 21149 tablet_bootstrap.cc:492] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 69b3b0ee0bdb42b39768623d8444232a: No bootstrap required, opened a new log
I20260709 12:27:51.718772 21149 ts_tablet_manager.cc:1403] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 69b3b0ee0bdb42b39768623d8444232a: Time spent bootstrapping tablet: real 0.124s	user 0.016s	sys 0.048s
I20260709 12:27:51.720413 21148 raft_consensus.cc:359] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.723927 21148 raft_consensus.cc:385] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:51.724421 21148 raft_consensus.cc:740] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Initialized, Role: FOLLOWER
I20260709 12:27:51.725291 21148 consensus_queue.cc:260] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.727955 21148 ts_tablet_manager.cc:1434] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 12:27:51.729086 21148 tablet_bootstrap.cc:492] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a: Bootstrap starting.
I20260709 12:27:51.721942 21149 raft_consensus.cc:359] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.723532 21150 tablet_bootstrap.cc:492] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f: No bootstrap required, opened a new log
I20260709 12:27:51.729853 20989 tablet_service.cc:1511] Processing CreateTablet for tablet 622f187c34ed45d2b3c17e391f150a49 (DEFAULT_TABLE table=soft_deleted_table [id=e6f6ffa2064a44db8b743b096295bd0c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:51.730557 21150 ts_tablet_manager.cc:1403] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.006s
I20260709 12:27:51.731359 20989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 622f187c34ed45d2b3c17e391f150a49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.733845 21150 raft_consensus.cc:359] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.734767 21150 raft_consensus.cc:385] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:51.735118 21150 raft_consensus.cc:740] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Initialized, Role: FOLLOWER
I20260709 12:27:51.736101 21150 consensus_queue.cc:260] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.739041 20837 tablet_service.cc:1511] Processing CreateTablet for tablet 5fa339aff7a7450c8322379571310a2b (DEFAULT_TABLE table=soft_deleted_table [id=e6f6ffa2064a44db8b743b096295bd0c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:51.740552 20837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fa339aff7a7450c8322379571310a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.740906 21149 raft_consensus.cc:385] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:51.741322 21149 raft_consensus.cc:740] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69b3b0ee0bdb42b39768623d8444232a, State: Initialized, Role: FOLLOWER
I20260709 12:27:51.743340 21149 consensus_queue.cc:260] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 69b3b0ee0bdb42b39768623d8444232a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.742319 21150 ts_tablet_manager.cc:1434] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
W20260709 12:27:51.739507 20801 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:51.750540 20920 tablet_service.cc:1511] Processing CreateTablet for tablet 5fa339aff7a7450c8322379571310a2b (DEFAULT_TABLE table=soft_deleted_table [id=e6f6ffa2064a44db8b743b096295bd0c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:51.751178 21150 tablet_bootstrap.cc:492] T a06a663278614fc9b3522a016587d87d P 2ba42136bb0e4a0293c4a2f617a5ec6f: Bootstrap starting.
I20260709 12:27:51.752038 20920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fa339aff7a7450c8322379571310a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.751904 20990 tablet_service.cc:1511] Processing CreateTablet for tablet 5fa339aff7a7450c8322379571310a2b (DEFAULT_TABLE table=soft_deleted_table [id=e6f6ffa2064a44db8b743b096295bd0c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:51.753317 20990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fa339aff7a7450c8322379571310a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.745994 21149 ts_tablet_manager.cc:1434] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 69b3b0ee0bdb42b39768623d8444232a: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.003s
I20260709 12:27:51.754853 21149 tablet_bootstrap.cc:492] T 56b11efee3c940f8b0cb5dda5ae9028f P 69b3b0ee0bdb42b39768623d8444232a: Bootstrap starting.
I20260709 12:27:51.761533 21149 tablet_bootstrap.cc:654] T 56b11efee3c940f8b0cb5dda5ae9028f P 69b3b0ee0bdb42b39768623d8444232a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:51.778505 21136 raft_consensus.cc:493] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.779100 21136 raft_consensus.cc:515] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.781888 21136 leader_election.cc:290] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:51.776631 21150 tablet_bootstrap.cc:654] T a06a663278614fc9b3522a016587d87d P 2ba42136bb0e4a0293c4a2f617a5ec6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:51.782713 20928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b11efee3c940f8b0cb5dda5ae9028f" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a" is_pre_election: true
W20260709 12:27:51.785401 20820 leader_election.cc:343] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:51.785842 21003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b11efee3c940f8b0cb5dda5ae9028f" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a" is_pre_election: true
W20260709 12:27:51.787985 20820 leader_election.cc:343] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:51.788467 20820 leader_election.cc:304] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f; no voters: 69b3b0ee0bdb42b39768623d8444232a, d19688849fc44393bbf88cb3589a1d3a
I20260709 12:27:51.789727 21136 raft_consensus.cc:2749] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:51.796380 21148 tablet_bootstrap.cc:654] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:51.798060 21149 tablet_bootstrap.cc:492] T 56b11efee3c940f8b0cb5dda5ae9028f P 69b3b0ee0bdb42b39768623d8444232a: No bootstrap required, opened a new log
I20260709 12:27:51.798852 21149 ts_tablet_manager.cc:1403] T 56b11efee3c940f8b0cb5dda5ae9028f P 69b3b0ee0bdb42b39768623d8444232a: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.000s
I20260709 12:27:51.802671 21149 raft_consensus.cc:359] T 56b11efee3c940f8b0cb5dda5ae9028f P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.803640 21149 raft_consensus.cc:385] T 56b11efee3c940f8b0cb5dda5ae9028f P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:51.804033 21149 raft_consensus.cc:740] T 56b11efee3c940f8b0cb5dda5ae9028f P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69b3b0ee0bdb42b39768623d8444232a, State: Initialized, Role: FOLLOWER
I20260709 12:27:51.805191 21150 tablet_bootstrap.cc:492] T a06a663278614fc9b3522a016587d87d P 2ba42136bb0e4a0293c4a2f617a5ec6f: No bootstrap required, opened a new log
I20260709 12:27:51.805107 21149 consensus_queue.cc:260] T 56b11efee3c940f8b0cb5dda5ae9028f P 69b3b0ee0bdb42b39768623d8444232a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.805913 21150 ts_tablet_manager.cc:1403] T a06a663278614fc9b3522a016587d87d P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent bootstrapping tablet: real 0.055s	user 0.008s	sys 0.013s
I20260709 12:27:51.808391 21148 tablet_bootstrap.cc:492] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a: No bootstrap required, opened a new log
I20260709 12:27:51.809103 21148 ts_tablet_manager.cc:1403] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a: Time spent bootstrapping tablet: real 0.080s	user 0.019s	sys 0.000s
I20260709 12:27:51.809721 21150 raft_consensus.cc:359] T a06a663278614fc9b3522a016587d87d P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.810683 21150 raft_consensus.cc:385] T a06a663278614fc9b3522a016587d87d P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:51.811025 21149 ts_tablet_manager.cc:1434] T 56b11efee3c940f8b0cb5dda5ae9028f P 69b3b0ee0bdb42b39768623d8444232a: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:27:51.811050 21150 raft_consensus.cc:740] T a06a663278614fc9b3522a016587d87d P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Initialized, Role: FOLLOWER
I20260709 12:27:51.812353 21149 tablet_bootstrap.cc:492] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a: Bootstrap starting.
I20260709 12:27:51.812289 21150 consensus_queue.cc:260] T a06a663278614fc9b3522a016587d87d P 2ba42136bb0e4a0293c4a2f617a5ec6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.815136 21150 ts_tablet_manager.cc:1434] T a06a663278614fc9b3522a016587d87d P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 12:27:51.816360 21150 tablet_bootstrap.cc:492] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Bootstrap starting.
I20260709 12:27:51.812904 21148 raft_consensus.cc:359] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.819588 21148 raft_consensus.cc:385] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:51.820034 21148 raft_consensus.cc:740] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Initialized, Role: FOLLOWER
I20260709 12:27:51.820803 21149 tablet_bootstrap.cc:654] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:51.821458 21148 consensus_queue.cc:260] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.823621 21150 tablet_bootstrap.cc:654] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:51.827378 21148 ts_tablet_manager.cc:1434] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a: Time spent starting tablet: real 0.018s	user 0.000s	sys 0.007s
I20260709 12:27:51.828776 21148 tablet_bootstrap.cc:492] T a06a663278614fc9b3522a016587d87d P d19688849fc44393bbf88cb3589a1d3a: Bootstrap starting.
I20260709 12:27:51.836467 21148 tablet_bootstrap.cc:654] T a06a663278614fc9b3522a016587d87d P d19688849fc44393bbf88cb3589a1d3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:51.837304 21128 raft_consensus.cc:493] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.838925 21128 raft_consensus.cc:515] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.841635 21128 leader_election.cc:290] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:51.841749 21149 tablet_bootstrap.cc:492] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a: No bootstrap required, opened a new log
I20260709 12:27:51.842542 20855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cb33ab8ff47aa81ee0ba714a80cb5" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" is_pre_election: true
I20260709 12:27:51.844197 21150 tablet_bootstrap.cc:492] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 2ba42136bb0e4a0293c4a2f617a5ec6f: No bootstrap required, opened a new log
W20260709 12:27:51.844581 20894 leader_election.cc:343] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:51.844870 21150 ts_tablet_manager.cc:1403] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.009s
I20260709 12:27:51.845765 21003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cb33ab8ff47aa81ee0ba714a80cb5" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a" is_pre_election: true
I20260709 12:27:51.842551 21149 ts_tablet_manager.cc:1403] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.012s
I20260709 12:27:51.846596 21003 raft_consensus.cc:2468] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 0.
I20260709 12:27:51.848114 20895 leader_election.cc:304] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69b3b0ee0bdb42b39768623d8444232a, d19688849fc44393bbf88cb3589a1d3a; no voters: 2ba42136bb0e4a0293c4a2f617a5ec6f
I20260709 12:27:51.849040 21150 raft_consensus.cc:359] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.849977 21150 raft_consensus.cc:385] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:51.849677 21149 raft_consensus.cc:359] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.850405 21150 raft_consensus.cc:740] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Initialized, Role: FOLLOWER
I20260709 12:27:51.851540 21150 consensus_queue.cc:260] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.853488 21128 raft_consensus.cc:2804] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:51.853979 21128 raft_consensus.cc:493] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:51.856122 21128 raft_consensus.cc:3060] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:51.854375 21150 ts_tablet_manager.cc:1434] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260709 12:27:51.863303 21150 tablet_bootstrap.cc:492] T b10c3331582b4158b0b8b913d8f32557 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Bootstrap starting.
I20260709 12:27:51.850550 21149 raft_consensus.cc:385] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:51.866300 21149 raft_consensus.cc:740] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69b3b0ee0bdb42b39768623d8444232a, State: Initialized, Role: FOLLOWER
I20260709 12:27:51.867357 21149 consensus_queue.cc:260] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.877233 21149 ts_tablet_manager.cc:1434] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.001s
I20260709 12:27:51.880718 21149 tablet_bootstrap.cc:492] T 47722b2045fd40febe80064f4553c763 P 69b3b0ee0bdb42b39768623d8444232a: Bootstrap starting.
I20260709 12:27:51.874061 21128 raft_consensus.cc:515] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.882315 21150 tablet_bootstrap.cc:654] T b10c3331582b4158b0b8b913d8f32557 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:51.884003 21128 leader_election.cc:290] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 1 election: Requested vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:51.884788 20855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cb33ab8ff47aa81ee0ba714a80cb5" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
I20260709 12:27:51.885533 20855 raft_consensus.cc:3060] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:51.885977 21003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cb33ab8ff47aa81ee0ba714a80cb5" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
I20260709 12:27:51.887056 21003 raft_consensus.cc:3060] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:51.889282 21149 tablet_bootstrap.cc:654] T 47722b2045fd40febe80064f4553c763 P 69b3b0ee0bdb42b39768623d8444232a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:51.894937 21150 tablet_bootstrap.cc:492] T b10c3331582b4158b0b8b913d8f32557 P 2ba42136bb0e4a0293c4a2f617a5ec6f: No bootstrap required, opened a new log
I20260709 12:27:51.895625 21150 ts_tablet_manager.cc:1403] T b10c3331582b4158b0b8b913d8f32557 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.010s
I20260709 12:27:51.896556 21003 raft_consensus.cc:2468] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 1.
I20260709 12:27:51.899211 21150 raft_consensus.cc:359] T b10c3331582b4158b0b8b913d8f32557 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.895426 20855 raft_consensus.cc:2468] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 1.
I20260709 12:27:51.899214 21148 tablet_bootstrap.cc:492] T a06a663278614fc9b3522a016587d87d P d19688849fc44393bbf88cb3589a1d3a: No bootstrap required, opened a new log
I20260709 12:27:51.901448 21150 raft_consensus.cc:385] T b10c3331582b4158b0b8b913d8f32557 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:51.901891 21150 raft_consensus.cc:740] T b10c3331582b4158b0b8b913d8f32557 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Initialized, Role: FOLLOWER
I20260709 12:27:51.902868 21150 consensus_queue.cc:260] T b10c3331582b4158b0b8b913d8f32557 P 2ba42136bb0e4a0293c4a2f617a5ec6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.903854 21148 ts_tablet_manager.cc:1403] T a06a663278614fc9b3522a016587d87d P d19688849fc44393bbf88cb3589a1d3a: Time spent bootstrapping tablet: real 0.075s	user 0.018s	sys 0.016s
I20260709 12:27:51.904374 21149 tablet_bootstrap.cc:492] T 47722b2045fd40febe80064f4553c763 P 69b3b0ee0bdb42b39768623d8444232a: No bootstrap required, opened a new log
I20260709 12:27:51.911597 21149 ts_tablet_manager.cc:1403] T 47722b2045fd40febe80064f4553c763 P 69b3b0ee0bdb42b39768623d8444232a: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.011s
I20260709 12:27:51.905589 21150 ts_tablet_manager.cc:1434] T b10c3331582b4158b0b8b913d8f32557 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:27:51.905368 20894 leader_election.cc:304] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:51.912241 21148 raft_consensus.cc:359] T a06a663278614fc9b3522a016587d87d P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.913177 21148 raft_consensus.cc:385] T a06a663278614fc9b3522a016587d87d P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:51.913472 21148 raft_consensus.cc:740] T a06a663278614fc9b3522a016587d87d P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Initialized, Role: FOLLOWER
I20260709 12:27:51.914206 21160 raft_consensus.cc:2804] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:51.914840 21160 raft_consensus.cc:697] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a [term 1 LEADER]: Becoming Leader. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Running, Role: LEADER
I20260709 12:27:51.914444 21148 consensus_queue.cc:260] T a06a663278614fc9b3522a016587d87d P d19688849fc44393bbf88cb3589a1d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.915858 21160 consensus_queue.cc:237] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.921705 21150 tablet_bootstrap.cc:492] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Bootstrap starting.
I20260709 12:27:51.924607 21148 ts_tablet_manager.cc:1434] T a06a663278614fc9b3522a016587d87d P d19688849fc44393bbf88cb3589a1d3a: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.010s
I20260709 12:27:51.926024 21148 tablet_bootstrap.cc:492] T 47722b2045fd40febe80064f4553c763 P d19688849fc44393bbf88cb3589a1d3a: Bootstrap starting.
I20260709 12:27:51.930040 21150 tablet_bootstrap.cc:654] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:51.930985 21149 raft_consensus.cc:359] T 47722b2045fd40febe80064f4553c763 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.931903 21149 raft_consensus.cc:385] T 47722b2045fd40febe80064f4553c763 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:51.932252 21149 raft_consensus.cc:740] T 47722b2045fd40febe80064f4553c763 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69b3b0ee0bdb42b39768623d8444232a, State: Initialized, Role: FOLLOWER
I20260709 12:27:51.934345 21148 tablet_bootstrap.cc:654] T 47722b2045fd40febe80064f4553c763 P d19688849fc44393bbf88cb3589a1d3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:51.938225 21149 consensus_queue.cc:260] T 47722b2045fd40febe80064f4553c763 P 69b3b0ee0bdb42b39768623d8444232a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.939749 21148 tablet_bootstrap.cc:492] T 47722b2045fd40febe80064f4553c763 P d19688849fc44393bbf88cb3589a1d3a: No bootstrap required, opened a new log
I20260709 12:27:51.938918 20753 catalog_manager.cc:5697] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a reported cstate change: term changed from 0 to 1, leader changed from <none> to d19688849fc44393bbf88cb3589a1d3a (127.9.145.194). New cstate: current_term: 1 leader_uuid: "d19688849fc44393bbf88cb3589a1d3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:51.940407 21148 ts_tablet_manager.cc:1403] T 47722b2045fd40febe80064f4553c763 P d19688849fc44393bbf88cb3589a1d3a: Time spent bootstrapping tablet: real 0.015s	user 0.004s	sys 0.009s
I20260709 12:27:51.941548 21149 ts_tablet_manager.cc:1434] T 47722b2045fd40febe80064f4553c763 P 69b3b0ee0bdb42b39768623d8444232a: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.002s
I20260709 12:27:51.942760 21149 tablet_bootstrap.cc:492] T b10c3331582b4158b0b8b913d8f32557 P 69b3b0ee0bdb42b39768623d8444232a: Bootstrap starting.
I20260709 12:27:51.943868 21148 raft_consensus.cc:359] T 47722b2045fd40febe80064f4553c763 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.944567 21148 raft_consensus.cc:385] T 47722b2045fd40febe80064f4553c763 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:51.944891 21148 raft_consensus.cc:740] T 47722b2045fd40febe80064f4553c763 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Initialized, Role: FOLLOWER
I20260709 12:27:51.945986 21148 consensus_queue.cc:260] T 47722b2045fd40febe80064f4553c763 P d19688849fc44393bbf88cb3589a1d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.951619 21149 tablet_bootstrap.cc:654] T b10c3331582b4158b0b8b913d8f32557 P 69b3b0ee0bdb42b39768623d8444232a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:51.955011 21148 ts_tablet_manager.cc:1434] T 47722b2045fd40febe80064f4553c763 P d19688849fc44393bbf88cb3589a1d3a: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 12:27:51.955369 21150 tablet_bootstrap.cc:492] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f: No bootstrap required, opened a new log
I20260709 12:27:51.957459 21150 ts_tablet_manager.cc:1403] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.004s
I20260709 12:27:51.960640 21150 raft_consensus.cc:359] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.961578 21150 raft_consensus.cc:385] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:51.961129 21148 tablet_bootstrap.cc:492] T b10c3331582b4158b0b8b913d8f32557 P d19688849fc44393bbf88cb3589a1d3a: Bootstrap starting.
I20260709 12:27:51.961824 21149 tablet_bootstrap.cc:492] T b10c3331582b4158b0b8b913d8f32557 P 69b3b0ee0bdb42b39768623d8444232a: No bootstrap required, opened a new log
I20260709 12:27:51.962570 21149 ts_tablet_manager.cc:1403] T b10c3331582b4158b0b8b913d8f32557 P 69b3b0ee0bdb42b39768623d8444232a: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.000s
I20260709 12:27:51.965816 21150 raft_consensus.cc:740] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Initialized, Role: FOLLOWER
I20260709 12:27:51.965804 21149 raft_consensus.cc:359] T b10c3331582b4158b0b8b913d8f32557 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.966779 21149 raft_consensus.cc:385] T b10c3331582b4158b0b8b913d8f32557 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:51.967293 21149 raft_consensus.cc:740] T b10c3331582b4158b0b8b913d8f32557 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69b3b0ee0bdb42b39768623d8444232a, State: Initialized, Role: FOLLOWER
I20260709 12:27:51.967079 21150 consensus_queue.cc:260] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.968509 21148 tablet_bootstrap.cc:654] T b10c3331582b4158b0b8b913d8f32557 P d19688849fc44393bbf88cb3589a1d3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:51.968346 21149 consensus_queue.cc:260] T b10c3331582b4158b0b8b913d8f32557 P 69b3b0ee0bdb42b39768623d8444232a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.971020 21149 ts_tablet_manager.cc:1434] T b10c3331582b4158b0b8b913d8f32557 P 69b3b0ee0bdb42b39768623d8444232a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:27:51.973665 21149 tablet_bootstrap.cc:492] T a06a663278614fc9b3522a016587d87d P 69b3b0ee0bdb42b39768623d8444232a: Bootstrap starting.
I20260709 12:27:51.975369 21150 ts_tablet_manager.cc:1434] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:27:51.980692 21148 tablet_bootstrap.cc:492] T b10c3331582b4158b0b8b913d8f32557 P d19688849fc44393bbf88cb3589a1d3a: No bootstrap required, opened a new log
I20260709 12:27:51.981419 21148 ts_tablet_manager.cc:1403] T b10c3331582b4158b0b8b913d8f32557 P d19688849fc44393bbf88cb3589a1d3a: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 12:27:51.981925 21150 tablet_bootstrap.cc:492] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Bootstrap starting.
I20260709 12:27:51.982511 21149 tablet_bootstrap.cc:654] T a06a663278614fc9b3522a016587d87d P 69b3b0ee0bdb42b39768623d8444232a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:51.984975 21148 raft_consensus.cc:359] T b10c3331582b4158b0b8b913d8f32557 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.985956 21148 raft_consensus.cc:385] T b10c3331582b4158b0b8b913d8f32557 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:51.986370 21148 raft_consensus.cc:740] T b10c3331582b4158b0b8b913d8f32557 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Initialized, Role: FOLLOWER
I20260709 12:27:51.987368 21148 consensus_queue.cc:260] T b10c3331582b4158b0b8b913d8f32557 P d19688849fc44393bbf88cb3589a1d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:51.990324 21148 ts_tablet_manager.cc:1434] T b10c3331582b4158b0b8b913d8f32557 P d19688849fc44393bbf88cb3589a1d3a: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.006s
I20260709 12:27:51.990450 21150 tablet_bootstrap.cc:654] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:51.991570 21148 tablet_bootstrap.cc:492] T 21e6a6037d0942f38ea7f29a5e2a73b8 P d19688849fc44393bbf88cb3589a1d3a: Bootstrap starting.
I20260709 12:27:51.999346 21148 tablet_bootstrap.cc:654] T 21e6a6037d0942f38ea7f29a5e2a73b8 P d19688849fc44393bbf88cb3589a1d3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.006289 21150 tablet_bootstrap.cc:492] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 2ba42136bb0e4a0293c4a2f617a5ec6f: No bootstrap required, opened a new log
I20260709 12:27:52.007050 21150 ts_tablet_manager.cc:1403] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.007s
I20260709 12:27:52.009433 21149 tablet_bootstrap.cc:492] T a06a663278614fc9b3522a016587d87d P 69b3b0ee0bdb42b39768623d8444232a: No bootstrap required, opened a new log
I20260709 12:27:52.009976 21149 ts_tablet_manager.cc:1403] T a06a663278614fc9b3522a016587d87d P 69b3b0ee0bdb42b39768623d8444232a: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.016s
I20260709 12:27:52.010474 21148 tablet_bootstrap.cc:492] T 21e6a6037d0942f38ea7f29a5e2a73b8 P d19688849fc44393bbf88cb3589a1d3a: No bootstrap required, opened a new log
I20260709 12:27:52.010262 21150 raft_consensus.cc:359] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.011051 21148 ts_tablet_manager.cc:1403] T 21e6a6037d0942f38ea7f29a5e2a73b8 P d19688849fc44393bbf88cb3589a1d3a: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.001s
I20260709 12:27:52.011106 21150 raft_consensus.cc:385] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.011534 21150 raft_consensus.cc:740] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.012333 21150 consensus_queue.cc:260] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 2ba42136bb0e4a0293c4a2f617a5ec6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.012637 21149 raft_consensus.cc:359] T a06a663278614fc9b3522a016587d87d P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.013320 21149 raft_consensus.cc:385] T a06a663278614fc9b3522a016587d87d P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.014372 21149 raft_consensus.cc:740] T a06a663278614fc9b3522a016587d87d P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69b3b0ee0bdb42b39768623d8444232a, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.014406 21148 raft_consensus.cc:359] T 21e6a6037d0942f38ea7f29a5e2a73b8 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.015342 21148 raft_consensus.cc:385] T 21e6a6037d0942f38ea7f29a5e2a73b8 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.015802 21148 raft_consensus.cc:740] T 21e6a6037d0942f38ea7f29a5e2a73b8 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.015462 21149 consensus_queue.cc:260] T a06a663278614fc9b3522a016587d87d P 69b3b0ee0bdb42b39768623d8444232a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.016698 21148 consensus_queue.cc:260] T 21e6a6037d0942f38ea7f29a5e2a73b8 P d19688849fc44393bbf88cb3589a1d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.018956 21148 ts_tablet_manager.cc:1434] T 21e6a6037d0942f38ea7f29a5e2a73b8 P d19688849fc44393bbf88cb3589a1d3a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:27:52.021186 21149 ts_tablet_manager.cc:1434] T a06a663278614fc9b3522a016587d87d P 69b3b0ee0bdb42b39768623d8444232a: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 12:27:52.024317 21148 tablet_bootstrap.cc:492] T 4dff16a162ef45a6bca0f8d57b68b5cf P d19688849fc44393bbf88cb3589a1d3a: Bootstrap starting.
I20260709 12:27:52.025329 21136 raft_consensus.cc:493] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.025995 21136 raft_consensus.cc:515] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.032657 21148 tablet_bootstrap.cc:654] T 4dff16a162ef45a6bca0f8d57b68b5cf P d19688849fc44393bbf88cb3589a1d3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.024670 21149 tablet_bootstrap.cc:492] T 4dff16a162ef45a6bca0f8d57b68b5cf P 69b3b0ee0bdb42b39768623d8444232a: Bootstrap starting.
I20260709 12:27:52.030336 21136 leader_election.cc:290] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:52.041039 21149 tablet_bootstrap.cc:654] T 4dff16a162ef45a6bca0f8d57b68b5cf P 69b3b0ee0bdb42b39768623d8444232a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.023074 21150 ts_tablet_manager.cc:1434] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:27:52.043555 21150 tablet_bootstrap.cc:492] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f: Bootstrap starting.
I20260709 12:27:52.045063 20928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47722b2045fd40febe80064f4553c763" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a" is_pre_election: true
I20260709 12:27:52.045783 20928 raft_consensus.cc:2468] T 47722b2045fd40febe80064f4553c763 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 0.
I20260709 12:27:52.048003 21003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47722b2045fd40febe80064f4553c763" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a" is_pre_election: true
I20260709 12:27:52.048321 20820 leader_election.cc:304] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:52.048745 21003 raft_consensus.cc:2468] T 47722b2045fd40febe80064f4553c763 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 0.
I20260709 12:27:52.049422 21173 raft_consensus.cc:2804] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:52.049839 21173 raft_consensus.cc:493] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.050254 21173 raft_consensus.cc:3060] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.055056 21150 tablet_bootstrap.cc:654] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.055416 21148 tablet_bootstrap.cc:492] T 4dff16a162ef45a6bca0f8d57b68b5cf P d19688849fc44393bbf88cb3589a1d3a: No bootstrap required, opened a new log
I20260709 12:27:52.056061 21148 ts_tablet_manager.cc:1403] T 4dff16a162ef45a6bca0f8d57b68b5cf P d19688849fc44393bbf88cb3589a1d3a: Time spent bootstrapping tablet: real 0.032s	user 0.005s	sys 0.010s
I20260709 12:27:52.055416 21149 tablet_bootstrap.cc:492] T 4dff16a162ef45a6bca0f8d57b68b5cf P 69b3b0ee0bdb42b39768623d8444232a: No bootstrap required, opened a new log
I20260709 12:27:52.058463 21149 ts_tablet_manager.cc:1403] T 4dff16a162ef45a6bca0f8d57b68b5cf P 69b3b0ee0bdb42b39768623d8444232a: Time spent bootstrapping tablet: real 0.036s	user 0.005s	sys 0.009s
I20260709 12:27:52.059494 21148 raft_consensus.cc:359] T 4dff16a162ef45a6bca0f8d57b68b5cf P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.059747 21173 raft_consensus.cc:515] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.060431 21148 raft_consensus.cc:385] T 4dff16a162ef45a6bca0f8d57b68b5cf P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.060973 21148 raft_consensus.cc:740] T 4dff16a162ef45a6bca0f8d57b68b5cf P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.061873 21148 consensus_queue.cc:260] T 4dff16a162ef45a6bca0f8d57b68b5cf P d19688849fc44393bbf88cb3589a1d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.062070 21149 raft_consensus.cc:359] T 4dff16a162ef45a6bca0f8d57b68b5cf P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.062919 21149 raft_consensus.cc:385] T 4dff16a162ef45a6bca0f8d57b68b5cf P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.063241 21149 raft_consensus.cc:740] T 4dff16a162ef45a6bca0f8d57b68b5cf P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69b3b0ee0bdb42b39768623d8444232a, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.064173 21149 consensus_queue.cc:260] T 4dff16a162ef45a6bca0f8d57b68b5cf P 69b3b0ee0bdb42b39768623d8444232a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.065017 21148 ts_tablet_manager.cc:1434] T 4dff16a162ef45a6bca0f8d57b68b5cf P d19688849fc44393bbf88cb3589a1d3a: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 12:27:52.067822 21150 tablet_bootstrap.cc:492] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f: No bootstrap required, opened a new log
I20260709 12:27:52.068286 21148 tablet_bootstrap.cc:492] T 622f187c34ed45d2b3c17e391f150a49 P d19688849fc44393bbf88cb3589a1d3a: Bootstrap starting.
I20260709 12:27:52.068476 21150 ts_tablet_manager.cc:1403] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.009s
I20260709 12:27:52.070940 20928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47722b2045fd40febe80064f4553c763" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
I20260709 12:27:52.071705 20928 raft_consensus.cc:3060] T 47722b2045fd40febe80064f4553c763 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.072260 21150 raft_consensus.cc:359] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.073172 21150 raft_consensus.cc:385] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.066808 21149 ts_tablet_manager.cc:1434] T 4dff16a162ef45a6bca0f8d57b68b5cf P 69b3b0ee0bdb42b39768623d8444232a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:27:52.074632 21149 tablet_bootstrap.cc:492] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a: Bootstrap starting.
I20260709 12:27:52.076076 21148 tablet_bootstrap.cc:654] T 622f187c34ed45d2b3c17e391f150a49 P d19688849fc44393bbf88cb3589a1d3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.081424 21150 raft_consensus.cc:740] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.083361 21149 tablet_bootstrap.cc:654] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.082490 21150 consensus_queue.cc:260] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.087728 21164 raft_consensus.cc:493] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.088762 21150 ts_tablet_manager.cc:1434] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:27:52.090057 21150 tablet_bootstrap.cc:492] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f: Bootstrap starting.
I20260709 12:27:52.088451 21164 raft_consensus.cc:515] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.092943 21164 leader_election.cc:290] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:52.094502 21003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b11efee3c940f8b0cb5dda5ae9028f" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a" is_pre_election: true
I20260709 12:27:52.095348 21003 raft_consensus.cc:2468] T 56b11efee3c940f8b0cb5dda5ae9028f P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 0.
I20260709 12:27:52.096845 20895 leader_election.cc:304] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69b3b0ee0bdb42b39768623d8444232a, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:52.099409 20855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b11efee3c940f8b0cb5dda5ae9028f" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" is_pre_election: true
I20260709 12:27:52.100350 20855 raft_consensus.cc:2468] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 0.
I20260709 12:27:52.103150 21136 raft_consensus.cc:493] T a06a663278614fc9b3522a016587d87d P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.103559 21173 leader_election.cc:290] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 election: Requested vote from peers d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:52.103777 21136 raft_consensus.cc:515] T a06a663278614fc9b3522a016587d87d P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.105137 21003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47722b2045fd40febe80064f4553c763" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
I20260709 12:27:52.106052 21003 raft_consensus.cc:3060] T 47722b2045fd40febe80064f4553c763 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.107525 20930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a06a663278614fc9b3522a016587d87d" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a" is_pre_election: true
I20260709 12:27:52.106002 21136 leader_election.cc:290] T a06a663278614fc9b3522a016587d87d P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:52.108043 20928 raft_consensus.cc:2468] T 47722b2045fd40febe80064f4553c763 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 1.
I20260709 12:27:52.097030 21150 tablet_bootstrap.cc:654] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.109210 21002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a06a663278614fc9b3522a016587d87d" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a" is_pre_election: true
I20260709 12:27:52.113642 21002 raft_consensus.cc:2468] T a06a663278614fc9b3522a016587d87d P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 0.
I20260709 12:27:52.107501 21164 raft_consensus.cc:2804] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:52.114277 20820 leader_election.cc:304] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:52.114604 21164 raft_consensus.cc:493] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.115046 21164 raft_consensus.cc:3060] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.115284 21149 tablet_bootstrap.cc:492] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a: No bootstrap required, opened a new log
I20260709 12:27:52.115397 21136 raft_consensus.cc:2804] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:52.116951 21149 ts_tablet_manager.cc:1403] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.004s
I20260709 12:27:52.117703 21136 raft_consensus.cc:697] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Becoming Leader. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Running, Role: LEADER
I20260709 12:27:52.108395 20930 raft_consensus.cc:2468] T a06a663278614fc9b3522a016587d87d P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 0.
I20260709 12:27:52.118737 21136 consensus_queue.cc:237] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.119685 20820 leader_election.cc:304] T a06a663278614fc9b3522a016587d87d P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:52.120157 21149 raft_consensus.cc:359] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.120837 21135 raft_consensus.cc:493] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.120978 21149 raft_consensus.cc:385] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.121408 21149 raft_consensus.cc:740] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69b3b0ee0bdb42b39768623d8444232a, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.121449 21135 raft_consensus.cc:515] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.122366 21149 consensus_queue.cc:260] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.130414 21173 raft_consensus.cc:2804] T a06a663278614fc9b3522a016587d87d P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:52.130623 21148 tablet_bootstrap.cc:492] T 622f187c34ed45d2b3c17e391f150a49 P d19688849fc44393bbf88cb3589a1d3a: No bootstrap required, opened a new log
I20260709 12:27:52.130661 20930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e6a6037d0942f38ea7f29a5e2a73b8" candidate_uuid: "69b3b0ee0bdb42b39768623d8444232a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a" is_pre_election: true
I20260709 12:27:52.131636 21148 ts_tablet_manager.cc:1403] T 622f187c34ed45d2b3c17e391f150a49 P d19688849fc44393bbf88cb3589a1d3a: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.029s
I20260709 12:27:52.131733 20930 raft_consensus.cc:2468] T 21e6a6037d0942f38ea7f29a5e2a73b8 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69b3b0ee0bdb42b39768623d8444232a in term 0.
I20260709 12:27:52.132239 20855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e6a6037d0942f38ea7f29a5e2a73b8" candidate_uuid: "69b3b0ee0bdb42b39768623d8444232a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" is_pre_election: true
I20260709 12:27:52.132964 20855 raft_consensus.cc:2468] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69b3b0ee0bdb42b39768623d8444232a in term 0.
I20260709 12:27:52.134872 20969 leader_election.cc:304] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69b3b0ee0bdb42b39768623d8444232a, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:52.135414 21148 raft_consensus.cc:359] T 622f187c34ed45d2b3c17e391f150a49 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.136276 21148 raft_consensus.cc:385] T 622f187c34ed45d2b3c17e391f150a49 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.136584 21148 raft_consensus.cc:740] T 622f187c34ed45d2b3c17e391f150a49 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.136605 21003 raft_consensus.cc:2468] T 47722b2045fd40febe80064f4553c763 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 1.
I20260709 12:27:52.137555 21148 consensus_queue.cc:260] T 622f187c34ed45d2b3c17e391f150a49 P d19688849fc44393bbf88cb3589a1d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.126024 21135 leader_election.cc:290] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331)
I20260709 12:27:52.139155 21180 raft_consensus.cc:2804] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:52.138588 21164 raft_consensus.cc:515] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.140439 21149 ts_tablet_manager.cc:1434] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a: Time spent starting tablet: real 0.023s	user 0.011s	sys 0.003s
I20260709 12:27:52.148139 21173 raft_consensus.cc:493] T a06a663278614fc9b3522a016587d87d P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.146723 21180 raft_consensus.cc:493] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.148655 21173 raft_consensus.cc:3060] T a06a663278614fc9b3522a016587d87d P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.149042 21180 raft_consensus.cc:3060] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.152351 21003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b11efee3c940f8b0cb5dda5ae9028f" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
I20260709 12:27:52.151150 21148 ts_tablet_manager.cc:1434] T 622f187c34ed45d2b3c17e391f150a49 P d19688849fc44393bbf88cb3589a1d3a: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:27:52.153182 21003 raft_consensus.cc:3060] T 56b11efee3c940f8b0cb5dda5ae9028f P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.154050 21148 tablet_bootstrap.cc:492] T 5fa339aff7a7450c8322379571310a2b P d19688849fc44393bbf88cb3589a1d3a: Bootstrap starting.
I20260709 12:27:52.160753 21148 tablet_bootstrap.cc:654] T 5fa339aff7a7450c8322379571310a2b P d19688849fc44393bbf88cb3589a1d3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.160923 21003 raft_consensus.cc:2468] T 56b11efee3c940f8b0cb5dda5ae9028f P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 1.
I20260709 12:27:52.161970 21149 tablet_bootstrap.cc:492] T 5fa339aff7a7450c8322379571310a2b P 69b3b0ee0bdb42b39768623d8444232a: Bootstrap starting.
I20260709 12:27:52.162235 20895 leader_election.cc:304] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69b3b0ee0bdb42b39768623d8444232a, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:52.163259 21160 raft_consensus.cc:2804] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:52.163776 21160 raft_consensus.cc:697] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a [term 1 LEADER]: Becoming Leader. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Running, Role: LEADER
I20260709 12:27:52.164633 21160 consensus_queue.cc:237] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.165510 20855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b11efee3c940f8b0cb5dda5ae9028f" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
I20260709 12:27:52.166253 20855 raft_consensus.cc:3060] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.168697 21149 tablet_bootstrap.cc:654] T 5fa339aff7a7450c8322379571310a2b P 69b3b0ee0bdb42b39768623d8444232a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.170388 21150 tablet_bootstrap.cc:492] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f: No bootstrap required, opened a new log
I20260709 12:27:52.171013 21150 ts_tablet_manager.cc:1403] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent bootstrapping tablet: real 0.081s	user 0.015s	sys 0.022s
I20260709 12:27:52.174062 21150 raft_consensus.cc:359] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.180464 21150 raft_consensus.cc:385] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.177428 21164 leader_election.cc:290] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 1 election: Requested vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:52.180832 21150 raft_consensus.cc:740] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.183682 21150 consensus_queue.cc:260] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.186336 21149 tablet_bootstrap.cc:492] T 5fa339aff7a7450c8322379571310a2b P 69b3b0ee0bdb42b39768623d8444232a: No bootstrap required, opened a new log
I20260709 12:27:52.187399 21149 ts_tablet_manager.cc:1403] T 5fa339aff7a7450c8322379571310a2b P 69b3b0ee0bdb42b39768623d8444232a: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.003s
I20260709 12:27:52.188529 21180 raft_consensus.cc:515] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.191201 21149 raft_consensus.cc:359] T 5fa339aff7a7450c8322379571310a2b P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.191546 21180 leader_election.cc:290] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a [CANDIDATE]: Term 1 election: Requested vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331)
I20260709 12:27:52.192739 20854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e6a6037d0942f38ea7f29a5e2a73b8" candidate_uuid: "69b3b0ee0bdb42b39768623d8444232a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
I20260709 12:27:52.195809 21149 raft_consensus.cc:385] T 5fa339aff7a7450c8322379571310a2b P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.196703 21149 raft_consensus.cc:740] T 5fa339aff7a7450c8322379571310a2b P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69b3b0ee0bdb42b39768623d8444232a, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.198627 21149 consensus_queue.cc:260] T 5fa339aff7a7450c8322379571310a2b P 69b3b0ee0bdb42b39768623d8444232a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.196223 20854 raft_consensus.cc:3060] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.190068 20752 catalog_manager.cc:5697] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a reported cstate change: term changed from 0 to 1, leader changed from <none> to d19688849fc44393bbf88cb3589a1d3a (127.9.145.194). New cstate: current_term: 1 leader_uuid: "d19688849fc44393bbf88cb3589a1d3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:52.209630 20854 raft_consensus.cc:2468] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69b3b0ee0bdb42b39768623d8444232a in term 1.
I20260709 12:27:52.211187 20968 leader_election.cc:304] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, 69b3b0ee0bdb42b39768623d8444232a; no voters: 
I20260709 12:27:52.211666 21150 ts_tablet_manager.cc:1434] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent starting tablet: real 0.040s	user 0.012s	sys 0.013s
I20260709 12:27:52.212852 21150 tablet_bootstrap.cc:492] T 622f187c34ed45d2b3c17e391f150a49 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Bootstrap starting.
I20260709 12:27:52.215157 21148 tablet_bootstrap.cc:492] T 5fa339aff7a7450c8322379571310a2b P d19688849fc44393bbf88cb3589a1d3a: No bootstrap required, opened a new log
I20260709 12:27:52.216847 21148 ts_tablet_manager.cc:1403] T 5fa339aff7a7450c8322379571310a2b P d19688849fc44393bbf88cb3589a1d3a: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.001s
W20260709 12:27:52.218360 20969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.145.194:42331, user_credentials={real_user=slave}} blocked reactor thread for 83687.3us
I20260709 12:27:52.219177 21182 raft_consensus.cc:2804] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:52.219903 21150 tablet_bootstrap.cc:654] T 622f187c34ed45d2b3c17e391f150a49 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.220079 21148 raft_consensus.cc:359] T 5fa339aff7a7450c8322379571310a2b P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.205716 21164 raft_consensus.cc:493] T b10c3331582b4158b0b8b913d8f32557 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.220273 20930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e6a6037d0942f38ea7f29a5e2a73b8" candidate_uuid: "69b3b0ee0bdb42b39768623d8444232a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
I20260709 12:27:52.221043 21182 raft_consensus.cc:697] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a [term 1 LEADER]: Becoming Leader. State: Replica: 69b3b0ee0bdb42b39768623d8444232a, State: Running, Role: LEADER
I20260709 12:27:52.220906 21148 raft_consensus.cc:385] T 5fa339aff7a7450c8322379571310a2b P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.222040 21148 raft_consensus.cc:740] T 5fa339aff7a7450c8322379571310a2b P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.221107 21164 raft_consensus.cc:515] T b10c3331582b4158b0b8b913d8f32557 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.221536 20930 raft_consensus.cc:3060] T 21e6a6037d0942f38ea7f29a5e2a73b8 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.222216 21182 consensus_queue.cc:237] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.224301 21164 leader_election.cc:290] T b10c3331582b4158b0b8b913d8f32557 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:52.226016 21003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10c3331582b4158b0b8b913d8f32557" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a" is_pre_election: true
I20260709 12:27:52.227733 20854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10c3331582b4158b0b8b913d8f32557" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" is_pre_election: true
I20260709 12:27:52.227923 21003 raft_consensus.cc:2468] T b10c3331582b4158b0b8b913d8f32557 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 0.
I20260709 12:27:52.228503 20854 raft_consensus.cc:2468] T b10c3331582b4158b0b8b913d8f32557 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 0.
I20260709 12:27:52.200325 20855 raft_consensus.cc:2468] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 1.
I20260709 12:27:52.229534 20895 leader_election.cc:304] T b10c3331582b4158b0b8b913d8f32557 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69b3b0ee0bdb42b39768623d8444232a, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:52.230744 21164 raft_consensus.cc:2804] T b10c3331582b4158b0b8b913d8f32557 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:52.231223 21164 raft_consensus.cc:493] T b10c3331582b4158b0b8b913d8f32557 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.230549 20752 catalog_manager.cc:5697] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193). New cstate: current_term: 1 leader_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:52.231616 21164 raft_consensus.cc:3060] T b10c3331582b4158b0b8b913d8f32557 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.239315 20930 raft_consensus.cc:2468] T 21e6a6037d0942f38ea7f29a5e2a73b8 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69b3b0ee0bdb42b39768623d8444232a in term 1.
I20260709 12:27:52.220587 21183 raft_consensus.cc:493] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.232152 21148 consensus_queue.cc:260] T 5fa339aff7a7450c8322379571310a2b P d19688849fc44393bbf88cb3589a1d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.193147 21173 raft_consensus.cc:515] T a06a663278614fc9b3522a016587d87d P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.241707 21183 raft_consensus.cc:515] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.244059 21148 ts_tablet_manager.cc:1434] T 5fa339aff7a7450c8322379571310a2b P d19688849fc44393bbf88cb3589a1d3a: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:27:52.229429 21149 ts_tablet_manager.cc:1434] T 5fa339aff7a7450c8322379571310a2b P 69b3b0ee0bdb42b39768623d8444232a: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 12:27:52.245193 21183 leader_election.cc:290] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:52.248481 21150 tablet_bootstrap.cc:492] T 622f187c34ed45d2b3c17e391f150a49 P 2ba42136bb0e4a0293c4a2f617a5ec6f: No bootstrap required, opened a new log
I20260709 12:27:52.249123 21150 ts_tablet_manager.cc:1403] T 622f187c34ed45d2b3c17e391f150a49 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.001s
I20260709 12:27:52.246311 20928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dff16a162ef45a6bca0f8d57b68b5cf" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a" is_pre_election: true
I20260709 12:27:52.250854 20928 raft_consensus.cc:2468] T 4dff16a162ef45a6bca0f8d57b68b5cf P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 0.
I20260709 12:27:52.246284 21003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dff16a162ef45a6bca0f8d57b68b5cf" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a" is_pre_election: true
I20260709 12:27:52.252267 21003 raft_consensus.cc:2468] T 4dff16a162ef45a6bca0f8d57b68b5cf P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 0.
I20260709 12:27:52.253786 20820 leader_election.cc:304] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, 69b3b0ee0bdb42b39768623d8444232a; no voters: 
I20260709 12:27:52.254216 20752 catalog_manager.cc:5697] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a reported cstate change: term changed from 0 to 1, leader changed from <none> to 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195). New cstate: current_term: 1 leader_uuid: "69b3b0ee0bdb42b39768623d8444232a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:52.255390 21136 raft_consensus.cc:2804] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:52.255926 21136 raft_consensus.cc:493] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.256323 21136 raft_consensus.cc:3060] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.257800 21173 leader_election.cc:290] T a06a663278614fc9b3522a016587d87d P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 election: Requested vote from peers d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:52.241829 21164 raft_consensus.cc:515] T b10c3331582b4158b0b8b913d8f32557 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.259699 20928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a06a663278614fc9b3522a016587d87d" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
I20260709 12:27:52.260419 20928 raft_consensus.cc:3060] T a06a663278614fc9b3522a016587d87d P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.261013 21164 leader_election.cc:290] T b10c3331582b4158b0b8b913d8f32557 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 1 election: Requested vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:52.260433 21003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a06a663278614fc9b3522a016587d87d" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
I20260709 12:27:52.262279 21003 raft_consensus.cc:3060] T a06a663278614fc9b3522a016587d87d P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.262485 21002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10c3331582b4158b0b8b913d8f32557" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
I20260709 12:27:52.263160 21002 raft_consensus.cc:3060] T b10c3331582b4158b0b8b913d8f32557 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.266441 20854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10c3331582b4158b0b8b913d8f32557" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
I20260709 12:27:52.267154 20854 raft_consensus.cc:3060] T b10c3331582b4158b0b8b913d8f32557 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.270776 21003 raft_consensus.cc:2468] T a06a663278614fc9b3522a016587d87d P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 1.
I20260709 12:27:52.272264 20820 leader_election.cc:304] T a06a663278614fc9b3522a016587d87d P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, 69b3b0ee0bdb42b39768623d8444232a; no voters: 
I20260709 12:27:52.274207 21173 raft_consensus.cc:2804] T a06a663278614fc9b3522a016587d87d P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:52.274788 21173 raft_consensus.cc:697] T a06a663278614fc9b3522a016587d87d P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Becoming Leader. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Running, Role: LEADER
I20260709 12:27:52.276857 20854 raft_consensus.cc:2468] T b10c3331582b4158b0b8b913d8f32557 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 1.
I20260709 12:27:52.277247 20928 raft_consensus.cc:2468] T a06a663278614fc9b3522a016587d87d P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 1.
I20260709 12:27:52.275609 21173 consensus_queue.cc:237] T a06a663278614fc9b3522a016587d87d P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.252228 21150 raft_consensus.cc:359] T 622f187c34ed45d2b3c17e391f150a49 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.279448 20894 leader_election.cc:304] T b10c3331582b4158b0b8b913d8f32557 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:52.281023 21160 raft_consensus.cc:2804] T b10c3331582b4158b0b8b913d8f32557 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:52.281610 21160 raft_consensus.cc:697] T b10c3331582b4158b0b8b913d8f32557 P d19688849fc44393bbf88cb3589a1d3a [term 1 LEADER]: Becoming Leader. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Running, Role: LEADER
I20260709 12:27:52.279458 21150 raft_consensus.cc:385] T 622f187c34ed45d2b3c17e391f150a49 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.282522 21160 consensus_queue.cc:237] T b10c3331582b4158b0b8b913d8f32557 P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.283443 21150 raft_consensus.cc:740] T 622f187c34ed45d2b3c17e391f150a49 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.284458 21150 consensus_queue.cc:260] T 622f187c34ed45d2b3c17e391f150a49 P 2ba42136bb0e4a0293c4a2f617a5ec6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.285674 21136 raft_consensus.cc:515] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.286549 21150 ts_tablet_manager.cc:1434] T 622f187c34ed45d2b3c17e391f150a49 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 12:27:52.271601 21002 raft_consensus.cc:2468] T b10c3331582b4158b0b8b913d8f32557 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 1.
I20260709 12:27:52.296586 20752 catalog_manager.cc:5697] T a06a663278614fc9b3522a016587d87d P 2ba42136bb0e4a0293c4a2f617a5ec6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193). New cstate: current_term: 1 leader_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:52.288069 21136 leader_election.cc:290] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 election: Requested vote from peers d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:52.289790 20928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dff16a162ef45a6bca0f8d57b68b5cf" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
I20260709 12:27:52.298317 20928 raft_consensus.cc:3060] T 4dff16a162ef45a6bca0f8d57b68b5cf P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.291522 21003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dff16a162ef45a6bca0f8d57b68b5cf" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
I20260709 12:27:52.299294 21003 raft_consensus.cc:3060] T 4dff16a162ef45a6bca0f8d57b68b5cf P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.301884 20753 catalog_manager.cc:5697] T b10c3331582b4158b0b8b913d8f32557 P d19688849fc44393bbf88cb3589a1d3a reported cstate change: term changed from 0 to 1, leader changed from <none> to d19688849fc44393bbf88cb3589a1d3a (127.9.145.194). New cstate: current_term: 1 leader_uuid: "d19688849fc44393bbf88cb3589a1d3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:52.306047 20928 raft_consensus.cc:2468] T 4dff16a162ef45a6bca0f8d57b68b5cf P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 1.
I20260709 12:27:52.306738 21003 raft_consensus.cc:2468] T 4dff16a162ef45a6bca0f8d57b68b5cf P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 1.
I20260709 12:27:52.307436 20820 leader_election.cc:304] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:52.308310 21136 raft_consensus.cc:2804] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:52.308813 21136 raft_consensus.cc:697] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Becoming Leader. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Running, Role: LEADER
I20260709 12:27:52.309680 21136 consensus_queue.cc:237] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.319762 20752 catalog_manager.cc:5697] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193). New cstate: current_term: 1 leader_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:52.411742 21136 raft_consensus.cc:493] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.412319 21136 raft_consensus.cc:515] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.414330 21136 leader_election.cc:290] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:52.415325 21003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa339aff7a7450c8322379571310a2b" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a" is_pre_election: true
I20260709 12:27:52.416013 21003 raft_consensus.cc:2468] T 5fa339aff7a7450c8322379571310a2b P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 0.
I20260709 12:27:52.415234 20928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa339aff7a7450c8322379571310a2b" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a" is_pre_election: true
I20260709 12:27:52.416821 20928 raft_consensus.cc:2468] T 5fa339aff7a7450c8322379571310a2b P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 0.
I20260709 12:27:52.417251 20820 leader_election.cc:304] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, 69b3b0ee0bdb42b39768623d8444232a; no voters: 
I20260709 12:27:52.418041 21136 raft_consensus.cc:2804] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:52.418453 21136 raft_consensus.cc:493] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.418767 21136 raft_consensus.cc:3060] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.424690 21136 raft_consensus.cc:515] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.426712 21136 leader_election.cc:290] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 election: Requested vote from peers d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:52.427289 20930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa339aff7a7450c8322379571310a2b" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
I20260709 12:27:52.427534 21003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa339aff7a7450c8322379571310a2b" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
I20260709 12:27:52.428037 20930 raft_consensus.cc:3060] T 5fa339aff7a7450c8322379571310a2b P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.428145 21003 raft_consensus.cc:3060] T 5fa339aff7a7450c8322379571310a2b P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.433593 21003 raft_consensus.cc:2468] T 5fa339aff7a7450c8322379571310a2b P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 1.
I20260709 12:27:52.434549 20930 raft_consensus.cc:2468] T 5fa339aff7a7450c8322379571310a2b P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 1.
I20260709 12:27:52.435801 20820 leader_election.cc:304] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, 69b3b0ee0bdb42b39768623d8444232a; no voters: 
I20260709 12:27:52.436959 21136 raft_consensus.cc:2804] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:52.437495 21136 raft_consensus.cc:697] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Becoming Leader. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Running, Role: LEADER
I20260709 12:27:52.438374 21136 consensus_queue.cc:237] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.445822 20752 catalog_manager.cc:5697] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193). New cstate: current_term: 1 leader_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:52.462495 21164 consensus_queue.cc:1048] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:52.475147 21164 consensus_queue.cc:1048] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:52.552536 21182 raft_consensus.cc:493] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.553087 21182 raft_consensus.cc:515] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.555138 21182 leader_election.cc:290] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331)
I20260709 12:27:52.556027 20854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622f187c34ed45d2b3c17e391f150a49" candidate_uuid: "69b3b0ee0bdb42b39768623d8444232a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" is_pre_election: true
I20260709 12:27:52.556216 20930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622f187c34ed45d2b3c17e391f150a49" candidate_uuid: "69b3b0ee0bdb42b39768623d8444232a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a" is_pre_election: true
I20260709 12:27:52.556746 20854 raft_consensus.cc:2468] T 622f187c34ed45d2b3c17e391f150a49 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69b3b0ee0bdb42b39768623d8444232a in term 0.
I20260709 12:27:52.556855 20930 raft_consensus.cc:2468] T 622f187c34ed45d2b3c17e391f150a49 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69b3b0ee0bdb42b39768623d8444232a in term 0.
I20260709 12:27:52.557827 20968 leader_election.cc:304] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, 69b3b0ee0bdb42b39768623d8444232a; no voters: 
I20260709 12:27:52.558699 21182 raft_consensus.cc:2804] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:52.559101 21182 raft_consensus.cc:493] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.559438 21182 raft_consensus.cc:3060] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.566195 21164 consensus_queue.cc:1048] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:52.567644 21182 raft_consensus.cc:515] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.569563 21182 leader_election.cc:290] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a [CANDIDATE]: Term 1 election: Requested vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331)
I20260709 12:27:52.570525 20855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622f187c34ed45d2b3c17e391f150a49" candidate_uuid: "69b3b0ee0bdb42b39768623d8444232a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
I20260709 12:27:52.571161 20855 raft_consensus.cc:3060] T 622f187c34ed45d2b3c17e391f150a49 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.571846 20930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622f187c34ed45d2b3c17e391f150a49" candidate_uuid: "69b3b0ee0bdb42b39768623d8444232a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
I20260709 12:27:52.572520 20930 raft_consensus.cc:3060] T 622f187c34ed45d2b3c17e391f150a49 P d19688849fc44393bbf88cb3589a1d3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.581537 21128 consensus_queue.cc:1048] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:52.588478 20930 raft_consensus.cc:2468] T 622f187c34ed45d2b3c17e391f150a49 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69b3b0ee0bdb42b39768623d8444232a in term 1.
I20260709 12:27:52.589866 20969 leader_election.cc:304] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69b3b0ee0bdb42b39768623d8444232a, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:52.590051 20855 raft_consensus.cc:2468] T 622f187c34ed45d2b3c17e391f150a49 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69b3b0ee0bdb42b39768623d8444232a in term 1.
I20260709 12:27:52.590812 21135 raft_consensus.cc:2804] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:52.591331 21135 raft_consensus.cc:697] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a [term 1 LEADER]: Becoming Leader. State: Replica: 69b3b0ee0bdb42b39768623d8444232a, State: Running, Role: LEADER
I20260709 12:27:52.592186 21135 consensus_queue.cc:237] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.604398 21136 consensus_queue.cc:1048] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:52.605702 20752 catalog_manager.cc:5697] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a reported cstate change: term changed from 0 to 1, leader changed from <none> to 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195). New cstate: current_term: 1 leader_uuid: "69b3b0ee0bdb42b39768623d8444232a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:52.614748 21183 consensus_queue.cc:1048] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:52.644109 20930 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c6cb33ab8ff47aa81ee0ba714a80cb5"
dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
mode: GRACEFUL
new_leader_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
 from {username='slave'} at 127.0.0.1:44488
I20260709 12:27:52.644767 20930 raft_consensus.cc:606] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a [term 1 LEADER]: Received request to transfer leadership to TS 2ba42136bb0e4a0293c4a2f617a5ec6f
I20260709 12:27:52.650431 20930 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56b11efee3c940f8b0cb5dda5ae9028f"
dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
mode: GRACEFUL
new_leader_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
 from {username='slave'} at 127.0.0.1:44488
I20260709 12:27:52.650976 20930 raft_consensus.cc:606] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a [term 1 LEADER]: Received request to transfer leadership to TS 2ba42136bb0e4a0293c4a2f617a5ec6f
I20260709 12:27:52.659228 21002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21e6a6037d0942f38ea7f29a5e2a73b8"
dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
mode: GRACEFUL
new_leader_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
 from {username='slave'} at 127.0.0.1:45968
I20260709 12:27:52.659778 21002 raft_consensus.cc:606] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a [term 1 LEADER]: Received request to transfer leadership to TS 2ba42136bb0e4a0293c4a2f617a5ec6f
I20260709 12:27:52.664965 20855 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47722b2045fd40febe80064f4553c763"
dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
mode: GRACEFUL
new_leader_uuid: "d19688849fc44393bbf88cb3589a1d3a"
 from {username='slave'} at 127.0.0.1:52614
I20260709 12:27:52.665495 20855 raft_consensus.cc:606] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Received request to transfer leadership to TS d19688849fc44393bbf88cb3589a1d3a
I20260709 12:27:52.673755 20855 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4dff16a162ef45a6bca0f8d57b68b5cf"
dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
mode: GRACEFUL
new_leader_uuid: "d19688849fc44393bbf88cb3589a1d3a"
 from {username='slave'} at 127.0.0.1:52614
I20260709 12:27:52.674320 20855 raft_consensus.cc:606] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Received request to transfer leadership to TS d19688849fc44393bbf88cb3589a1d3a
I20260709 12:27:52.679457 21002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "622f187c34ed45d2b3c17e391f150a49"
dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
mode: GRACEFUL
new_leader_uuid: "d19688849fc44393bbf88cb3589a1d3a"
 from {username='slave'} at 127.0.0.1:45968
I20260709 12:27:52.680002 21002 raft_consensus.cc:606] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a [term 1 LEADER]: Received request to transfer leadership to TS d19688849fc44393bbf88cb3589a1d3a
I20260709 12:27:52.684863 20855 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fa339aff7a7450c8322379571310a2b"
dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
mode: GRACEFUL
new_leader_uuid: "69b3b0ee0bdb42b39768623d8444232a"
 from {username='slave'} at 127.0.0.1:52614
I20260709 12:27:52.685415 20855 raft_consensus.cc:606] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Received request to transfer leadership to TS 69b3b0ee0bdb42b39768623d8444232a
I20260709 12:27:52.697013 21183 consensus_queue.cc:1048] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:52.703333 21186 raft_consensus.cc:993] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f: : Instructing follower d19688849fc44393bbf88cb3589a1d3a to start an election
I20260709 12:27:52.703846 21186 raft_consensus.cc:1081] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Signalling peer d19688849fc44393bbf88cb3589a1d3a to start an election
I20260709 12:27:52.706143 20928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4dff16a162ef45a6bca0f8d57b68b5cf"
dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
 from {username='slave'} at 127.0.0.1:44476
I20260709 12:27:52.710186 20928 raft_consensus.cc:493] T 4dff16a162ef45a6bca0f8d57b68b5cf P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:52.710644 20928 raft_consensus.cc:3060] T 4dff16a162ef45a6bca0f8d57b68b5cf P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:52.710740 21183 consensus_queue.cc:1048] T a06a663278614fc9b3522a016587d87d P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:52.718456 20928 raft_consensus.cc:515] T 4dff16a162ef45a6bca0f8d57b68b5cf P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.718792 21183 consensus_queue.cc:1048] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:52.724210 20855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dff16a162ef45a6bca0f8d57b68b5cf" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
I20260709 12:27:52.725065 20855 raft_consensus.cc:3055] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:52.725375 20855 raft_consensus.cc:740] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Running, Role: LEADER
I20260709 12:27:52.726143 20855 consensus_queue.cc:260] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.727046 20855 raft_consensus.cc:3060] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:52.734001 21136 consensus_queue.cc:1048] T a06a663278614fc9b3522a016587d87d P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:52.745925 20928 leader_election.cc:290] T 4dff16a162ef45a6bca0f8d57b68b5cf P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 2 election: Requested vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:52.748728 21002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dff16a162ef45a6bca0f8d57b68b5cf" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
I20260709 12:27:52.749467 21002 raft_consensus.cc:3060] T 4dff16a162ef45a6bca0f8d57b68b5cf P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:52.748941 20855 raft_consensus.cc:2468] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 2.
I20260709 12:27:52.751547 20894 leader_election.cc:304] T 4dff16a162ef45a6bca0f8d57b68b5cf P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:52.752395 21128 raft_consensus.cc:2804] T 4dff16a162ef45a6bca0f8d57b68b5cf P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:52.752880 21128 raft_consensus.cc:697] T 4dff16a162ef45a6bca0f8d57b68b5cf P d19688849fc44393bbf88cb3589a1d3a [term 2 LEADER]: Becoming Leader. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Running, Role: LEADER
I20260709 12:27:52.753671 21128 consensus_queue.cc:237] T 4dff16a162ef45a6bca0f8d57b68b5cf P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.757319 21002 raft_consensus.cc:2468] T 4dff16a162ef45a6bca0f8d57b68b5cf P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 2.
I20260709 12:27:52.766048 20751 catalog_manager.cc:5697] T 4dff16a162ef45a6bca0f8d57b68b5cf P d19688849fc44393bbf88cb3589a1d3a reported cstate change: term changed from 1 to 2, leader changed from 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193) to d19688849fc44393bbf88cb3589a1d3a (127.9.145.194). New cstate: current_term: 2 leader_uuid: "d19688849fc44393bbf88cb3589a1d3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:52.772351 21182 consensus_queue.cc:1048] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:52.781180 21182 consensus_queue.cc:1048] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:52.786551 21135 raft_consensus.cc:993] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a: : Instructing follower 2ba42136bb0e4a0293c4a2f617a5ec6f to start an election
I20260709 12:27:52.787503 21182 raft_consensus.cc:1081] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a [term 1 LEADER]: Signalling peer 2ba42136bb0e4a0293c4a2f617a5ec6f to start an election
I20260709 12:27:52.789283 20854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21e6a6037d0942f38ea7f29a5e2a73b8"
dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
 from {username='slave'} at 127.0.0.1:52610
I20260709 12:27:52.789868 20854 raft_consensus.cc:493] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:52.790300 20854 raft_consensus.cc:3060] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:52.799736 20854 raft_consensus.cc:515] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.802546 20928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e6a6037d0942f38ea7f29a5e2a73b8" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
I20260709 12:27:52.802721 20854 leader_election.cc:290] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 2 election: Requested vote from peers d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:52.803157 20928 raft_consensus.cc:3060] T 21e6a6037d0942f38ea7f29a5e2a73b8 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:52.803973 21002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e6a6037d0942f38ea7f29a5e2a73b8" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
I20260709 12:27:52.804625 21002 raft_consensus.cc:3055] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:52.804975 21002 raft_consensus.cc:740] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 69b3b0ee0bdb42b39768623d8444232a, State: Running, Role: LEADER
I20260709 12:27:52.805891 21002 consensus_queue.cc:260] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.807279 21002 raft_consensus.cc:3060] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:52.808391 21128 consensus_queue.cc:1048] T b10c3331582b4158b0b8b913d8f32557 P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:52.810777 20928 raft_consensus.cc:2468] T 21e6a6037d0942f38ea7f29a5e2a73b8 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 2.
I20260709 12:27:52.812136 20820 leader_election.cc:304] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:52.812906 21136 raft_consensus.cc:2804] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:52.813431 21136 raft_consensus.cc:697] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 LEADER]: Becoming Leader. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Running, Role: LEADER
I20260709 12:27:52.814338 21136 consensus_queue.cc:237] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.816766 21002 raft_consensus.cc:2468] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 2.
I20260709 12:27:52.831207 21213 consensus_queue.cc:1048] T b10c3331582b4158b0b8b913d8f32557 P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:27:52.835815 20753 catalog_manager.cc:5697] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 2ba42136bb0e4a0293c4a2f617a5ec6f reported cstate change: term changed from 1 to 2, leader changed from 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195) to 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193). New cstate: current_term: 2 leader_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:52.875685 21136 consensus_queue.cc:1048] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:52.882131 21187 raft_consensus.cc:993] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f: : Instructing follower 69b3b0ee0bdb42b39768623d8444232a to start an election
I20260709 12:27:52.882632 21173 raft_consensus.cc:1081] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Signalling peer 69b3b0ee0bdb42b39768623d8444232a to start an election
I20260709 12:27:52.884614 21004 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5fa339aff7a7450c8322379571310a2b"
dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
 from {username='slave'} at 127.0.0.1:45966
I20260709 12:27:52.885247 21004 raft_consensus.cc:493] T 5fa339aff7a7450c8322379571310a2b P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:52.885622 21004 raft_consensus.cc:3060] T 5fa339aff7a7450c8322379571310a2b P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:52.890420 21136 consensus_queue.cc:1048] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:52.893361 21004 raft_consensus.cc:515] T 5fa339aff7a7450c8322379571310a2b P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.894481 21002 raft_consensus.cc:1240] T 5fa339aff7a7450c8322379571310a2b P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Rejecting Update request from peer 2ba42136bb0e4a0293c4a2f617a5ec6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:52.896452 20855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa339aff7a7450c8322379571310a2b" candidate_uuid: "69b3b0ee0bdb42b39768623d8444232a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
I20260709 12:27:52.897240 20855 raft_consensus.cc:3055] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:52.897603 20855 raft_consensus.cc:740] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Running, Role: LEADER
I20260709 12:27:52.898277 21004 leader_election.cc:290] T 5fa339aff7a7450c8322379571310a2b P 69b3b0ee0bdb42b39768623d8444232a [CANDIDATE]: Term 2 election: Requested vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331)
I20260709 12:27:52.898598 21136 consensus_queue.cc:1059] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:52.898967 20930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa339aff7a7450c8322379571310a2b" candidate_uuid: "69b3b0ee0bdb42b39768623d8444232a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
I20260709 12:27:52.904852 20855 consensus_queue.cc:260] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.905910 20855 raft_consensus.cc:3060] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:52.912564 20855 raft_consensus.cc:2468] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69b3b0ee0bdb42b39768623d8444232a in term 2.
I20260709 12:27:52.913769 20968 leader_election.cc:304] T 5fa339aff7a7450c8322379571310a2b P 69b3b0ee0bdb42b39768623d8444232a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, 69b3b0ee0bdb42b39768623d8444232a; no voters: d19688849fc44393bbf88cb3589a1d3a
W20260709 12:27:52.914254 21173 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:27:52.914757 21211 raft_consensus.cc:2804] T 5fa339aff7a7450c8322379571310a2b P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:52.915381 21211 raft_consensus.cc:697] T 5fa339aff7a7450c8322379571310a2b P 69b3b0ee0bdb42b39768623d8444232a [term 2 LEADER]: Becoming Leader. State: Replica: 69b3b0ee0bdb42b39768623d8444232a, State: Running, Role: LEADER
I20260709 12:27:52.916294 21211 consensus_queue.cc:237] T 5fa339aff7a7450c8322379571310a2b P 69b3b0ee0bdb42b39768623d8444232a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:52.924037 20753 catalog_manager.cc:5697] T 5fa339aff7a7450c8322379571310a2b P 69b3b0ee0bdb42b39768623d8444232a reported cstate change: term changed from 1 to 2, leader changed from 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193) to 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195). New cstate: current_term: 2 leader_uuid: "69b3b0ee0bdb42b39768623d8444232a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:53.010959 21128 raft_consensus.cc:993] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a: : Instructing follower 2ba42136bb0e4a0293c4a2f617a5ec6f to start an election
I20260709 12:27:53.011405 21213 raft_consensus.cc:1081] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a [term 1 LEADER]: Signalling peer 2ba42136bb0e4a0293c4a2f617a5ec6f to start an election
I20260709 12:27:53.012912 20855 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c6cb33ab8ff47aa81ee0ba714a80cb5"
dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
 from {username='slave'} at 127.0.0.1:52602
I20260709 12:27:53.013398 20855 raft_consensus.cc:493] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:53.013665 20855 raft_consensus.cc:3060] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.018635 20855 raft_consensus.cc:515] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:53.020130 20855 leader_election.cc:290] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 2 election: Requested vote from peers d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:53.021075 20928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cb33ab8ff47aa81ee0ba714a80cb5" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
I20260709 12:27:53.021325 21002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cb33ab8ff47aa81ee0ba714a80cb5" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
I20260709 12:27:53.021688 20928 raft_consensus.cc:3055] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:53.021883 21002 raft_consensus.cc:3060] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.021988 20928 raft_consensus.cc:740] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Running, Role: LEADER
I20260709 12:27:53.022895 20928 consensus_queue.cc:260] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:53.023824 20928 raft_consensus.cc:3060] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.027809 21002 raft_consensus.cc:2468] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 2.
I20260709 12:27:53.029117 20928 raft_consensus.cc:2468] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 2.
I20260709 12:27:53.029907 20820 leader_election.cc:304] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, 69b3b0ee0bdb42b39768623d8444232a; no voters: 
I20260709 12:27:53.030742 21173 raft_consensus.cc:2804] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:53.031164 21173 raft_consensus.cc:697] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 LEADER]: Becoming Leader. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Running, Role: LEADER
I20260709 12:27:53.031893 21173 consensus_queue.cc:237] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:53.038604 20753 catalog_manager.cc:5697] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 2ba42136bb0e4a0293c4a2f617a5ec6f reported cstate change: term changed from 1 to 2, leader changed from d19688849fc44393bbf88cb3589a1d3a (127.9.145.194) to 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193). New cstate: current_term: 2 leader_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:53.049157 21211 consensus_queue.cc:1048] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:53.056123 21182 raft_consensus.cc:993] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a: : Instructing follower d19688849fc44393bbf88cb3589a1d3a to start an election
I20260709 12:27:53.056665 21135 raft_consensus.cc:1081] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a [term 1 LEADER]: Signalling peer d19688849fc44393bbf88cb3589a1d3a to start an election
I20260709 12:27:53.058509 20930 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "622f187c34ed45d2b3c17e391f150a49"
dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
 from {username='slave'} at 127.0.0.1:44464
I20260709 12:27:53.059121 20930 raft_consensus.cc:493] T 622f187c34ed45d2b3c17e391f150a49 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:53.059536 20930 raft_consensus.cc:3060] T 622f187c34ed45d2b3c17e391f150a49 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.064990 21218 consensus_queue.cc:1048] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:53.067623 20930 raft_consensus.cc:515] T 622f187c34ed45d2b3c17e391f150a49 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:53.072424 20854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622f187c34ed45d2b3c17e391f150a49" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
I20260709 12:27:53.072803 21004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622f187c34ed45d2b3c17e391f150a49" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
I20260709 12:27:53.073534 21004 raft_consensus.cc:3055] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:53.073845 21004 raft_consensus.cc:740] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 69b3b0ee0bdb42b39768623d8444232a, State: Running, Role: LEADER
I20260709 12:27:53.074651 21004 consensus_queue.cc:260] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:53.075387 21004 raft_consensus.cc:3060] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.076073 21213 raft_consensus.cc:993] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a: : Instructing follower 2ba42136bb0e4a0293c4a2f617a5ec6f to start an election
I20260709 12:27:53.076608 21213 raft_consensus.cc:1081] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a [term 1 LEADER]: Signalling peer 2ba42136bb0e4a0293c4a2f617a5ec6f to start an election
I20260709 12:27:53.078709 20930 leader_election.cc:290] T 622f187c34ed45d2b3c17e391f150a49 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 2 election: Requested vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:53.078860 20853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "56b11efee3c940f8b0cb5dda5ae9028f"
dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
 from {username='slave'} at 127.0.0.1:52602
I20260709 12:27:53.079599 20853 raft_consensus.cc:493] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:53.079988 20853 raft_consensus.cc:3060] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.088419 20853 raft_consensus.cc:515] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:53.088586 21004 raft_consensus.cc:2468] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 2.
I20260709 12:27:53.090067 20895 leader_election.cc:304] T 622f187c34ed45d2b3c17e391f150a49 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69b3b0ee0bdb42b39768623d8444232a, d19688849fc44393bbf88cb3589a1d3a; no voters: 2ba42136bb0e4a0293c4a2f617a5ec6f
I20260709 12:27:53.091017 21128 raft_consensus.cc:2804] T 622f187c34ed45d2b3c17e391f150a49 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:53.091518 21128 raft_consensus.cc:697] T 622f187c34ed45d2b3c17e391f150a49 P d19688849fc44393bbf88cb3589a1d3a [term 2 LEADER]: Becoming Leader. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Running, Role: LEADER
I20260709 12:27:53.091603 20853 leader_election.cc:290] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 2 election: Requested vote from peers d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:53.092247 20930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b11efee3c940f8b0cb5dda5ae9028f" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
I20260709 12:27:53.092975 20930 raft_consensus.cc:3055] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:53.093297 21004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b11efee3c940f8b0cb5dda5ae9028f" candidate_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
I20260709 12:27:53.093204 21128 consensus_queue.cc:237] T 622f187c34ed45d2b3c17e391f150a49 P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:53.094079 21004 raft_consensus.cc:3060] T 56b11efee3c940f8b0cb5dda5ae9028f P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.093323 20930 raft_consensus.cc:740] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Running, Role: LEADER
I20260709 12:27:53.097585 20930 consensus_queue.cc:260] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:53.098977 20930 raft_consensus.cc:3060] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.100044 21136 raft_consensus.cc:993] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f: : Instructing follower d19688849fc44393bbf88cb3589a1d3a to start an election
I20260709 12:27:53.100611 21136 raft_consensus.cc:1081] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Signalling peer d19688849fc44393bbf88cb3589a1d3a to start an election
I20260709 12:27:53.102188 21004 raft_consensus.cc:2468] T 56b11efee3c940f8b0cb5dda5ae9028f P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 2.
I20260709 12:27:53.102459 20928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47722b2045fd40febe80064f4553c763"
dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
 from {username='slave'} at 127.0.0.1:44476
I20260709 12:27:53.103513 20820 leader_election.cc:304] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, 69b3b0ee0bdb42b39768623d8444232a; no voters: 
I20260709 12:27:53.103147 20751 catalog_manager.cc:5697] T 622f187c34ed45d2b3c17e391f150a49 P d19688849fc44393bbf88cb3589a1d3a reported cstate change: term changed from 1 to 2, leader changed from 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195) to d19688849fc44393bbf88cb3589a1d3a (127.9.145.194). New cstate: current_term: 2 leader_uuid: "d19688849fc44393bbf88cb3589a1d3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:53.104406 21173 raft_consensus.cc:2804] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:53.105090 21173 raft_consensus.cc:697] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 LEADER]: Becoming Leader. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Running, Role: LEADER
I20260709 12:27:53.105942 21173 consensus_queue.cc:237] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:53.103199 20928 raft_consensus.cc:493] T 47722b2045fd40febe80064f4553c763 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:53.106640 20930 raft_consensus.cc:2468] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ba42136bb0e4a0293c4a2f617a5ec6f in term 2.
I20260709 12:27:53.107860 20928 raft_consensus.cc:3060] T 47722b2045fd40febe80064f4553c763 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.114279 20928 raft_consensus.cc:515] T 47722b2045fd40febe80064f4553c763 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:53.115224 20753 catalog_manager.cc:5697] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f reported cstate change: term changed from 1 to 2, leader changed from d19688849fc44393bbf88cb3589a1d3a (127.9.145.194) to 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193). New cstate: current_term: 2 leader_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:53.115898 20928 leader_election.cc:290] T 47722b2045fd40febe80064f4553c763 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 2 election: Requested vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195:33581)
I20260709 12:27:53.116873 20853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47722b2045fd40febe80064f4553c763" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
I20260709 12:27:53.117275 21004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47722b2045fd40febe80064f4553c763" candidate_uuid: "d19688849fc44393bbf88cb3589a1d3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
I20260709 12:27:53.117556 20853 raft_consensus.cc:3055] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:53.117914 21004 raft_consensus.cc:3060] T 47722b2045fd40febe80064f4553c763 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.117916 20853 raft_consensus.cc:740] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Running, Role: LEADER
I20260709 12:27:53.119014 20853 consensus_queue.cc:260] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:53.120342 20853 raft_consensus.cc:3060] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.126209 21004 raft_consensus.cc:2468] T 47722b2045fd40febe80064f4553c763 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 2.
I20260709 12:27:53.127521 20895 leader_election.cc:304] T 47722b2045fd40febe80064f4553c763 P d19688849fc44393bbf88cb3589a1d3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69b3b0ee0bdb42b39768623d8444232a, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:53.127944 20853 raft_consensus.cc:2468] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d19688849fc44393bbf88cb3589a1d3a in term 2.
I20260709 12:27:53.128381 21128 raft_consensus.cc:2804] T 47722b2045fd40febe80064f4553c763 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:53.129009 21128 raft_consensus.cc:697] T 47722b2045fd40febe80064f4553c763 P d19688849fc44393bbf88cb3589a1d3a [term 2 LEADER]: Becoming Leader. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Running, Role: LEADER
I20260709 12:27:53.129825 21128 consensus_queue.cc:237] T 47722b2045fd40febe80064f4553c763 P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:53.136418 20753 catalog_manager.cc:5697] T 47722b2045fd40febe80064f4553c763 P d19688849fc44393bbf88cb3589a1d3a reported cstate change: term changed from 1 to 2, leader changed from 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193) to d19688849fc44393bbf88cb3589a1d3a (127.9.145.194). New cstate: current_term: 2 leader_uuid: "d19688849fc44393bbf88cb3589a1d3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:53.242573 20853 raft_consensus.cc:1275] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Refusing update from remote peer d19688849fc44393bbf88cb3589a1d3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.243871 21128 consensus_queue.cc:1048] T 4dff16a162ef45a6bca0f8d57b68b5cf P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:53.251439 21002 raft_consensus.cc:1275] T 4dff16a162ef45a6bca0f8d57b68b5cf P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Refusing update from remote peer d19688849fc44393bbf88cb3589a1d3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.253350 21128 consensus_queue.cc:1048] T 4dff16a162ef45a6bca0f8d57b68b5cf P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:53.333775 20928 raft_consensus.cc:1275] T 21e6a6037d0942f38ea7f29a5e2a73b8 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Refusing update from remote peer 2ba42136bb0e4a0293c4a2f617a5ec6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.335170 21173 consensus_queue.cc:1048] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:53.343626 21002 raft_consensus.cc:1275] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Refusing update from remote peer 2ba42136bb0e4a0293c4a2f617a5ec6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.345690 21173 consensus_queue.cc:1048] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:53.435192 20928 raft_consensus.cc:3060] T 5fa339aff7a7450c8322379571310a2b P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.440567 20928 raft_consensus.cc:1275] T 5fa339aff7a7450c8322379571310a2b P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Refusing update from remote peer 69b3b0ee0bdb42b39768623d8444232a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.442067 21218 consensus_queue.cc:1048] T 5fa339aff7a7450c8322379571310a2b P 69b3b0ee0bdb42b39768623d8444232a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:53.443037 20853 raft_consensus.cc:1275] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Refusing update from remote peer 69b3b0ee0bdb42b39768623d8444232a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.444622 21218 consensus_queue.cc:1048] T 5fa339aff7a7450c8322379571310a2b P 69b3b0ee0bdb42b39768623d8444232a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:53.454924 21002 raft_consensus.cc:1275] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Refusing update from remote peer 2ba42136bb0e4a0293c4a2f617a5ec6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.457399 21173 consensus_queue.cc:1048] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:53.473493 20928 raft_consensus.cc:1275] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Refusing update from remote peer 2ba42136bb0e4a0293c4a2f617a5ec6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.475240 21187 consensus_queue.cc:1048] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:53.490130 21002 raft_consensus.cc:1275] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Refusing update from remote peer d19688849fc44393bbf88cb3589a1d3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.491582 21128 consensus_queue.cc:1048] T 622f187c34ed45d2b3c17e391f150a49 P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:53.499851 20853 raft_consensus.cc:3060] T 622f187c34ed45d2b3c17e391f150a49 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.508031 20853 raft_consensus.cc:1275] T 622f187c34ed45d2b3c17e391f150a49 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Refusing update from remote peer d19688849fc44393bbf88cb3589a1d3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.509380 21128 consensus_queue.cc:1048] T 622f187c34ed45d2b3c17e391f150a49 P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:53.610749 21002 raft_consensus.cc:1275] T 56b11efee3c940f8b0cb5dda5ae9028f P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Refusing update from remote peer 2ba42136bb0e4a0293c4a2f617a5ec6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.612095 21187 consensus_queue.cc:1048] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:53.620896 20928 raft_consensus.cc:1275] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Refusing update from remote peer 2ba42136bb0e4a0293c4a2f617a5ec6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.622851 21136 consensus_queue.cc:1048] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:53.659502 21002 raft_consensus.cc:1275] T 47722b2045fd40febe80064f4553c763 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Refusing update from remote peer d19688849fc44393bbf88cb3589a1d3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.660811 21128 consensus_queue.cc:1048] T 47722b2045fd40febe80064f4553c763 P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:53.671520 20853 raft_consensus.cc:1275] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Refusing update from remote peer d19688849fc44393bbf88cb3589a1d3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.673125 21213 consensus_queue.cc:1048] T 47722b2045fd40febe80064f4553c763 P d19688849fc44393bbf88cb3589a1d3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:55.688894 20750 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36294:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:27:55.709986 20750 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36294:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:27:55.762810  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:27:55.910506 21242 log.cc:927] Time spent T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:27:55.952644 21270 tablet.cc:1724] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:55.997308 21257 log.cc:927] Time spent T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:27:56.012502 21280 tablet.cc:1724] T 56b11efee3c940f8b0cb5dda5ae9028f P 69b3b0ee0bdb42b39768623d8444232a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.022881 21279 tablet.cc:1724] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:56.016613 21255 log.cc:927] Time spent T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:27:56.073578 21289 tablet.cc:1724] T b10c3331582b4158b0b8b913d8f32557 P d19688849fc44393bbf88cb3589a1d3a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:56.078274 20895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:33581, user_credentials={real_user=slave}} blocked reactor thread for 119959us
I20260709 12:27:56.046070 21272 tablet.cc:1724] T 4dff16a162ef45a6bca0f8d57b68b5cf P d19688849fc44393bbf88cb3589a1d3a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.108987 21285 tablet.cc:1724] T b10c3331582b4158b0b8b913d8f32557 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:56.145184 21275 log.cc:927] Time spent T 4dff16a162ef45a6bca0f8d57b68b5cf P 69b3b0ee0bdb42b39768623d8444232a: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 12:27:56.163537 20894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.193:36867, user_credentials={real_user=slave}} blocked reactor thread for 49078us
I20260709 12:27:56.180351 21289 tablet.cc:1724] T 622f187c34ed45d2b3c17e391f150a49 P d19688849fc44393bbf88cb3589a1d3a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.131160 21290 tablet.cc:1724] T a06a663278614fc9b3522a016587d87d P 2ba42136bb0e4a0293c4a2f617a5ec6f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.210018 20854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14928e2dd87f43abb72a0cecdcf24c54"
dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
mode: GRACEFUL
new_leader_uuid: "69b3b0ee0bdb42b39768623d8444232a"
 from {username='slave'} at 127.0.0.1:43966
I20260709 12:27:56.210866 20854 raft_consensus.cc:606] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 LEADER]: Received request to transfer leadership to TS 69b3b0ee0bdb42b39768623d8444232a
I20260709 12:27:56.200721 21280 tablet.cc:1724] T a06a663278614fc9b3522a016587d87d P 69b3b0ee0bdb42b39768623d8444232a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.209425 21294 tablet.cc:1724] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 69b3b0ee0bdb42b39768623d8444232a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.221261 21293 tablet.cc:1724] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.222540 21297 tablet.cc:1724] T 5fa339aff7a7450c8322379571310a2b P 69b3b0ee0bdb42b39768623d8444232a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.227245 21295 tablet.cc:1724] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.255133 21296 tablet.cc:1724] T 47722b2045fd40febe80064f4553c763 P d19688849fc44393bbf88cb3589a1d3a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.256999 21285 tablet.cc:1724] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.258620 21279 tablet.cc:1724] T a06a663278614fc9b3522a016587d87d P d19688849fc44393bbf88cb3589a1d3a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.282325 21289 tablet.cc:1724] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.290964 21272 tablet.cc:1724] T 21e6a6037d0942f38ea7f29a5e2a73b8 P d19688849fc44393bbf88cb3589a1d3a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.301479 21270 tablet.cc:1724] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.299948 21294 tablet.cc:1724] T 47722b2045fd40febe80064f4553c763 P 69b3b0ee0bdb42b39768623d8444232a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.289143 21290 tablet.cc:1724] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.301584 21296 tablet.cc:1724] T 5fa339aff7a7450c8322379571310a2b P d19688849fc44393bbf88cb3589a1d3a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.308557 21293 tablet.cc:1724] T 622f187c34ed45d2b3c17e391f150a49 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.311451 21285 tablet.cc:1724] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.323073 21302 raft_consensus.cc:993] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f: : Instructing follower 69b3b0ee0bdb42b39768623d8444232a to start an election
I20260709 12:27:56.323884 21247 raft_consensus.cc:1081] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 LEADER]: Signalling peer 69b3b0ee0bdb42b39768623d8444232a to start an election
W20260709 12:27:56.313925 20895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.145.195:33581, user_credentials={real_user=slave}} blocked reactor thread for 45790.7us
I20260709 12:27:56.328545 20998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14928e2dd87f43abb72a0cecdcf24c54"
dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
 from {username='slave'} at 127.0.0.1:45966
I20260709 12:27:56.329205 20998 raft_consensus.cc:493] T 14928e2dd87f43abb72a0cecdcf24c54 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:56.329622 20998 raft_consensus.cc:3060] T 14928e2dd87f43abb72a0cecdcf24c54 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:56.331489 21297 tablet.cc:1724] T 4dff16a162ef45a6bca0f8d57b68b5cf P 69b3b0ee0bdb42b39768623d8444232a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.305661 21295 tablet.cc:1724] T b10c3331582b4158b0b8b913d8f32557 P 69b3b0ee0bdb42b39768623d8444232a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.362748 21280 tablet.cc:1724] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.361793 20998 raft_consensus.cc:515] T 14928e2dd87f43abb72a0cecdcf24c54 P 69b3b0ee0bdb42b39768623d8444232a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:56.370625 20854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14928e2dd87f43abb72a0cecdcf24c54" candidate_uuid: "69b3b0ee0bdb42b39768623d8444232a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
I20260709 12:27:56.371374 20854 raft_consensus.cc:3055] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:56.371731 20854 raft_consensus.cc:740] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2ba42136bb0e4a0293c4a2f617a5ec6f, State: Running, Role: LEADER
I20260709 12:27:56.372582 20854 consensus_queue.cc:260] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:56.373296 20998 leader_election.cc:290] T 14928e2dd87f43abb72a0cecdcf24c54 P 69b3b0ee0bdb42b39768623d8444232a [CANDIDATE]: Term 3 election: Requested vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331)
I20260709 12:27:56.373842 20854 raft_consensus.cc:3060] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:56.374643 20927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14928e2dd87f43abb72a0cecdcf24c54" candidate_uuid: "69b3b0ee0bdb42b39768623d8444232a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
I20260709 12:27:56.375463 20927 raft_consensus.cc:3060] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:56.380720 20752 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 48f47eb857e846c3a511db95a9f56aca: soft_deleted_table [id=e6f6ffa2064a44db8b743b096295bd0c] alter complete (version 1)
I20260709 12:27:56.385108 20927 raft_consensus.cc:2468] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69b3b0ee0bdb42b39768623d8444232a in term 3.
I20260709 12:27:56.389739 20854 raft_consensus.cc:2468] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69b3b0ee0bdb42b39768623d8444232a in term 3.
I20260709 12:27:56.391649 20969 leader_election.cc:304] T 14928e2dd87f43abb72a0cecdcf24c54 P 69b3b0ee0bdb42b39768623d8444232a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69b3b0ee0bdb42b39768623d8444232a, d19688849fc44393bbf88cb3589a1d3a; no voters: 
I20260709 12:27:56.392702 21211 raft_consensus.cc:2804] T 14928e2dd87f43abb72a0cecdcf24c54 P 69b3b0ee0bdb42b39768623d8444232a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:56.393226 21211 raft_consensus.cc:697] T 14928e2dd87f43abb72a0cecdcf24c54 P 69b3b0ee0bdb42b39768623d8444232a [term 3 LEADER]: Becoming Leader. State: Replica: 69b3b0ee0bdb42b39768623d8444232a, State: Running, Role: LEADER
I20260709 12:27:56.394085 21211 consensus_queue.cc:237] T 14928e2dd87f43abb72a0cecdcf24c54 P 69b3b0ee0bdb42b39768623d8444232a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:56.403929 20927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85248b50821b406ca1571b018430b9f5"
dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
mode: GRACEFUL
new_leader_uuid: "69b3b0ee0bdb42b39768623d8444232a"
 from {username='slave'} at 127.0.0.1:60280
I20260709 12:27:56.404696 20927 raft_consensus.cc:606] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a [term 2 LEADER]: Received request to transfer leadership to TS 69b3b0ee0bdb42b39768623d8444232a
I20260709 12:27:56.406317  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:27:56.407027  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:56.414093 20750 catalog_manager.cc:5697] T 14928e2dd87f43abb72a0cecdcf24c54 P 69b3b0ee0bdb42b39768623d8444232a reported cstate change: term changed from 2 to 3, leader changed from 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193) to 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195). New cstate: current_term: 3 leader_uuid: "69b3b0ee0bdb42b39768623d8444232a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:56.487895 21250 raft_consensus.cc:993] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a: : Instructing follower 69b3b0ee0bdb42b39768623d8444232a to start an election
I20260709 12:27:56.488440 21301 raft_consensus.cc:1081] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a [term 2 LEADER]: Signalling peer 69b3b0ee0bdb42b39768623d8444232a to start an election
I20260709 12:27:56.490182 20998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85248b50821b406ca1571b018430b9f5"
dest_uuid: "69b3b0ee0bdb42b39768623d8444232a"
 from {username='slave'} at 127.0.0.1:45962
I20260709 12:27:56.490691 20998 raft_consensus.cc:493] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:56.490958 20998 raft_consensus.cc:3060] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:56.496543 20998 raft_consensus.cc:515] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:56.498461 20998 leader_election.cc:290] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a [CANDIDATE]: Term 3 election: Requested vote from peers 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867), d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331)
I20260709 12:27:56.499274 20854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85248b50821b406ca1571b018430b9f5" candidate_uuid: "69b3b0ee0bdb42b39768623d8444232a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f"
I20260709 12:27:56.499519 20927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85248b50821b406ca1571b018430b9f5" candidate_uuid: "69b3b0ee0bdb42b39768623d8444232a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d19688849fc44393bbf88cb3589a1d3a"
I20260709 12:27:56.500092 20854 raft_consensus.cc:3060] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:56.500159 20927 raft_consensus.cc:3055] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:56.500567 20927 raft_consensus.cc:740] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d19688849fc44393bbf88cb3589a1d3a, State: Running, Role: LEADER
I20260709 12:27:56.501266 20927 consensus_queue.cc:260] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:56.502378 20927 raft_consensus.cc:3060] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:56.505995 20854 raft_consensus.cc:2468] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69b3b0ee0bdb42b39768623d8444232a in term 3.
I20260709 12:27:56.507443 20968 leader_election.cc:304] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ba42136bb0e4a0293c4a2f617a5ec6f, 69b3b0ee0bdb42b39768623d8444232a; no voters: 
I20260709 12:27:56.507800 20927 raft_consensus.cc:2468] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69b3b0ee0bdb42b39768623d8444232a in term 3.
I20260709 12:27:56.508397 21273 raft_consensus.cc:2804] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:56.508968 21273 raft_consensus.cc:697] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a [term 3 LEADER]: Becoming Leader. State: Replica: 69b3b0ee0bdb42b39768623d8444232a, State: Running, Role: LEADER
I20260709 12:27:56.509816 21273 consensus_queue.cc:237] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } }
I20260709 12:27:56.518014 20750 catalog_manager.cc:5697] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a reported cstate change: term changed from 2 to 3, leader changed from d19688849fc44393bbf88cb3589a1d3a (127.9.145.194) to 69b3b0ee0bdb42b39768623d8444232a (127.9.145.195). New cstate: current_term: 3 leader_uuid: "69b3b0ee0bdb42b39768623d8444232a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69b3b0ee0bdb42b39768623d8444232a" member_type: VOTER last_known_addr { host: "127.9.145.195" port: 33581 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:56.809412 20927 raft_consensus.cc:1275] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [term 3 FOLLOWER]: Refusing update from remote peer 69b3b0ee0bdb42b39768623d8444232a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:56.810840 21211 consensus_queue.cc:1048] T 14928e2dd87f43abb72a0cecdcf24c54 P 69b3b0ee0bdb42b39768623d8444232a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:56.821663 20854 raft_consensus.cc:1275] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 3 FOLLOWER]: Refusing update from remote peer 69b3b0ee0bdb42b39768623d8444232a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:56.823211 21211 consensus_queue.cc:1048] T 14928e2dd87f43abb72a0cecdcf24c54 P 69b3b0ee0bdb42b39768623d8444232a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:57.065654 20852 raft_consensus.cc:1275] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 3 FOLLOWER]: Refusing update from remote peer 69b3b0ee0bdb42b39768623d8444232a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:57.067199 21211 consensus_queue.cc:1048] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ba42136bb0e4a0293c4a2f617a5ec6f" member_type: VOTER last_known_addr { host: "127.9.145.193" port: 36867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:57.077625 20927 raft_consensus.cc:1275] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a [term 3 FOLLOWER]: Refusing update from remote peer 69b3b0ee0bdb42b39768623d8444232a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:57.079317 21273 consensus_queue.cc:1048] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d19688849fc44393bbf88cb3589a1d3a" member_type: VOTER last_known_addr { host: "127.9.145.194" port: 42331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:57.408185  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:57.414568  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:57.415006  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:58.416314  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:58.421752  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:58.422331  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:59.423679  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:59.431599  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:59.432113  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:00.433349  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:00.439343  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:00.439826  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:01.440945  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:01.446223  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:01.446708  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:02.447863  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:02.453337  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:02.453951  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:03.455128  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:03.460570  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:03.461022  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:04.462075  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:04.467702  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:04.468176  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:05.469230  9799 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:05.474658  9799 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:05.475114  9799 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:06.542934  9799 tablet_server.cc:179] TabletServer@127.9.145.193:0 shutting down...
I20260709 12:28:06.586798  9799 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:06.587710  9799 tablet_replica.cc:333] T 622f187c34ed45d2b3c17e391f150a49 P 2ba42136bb0e4a0293c4a2f617a5ec6f: stopping tablet replica
I20260709 12:28:06.588748  9799 raft_consensus.cc:2243] T 622f187c34ed45d2b3c17e391f150a49 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.589653  9799 raft_consensus.cc:2272] T 622f187c34ed45d2b3c17e391f150a49 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.593272  9799 tablet_replica.cc:333] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f: stopping tablet replica
I20260709 12:28:06.593930  9799 raft_consensus.cc:2243] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.594583  9799 raft_consensus.cc:2272] T 4dff16a162ef45a6bca0f8d57b68b5cf P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.597259  9799 tablet_replica.cc:333] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 2ba42136bb0e4a0293c4a2f617a5ec6f: stopping tablet replica
I20260709 12:28:06.597947  9799 raft_consensus.cc:2243] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:06.598987  9799 raft_consensus.cc:2272] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.601792  9799 tablet_replica.cc:333] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f: stopping tablet replica
I20260709 12:28:06.602537  9799 raft_consensus.cc:2243] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.603142  9799 raft_consensus.cc:2272] T 47722b2045fd40febe80064f4553c763 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.605830  9799 tablet_replica.cc:333] T b10c3331582b4158b0b8b913d8f32557 P 2ba42136bb0e4a0293c4a2f617a5ec6f: stopping tablet replica
I20260709 12:28:06.606743  9799 raft_consensus.cc:2243] T b10c3331582b4158b0b8b913d8f32557 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.607437  9799 raft_consensus.cc:2272] T b10c3331582b4158b0b8b913d8f32557 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:06.608790 20968 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
I20260709 12:28:06.611934  9799 tablet_replica.cc:333] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f: stopping tablet replica
I20260709 12:28:06.613092  9799 raft_consensus.cc:2243] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:28:06.613229 20968 consensus_peers.cc:597] T d0a1fdfc30754de192891e2312d5c020 P 69b3b0ee0bdb42b39768623d8444232a -> Peer 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867): Couldn't send request to peer 2ba42136bb0e4a0293c4a2f617a5ec6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:06.613869 20894 consensus_peers.cc:597] T b10c3331582b4158b0b8b913d8f32557 P d19688849fc44393bbf88cb3589a1d3a -> Peer 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867): Couldn't send request to peer 2ba42136bb0e4a0293c4a2f617a5ec6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:06.614547  9799 raft_consensus.cc:2272] T 56b11efee3c940f8b0cb5dda5ae9028f P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.617663  9799 tablet_replica.cc:333] T a06a663278614fc9b3522a016587d87d P 2ba42136bb0e4a0293c4a2f617a5ec6f: stopping tablet replica
I20260709 12:28:06.618429  9799 raft_consensus.cc:2243] T a06a663278614fc9b3522a016587d87d P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:06.619547  9799 raft_consensus.cc:2272] T a06a663278614fc9b3522a016587d87d P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:06.621233 20894 consensus_peers.cc:597] T 8c6b02b11e4d46939d1da88c9b12d062 P d19688849fc44393bbf88cb3589a1d3a -> Peer 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867): Couldn't send request to peer 2ba42136bb0e4a0293c4a2f617a5ec6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:06.623366  9799 tablet_replica.cc:333] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f: stopping tablet replica
I20260709 12:28:06.624258  9799 raft_consensus.cc:2243] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.624825  9799 raft_consensus.cc:2272] T 982cee52faae499e8f087e106b51bbd9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.627566  9799 tablet_replica.cc:333] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f: stopping tablet replica
I20260709 12:28:06.628182  9799 raft_consensus.cc:2243] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.628762  9799 raft_consensus.cc:2272] T 5fa339aff7a7450c8322379571310a2b P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.631500  9799 tablet_replica.cc:333] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f: stopping tablet replica
I20260709 12:28:06.632113  9799 raft_consensus.cc:2243] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.632758  9799 raft_consensus.cc:2272] T 8c6b02b11e4d46939d1da88c9b12d062 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.636348  9799 tablet_replica.cc:333] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 2ba42136bb0e4a0293c4a2f617a5ec6f: stopping tablet replica
I20260709 12:28:06.637260  9799 raft_consensus.cc:2243] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:06.638470  9799 raft_consensus.cc:2272] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:06.641336 20894 consensus_peers.cc:597] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a -> Peer 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867): Couldn't send request to peer 2ba42136bb0e4a0293c4a2f617a5ec6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:06.642205  9799 tablet_replica.cc:333] T 31700e88bf154c04bf1ea79652e72042 P 2ba42136bb0e4a0293c4a2f617a5ec6f: stopping tablet replica
I20260709 12:28:06.643059  9799 raft_consensus.cc:2243] T 31700e88bf154c04bf1ea79652e72042 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:06.643965  9799 raft_consensus.cc:2272] T 31700e88bf154c04bf1ea79652e72042 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.646895  9799 tablet_replica.cc:333] T d0a1fdfc30754de192891e2312d5c020 P 2ba42136bb0e4a0293c4a2f617a5ec6f: stopping tablet replica
I20260709 12:28:06.647495  9799 raft_consensus.cc:2243] T d0a1fdfc30754de192891e2312d5c020 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.648002  9799 raft_consensus.cc:2272] T d0a1fdfc30754de192891e2312d5c020 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.650665  9799 tablet_replica.cc:333] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f: stopping tablet replica
I20260709 12:28:06.651238  9799 raft_consensus.cc:2243] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:06.652201  9799 raft_consensus.cc:2272] T fb866cd22e194cbabbe70fd7b3464ff2 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.654937  9799 tablet_replica.cc:333] T 81f0c796981141c48241e102703807b9 P 2ba42136bb0e4a0293c4a2f617a5ec6f: stopping tablet replica
I20260709 12:28:06.655579  9799 raft_consensus.cc:2243] T 81f0c796981141c48241e102703807b9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.656055  9799 raft_consensus.cc:2272] T 81f0c796981141c48241e102703807b9 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.658742  9799 tablet_replica.cc:333] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f: stopping tablet replica
I20260709 12:28:06.659286  9799 raft_consensus.cc:2243] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.659765  9799 raft_consensus.cc:2272] T 14928e2dd87f43abb72a0cecdcf24c54 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.662379  9799 tablet_replica.cc:333] T 3c498679415641cbb2970d4c4f71930a P 2ba42136bb0e4a0293c4a2f617a5ec6f: stopping tablet replica
I20260709 12:28:06.663077  9799 raft_consensus.cc:2243] T 3c498679415641cbb2970d4c4f71930a P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:06.664460  9799 raft_consensus.cc:2272] T 3c498679415641cbb2970d4c4f71930a P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.667832  9799 tablet_replica.cc:333] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f: stopping tablet replica
I20260709 12:28:06.668543  9799 raft_consensus.cc:2243] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.669207  9799 raft_consensus.cc:2272] T 85248b50821b406ca1571b018430b9f5 P 2ba42136bb0e4a0293c4a2f617a5ec6f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.721527  9799 tablet_server.cc:196] TabletServer@127.9.145.193:0 shutdown complete.
I20260709 12:28:06.770910  9799 tablet_server.cc:179] TabletServer@127.9.145.194:0 shutting down...
W20260709 12:28:06.805717 20894 consensus_peers.cc:597] T 622f187c34ed45d2b3c17e391f150a49 P d19688849fc44393bbf88cb3589a1d3a -> Peer 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867): Couldn't send request to peer 2ba42136bb0e4a0293c4a2f617a5ec6f. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:36867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:06.806300  9799 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:06.807363  9799 tablet_replica.cc:333] T 622f187c34ed45d2b3c17e391f150a49 P d19688849fc44393bbf88cb3589a1d3a: stopping tablet replica
I20260709 12:28:06.808619  9799 raft_consensus.cc:2243] T 622f187c34ed45d2b3c17e391f150a49 P d19688849fc44393bbf88cb3589a1d3a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:06.809890  9799 raft_consensus.cc:2272] T 622f187c34ed45d2b3c17e391f150a49 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.812875  9799 tablet_replica.cc:333] T 4dff16a162ef45a6bca0f8d57b68b5cf P d19688849fc44393bbf88cb3589a1d3a: stopping tablet replica
I20260709 12:28:06.813597  9799 raft_consensus.cc:2243] T 4dff16a162ef45a6bca0f8d57b68b5cf P d19688849fc44393bbf88cb3589a1d3a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:06.814589  9799 raft_consensus.cc:2272] T 4dff16a162ef45a6bca0f8d57b68b5cf P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.817039  9799 tablet_replica.cc:333] T 21e6a6037d0942f38ea7f29a5e2a73b8 P d19688849fc44393bbf88cb3589a1d3a: stopping tablet replica
I20260709 12:28:06.817651  9799 raft_consensus.cc:2243] T 21e6a6037d0942f38ea7f29a5e2a73b8 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.818182  9799 raft_consensus.cc:2272] T 21e6a6037d0942f38ea7f29a5e2a73b8 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.820602  9799 tablet_replica.cc:333] T b10c3331582b4158b0b8b913d8f32557 P d19688849fc44393bbf88cb3589a1d3a: stopping tablet replica
I20260709 12:28:06.821213  9799 raft_consensus.cc:2243] T b10c3331582b4158b0b8b913d8f32557 P d19688849fc44393bbf88cb3589a1d3a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:06.822202  9799 raft_consensus.cc:2272] T b10c3331582b4158b0b8b913d8f32557 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.824703  9799 tablet_replica.cc:333] T 47722b2045fd40febe80064f4553c763 P d19688849fc44393bbf88cb3589a1d3a: stopping tablet replica
I20260709 12:28:06.825265  9799 raft_consensus.cc:2243] T 47722b2045fd40febe80064f4553c763 P d19688849fc44393bbf88cb3589a1d3a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:06.826143  9799 raft_consensus.cc:2272] T 47722b2045fd40febe80064f4553c763 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.828665  9799 tablet_replica.cc:333] T 5fa339aff7a7450c8322379571310a2b P d19688849fc44393bbf88cb3589a1d3a: stopping tablet replica
I20260709 12:28:06.829263  9799 raft_consensus.cc:2243] T 5fa339aff7a7450c8322379571310a2b P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.829802  9799 raft_consensus.cc:2272] T 5fa339aff7a7450c8322379571310a2b P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.833254  9799 tablet_replica.cc:333] T 8c6b02b11e4d46939d1da88c9b12d062 P d19688849fc44393bbf88cb3589a1d3a: stopping tablet replica
I20260709 12:28:06.834139  9799 raft_consensus.cc:2243] T 8c6b02b11e4d46939d1da88c9b12d062 P d19688849fc44393bbf88cb3589a1d3a [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:28:06.834760 20969 consensus_peers.cc:597] T 5fa339aff7a7450c8322379571310a2b P 69b3b0ee0bdb42b39768623d8444232a -> Peer d19688849fc44393bbf88cb3589a1d3a (127.9.145.194:42331): Couldn't send request to peer d19688849fc44393bbf88cb3589a1d3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:06.835250  9799 raft_consensus.cc:2272] T 8c6b02b11e4d46939d1da88c9b12d062 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.837924  9799 tablet_replica.cc:333] T 3c498679415641cbb2970d4c4f71930a P d19688849fc44393bbf88cb3589a1d3a: stopping tablet replica
I20260709 12:28:06.838567  9799 raft_consensus.cc:2243] T 3c498679415641cbb2970d4c4f71930a P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.839035  9799 raft_consensus.cc:2272] T 3c498679415641cbb2970d4c4f71930a P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.841347  9799 tablet_replica.cc:333] T 81f0c796981141c48241e102703807b9 P d19688849fc44393bbf88cb3589a1d3a: stopping tablet replica
I20260709 12:28:06.841926  9799 raft_consensus.cc:2243] T 81f0c796981141c48241e102703807b9 P d19688849fc44393bbf88cb3589a1d3a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:06.842828  9799 raft_consensus.cc:2272] T 81f0c796981141c48241e102703807b9 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.845183  9799 tablet_replica.cc:333] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a: stopping tablet replica
I20260709 12:28:06.845727  9799 raft_consensus.cc:2243] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.846252  9799 raft_consensus.cc:2272] T 14928e2dd87f43abb72a0cecdcf24c54 P d19688849fc44393bbf88cb3589a1d3a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.848579  9799 tablet_replica.cc:333] T 31700e88bf154c04bf1ea79652e72042 P d19688849fc44393bbf88cb3589a1d3a: stopping tablet replica
I20260709 12:28:06.849123  9799 raft_consensus.cc:2243] T 31700e88bf154c04bf1ea79652e72042 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.849625  9799 raft_consensus.cc:2272] T 31700e88bf154c04bf1ea79652e72042 P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.852159  9799 tablet_replica.cc:333] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a: stopping tablet replica
I20260709 12:28:06.852717  9799 raft_consensus.cc:2243] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.853245  9799 raft_consensus.cc:2272] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.855991  9799 tablet_replica.cc:333] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a: stopping tablet replica
I20260709 12:28:06.856668  9799 raft_consensus.cc:2243] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.857239  9799 raft_consensus.cc:2272] T 85248b50821b406ca1571b018430b9f5 P d19688849fc44393bbf88cb3589a1d3a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.860176  9799 tablet_replica.cc:333] T a06a663278614fc9b3522a016587d87d P d19688849fc44393bbf88cb3589a1d3a: stopping tablet replica
W20260709 12:28:06.860402 20968 consensus_peers.cc:597] T 5fa339aff7a7450c8322379571310a2b P 69b3b0ee0bdb42b39768623d8444232a -> Peer 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867): Couldn't send request to peer 2ba42136bb0e4a0293c4a2f617a5ec6f. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:36867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:06.860865  9799 raft_consensus.cc:2243] T a06a663278614fc9b3522a016587d87d P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.861521  9799 raft_consensus.cc:2272] T a06a663278614fc9b3522a016587d87d P d19688849fc44393bbf88cb3589a1d3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.863986  9799 tablet_replica.cc:333] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a: stopping tablet replica
I20260709 12:28:06.864590  9799 raft_consensus.cc:2243] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.865154  9799 raft_consensus.cc:2272] T 56b11efee3c940f8b0cb5dda5ae9028f P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.867687  9799 tablet_replica.cc:333] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a: stopping tablet replica
I20260709 12:28:06.868213  9799 raft_consensus.cc:2243] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.868743  9799 raft_consensus.cc:2272] T d0a1fdfc30754de192891e2312d5c020 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.871152  9799 tablet_replica.cc:333] T fb866cd22e194cbabbe70fd7b3464ff2 P d19688849fc44393bbf88cb3589a1d3a: stopping tablet replica
I20260709 12:28:06.871737  9799 raft_consensus.cc:2243] T fb866cd22e194cbabbe70fd7b3464ff2 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.872238  9799 raft_consensus.cc:2272] T fb866cd22e194cbabbe70fd7b3464ff2 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.874881  9799 tablet_replica.cc:333] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a: stopping tablet replica
I20260709 12:28:06.875370  9799 raft_consensus.cc:2243] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:06.876318  9799 raft_consensus.cc:2272] T 982cee52faae499e8f087e106b51bbd9 P d19688849fc44393bbf88cb3589a1d3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.921954  9799 tablet_server.cc:196] TabletServer@127.9.145.194:0 shutdown complete.
W20260709 12:28:06.954267 20968 consensus_peers.cc:597] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a -> Peer 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867): Couldn't send request to peer 2ba42136bb0e4a0293c4a2f617a5ec6f. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:36867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:06.962961 20968 consensus_peers.cc:597] T 14928e2dd87f43abb72a0cecdcf24c54 P 69b3b0ee0bdb42b39768623d8444232a -> Peer 2ba42136bb0e4a0293c4a2f617a5ec6f (127.9.145.193:36867): Couldn't send request to peer 2ba42136bb0e4a0293c4a2f617a5ec6f. Status: Network error: Client connection negotiation failed: client connection to 127.9.145.193:36867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:06.968210  9799 tablet_server.cc:179] TabletServer@127.9.145.195:0 shutting down...
I20260709 12:28:06.997206  9799 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:06.998118  9799 tablet_replica.cc:333] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a: stopping tablet replica
I20260709 12:28:06.999177  9799 raft_consensus.cc:2243] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.999931  9799 raft_consensus.cc:2272] T 622f187c34ed45d2b3c17e391f150a49 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.002377  9799 tablet_replica.cc:333] T 4dff16a162ef45a6bca0f8d57b68b5cf P 69b3b0ee0bdb42b39768623d8444232a: stopping tablet replica
I20260709 12:28:07.002983  9799 raft_consensus.cc:2243] T 4dff16a162ef45a6bca0f8d57b68b5cf P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.003466  9799 raft_consensus.cc:2272] T 4dff16a162ef45a6bca0f8d57b68b5cf P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.005815  9799 tablet_replica.cc:333] T b10c3331582b4158b0b8b913d8f32557 P 69b3b0ee0bdb42b39768623d8444232a: stopping tablet replica
I20260709 12:28:07.006503  9799 raft_consensus.cc:2243] T b10c3331582b4158b0b8b913d8f32557 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.006978  9799 raft_consensus.cc:2272] T b10c3331582b4158b0b8b913d8f32557 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.009389  9799 tablet_replica.cc:333] T 47722b2045fd40febe80064f4553c763 P 69b3b0ee0bdb42b39768623d8444232a: stopping tablet replica
I20260709 12:28:07.009984  9799 raft_consensus.cc:2243] T 47722b2045fd40febe80064f4553c763 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.010502  9799 raft_consensus.cc:2272] T 47722b2045fd40febe80064f4553c763 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.012717  9799 tablet_replica.cc:333] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a: stopping tablet replica
I20260709 12:28:07.013293  9799 raft_consensus.cc:2243] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.013798  9799 raft_consensus.cc:2272] T 21e6a6037d0942f38ea7f29a5e2a73b8 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.016023  9799 tablet_replica.cc:333] T 5fa339aff7a7450c8322379571310a2b P 69b3b0ee0bdb42b39768623d8444232a: stopping tablet replica
I20260709 12:28:07.016543  9799 raft_consensus.cc:2243] T 5fa339aff7a7450c8322379571310a2b P 69b3b0ee0bdb42b39768623d8444232a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:07.017396  9799 raft_consensus.cc:2272] T 5fa339aff7a7450c8322379571310a2b P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.019737  9799 tablet_replica.cc:333] T 8c6b02b11e4d46939d1da88c9b12d062 P 69b3b0ee0bdb42b39768623d8444232a: stopping tablet replica
I20260709 12:28:07.020262  9799 raft_consensus.cc:2243] T 8c6b02b11e4d46939d1da88c9b12d062 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.020715  9799 raft_consensus.cc:2272] T 8c6b02b11e4d46939d1da88c9b12d062 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.023057  9799 tablet_replica.cc:333] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 69b3b0ee0bdb42b39768623d8444232a: stopping tablet replica
I20260709 12:28:07.023602  9799 raft_consensus.cc:2243] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.024097  9799 raft_consensus.cc:2272] T 3c6cb33ab8ff47aa81ee0ba714a80cb5 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.026315  9799 tablet_replica.cc:333] T 31700e88bf154c04bf1ea79652e72042 P 69b3b0ee0bdb42b39768623d8444232a: stopping tablet replica
I20260709 12:28:07.026827  9799 raft_consensus.cc:2243] T 31700e88bf154c04bf1ea79652e72042 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.027271  9799 raft_consensus.cc:2272] T 31700e88bf154c04bf1ea79652e72042 P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.029446  9799 tablet_replica.cc:333] T 982cee52faae499e8f087e106b51bbd9 P 69b3b0ee0bdb42b39768623d8444232a: stopping tablet replica
I20260709 12:28:07.029973  9799 raft_consensus.cc:2243] T 982cee52faae499e8f087e106b51bbd9 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.030474  9799 raft_consensus.cc:2272] T 982cee52faae499e8f087e106b51bbd9 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.032680  9799 tablet_replica.cc:333] T a06a663278614fc9b3522a016587d87d P 69b3b0ee0bdb42b39768623d8444232a: stopping tablet replica
I20260709 12:28:07.033216  9799 raft_consensus.cc:2243] T a06a663278614fc9b3522a016587d87d P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.033718  9799 raft_consensus.cc:2272] T a06a663278614fc9b3522a016587d87d P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.036011  9799 tablet_replica.cc:333] T 56b11efee3c940f8b0cb5dda5ae9028f P 69b3b0ee0bdb42b39768623d8444232a: stopping tablet replica
I20260709 12:28:07.036578  9799 raft_consensus.cc:2243] T 56b11efee3c940f8b0cb5dda5ae9028f P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.037087  9799 raft_consensus.cc:2272] T 56b11efee3c940f8b0cb5dda5ae9028f P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.039286  9799 tablet_replica.cc:333] T d0a1fdfc30754de192891e2312d5c020 P 69b3b0ee0bdb42b39768623d8444232a: stopping tablet replica
I20260709 12:28:07.039767  9799 raft_consensus.cc:2243] T d0a1fdfc30754de192891e2312d5c020 P 69b3b0ee0bdb42b39768623d8444232a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:07.040603  9799 raft_consensus.cc:2272] T d0a1fdfc30754de192891e2312d5c020 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.042914  9799 tablet_replica.cc:333] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a: stopping tablet replica
I20260709 12:28:07.043457  9799 raft_consensus.cc:2243] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.043928  9799 raft_consensus.cc:2272] T fb866cd22e194cbabbe70fd7b3464ff2 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.046061  9799 tablet_replica.cc:333] T 3c498679415641cbb2970d4c4f71930a P 69b3b0ee0bdb42b39768623d8444232a: stopping tablet replica
I20260709 12:28:07.046592  9799 raft_consensus.cc:2243] T 3c498679415641cbb2970d4c4f71930a P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.047021  9799 raft_consensus.cc:2272] T 3c498679415641cbb2970d4c4f71930a P 69b3b0ee0bdb42b39768623d8444232a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.049211  9799 tablet_replica.cc:333] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a: stopping tablet replica
I20260709 12:28:07.049708  9799 raft_consensus.cc:2243] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:07.050567  9799 raft_consensus.cc:2272] T 85248b50821b406ca1571b018430b9f5 P 69b3b0ee0bdb42b39768623d8444232a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.052734  9799 tablet_replica.cc:333] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a: stopping tablet replica
I20260709 12:28:07.053215  9799 raft_consensus.cc:2243] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.053663  9799 raft_consensus.cc:2272] T 81f0c796981141c48241e102703807b9 P 69b3b0ee0bdb42b39768623d8444232a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.055823  9799 tablet_replica.cc:333] T 14928e2dd87f43abb72a0cecdcf24c54 P 69b3b0ee0bdb42b39768623d8444232a: stopping tablet replica
I20260709 12:28:07.056272  9799 raft_consensus.cc:2243] T 14928e2dd87f43abb72a0cecdcf24c54 P 69b3b0ee0bdb42b39768623d8444232a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:07.057142  9799 raft_consensus.cc:2272] T 14928e2dd87f43abb72a0cecdcf24c54 P 69b3b0ee0bdb42b39768623d8444232a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.100389  9799 tablet_server.cc:196] TabletServer@127.9.145.195:0 shutdown complete.
I20260709 12:28:07.140257  9799 master.cc:562] Master@127.9.145.254:35769 shutting down...
I20260709 12:28:07.169822  9799 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 48f47eb857e846c3a511db95a9f56aca [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:07.170502  9799 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 48f47eb857e846c3a511db95a9f56aca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.170845  9799 tablet_replica.cc:333] T 00000000000000000000000000000000 P 48f47eb857e846c3a511db95a9f56aca: stopping tablet replica
I20260709 12:28:07.192477  9799 master.cc:584] Master@127.9.145.254:35769 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (20699 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (41575 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (367596 ms total)
[  PASSED  ] 8 tests.
I20260709 12:28:07.248715  9799 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2209 messages since previous log ~31 seconds ago
I20260709 12:28:07.248932  9799 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2216 messages since previous log ~31 seconds ago
I20260709 12:28:07.249074  9799 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2216 messages since previous log ~31 seconds ago
I20260709 12:28:07.249239  9799 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~50 seconds ago
I20260709 12:28:07.249398  9799 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~50 seconds ago
I20260709 12:28:07.249581  9799 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 5 messages since previous log ~168 seconds ago
I20260709 12:28:07.249727  9799 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 2 messages since previous log ~217 seconds ago
I20260709 12:28:07.249871  9799 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 2 messages since previous log ~218 seconds ago
I20260709 12:28:07.250077  9799 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 8 messages since previous log ~0 seconds ago
I20260709 12:28:07.250391  9799 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~19 seconds ago
